Shuai Liu

Currently I am an MEng (by Research) student at MMLab@NTU. I am fortunate to be advised by Prof. Ziwei Liu and to have received kind and valuable guidance from Jingkang Yang, Bo Li and Yuanhan Zhang.

Prior to this, I obtained my bachelor’s degree in Artificial Intelligence from BUPT in 2024. Additionally, I had a wonderful time as an intern at the Shanghai AI Laboratory under the mentorship of Prof. Ziwei Liu, and I also completed internships at NLPR@CASIA and HAOMO.AI, supervised by Prof. Yang Yang and Prof. Zhen Lei.

🔭 My current research focuses on Embodied Intelligence and multimodality. As a member of LMMs-Lab , I am on an exciting journey towards LMMs and feeling the AGI.

Feel free to reach out to me for collaborations, questions, or just to chat!

📧Email: ls2001927@gmail.com 📄Resume: CV

news

Aug 13, 2024 Join MMLab@NTU as a master student! 🚀🚀🚀
Jul 17, 2024 We introduce LMMs-Eval, a comprehensive and efficient benchmark for evaluating Large Multimodal Models, alongside LMMs-Eval Lite and Multimodal Livebench, which ensure low-cost and contamination-free evaluations in dynamic environments.
Jul 01, 2024 Octopus is accepted by ECCV-2024. Unfortunately, due to funding reasons, I won’t be able to see you in Milano😭.
Jun 12, 2024 We introduce lmms-eval/v0.2.0 to support video evaluations for video models like LLaVA-NeXT Video and Gemini 1.5 Pro across tasks such as EgoSchema, PerceptionTest, VideoMME, and more.
Oct 12, 2023 We introduce Octopus, an embodied vision language programmer that plays GTA-V.
Aug 20, 2023 PSG4D is accepted as NeurIPS-23 Spotlight!

selected publications

  1. octopus.jpg
    Octopus: Embodied Vision-Language Programmer from Environmental Feedback
    Jingkang Yang, Yuhao Dong, Shuai Liu, and 8 more authors
    2023
  2. psg4d.png
    4D Panoptic Scene Graph Generation
    Jingkang Yang, Jun Cen, Wenxuan Peng, and 6 more authors
    2023
  3. lmms-eval.png
    LMMs-Eval: Reality Check on the Evaluation of Large Multimodal Models
    Kaichen Zhang, Bo Li, Peiyuan Zhang, and 8 more authors
    2024
  4. lmms-eval-vid.png
    Embracing Video Evaluations with LMMs-Eval
    Kairui Hu, Fanyi Pu, Kaichen Zhang, and 5 more authors
    2024