Shuai Liu

Currently I am an MEng (by Research) student at MMLab@NTU. I am fortunate to be advised by Prof. Ziwei Liu and to have received kind and valuable guidance from Jingkang Yang and Bo Li.

Prior to this, I obtained my bachelor’s degree in Artificial Intelligence from BUPT in 2024. Additionally, I had a wonderful time as an intern at the Shanghai AI Laboratory under the mentorship of Prof. Ziwei Liu, and I also completed internships at NLPR@CASIA and HAOMO.AI, supervised by Prof. Yang Yang and Prof. Zhen Lei.

🔭 My current research focuses on Embodied Intelligence and multimodality. As a member of LMMs-Lab , I am on an exciting journey towards LMMs and feeling the AGI.

Feel free to reach out to me for collaborations, questions, or just to chat!

📧Email: ls2001927@gmail.com 📄Resume: CV

news

Aug 13, 2024 Join MMLab@NTU as a master student! 🚀🚀🚀
Jul 17, 2024 We introduce LMMs-Eval, a comprehensive and efficient benchmark for evaluating Large Multimodal Models, alongside LMMs-Eval Lite and Multimodal Livebench, which ensure low-cost and contamination-free evaluations in dynamic environments.
Jul 01, 2024 Octopus is accepted by ECCV-2024. Unfortunately, due to funding reasons, I won’t be able to see you in Milano😭.
Jun 12, 2024 We introduce lmms-eval/v0.2.0 to support video evaluations for video models like LLaVA-NeXT Video and Gemini 1.5 Pro across tasks such as EgoSchema, PerceptionTest, VideoMME, and more.
Oct 12, 2023 We introduce Octopus, an embodied vision language programmer that plays GTA-V.
Aug 20, 2023 PSG4D is accepted as NeurIPS-23 Spotlight!

selected publications

  1. octopus.jpg
    Octopus: Embodied Vision-Language Programmer from Environmental Feedback
    Jingkang Yang*, Yuhao Dong*, Shuai Liu*, Bo Li*, Ziyue Wang, Chencheng Jiang, Haoran Tan, Jiamu Kang, Yuanhan Zhang, Kaiyang Zhou, and Ziwei Liu
    2024
  2. psg4d.png
    4D Panoptic Scene Graph Generation
    Jingkang Yang, Jun Cen, Wenxuan Peng, Shuai Liu, Fangzhou Hong, Xiangtai Li, Kaiyang Zhou, Qifeng Chen, and Ziwei Liu
    2023
  3. lmms-eval.png
    LMMs-Eval: Reality Check on the Evaluation of Large Multimodal Models
    Kaichen Zhang, Bo Li, Peiyuan Zhang, Fanyi Pu, Joshua Adrian Cahyono, Kairui Hu, Shuai Liu, Yuanhan Zhang, Jingkang Yang, Chunyuan Li, and Ziwei Liu
    2024
  4. lmms-eval-vid.png
    Embracing Video Evaluations with LMMs-Eval
    Kairui Hu*, Fanyi Pu*, Kaichen Zhang*, Shuai Liu*, Yuanhan Zhang*, Bo Li*, Peiyuan Zhang, and Ziwei Liu
    2024