Shuai Liu

Shuai Liu

Ph.D. Student @ MMLab, NTU

I am a Ph.D. student at MMLab@NTU, supervised by Prof. Ziwei Liu.

Prior to this, I was a Founding Team Member at Synvo AI, advised by Prof. Chen Change Loy. I obtained my MEng (by Research) degree at MMLab@NTU, where I was fortunate to be advised by Prof. Ziwei Liu and to have received kind and valuable guidance from Jingkang Yang and Bo Li. I obtained my bachelor's degree in Artificial Intelligence from BUPT in 2024.

Additionally, I had a wonderful time as an intern at the Shanghai AI Laboratory under the mentorship of Prof. Ziwei Liu.

My research lies in Multimodality, Egocentric AI, and Agent.

Feel free to reach out for collaborations, questions, or just to chat!

News

  1. EgoTools is released — a 100-hour egocentric dataset, a diagnostic benchmark, and an 8B reference model for reasoning about tools in real-world first-person video.

  2. Demo-ICL is accepted by EMNLP 2026 (Findings).

  3. EgoTools: Towards Tool-Centric Reasoning in Real-World Egocentric Videos is accepted by EMNLP 2026.

  4. HumanCLAW is released — can VLMs truly act through a body, or do they lose track of themselves in the physical world?

  5. EgoLife is selected as EgoVis 2024/2025 Distinguished Paper Award.

  6. HippoCamp is accepted by ECCV 2026.

  7. FileGram is out — what if your OS agent could learn who you are just by watching how you work with files?

  8. Habitus is now in beta — your Mac gets a memory. It remembers how you work so you don't have to repeat yourself.

  9. HippoCamp is out — we collected 3 real people's entire digital lives to build the first file-system memory dataset.

  10. Released Engram Teams — upgraded version with team-based AI workflow support.

  11. Demo-ICL is released — in-context learning for procedural video knowledge acquisition.

  12. Released Engram — a privacy-first AI memory layer.

  13. Graduated from NTU with MEng (by Research). Thesis: Egocentric Perception and Memory.

  14. New blog post at Synvo AI: The Digital Avalanche: Building the Memory Layer for Next-Gen Corporation AI Agents.

  15. Aero-1-Audio: Our first generation of lightweight audio models, outperforming Whisper and Qwen-2-Audio.

  16. EgoLife is accepted by CVPR 2025.

  17. LMMs-Eval is accepted by NAACL 2025 (Findings).

  18. Joined Synvo AI as a Founding Team Member.

  19. Joined MMLab@NTU as a master student.

  20. Released LMMs-Eval, a comprehensive benchmark for evaluating Large Multimodal Models.

  21. Octopus is accepted by ECCV 2024.

  22. Released lmms-eval/v0.2.0 to support video evaluations.

  23. Introduced Octopus, an embodied vision-language programmer that plays GTA-V.

  24. PSG4D is accepted as NeurIPS 2023 (Spotlight).

Publications

Google Scholar

* equal contribution

  1. 2026
  2. EgoTools

    EgoTools: Towards Tool-Centric Reasoning in Real-World Egocentric Videos

    Shulin Tian*, Junsu Kim*, Shuai Liu*, Hao Li*, Yujiao Shen, Sihan Li, Zhe Yang, Yeongon Kim, et al., Jingkang Yang, Hongyuan Zhu, Ziwei Liu

    EMNLP 2026 PaperProjectCodeDatasetModel

  3. Video-HopChain: Multi-Hop Questions and Confidence-Gated Exploration for Video Reasoning Models

    Trung Nguyen Quang, Yuhao Dong, Shuo Sun, Shuai Liu, Shulin Tian, Kim-Hui Yap, Ziwei Liu

    arXiv 2026 Paper

  4. HumanCLAW

    HumanCLAW: Can Vision-Language Models Act Through a Body?

    Siyao Li, Jiawei Gu, Shuai Liu, Kairui Hu, Zekun Li, Linjie Li, Chengcheng Tang, et al., Ziwei Liu, Chuan Guo

    arXiv 2026 PaperProjectCodeHF

  5. FileGram

    FileGram: Grounding Agent Personalization in File-System Behavioral Traces

    Shuai Liu, Shulin Tian, Kairui Hu, Yuhao Dong, Zhe Yang, Bo Li, Jingkang Yang, Chen Change Loy, Ziwei Liu

    arXiv 2026 PaperProjectCodeDataset

  6. HippoCamp

    HippoCamp: Benchmarking Contextual Agents on Personal Computers

    Zhe Yang, Shulin Tian, Kairui Hu, Shuai Liu, Hoang-Nhat Nguyen, Yichi Zhang, Zujin Guo, Mengying Yu, Zinan Zhang, Jingkang Yang, Chen Change Loy, Ziwei Liu

    ECCV 2026 PaperProjectCodeDataset

  7. Demo-ICL

    Demo-ICL: In-Context Learning for Procedural Video Knowledge Acquisition

    Yuhao Dong, Shulin Tian, Shuai Liu, Shuangrui Ding, Yuhang Zang, Xiaoyi Dong, Yuhang Cao, Jiaqi Wang, Ziwei Liu

    EMNLP 2026 (Findings) PaperCodeDataset

  8. 2025
  9. EgoLife

    EgoLife: Towards Egocentric Life Assistant

    Jingkang Yang, Shuai Liu, Hongming Guo, Yuhao Dong, Xiamengwei Zhang, et al., Bo Li, Ziwei Liu

    CVPR 2025 (EgoVis 2024/2025 Distinguished Paper Award) PaperCodeProject

  10. LMMs-Eval

    LMMs-Eval: Reality Check on the Evaluation of Large Multimodal Models

    Kaichen Zhang, Bo Li, Peiyuan Zhang, Fanyi Pu, Joshua Adrian Cahyono, Kairui Hu, Shuai Liu, Yuanhan Zhang, Jingkang Yang, Chunyuan Li, Ziwei Liu

    NAACL 2025 (Findings) PaperCodeBlog

  11. Mel-Refine: A Plug-and-Play Approach to Refine Mel-Spectrogram in Audio Generation

    Hongming Guo, Ruibo Fu, Yizhong Geng, Shuai Liu, Shuchen Shi, Tao Wang, Chunyu Qiang, Chenxing Li, Ya Li, Zhengqi Wen, Yukun Liu, Xuefei Liu

    ASRU 2025 Paper

  12. Aero-1-Audio: Audio-Enhanced Large Language Models

    Bo Li*, Chen Change Loy, Fanyi Pu, Jingkang Yang, Kaichen Zhang*, Kairui Hu, Luu Minh Thang*, Nguyen Quang Trung*, Pham Ba Cong*, Shuai Liu, Yezhen Wang*, Ziwei Liu

    Technical Blog 2025 Blog

  13. Egocentric Perception and Memory: From Embodied Understanding to a Lifelong Assistant

    Shuai Liu — Nanyang Technological University

    MEng Thesis 2025 Thesis

  14. 2024
  15. Octopus

    Octopus: Embodied Vision-Language Programmer from Environmental Feedback

    Jingkang Yang*, Yuhao Dong*, Shuai Liu*, Bo Li*, Ziyue Wang, Chencheng Jiang, Haoran Tan, Jiamu Kang, Yuanhan Zhang, Kaiyang Zhou, Ziwei Liu

    ECCV 2024 PaperCodeProjectVideo

  16. 2023
  17. PSG4D

    4D Panoptic Scene Graph Generation

    Jingkang Yang, Jun Cen, Wenxuan Peng, Shuai Liu, Fangzhou Hong, Xiangtai Li, Kaiyang Zhou, Qifeng Chen, Ziwei Liu

    NeurIPS 2023 (Spotlight) PaperCode

Projects

  • Habitus

    Habitus

    A proactive AI agent built on FileGram's behavioral trace and content delta philosophy. Turns the proactive agent setting from research into a real product.

    Proactive Agent · Behavioral Trace · Content Delta Website

  • Engram Suite

    Engram Suite

    Privacy-first AI memory layer — "Signal for AI Memory." End-to-end encrypted memory system for AI assistants with zero-knowledge sync.

    E2E Encryption · MCP · Local-first GitHub

  • Cocoa Suite

    Cocoa Suite

    A local AI assistant that transforms files into actionable memory through semantic understanding. Fully private, on-device, zero cloud dependency.

    On-device · Multimodal · Vector Search GitHub