SOK-Bench: A Situated Video Reasoning Benchmark with Aligned Open-World Knowledge
- Andong Wang
- Bo Wu
- et al.
- 2024
- CVPR 2024
Bio
I am a researcher at MIT-IBM Watson AI Lab in Cambridge, MA, USA. I received my Ph.D. degree from the Department of Computer Science at The University of Hong Kong. My interests are centered around machine learning and its applications to computer vision and natural language processing. My ultimate research goal is to develop an AI system that can perceive and reason about the physical world, and communicate with humans in natural language.
Publications
GENOME: Generative Neuro-Symbolic Visual Reasoning by Growing and Reusing Modules
- Zhenfang Chen
- Rui Sun
- et al.
- 2024
- ICLR 2024
Visual Chain-of-Thought Prompting for Knowledge-based Visual Reasoning
- Zhenfang Chen
- Qinhong Zhou
- et al.
- 2024
- AAAI 2024
Principle-Driven Self-Alignment of Language Models from Scratch with Minimal Human Supervision
- Zhiqing Sun
- Yikang Shen
- et al.
- 2023
- NeurIPS 2023
3D-LLM: Injecting the 3D World into Large Language Models
- Yining Hong
- Haoyu Zhen
- et al.
- 2023
- NeurIPS 2023
Physion++: Evaluating Physical Scene Understanding that Requires Online Inference of Different Physical Properties
- Hsiao-yu Tung
- Mingyu Ding
- et al.
- 2023
- NeurIPS 2023
3D Concept Learning and Reasoning from Multi-View Images
- Yining Hong
- Chunru Lin
- et al.
- 2023
- CVPR 2023
Mod-Squad: Designing Mixtures of Experts As Modular Multi-Task Learners
- Zitian Chen
- Yikang Shen
- et al.
- 2023
- CVPR 2023
Visual Dependency Transformers: Dependency Tree Emerges from Reversed Attention
- Mingyu Ding
- Yikang Shen
- et al.
- 2023
- CVPR 2023
Deep Face Video Inpainting via UV Mapping
- Wenqi Yang
- Zhenfang Chen
- et al.
- 2023
- IEEE TIP
Patents
Projects
Dromedary
Training language models to better follow user intentions and make them more truthful
Top collaborators
YS
Yikang Shen
Staff Research Scientist, LLM
DC
David D. Cox
VP, AI Models; IBM Director, MIT-IBM Watson AI Lab
DG
Dan Gutfreund
Principal Research Staff Member, Manager, AI Models Science