*: Equal Contributions; ✝: My Advisee

• 🔥 Demystifying Long Chain-of-Thought Reasoning in LLMs
  Edward Yeo*✝, Yuxuan Tong*✝, Morry Niu, Graham Neubig, Xiang Yue
  ICML 2025
  (Also 🏆Best Paper Award at ICLR 2025 Workshop on Foundation Models in the Wild)
  

• Pangea: A Fully Open Multilingual Multimodal LLM for 39 Languages
  Xiang Yue*, Yueqi Song*, Akari Asai, Seungone Kim, Jean de Dieu Nyandwi, Simran Khanuja, Anjali Kantharuban, Lintang Sutawika, Sathyanarayanan Ramamoorthy, Graham Neubig
  ICLR 2025
  

• MAmmoTH2: Scaling Instructions from the Web
  Xiang Yue, Tuney Zheng, Ge Zhang, Wenhu Chen
  NeurIPS 2024
  

• Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization
  Boshi Wang, Xiang Yue, Yu Su, Huan Sun
  NeurIPS 2024
  

• MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmark
  Yubo Wang, Xueguang Ma, Ge Zhang, Yuansheng Ni, Abhranil Chandra, Shiguang Guo, Weiming Ren, Aaran Arulraj, Xuan He, Ziyan Jiang, Tianle Li, Max Ku, Kai Wang, Alex Zhuang, Rongqi Fan, Xiang Yue, Wenhu Chen
  NeurIPS 2024 (Spotlight)
  

• VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?
  Junpeng Liu*✝, Yifan Song*, Bill Yuchen Lin, Wai Lam, Graham Neubig, Yuanzhi Li, Xiang Yue
  COLM 2024
  

• OpenCodeInterpreter: Integrating Code Generation with Execution and Refinement
  Tianyu Zheng*✝, Ge Zhang*, Tianhao Shen*, Xueling Liu*, Bill Yuchen Lin, Jie Fu, Wenhu Chen, Xiang Yue
  ACL 2024, Findings
  

• 🔥 MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI
  Xiang Yue, Yuansheng Ni, Kai Zhang, Tianyu Zheng, Ruoqi Liu, Ge Zhang, Samuel Stevens, Dongfu Jiang, Weiming Ren, Yuxuan Sun, Cong Wei, Botao Yu, Ruibin Yuan, Renliang Sun, Ming Yin, Boyuan Zheng, Zhenzhu Yang, Yibo Liu, Wenhao Huang, Huan Sun, Yu Su, Wenhu Chen
  CVPR 2024 (🏆 Award Candidate Paper, Oral: 24/11,532=0.2%)
  
  MMMU-Pro: A more robust multi-discipline multimodal understanding benchmark
  Xiang Yue*, Tianyu Zheng*, Yuansheng Ni*, Yubo Wang, Kai Zhang, Shengbang Tong, Yuxuan Sun, Botao Yu, Ge Zhang, Huan Sun, Yu Su, Wenhu Chen, Graham Neubig
  ACL 2025

• MAmmoTH: Building Math Generalist Models through Hybrid Instruction Tuning
  Xiang Yue*, Xingwei Qu, Ge Zhang, Yao Fu, Wenhao Huang, Huan Sun, Yu Su, Wenhu Chen*
  ICLR 2024 (Spotlight)
  

• Automatic Evaluation of Attribution by Large Language Models
  Xiang Yue, Boshi Wang, Kai Zhang, Ziru Chen, Yu Su, Huan Sun
  EMNLP 2023, Findings
  

• Synthetic Text Generation with Differential Privacy: A Simple and Practical Recipe
  Xiang Yue, Huseyin A. Inan, Xuechen Li, Girish Kumar, Julia McAnallen, Hoda Shajari, Huan Sun, David Levitan, Robert Sim
  ACL 2023 (🏆 Best Paper Honorable Mention)
  

• Synthetic Question Value Estimation for Domain Adaptation of Question Answering
  Xiang Yue, Ziyu Yao, Huan Sun
  ACL 2022
  

• CliniQG4QA: Generating Diverse Questions for Domain Adaptation of Clinical Question Answering
  Xiang Yue*, Frederick Zhang*, Ziyu Yao, Simon Lin, Huan Sun
  IEEE Internatinal Conference on Bioinformatics and Biomedicine 2021 (BIBM 2021)
  🏆 Best Paper (1/727=0.1%)