Selected Publications

See Google Scholar Profile for Full List
(* denotes equal contribution, † indicates corresponding author)

RLVR and Agent

• CDE: Curiosity-Driven Exploration for Efficient Reinforcement Learning in Large Language Models
  Runpeng Dai, Linfeng Song†, Haolin Liu, Zhenwen Liang, Dian Yu, Haitao Mi, Zhaopeng Tu, Rui Liu, Tong Zheng, Hongtu Zhu, Dong Yu. Arxiv.

Selected Papers on Automatic Theorem Proving

• EconProver: Towards More Economical Test-Time Scaling for Automated Theorem Proving
  Mukai Li, Linfeng Song†, Zhenwen Liang, Jiahao Xu, Shansan Gong, Qi Liu, Haitao Mi, Dong Yu. Arxiv.

• Towards Solving More Challenging IMO Problems via Decoupled Reasoning and Proving
  Zhenwen Liang, Linfeng Song, Yang Li, Tao Yang, Feng Zhang, Haitao Mi and Dong Yu. Arxiv.

• MPS-Prover: Advancing Stepwise Theorem Proving by Multi-Perspective Search and Data Curation
  Zhenwen Liang, Linfeng Song, Yang Li, Tao Yang, Feng Zhang, Haitao Mi and Dong Yu. Neurips 2025.

• HunyuanProver: A Scalable Data Synthesis Framework and Guided Tree Search for Automated Theorem Proving
  Yang Li*, Dong Du*, Linfeng Song*, Chen Li*, Weikang Wang, Tao Yang and Haitao Mi. Arxiv.

Selected Papers on Search and RL

• Don’t Get Lost in the Trees: Streamlining LLM Reasoning by Overcoming Tree Search Exploration Pitfalls
  Ante Wang, Linfeng Song†, Ye Tian, Dian Yu, Haitao Mi, Xiangyu Duan, Zhaopeng Tu†, Jinsong Su† and Dong Yu. ACL 2025.

• LiteSearch: Efficacious Tree Search for LLM
  Ante Wang, Linfeng Song†, Ye Tian, Baolin Peng, Dian Yu, Haitao Mi, Jinsong Su† and Dong Yu. AAAI 2025.

• Towards Self-Improvement of LLMs via MCTS: Leveraging Stepwise Knowledge with Curriculum Preference Learning
  Xiyao Wang, Linfeng Song†, Ye Tian, Dian Yu, Baolin Peng, Haitao Mi, Furong Huang and Dong Yu. Arxiv.

• Toward Self-Improvement of LLMs via Imagination, Searching, and Criticizing
  Ye Tian*, Baolin Peng*, Linfeng Song*, Lifeng Jin, Dian Yu, Haitao Mi and Dong Yu. Neurips 2024.

2025

• Do NOT Think That Much for 2+3=? On the Overthinking of o1-Like LLMs
  Xingyu Chen, Jiahao Xu, Tian Liang, Zhiwei He, Jianhui Pang, Dian Yu, Linfeng Song, Qiuzhi Liu, Mengfei Zhou, Zhuosheng Zhang, Rui Wang, Zhaopeng Tu, Haitao Mi, Dong Yu. ICML 2025.

• Thoughts Are All Over the Place: On the Underthinking of o1-Like LLMs
  Yue Wang, Qiuzhi Liu, Jiahao Xu, Tian Liang, Xingyu Chen, Zhiwei He, Linfeng Song, Dian Yu, Juntao Li, Zhuosheng Zhang, Rui Wang, Zhaopeng Tu, Haitao Mi, Dong Yu. Neurips 2025.

• Improving LLM General Preference Alignment via Optimistic Online Mirror Descent
  Yuheng Zhang, Dian Yu, Tao Ge, Linfeng Song, Zhichen Zeng, Haitao Mi, Nan Jiang, Dong Yu. Neurips 2025.

• Iterative Nash Policy Optimization: Aligning LLMs with General Preferences via No-Regret Learning
  Yuheng Zhang, Dian Yu, Baolin Peng, Linfeng Song, Ye Tian, Mingyue Huo, Nan Jiang, Haitao Mi, Dong Yu. ICLR 2025.

2024

• Collaborative Decoding of Critical Tokens for Boosting Factuality of Large Language Models
  Lifeng Jin, Baolin Peng, Linfeng Song, Haitao Mi, Ye Tian and Dong Yu. Arxiv.

• The Trickle-down Impact of Reward (In-)consistency on RLHF
  Lingfeng Shen, Sihao Chen, Linfeng Song, Lifeng Jin, Baolin Peng, Haitao Mi, Daniel Khashabi, Dong Yu. ICLR 2024.

• Self-Consistency Boosts Calibration for Math Reasoning
  Ante Wang, Linfeng Song, Ye Tian, Baolin Peng, Lifeng Jin, Haitao Mi, Jinsong Su, Dong Yu. EMNLP 2024 (Findings).

• Fine-Grained Self-Endorsement Improves Factuality and Reasoning
  Ante Wang, Linfeng Song, Baolin Peng, Ye Tian, Lifeng Jin, Haitao Mi, Jinsong Su, Dong Yu. ACL 2024 (Findings).

• Self-Alignment for Factuality: Mitigating Hallucinations in LLMs via Self-Evaluation
  Xiaoying Zhang, Baolin Peng, Ye Tian, Jingyan Zhou, Lifeng Jin, Linfeng Song, Haitao Mi, Helen Meng. ACL 2024.

• Mitigating Catastrophic Forgetting in Large Language Models with Self-Synthesized Rehearsal
  Jianheng Huang, Leyang Cui, Ante Wang, Chengyi Yang, Xinting Liao, Linfeng Song, Junfeng Yao, Jinsong Su. ACL 2024.

• Response Enhanced Semi-Supervised Dialogue Query Generation
  Jianheng Huang, Ante Wang, Linfeng Gao, Linfeng Song, Jinsong Su. AAAI 2024.

2023

• Stabilizing RLHF through Advantage Model and Selective Rehearsal
  Baolin Peng*, Linfeng Song*, Ye Tian, Lifeng Jin, Haitao Mi and Dong Yu. Arxiv.

• Domain Adaptation for Conversational Query Production with the RAG Model Feedback
  Ante Wang, Linfeng Song, Ge Xu, Jinsong Su. EMNLP 2023 (Findings).

• OpenFact: Factuality Enhanced Open Knowledge Extraction
  Linfeng Song*, Ante Wang*, Xiaoman Pan, Hongming Zhang, Dian Yu, Lifeng Jin, Haitao Mi, Jinsong Su, Yue Zhang and Dong Yu. TACL 2023.

• Discover, Explanation, Improvement: Automatic Slice Detection Framework for Natural Language Processing
  Wenyue Hua, Lifeng Jin, Linfeng Song, Haitao Mi, Yongfeng Zhang, Dong Yu. TACL 2023.

• D²PSG: Multi-Party Dialogue Discourse Parsing as Sequence Generation
  Ante Wang, Linfeng Song, Lifeng Jin, Junfeng Yao, Haitao Mi, Chen Lin, Jinsong Su and Dong Yu. TASLP 2023.

• Bi-level Finetuning with Task-dependent Similarity Structure for Low-resource Training
  Sai Ashish Somayajula, Lifeng Jin, Linfeng Song, Haitao Mi and Dong Yu. ACL 2023 (Findings).

• SafeConv: Explaining and Correcting Conversational Unsafe Behavior
  Mian Zhang, Lifeng Jin, Linfeng Song, Haitao Mi, Wenliang Chen and Dong Yu. ACL 2023.

• A Survey on Zero Pronoun Translation
  Longyue Wang, Siyou Liu, Mingzhou Xu, Linfeng Song, Shuming Shi and Zhaopeng Tu. ACL 2023.

• Search-Engine-augmented Dialogue Response Generation with Cheaply Supervised Query Production
  Ante Wang*, Linfeng Song*, Qi Liu, Haitao Mi, Longyue Wang, Zhaopeng Tu, Jinsong Su and Dong Yu. AI 2023.

2022

• Learning a Grammar Inducer from Massive Uncurated Instructional Videos
  Songyang Zhang, Linfeng Song, Lifeng Jin, Haitao Mi, Kun Xu, Dong Yu and Jiebo Luo. EMNLP 2022.

• Cross-lingual Text-to-SQL Semantic Parsing with Representation Mixup
  Peng Shi, Linfeng Song, Lifeng Jin, Haitao Mi, He Bai, Jimmy Lin and Dong Yu. EMNLP 2022 (Findings).

• Augmenting Multi-Turn Text-to-SQL Datasets with Self-Play
  Qi Liu, Zihuiwen Ye, Tao Yu, Phil Blunsom and Linfeng Song. EMNLP 2022 (Findings).

• Cross-domain Generalization for AMR Parsing
  Xuefeng Bai, Sen Yang, Leyang Cui, Linfeng Song and Yue Zhang. EMNLP 2022.

• Getting the Most out of Simile Recognition
  Xiaoyue Wang*, Linfeng Song*, Xin Liu, Chulun Zhou, Hualin Zeng and Jinsong Su. EMNLP 2022 (Findings).

• A Benchmark for Zero Pronoun Recovery and Translation
  Mingzhou Xu, Longyue Wang, Derek F. Wong, Hongye Liu, Linfeng Song, Lidia S. Chao, Shuming Shi and Zhaopeng Tu. EMNLP 2022.

• Variational Graph Autoencoding as Cheap Supervision for AMR Coreference Resolution
  Irene Li, Linfeng Song†, Kun Xu and Dong Yu. ACL 2022.

• Hierarchical Context Tagging for Utterance Rewriting
  Lisa Jin, Linfeng Song†, Lifeng Jin, Daniel Gildea, Dong Yu. AAAI 2022.

• CASA: Conversational Aspect Sentiment Analysis for Dialogue Understanding
  Linfeng Song, Chunlei Xin, Shaopeng Lai, Ante Wang, Jinsong Su, and Kun Xu. JAIR 2022.

• A Multi-Level Optimization Framework for End-to-End Text Augmentation
  Sai Ashish Somayajula, Linfeng Song, Pengtao Xie. TACL 2022.

2021

• RAST: Domain-Robust Dialogue Rewriting as Sequence Tagging
  Jie Hao, Linfeng Song†, Liwei Wang, Kun Xu, Zhaopeng Tu, Dong Yu. EMNLP 2021.

• Instance-adaptive training with noise-robust losses against noisy labels
  Lifeng Jin, Linfeng Song, Kun Xu, Dong Yu. EMNLP 2021.

• Conversational Semantic Role Labeling
  Kun Xu, Han Wu, Linfeng Song, Haisong Zhang, Linqi Song, Dong Yu. TASLP 2021.

• End-to-End AMR Corefencence Resolution
  Qiankun Fu, Linfeng Song†, Wenyu Du, and Yue Zhang. ACL 2021.

• Semantic Representation for Dialogue Modeling
  Xuefeng Bai, Yulong Chen, Linfeng Song, and Yue Zhang. ACL 2021.

• JointGT: Graph-Text Joint Representation Learning for Text Generation from Knowledge Graphs
  Pei Ke, Haozhe Ji, Yu Ran, Xin Cui, Liwei Wang, Linfeng Song, Xiaoyan Zhu, and Minlie Huang. ACL 2021 (Findings).

• TexSmart: A System for Enhanced Natural Language Understanding
  Lemao Liu, Haisong Zhang, Haiyun Jiang, Yangming Li, Enbo Zhao, Kun Xu, Linfeng Song, Suncong Zheng, Botong Zhou, Dick Zhu, Xiao Feng, Tao Chen, Tao Yang, Dong Yu, Feng Zhang, ZhanHui Kang, Shuming Shi. ACL 2021 (Demo Track).

• Domain-Adaptive Pretraining Methods for Dialogue Understanding
  Han Wu, Kun Xu, Linfeng Song, Lifeng Jin, Haisong Zhang, and Linqi Song. ACL 2021 (Short).

• Video-aided Unsupervised Grammar Induction
  Songyang Zhang, Linfeng Song, Lifeng Jin, Kun Xu, Dong Yu and Jiebo Luo. NAACL 2021 (Best Long Paper).

• A Structure Self-Aware Model for Discourse Parsing on Multi-Party Dialogues
  Ante Wang*, Linfeng Song*, Hui Jiang, Shaopeng Lai, Junfeng Yao, Min Zhang, Jinsong Su. IJCAI 2021.

2020

• Robust Dialogue Utterance Rewriting as Sequence Tagging
  Jie Hao, Linfeng Song, Liwei Wang, Kun Xu, Zhaopeng Tu, Dong Yu. (Arxiv version of Hao et al., EMNLP 2021)

• Rich Syntactic and Semantic Information Helps Unsupervised Text Style Transfer
  Hongyu Gong, Linfeng Song and Suma Bhat. In Proceedings of the 2020 Conference on Natural Language Generation (INLG 2020).

• Online Back-Parsing for AMR-to-Text Generation
  Xuefeng Bai, Linfeng Song and Yue Zhang. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP 2020).

• Semantic Role Labeling Guided Multi-turn Dialogue ReWriter
  Kun Xu, Haochen Tan, Linfeng Song, Han Wu, Haisong Zhang, Linqi Song and Dong Yu. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP 2020).

• Structural Information Preserving for Graph-to-Text Generation
  Linfeng Song, Ante Wang, Jinsong Su, Yue Zhang, Kun Xu, Yubin Ge and Dong Yu. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (ACL 2020).

• ZPR2: Joint Zero Pronoun Recovery and Resolution using Multi-Task Learning and BERT
  Linfeng Song, Kun Xu, Yue Zhang, Jianshu Chen and Dong Yu. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (ACL 2020).

• Evidence Integration for Multi-hop Reading Comprehension with Graph Neural Networks
  Linfeng Song, Zhiguo Wang, Mo Yu, Yue Zhang, Radu Florian and Daniel Gildea. In IEEE Transactions on Knowledge and Data Engineering (TKDE).

• Relation Extraction Exploiting Full Dependency Forests
  Lifeng Jin*, Linfeng Song*, Yue Zhang, Kun Xu, Wei-yun Ma, and Dong Yu. In Proceedings of Thirty-Fourth AAAI Conference on Artificial Intelligence (AAAI-20), Oral.

• Coordinated Reasoning for Cross-Lingual Knowledge Graph Alignment
  Kun Xu, Linfeng Song, Yansong Feng, Yan Song, and Dong Yu. In Proceedings of Thirty-Fourth AAAI Conference on Artificial Intelligence (AAAI-20).

• Neural Simile Recognition with Cyclic Multitask Learning and Local Attention
  Jiali Zeng*, Linfeng Song*, Jinsong Su, Jun Xie, Wei Song, and Jiebo Luo. In Proceedings of Thirty-Fourth AAAI Conference on Artificial Intelligence (AAAI-20).

• Enhancing Pointer Network for Sentence Ordering with Pairwise Ordering Predictions
  Yongjing Yin, Fandong Meng, Jinsong Su, Yubin Ge, Linfeng Song, Jie Zhou, and Jiebo Luo. In Proceedings of Thirty-Fourth AAAI Conference on Artificial Intelligence (AAAI-20).

2019

• Leveraging Dependency Forest for Neural Medical Relation Extraction
  Linfeng Song, Yue Zhang, Daniel Gildea, Mo Yu, Zhiguo Wang and Jinsong Su. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing (EMNLP 2019).
• SemBleu: A Robust Metric for AMR Parsing Evaluation
  Linfeng Song, Daniel Gildea. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics (ACL 2019).
• Progressive Self-Supervised Attention Learning for Aspect-Level Sentiment Analysis
  Jialong Tang, Ziyao Lu, Jinsong Su, Yubin Ge, Linfeng Song, Le Sun and Jiebo Luo. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics (ACL 2019).
• Semantic Neural Machine Translation using AMR
  Linfeng Song, Daniel Gildea, Yue Zhang, Zhiguo Wang and Jinsong Su. In Transaction of ACL 2019 (TACL 2019).
• Graph-based Neural Sentence Ordering
  Yongjing Yin*, Linfeng Song*, Jinsong Su, Jiali Zeng, Chulun Zhou and Jiebo Luo. In 2019 International Joint Conference on Artificial Intelligence (IJCAI 2019).
• Neural Collective Entity Linking Based on Recurrent Random Walk Network Learning
  Mengge Xue, Weiming Cai, Jinsong Su, Linfeng Song, Yubin Ge, Yubao Liu and Bin Wang. In 2019 International Joint Conference on Artificial Intelligence (IJCAI 2019).
• Multi-Granular Text Encoding for Self-Explaining Categorization
  Zhiguo Wang, Yue Zhang, Mo Yu, Wei Zhang, Lin Pan, Linfeng Song, Kun Xu, Yousef El-Kurdi. In BlackboxNLP 2019.

2018

• Exploring Graph-structured Passage Representation for Multi-hop Reading Comprehension with Graph Neural Networks
  Linfeng Song, Zhiguo Wang, Mo Yu, Yue Zhang, Radu Florian and Daniel Gildea. In arXiv preprint arXiv:1809.02040. (Arxiv version of Song et al., (TKDE 2020))
• Neural Transition-based Syntactic Linearization
  Linfeng Song, Yue Zhang and Daniel Gildea. In Proceedings of the 2018 Conference on Natural Language Generation (INLG 2018), Oral.
• N-ary Relation Extraction using Graph State LSTM
  Linfeng Song, Yue Zhang, Zhiguo Wang and Daniel Gildea. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing (EMNLP 2018).
• A Graph-to-Sequence Model for AMR-to-Text Generation
  Linfeng Song, Yue Zhang, Zhiguo Wang and Daniel Gildea. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (ACL 2018).
• Sentence-State LSTM for Text Representation
  Yue Zhang, Qi Liu and Linfeng Song. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (ACL 2018).
• Sequence-to-sequence Models for Cache Transition Systems
  Xiaochang Peng, Linfeng Song, Daniel Gildea and Giorgio Satta. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (ACL 2018), Oral.
• Leveraging Context Information for Natural Question Generation
  Linfeng Song, Zhiguo Wang, Wael Hamza, Yue Zhang and Daniel Gildea. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics (NAACL 2018).

2017

• A Unified Query-based Generative Model for Question Generation and Question Answering
  Linfeng Song, Zhiguo Wang and Wael Hamza. In arXiv preprint arXiv:1709.01058. (Arxiv version of Song et al., (NAACL 2018))
• k-Nearest Neighbor Augmented Neural Networks for Text Classification
  Zhiguo Wang, Wael Hamza and Linfeng Song. In arXiv preprint arXiv:1708.07863.
• AMR-to-text Generation with Synchronous Node Replacement Grammar
  Linfeng Song, Xiaochang Peng, Yue Zhang, Zhiguo Wang and Daniel Gildea. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (ACL 2017), Oral.

2016

• Word Embedding, Sense Embedding and their Application to Word Sense Induction slides
  Linfeng Song. Area Paper.
• AMR-to-text generation as a Traveling Salesman Problem
  Linfeng Song, Yue Zhang, Xiaochang Peng, Zhiguo Wang and Daniel Gildea. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing (EMNLP 2016).
• Sense Embedding for Word Sense Induction
  Linfeng Song, Zhiguo Wang, Haitao Mi and Daniel Gildea. In Proceedings of the Fifth Joint Conference on Lexical and Computational Semantics (*SEM 2016).

2015

• A Synchronous Hyperedge Replacement Grammar based approach for AMR parsing
  Xiaochang Peng, Linfeng Song and Daniel Gildea. In Proceedings of the Nineteenth Conference on Computational Natural Language Learning (CoNLL 2015).

2014 and earlier

• Joint Morphological Generation and Syntactic Linearization
  Linfeng Song, Yue Zhang, Kai Song and Qun Liu. In Twenty-Eighth AAAI Conference on Artificial Intelligence (AAAI 2014).
• Syntactic SMT Using a Discriminative Text Generation Model
  Yue Zhang, Kai Song, Linfeng Song, Jingbo Zhu and Qun Liu. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP 2014).
• Translation with Source Constituency and Dependency Trees
  Fandong Meng, Jun Xie, Linfeng Song, Yajuan Lv and Qun Liu. In Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing (EMNLP 2013).
• Bagging-based System Combination for Domain Adaptation
  Linfeng Song, Haitao Mi, Yajuan Lv and Qun Liu. In Proceedings of MT-Summit XIII.