Publications / Preprints

* denotes equal contribution

Please see my  Google Scholar or  Semantic Scholar for the most up-to-date list of publications.

Preprints

2024

  1. MMLongBench-Doc: Benchmarking Long-context Document Understanding with Visualizations
    Yubo Ma, Yuhang Zang, Liangyu Chen, Meiqi Chen, Yizhu Jiao, Xinze Li, Xinyuan Lu, Ziyu Liu, Yan Ma, Xiaoyi Dong, Pan Zhang,  Liangming Pan, Yu-Gang Jiang, Jiaqi Wang, Yixin Cao, and Aixin Sun
    arXiv preprint, 2024
  2. SeaKR: Self-aware Knowledge Retrieval for Adaptive Retrieval Augmented Generation
    Zijun Yao, Weijian Qi,  Liangming Pan, Shulin Cao, Linmei Hu, Weichuan Liu, Lei Hou, and Juanzi Li
    arXiv preprint, 2024
  3. DistiLRR: Transferring Code Repair for Low-Resource Programming Languages
    Kyle Wong, Alfonso Amayuelas,  Liangming Pan, and William Yang Wang
    arXiv preprint, 2024
  4. MultiAgent Collaboration Attack: Investigating Adversarial Attacks in Large Language Model Collaborations via Debate
    Alfonso Amayuelas, Xianjun Yang, Antonis Antoniades, Wenyue Hua,  Liangming Pan, and William Wang
    arXiv preprint, 2024
  5. Updating Language Models with Unstructured Facts: Towards Practical Knowledge Editing
    Xiaobao Wu,  Liangming Pan, William Yang Wang, and Anh Tuan Luu
    arXiv preprint, 2024
  6. SciAgent: Tool-augmented Language Models for Scientific Reasoning
    Yubo Ma, Zhibin Gou, Junheng Hao, Ruochen Xu, Shuohang Wang,  Liangming Pan, Yujiu Yang, Yixin Cao, Aixin Sun, Hany Awadalla, and Weizhu Chen
    arXiv preprint, 2024
  7. Factcheck-Bench: Fine-Grained Evaluation Benchmark for Automatic Fact-checkers
    Yuxia Wang, Revanth Gangi Reddy, Zain Muhammad Mujahid, Arnav Arora, Aleksandr Rubashevskii, Jiahui Geng, Osama Mohammed Afzal,  Liangming Pan, Nadav Borenstein, Aditya Pillai, Isabelle Augenstein, Iryna Gurevych, and Preslav Nakov
    arXiv preprint, 2024

2023

  1. A Survey on Detection of LLMs-Generated Content
    Xianjun Yang,  Liangming Pan, Xuandong Zhao, Haifeng Chen, Linda Petzold, William Yang Wang, and Wei Cheng
    arXiv preprint, 2023

Conference & Journal Papers

2024

  1. Automatically Correcting Large Language Models: Surveying the Landscape of Diverse Automated Correction Strategies
    Liangming Pan, Michael Saxon, Wenda Xu, Deepak Nathani, Xinyi Wang, and William Yang Wang
    Transactions of the Association for Computational Linguistics (TACL), 2024
    Oral Presentation at ACL 2024
  2. ACL
    Faithful Logical Reasoning via Symbolic Chain-of-Thought
    Jundong Xu, Hao Fei,  Liangming Pan, Qian Liu, Mong-Li Lee, and Wynne Hsu
    In Annual Meeting of the Association for Computational Linguistics (ACL), 2024
  3. ACL Oral Presentation
    Pride and Prejudice: LLM Amplifies Self-Bias in Self-Refinement
    Wenda Xu, Guanglei Zhu, Xuandong Zhao,  Liangming Pan, Lei Li, and William Yang Wang
    In Annual Meeting of the Association for Computational Linguistics (ACL), 2024
  4. ACL
    Knowledge of Knowledge: Exploring Known-Unknowns Uncertainty with Large Language Models
    Alfonso Amayuelas, Kyle Wong,  Liangming Pan, Wenhu Chen, and William Yang Wang
    In Findings of Annual Meeting of the Association for Computational Linguistics (ACL), 2024
  5. ACL
    The Knowledge Alignment Problem: Bridging Human and External Knowledge for Large Language Models
    Shuo Zhang,  Liangming Pan, Junzhou Zhao, and William Yang Wang
    In Findings of Annual Meeting of the Association for Computational Linguistics (ACL), 2024
  6. ACL
    Towards Verifiable Generation: A Benchmark for Knowledge-aware Language Model Attribution
    Xinze Li, Yixin Cao,  Liangming Pan, Yubo Ma, and Aixin Sun
    In Findings of Annual Meeting of the Association for Computational Linguistics (ACL), 2024
  7. ACL
    Modeling Dynamic Topics in Chain-Free Fashion by Evolution-Tracking Contrastive Learning and Unassociated Word Exclusion
    Xiaobao Wu, Xinshuai Dong,  Liangming Pan, Thong Nguyen, and Anh Tuan Luu
    In Findings of Annual Meeting of the Association for Computational Linguistics (ACL), 2024
  8. Understanding Reasoning Ability of Language Models From the Perspective of Reasoning Paths Aggregation
    Xinyi Wang, Alfonso Amayuelas, Kexun Zhang,  Liangming Pan, Wenhu Chen, and William Yang Wang
    In International Conference on Machine Learning (ICML), 2024
  9. Tweets to Citations: Unveiling the Impact of Social Media Influencers on AI Research Visibility
    Iain Xie Weissburg, Mehir Arora, Xinyi Wang,  Liangming Pan, and William Yang Wang
    In International Conference on Machine Learning (ICML), 2024
  10. A Survey on Data Selection for Language Models
    Alon Albalak, Yanai Elazar, Sang Michael Xie, Shayne Longpre, Nathan Lambert, Xinyi Wang, Niklas Muennighoff, Bairu Hou,  Liangming Pan, Haewon Jeong, Colin Raffel, Shiyu Chang, Tatsunori Hashimoto, and William Yang Wang
    Transactions on Machine Learning Research (TMLR), 2024

2023

  1. SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tables
    Xinyuan Lu*Liangming Pan*, Qian Liu, Preslav Nakov, and Min-Yen Kan
    In Conference on Empirical Methods in Natural Language Processing (EMNLP), 2023
  2. MAF: Multi-Aspect Feedback for Improving Reasoning in Large Language Models
    Deepak Nathani, David Wang,  Liangming Pan, and William Wang
    In Conference on Empirical Methods in Natural Language Processing (EMNLP), 2023
  3. EMNLP Oral Presentation
    INSTRUCTSCORE: Towards Explainable Text Generation Evaluation with Automatic Feedback
    Wenda Xu, Danqing Wang,  Liangming Pan, Zhenqiao Song, Markus Freitag, William Wang, and Lei Li
    In Conference on Empirical Methods in Natural Language Processing (EMNLP), 2023
  4. Doolittle: Benchmarks and Corpora for Academic Writing Formalization
    Shizhe Diao, Yongyu Lei,  Liangming Pan, Tianqing Fang, Wangchunshu Zhou, Sedrick Keh, Min-Yen Kan, and Tong Zhang
    In Conference on Empirical Methods in Natural Language Processing (EMNLP), 2023
  5. Logic-LM: Empowering Large Language Models with Symbolic Solvers for Faithful Logical Reasoning
    Liangming Pan, Alon Albalak, Xinyi Wang, and William Wang
    In Findings of Conference on Empirical Methods in Natural Language Processing (EMNLP), 2023
  6. On the Risk of Misinformation Pollution with Large Language Models
    Yikang Pan*Liangming Pan*, Wenhu Chen, Preslav Nakov, Min-Yen Kan, and William Wang
    In Findings of Conference on Empirical Methods in Natural Language Processing (EMNLP), 2023
  7. QACheck: A Demonstration System for Question-Guided Multi-Hop Fact-Checking
    Liangming Pan, Xinyuan Lu, Min-Yen Kan, and Preslav Nakov
    In Conference on Empirical Methods in Natural Language Processing: System Demonstrations (EMNLP Demo), 2023
  8. ACL
    Fact-Checking Complex Claims with Program-Guided Reasoning
    Liangming Pan, Xiaobao Wu, Xinyuan Lu, Anh Tuan Luu, William Yang Wang, Min-Yen Kan, and Preslav Nakov
    In Annual Meeting of the Association for Computational Linguistics (ACL), 2023
  9. ACL
    Modeling What-to-ask and How-to-ask for Answer-unaware Conversational Question Generation
    Xuan Long Do, Bowei Zou, Shafiq Joty, Tran Tai,  Liangming Pan, Nancy Chen, and Ai Ti Aw
    In Annual Meeting of the Association for Computational Linguistics (ACL), 2023
  10. AACL / IJCNLP Oral Presentation
    Attacking Open-domain Question Answering by Injecting Misinformation
    Liangming Pan, Wenhu Chen, Min-Yen Kan, and William Yang Wang
    In International Joint Conference on Natural Language Processing and Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (IJCNLP-AACL), 2023
    Area Chair Award (Question Answering Track)
  11. AACL / IJCNLP Oral Presentation
    Investigating Zero- and Few-shot Generalization in Fact Verification
    Liangming Pan, Yunxiang Zhang, and Min-Yen Kan
    In International Joint Conference on Natural Language Processing and Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (IJCNLP-AACL), 2023
  12. AACL / IJCNLP Oral Presentation
    FollowupQG: Towards Information-Seeking Follow-up Question Generation
    Yan Meng,  Liangming Pan, Yixin Cao, and Min-Yen Kan
    In International Joint Conference on Natural Language Processing and Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (IJCNLP-AACL), 2023
  13. Efficient Online Data Mixing For Language Model Pre-Training
    Alon Albalak,  Liangming Pan, Colin Raffel, and William Yang Wang
    In NeurIPS Workshop on Robustness of Few-shot and Zero-shot Learning in Foundation Models (R0-FoMo@NeurIPS), 2023
    Spotlight Paper
  14. WWW
    Hashtag-Guided Low-Resource Tweet Classification
    Shizhe Diao, Sedrick Scott Keh,  Liangming Pan, Zhiliang Tian, Yan Song, and Tong Zhang
    In International World Wide Web Conference (WWW), 2023
  15. InfoCTM: A Mutual Information Maximization Perspective of Cross-Lingual Topic Modeling
    Xiaobao Wu, Xinshuai Dong, Thong Nguyen, Chaoqun Liu,  Liangming Pan, and Anh Tuan Luu
    In AAAI Conference on Artificial Intelligence (AAAI), 2023

2022

  1. ACL Oral Presentation
    KQA Pro: A Dataset with Explicit Compositional Programs for Complex Question Answering over Knowledge Base
    Shulin Cao, Jiaxin Shi,  Liangming Pan, Lunyiu Nie, Yutong Xiang, Lei Hou, Juanzi Li, Bin He, and Hanwang Zhang
    In Annual Meeting of the Association for Computational Linguistics (ACL), 2022
  2. ACL
    Interpreting the Robustness of Neural NLP Models to Textual Perturbations
    Yunxiang Zhang,  Liangming Pan, Samson Tan, and Min-Yen Kan
    In Findings of Annual Meeting of the Association for Computational Linguistics (ACL), 2022
  3. KHANQ: A Dataset for Generating Deep Questions in Education
    Huanli Gong,  Liangming Pan, and Hengchang Hu
    In International Conference on Computational Linguistics (COLING), 2022
  4. CoHS-CQG: Context and History Selection for Conversational Question Generation
    Xuan Long Do, Bowei Zou,  Liangming Pan, Nancy F. Chen, Shafiq Joty, and Ai Ti Aw
    In International Conference on Computational Linguistics (COLING), 2022
  5. Automatic True/False Question Generation for Educational Purpose
    Bowei Zou, Pengfei Li,  Liangming Pan, and Ai Ti Aw
    In NAACL Workshop on Innovative Use of NLP for Building Educational Applications (BEA@NAACL), 2022
  6. Ingredient-enriched Recipe Generation from Cooking Videos
    Jianlong Wu,  Liangming Pan, Jingjing Chen, and Yu-Gang Jiang
    In International Conference on Multimedia Retrieval (ICMR), 2022
  7. Modeling and Leveraging Prerequisite Context in Recommendation
    Hengchang Hu,  Liangming Pan, Yiding Ran, and Min-Yen Kan
    In RecSys Workshop on Context-Aware Recommender Systems (CARS@RecSys), 2022

2021

  1. ACL Oral Presentation
    Zero-shot Fact Verification by Claim Generation
    Liangming Pan, Wenhu Chen, Wenhan Xiong, Min-Yen Kan, and William Yang Wang
    In Annual Meeting of the Association for Computational Linguistics (ACL), 2021
  2. NAACL Oral Presentation
    Unsupervised Multi-hop Question Answering by Question Generation
    Liangming Pan, Wenhu Chen, Wenhan Xiong, Min-Yen Kan, and William Yang Wang
    In Annual Conference of the North American Chapter of the Association for Computational Linguistics (NAACL), 2021
  3. TMM
    A Hybrid Approach for Detecting Prerequisite Relations in Multi-Modal Food Recipes
    Liangming Pan, Jingjing Chen, Shaoteng Liu, Chong-Wah Ngo, Min-Yen Kan, and Tat-Seng Chua
    IEEE Transactions on Multimedia (TMM), 2021

2020

  1. ACL Oral Presentation
    Semantic Graphs for Generating Deep Questions
    Liangming Pan, Yuxi Xie, Yansong Feng, Tat-Seng Chua, and Min-Yen Kan
    In Annual Meeting of the Association for Computational Linguistics (ACL), 2020
  2. ACL Oral Presentation
    Expertise Style Transfer: A New Task Towards Better Communication between Experts and Laymen
    Yixin Cao, Ruihao Shui,  Liangming Pan, Min-Yen Kan, Zhiyuan Liu, and Tat-Seng Chua
    In Annual Meeting of the Association for Computational Linguistics (ACL), 2020
  3. Exploring and Evaluating Attributes, Values, and Structures for Entity Alignment
    Zhiyuan Liu, Yixin Cao,  Liangming Pan, Juanzi Li, Zhiyuan Liu, and Tat-Seng Chua
    In Conference on Empirical Methods in Natural Language Processing (EMNLP), 2020
  4. Exploring Question-Specific Rewards for Generating Deep Questions
    Yuxi Xie,  Liangming Pan*, Dongzhe Wang, Min-Yen Kan, and Yansong Feng
    In International Conference on Computational Linguistics (COLING), 2020
  5. ACM MM Oral Presentation
    Multi-modal Cooking Workflow Construction for Food Recipes
    Liangming Pan, Jingjing Chen, Jianlong Wu, Shaoteng Liu, Chong-Wah Ngo, Min-Yen Kan, Yu-Gang Jiang, and Tat-Seng Chua
    In ACM International Conference on Multimedia (ACM MM), 2020
  6. CVPR
    Hyperbolic Visual Embedding Learning for Zero-Shot Recognition
    Shaoteng Liu, Jingjing Chen,  Liangming Pan, Chong-Wah Ngo, Tat-Seng Chua, and Yu-Gang Jiang
    In IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020
  7. Zero-Shot Ingredient Recognition by Multi-Relational Graph Convolutional Network
    Jingjing Chen,  Liangming Pan, Zhipeng Wei, Xiang Wang, Chong-Wah Ngo, and Tat-Seng Chua
    In AAAI Conference on Artificial Intelligence (AAAI), 2020

2017

  1. ACL
    Prerequisite Relation Learning for Concepts in MOOCs
    Liangming Pan, Chengjiang Li, Juanzi Li, and Jie Tang
    In Annual Meeting of the Association for Computational Linguistics (ACL), 2017
  2. Course Concept Extraction in MOOCs via Embedding-Based Graph Propagation
    Liangming Pan, Xiaochen Wang, Chengjiang Li, Juanzi Li, and Jie Tang
    In International Joint Conference on Natural Language Processing (IJCNLP), 2017

PhD thesis

2022

  1. Towards Generating Deep Questions from Text
    National University of Singapore, 2022