Publications (Google Scholar)
Preprint
- Xiaohan Xu, Ming Li, Chongyang Tao, Tao Shen, Reynold Cheng, Jinyang Li, Can Xu, Dacheng Tao, Tianyi Zhou. A Survey on Knowledge Distillation of Large Language Models. In Arxiv (2024), 2024.02.
- Yibin Lei, Di Wu, Tao, Shen, Yu Cao, Chongyang Tao, Andrew Yates. Meta-Task Prompting Elicits Embedding from Large Language Models. In Arxiv (2024), 2024.02.
- Kaiwen Yang, Tao Shen, Xinmei Tian, Xiubo Geng, Chongyang Tao, Dacheng Tao, Tianyi Zhou. Good Questions Help Zero-Shot Image Reasoning. In Arxiv (2023), 2023.12.
- Yucheng Zhou, Xiubo Geng, Tao Shen, Chongyang Tao, Guodong Long, Jianguang Lou. Thread of thought unraveling chaotic contexts. In Arxiv (2023), 2023.11.
- Jia Li, Ge Li, Chongyang Tao, Hai Zhang, Fang Liu, Zhi Jin. Large Language Model-Aware In-Context Learning for Code Generation. In Arxiv (2023), 2023.11.
- Xiaohan Xu, Chongyang Tao, Tao Shen, Can Xu, Hongbo Xu, Guodong Long, Jian-guang Lou. Re-Reading Improves Reasoning in Language Models. In Arxiv (2023), 2023.09.
- Jiazhan Feng*, Chongyang Tao*, Xiubo Geng, Tao Shen, Can Xu, Guodong Long, Dongyan Zhao, Daxin Jiang. Knowledge Refinement via Interaction Between Search Engines and Large Language Models. In Arxiv (2023), 2023.05. [Code]
- Ziyang Luo, Can Xu, Pu Zhao, Xiubo Geng, Chongyang Tao, Jing Ma, Qingwei Lin, Daxin Jiang. Augmented Large Language Models with Parametric Knowledge Guiding. In Arxiv (2023), 2023.05.
- Tao Shen, Guodong Long, Xiubo Geng, Chongyang Tao, Tianyi Zhou, Daxin Jiang. Large Language Models are Strong Zero-Shot Retriever. In Arxiv (2023), 2023.04.
- Chang Liu*, Chongyang Tao*, Xiubo Geng, Tao Shen, Dongyan Zhao, Can Xu, Binxing Jiao, Daxin Jiang. Adam: Dense Retrieval Distillation with Adaptive Dark Examples. In Arxiv (2022), 2022.12
2024
- Can Xu, Qingfeng Sun, Kai Zheng, Xiubo Geng, Jiazhan Feng, Chongyang Tao, Daxin Jiang. WizadLM: Empowering Large Language Models to Follow Complex Instructions .In Proceedings of the International Conference on Learning Representations (ICLR 2024), 2024.02. [Code]
- Ziyang Luo*, Can Xu*, Pu Zhao, Qingfeng Sun, Xiubo Geng, Wenxiang Hu, Chongyang Tao, Jing Ma, Qingwei Lin, Daxin Jiang. WizardCoder: Empowering Code Large Language Models with Evol-Instruct. In Proceedings of the International Conference on Learning Representations (ICLR 2024), 2024.02. [Code]
- Yucheng Zhou, Tao Shen, Xiubo Geng, Chongyang Tao, Guodong Long, Can Xu, Daxin Jiang. Fine-Grained Distillation for Long Document Retrieval. In Proceedings of the AAAI Conference on Artificial Intelligence (AAAI 2024)
- Yang Li, Canran Xu, Guodong Long, Tao Shen, Chongyang Tao, Jing Jiang. CCPrefix: Counter- factual Contrastive Prefix-Tuning for Many-Class Classification. In Proceedings of the European Chapter of the Association for Computational Linguistics (EACL 2024)
2023
- Ziyang Luo, Pu Zhao, Can Xu, Xiubo Geng, Tao Shen, Chongyang Tao, Jing Ma, Daxin Jiang. LexLIP: Lexicon-Bottlenecked Language-Image Pre-Training for Large-Scale Image-Text Retrieval. In Proceeding of the International Conference on Computer Vision (ICCV 2023), 2023.08.
- Tao Shen, Xiubo Geng, Chongyang Tao, Can Xu, Kai Zhang, Daxin Jiang. UnifieR: A Unified Retriever for Large-Scale Retrieval. In Proceeding of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (SIGKDD 2023), 2023.07. [Code]
- Chongyang Tao, Tao Shen, Jiazhan Feng, Chang Liu, Juntao Li, Xiubo Geng, Daxin Jiang. CoRe: Cooperative Training of Retriever-Reranker for Effective Dialogue Response Selection. In Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL 2023), Toronto, Canada, 2023.7.
- Zhen Li+, Chongyang Tao, Jiazhan Feng, Tao Shen, Dongyan Zhao, Xiubo Geng and Daxin Jiang. FAA: Fine-grained Attention Alignment for Cascade Document Ranking. In Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL 2023), Toronto, Canada, 2023.7.
- Xiuyin Chen+, Guodong Long, Chongyang Tao, Xing Gao, Chengqi Zhang, Xiangliang Zhang. Improving the Robustness of Summarization Systems with Dual Augmentation. In Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL 2023), Toronto, Canada, 2023.7. [Code]
- Jiazhan Feng+, Qingfeng Sun, Can Xu, Pu Zhao, Yaming Yang, Chongyang Tao, Dongyan Zhao, Qingwei Li. MMDialog: A Large-scale Multi-turn Dialogue Dataset Towards Multi-modal Open-domain Conversation. In Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL 2023), Toronto, Canada, 2023.7. [Dataset]
- Yucheng Zhou, Tao Shen, Xiubo Geng, Chongyang Tao, Can Xu, Guodong Long, Binxing Jiao, Daxin Jiang. Towards Robust Ranker for Text Retrieval. In Findings of the Annual Meeting of the Association for Computational Linguistics (Findings of ACL 2023), Toronto, Canada, 2023.7.
- Kai Zhang+, Chongyang Tao, Tao Shen, Can Xu, Xiubo Geng, Binxing Jiao, Daxin Jiang. LED: Lexicon-Enlightened Dense Retriever for Large-Scale Retrieval. In Proceedings of the International World Wide Web Conference (WWW 2023), 2023.01. [Code]
- Zefeng Cai+, Chongyang Tao, Tao Shen, Can Xu, Xiubo Geng, Xin Alex Lin, Liang He, and Daxin Jiang. HypeR: Multitask Hyper-Prompted Training Enables Large-Scale Retrieval Generalization. In Proceedings of the International Conference on Learning Representations (ICLR 2023), 2023.01. [Code]
- Tao Shen, Xiubo Geng, Chongyang Tao, Can Xu, Xiaolong Huang, Binxing Jiao, Linjun Yang, Daxin Jiang. LexMAE: Lexicon-Bottlenecked Pretraining for Large-Scale Retrieval. In Proceedings of the International Conference on Learning Representations (ICLR 2023), 2023.01. [Code]
- Yufei Wang, Jiayi Zheng, Can Xu, Xiubo Geng, Tao Shen, Chongyang Tao, Daxin Jiang. KnowDA: All-in-One Knowledge Mixture Model for Data Augmentation in Few-Shot NLP. In Proceedings of the International Conference on Learning Representations (ICLR 2023), 2023.01. [Code]
- Jiazhan Feng+, Chongyang Tao, Xueliang Zhao, Rui Yan, Dongyan Zhao. Learning Multi-turn Response Selection in Grounded Dialogues with Reinforced Knowledge and Context Distillation. In ACM Transactions on Information Systems, Volume 41, Issue 4, Article No.115. (TOIS 2023), 2023.4.
2022
- Qiyu Wu+, Chongyang Tao, Tao Shen, Can Xu, Xiubo Geng, Daxin Jiang. PCL: Peer-Contrastive Learning with Diverse Augmentations for Unsupervised Sentence Embeddings. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP 2022), 2022.11. [Code]
- Chang Liu+, Chongyang Tao, Jianxin Liang, Tao Shen, Jiazhan Feng, Quzhe Huang, Dongyan Zhao. Rethinking Task-Specific Knowledge Distillation: Contextualized Corpus as Better Textbook. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP 2022), 2022.11
- Jiazhan Feng, Chongyang Tao, Chang Liu, Rui Yan, Dongyan Zhao. How to Represent Context Better? An Empirical Study on Context Modeling for Multi-turn Response Selection. In Findings of the Conference on Empirical Methods in Natural Language Processing (EMNLP 2022), 2022.11
- Tingchen Fu*, Xueliang Zhao*, Chongyang Tao, Rui Yan, Ji-Rong Wen. There Is No Standard Answer: Knowledge-Grounded Dialogue Generation with Adversarial Activated Multi-Reference Learning. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP 2022), 2022.11
- Xueliang Zhao, Yuxuan Wang, Chongyang Tao, Chenshuo Wang, Dongyan Zhao. Collaborative Reasoning on Multi-Modal Semantic Graphs for Video-Grounded Dialogue Generation. In Findings of the Conference on Empirical Methods in Natural Language Processing (EMNLP 2022), 2022.11
- Xueliang Zhao, Tingchen Fu, Chongyang Tao, Wei Wu, Dongyan Zhao, Rui Yan. Learning to Express in Knowledge-Grounded Conversation. In Proceedings of the North American Chapter of the Association for Computational Linguistics - Human Language Technologies (NAACL-HLT 2022), Seattle, Washington, 2022.7
- Jia-chen Gu+, Chongyang Tao, Zhen-Hua Ling. Who Says What to Whom: A Survey of Multi-Party Conversations. In Proceedings of the 31th International Joint Conference on Artificial Intelligence (IJCAI 2022), Vienna, Austria, 2022.7
- Jia-Chen Gu+, Chao-Hong Tan+, Chongyang Tao, Zhen-Hua Ling, Huang Hu, Xiubo Geng, Daxin Jiang. HeterMPC: A Heterogeneous Graph Neural Network for Response Generation in Multi-Party Conversations. In Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL 2022), Dublin, Ireland, 2022.5. [Code]
- Chang Liu, Chongyang Tao, Jiazhan Feng, Dongyan Zhao. Multi-Granularity Structural Knowledge Distillation for Language Model Compression. In Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL 2022), Dublin, Ireland, 2022.5. [Code]
- Chang Liu, Xu Tan, Chongyang Tao, Zhenxin Fu, Dongyan Zhao, Tie-Yan Liu, Rui Yan. ProphetChat: Enhancing Dialogue Generation with Simulation of Future Conversation. In Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL 2022), Dublin, Ireland, 2022.5
- Tingchen Fu*, Xueliang Zhao*, Chongyang Tao, Ji-Rong Wen, Rui Yan. There Are a Thousand Hamlets in a Thousand People's Eyes: Enhancing Knowledge-grounded Dialogue with Personal Memory. In Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL 2022), Dublin, Ireland, 2022.5
- Yufei Wang, Can Xu, Qingfeng Sun, Huang Hu, Chongyang Tao, Xiubo Geng, Daxin Jiang. Prompt-based Data Augmentation for Low-Resource NLU Tasks. In Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL 2022), Dublin, Ireland, 2022.5 [Code]
- Chao-Hong Tan+, Jia-Chen Gu+, Chongyang Tao, Zhen-Hua Ling, Can Xu, Huang Hu, Xiubo Geng, Daxin Jiang. TegTok: Augmenting Text Generation via Task-specific and Open-world Knowledge. In Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL 2022 Findings), Dublin, Ireland, 2022.5. [Code]
- Jia Li+, Chongyang Tao, Huang Hu, Can Xu, Yining Chen and Daxin Jiang. Unsupervised Cross-Domain Adaptation for Response Selection Using Self-Supervised and Adversarial Training. In Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining (WSDM 2022), Phoenix, Arizona, 2022.2
2021
- Yufei Wang, Can Xu, Huang Hu, Chongyang Tao, Stephen Wan, Mark Dras, Mark Johnson, Daxin Jiang. Neural Rule-Execution Tracking Machine For Transformer-Based Text Generation. In Advances in Neural Information Processing Systems (NeurIPS 2021), 2021.11 [Video]
- Jia-Chen Gu+, Chongyang Tao, Zhenhua Ling, Can Xu, Xiubo Geng, Daxin Jiang. MPC-BERT: A Pre-Trained Language Model for Multi-Party Conversation Understanding. In Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL 2021), 2021.8 [Code]
- Zujie Liang, Huang Hu, Can Xu, Chongyang Tao, Xiubo Geng, Yining Chen, Fan Liang, Daxin Jiang. Maria: A Visual Experience Powered Conversational Agent. In Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL 2021), 2021.8 [Code]
- Chongyang Tao, Changyu Chen, Jiazhan Feng, Ji-Rong Wen, Rui Yan. A Pre-training Strategy for Zero-Resource Response Selection in Knowledge-Grounded Conversations. In Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL 2021), 2021.8
- Chongyang Tao, Jiazhan Feng, Rui Yan, Wei Wu, Daxin Jiang. A Survey on Response Selection for Retrieval-based Dialogues. In Proceedings of the 30th International Joint Conference on Artificial Intelligence (IJCAI 2021), 2021.8
- Chongyang Tao, Shen Gao, Juntao Li, Yansong Feng, Dongyan Zhao, Rui Yan. Learning to Organize a Bag of Words into Sentences with Neural Networks: An Empirical Study. In Proceedings of the North American Chapter of the Association for Computational Linguistics (NAACL 2021), 2021.6
- Ruijian Xu, Chongyang Tao, Jiazhan Feng, Wei Wu, Rui Yan, Dongyan Zhao. Response Ranking with Multi-types of Deep Interactive Representations in Retrieval-based Dialogues. In ACM Transactions on Information Systems, Volume 39, Issue 4 (TOIS 2021), 2021.8
- Ruijian Xu, Chongyang Tao, Daxin Jiang, Xueliang Zhao, Dongyan Zhao, Rui Yan. Learning an Effective Context-Response Matching Model with Self-Supervised Tasks for Retrieval-based Dialogues. In Proceedings of the AAAI Conference on Artificial Intelligence (AAAI 2021), 2021.2. [Code]
- Juntao Li*, Chang Liu*, Chongyang Tao, Zhangming Chan, Dongyan Zhao, Rui Yan. Dialogue History Matters! Personalized Response Selectionin Multi-turn Retrieval-based Chatbots. In ACM Transactions on Information Systems, Volume 39, Issue 4 (TOIS 2021), 2021.2
2020
- Linxiao Li, Can Xu, Wei Wu, Yufan Zhao, Xueliang Zhao, Chongyang Tao. Zero-Resource Knowledge-Grounded Dialogue Generation. In Advances in Neural Information Processing Systems (NeurIPS 2020), 2020.12 [Code]
- Xueliang Zhao, Wei Wu, Can Xu, Chongyang Tao, Dongyan Zhao, Rui Yan. Knowledge-Grounded Dialogue Generation with Pre-trained Language Models. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP 2020), 2020.11 [Code]
- Kai Hua+, Zhiyuan Feng, Chongyang Tao, Rui Yan, Lu Zhang. Learning to Detect Relevant Contexts and Knowledge for Response Selection in Retrieval-based Dialogue Systems. In Proceedings of the 29th ACM International Conference on Information and Knowledge Management (CIKM 2020), 2020.10
- Chongyang Tao, Wei Wu, Yansong Feng, Dongyan Zhao, Rui Yan. Improving Matching Models with Hierarchical Contextualized Representations for Multi-turn Response Selection. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2020), 2020.07
- Xueliang Zhao, Wei Wu, Chongyang Tao, Can Xu, Dongyan Zhao, Rui Yan. Low-Resource Knowledge-Grounded Dialogue Generation. In Proceedings of the International Conference on Learning Representations (ICLR 2020), 2020.4
2019
- Chongyang Tao, Wei Wu, Can Xu, Wenpeng Hu, Dongyan Zhao and Rui Yan. One Time of Interaction May Not Be Enough: Go Deep with an Interaction-over-Interaction Network for Response Selection in Dialogues . In Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL 2019), Florence, Italy, 2019.7 [Code]
- Jiazhan Feng*, Chongyang Tao*, Wei Wu, Yansong Feng, Dongyan Zhao and Rui Yan. Learning a Matching Model with Co-teaching for Multi-turn Response Selection in Retrieval-based Dialogue Systems. In Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL 2021), Florence, Italy, 2019.7
- Can Xu, Wei Wu, Chongyang Tao, Huang Hu and Matt Schuerman. Neural Response Generation with Meta-words. In Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL 2019), Florence, Italy, 2019.7
- Xueliang Zhao*, Chongyang Tao*, Wei Wu, Yansong Feng, Dongyan Zhao and Rui Yan. A Document-grounded Matching Network for Response Selection in Retrieval-based Chatbots. In Proceedings of the 27th International Joint Conference on Artificial Intelligence (IJCAI 2019), Macao, China, 2019.8
- Jiayi Zhang*, Chongyang Tao*, Zhenjing Xu, Qiaojing Xie, Wei Chen and Rui Yan. EnsembleGAN: Adversarial Learning for Retrieval-Generation Ensemble Model on Short-Text Conversation. In Proceedings of the Annual Meeting of the Association for Computational Linguistics (SIGIR 2019), Paris, France, 2019.7
- Jia Li, Chongyang Tao, Wei Wu, Yansong Feng, Dongyan Zhao, Rui Yan. Sampling Matters! An Empirical Study of Negative Sampling Strategies for Learning of Matching Models in Retrieval-based Dialogue Systems. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP 2019), Hong Kong, China, 2019.11
- Wenpeng Hu, Zhou Lin, Bin Liu, Chongyang Tao, Zhengwei Tao, Jinwen Ma, Dongyan Zhao and Rui Yan. Overcoming Catastrophic Forgetting via Model Adaptation. In Proceedings of the International Conference on Learning Representations (ICLR 2019), New Orleans, Louisiana, 2019.7 [Code]
- Xiaoye Tan, Rui Yan, Chongyang Tao, Mingrui Wu.Mimicking Human Process: Text Representation via Latent Semantic Clustering for Classification. In Proceedings of the CCF International Conference on Natural Language Processing and Chinese Computing (NLPCC 2019 & 2nd workshop of HAI at IJCAI 2019, Outstanding Paper Award) , Dunhuang, China, 2019.7
- Chongyang Tao, Wei Wu, Can Xu, Wenpeng Hu, Dongyan Zhao and Rui Yan. Multi-Representation Fusion Network for Multi-turn Response Selection in Retrieval-based Chatbots. In Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining (WSDM 2019), Melbourne, Australia, 2019.2 [Code]
2018
- Xiuying Chen, Shen Gao, Chongyang Tao, Dongyan Zhao and Rui Yan. Iterative Document Representation Learning Towards Summarization with Polishing. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP 2018), Brussels, Belgium, 2018.11 [Code]
- Huang Hu, Xianchao Wu, Bingfeng Luo, Chongyang Tao, Can Xu, Wei Wu and Zhan Chen. Playing 20 Question Game with Policy-Based Reinforcement Learning. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP 2018), Brussels, Belgium, 2018.11 [Code]
- Chongyang Tao, Shen Gao, Mingyue Shang, Wei Wu, Dongyan Zhao and Rui Yan. Get The Point of My Utterance! Learning Towards Effective Responses with Multi-Head Attention Mechanism . In Proceedings of the 27th International Joint Conference on Artificial Intelligence (IJCAI 2018), Stockholm, Sweden, 2018.7
- Chongyang Tao, Lili Mou, Dongyan Zhao and Rui Yan. RUBER: An Unsupervised Method for Automatic Evaluation of Open-Domain Dialog Systems. In Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence (AAAI 2018), New Orleans, Louisiana, 2018.2
*means equal contribution, #means the corresponding author.