Knowledge Commons of Institute of Automation,CAS
Representative Demonstration Selection for In-Context Learning with Two-Stage Determinantal Point Process | |
Zhao Yang1,2; Yuanzhe Zhang1,2; Dianbo Sui4; Cao Liu3; Jun Zhao1,2; Kang Liu1,2,5 | |
2023 | |
会议名称 | Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing |
会议日期 | 2023-12 |
会议地点 | Singapore |
会议举办国 | Singapore |
摘要 | Although In-Context Learning has proven effective across a broad array of tasks, its efficiency is noticeably influenced by the selection of demonstrations. Existing methods tend to select different demonstrations for each test instance, which is time-consuming and poses limitations in practical scenarios. Therefore, this study aims to address the challenge of selecting a representative subset of in-context demonstrations that can effectively prompt different test instances in a specific task. We propose that this representative subset should be of high quality and diversity. Our empirical analyses confirm that demonstrations that meet these criteria can indeed bolster model performance. To satisfy these criteria, this paper further introduces a two-stage Determinantal Point Process (DPP) method designed to incorporate both quality and diversity in the process of demonstration selection, thereby obtaining representative in-context demonstrations. Through comprehensive experimentation, we have confirmed the efficacy of our proposed method, paving the way for more practical and effective In-Context Learning. |
收录类别 | EI |
七大方向——子方向分类 | 自然语言处理 |
国重实验室规划方向分类 | 语音语言处理 |
是否有论文关联数据集需要存交 | 否 |
文献类型 | 会议论文 |
条目标识符 | http://ir.ia.ac.cn/handle/173211/56724 |
专题 | 复杂系统认知与决策实验室 |
通讯作者 | Kang Liu |
作者单位 | 1.School of Artificial Intelligence, University of Chinese Academy of Sciences, China 2.The Laboratory of Cognition and Decision Intelligence for Complex Systems, Institute of Automation, Chinese Academy of Sciences, China 3.Meituan, Beijing, China 4.Harbin Institute of Technology, Weihai, China 5.Shanghai Artificial Intelligence Laboratory, China |
第一作者单位 | 中国科学院自动化研究所 |
通讯作者单位 | 中国科学院自动化研究所 |
推荐引用方式 GB/T 7714 | Zhao Yang,Yuanzhe Zhang,Dianbo Sui,et al. Representative Demonstration Selection for In-Context Learning with Two-Stage Determinantal Point Process[C],2023. |
条目包含的文件 | 下载所有文件 | |||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 | ||
杨朝-EMNLP.pdf(592KB) | 会议论文 | 开放获取 | CC BY-NC-SA | 浏览 下载 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论