Knowledge Commons of Institute of Automation,CAS
Norm-based Noisy Corpora Filtering and Refurbishing in Neural Machine Translation | |
Yu, Lu1,2![]() ![]() | |
2022-12 | |
会议名称 | Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing (EMNLP 2022) |
会议日期 | 2022-12 |
会议地点 | 线上 |
摘要 | Recent advances in neural machine translation depend on massive parallel corpora, which are collected from any open source without much guarantee of quality. It stresses the need for noisy corpora filtering, but existing methods are insufficient to solve this issue. They spend much time ensembling multiple scorers trained on clean bitexts, unavailable for low-resource languages in practice. In this paper, we propose a norm-based noisy corpora filtering and refurbishing method with no external data and costly scorers. The noisy and clean samples are separated based on how much information from the source and target sides the model requires to fit the given translation. For the unparallel sentence, the target-side history translation is much more important than the source context, contrary to the parallel ones. The amount of these two information flows can be measured by norms of source-/target-side context vectors. Moreover, we propose to reuse the discovered noisy data by generating pseudo labels via online knowledge distillation. Extensive experiments show that our proposed filtering method performs comparably with state-of-the-art noisy corpora filtering techniques but is more efficient and easier to operate. Noisy sample refurbishing further enhances the performance by making the most of the given data. |
关键词 | 神经机器翻译 |
学科领域 | 计算机科学技术 ; 人工智能 |
学科门类 | 工学 ; 工学::计算机科学与技术(可授工学、理学学位) |
URL | 查看原文 |
收录类别 | EI |
语种 | 英语 |
七大方向——子方向分类 | 自然语言处理 |
国重实验室规划方向分类 | 可解释人工智能 |
是否有论文关联数据集需要存交 | 否 |
文献类型 | 会议论文 |
条目标识符 | http://ir.ia.ac.cn/handle/173211/51838 |
专题 | 多模态人工智能系统全国重点实验室_自然语言处理 |
通讯作者 | Jiajun, Zhang |
作者单位 | 1.National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences 2.School of Artificial Intelligence, University of Chinese Academy of Sciences |
第一作者单位 | 模式识别国家重点实验室 |
通讯作者单位 | 模式识别国家重点实验室 |
推荐引用方式 GB/T 7714 | Yu, Lu,Jiajun, Zhang. Norm-based Noisy Corpora Filtering and Refurbishing in Neural Machine Translation[C],2022. |
条目包含的文件 | 下载所有文件 | |||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 | ||
2022.emnlp-main.363.(983KB) | 会议论文 | 开放获取 | CC BY-NC-SA | 浏览 下载 |
个性服务 |
推荐该条目 |
保存到收藏夹 |
查看访问统计 |
导出为Endnote文件 |
谷歌学术 |
谷歌学术中相似的文章 |
[Yu, Lu]的文章 |
[Jiajun, Zhang]的文章 |
百度学术 |
百度学术中相似的文章 |
[Yu, Lu]的文章 |
[Jiajun, Zhang]的文章 |
必应学术 |
必应学术中相似的文章 |
[Yu, Lu]的文章 |
[Jiajun, Zhang]的文章 |
相关权益政策 |
暂无数据 |
收藏/分享 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论