Knowledge Commons of Institute of Automation,CAS
Transformer: A General Framework from Machine Translation to Others | |
Yang Zhao1,2; Jiajun Zhang1,2; Chengqing Zong1,2 | |
发表期刊 | Machine Intelligence Research |
ISSN | 2731-538X |
2023 | |
卷号 | 20期号:4页码:514-538 |
摘要 | Machine translation is an important and challenging task that aims at automatically translating natural language sentences from one language into another. Recently, Transformer-based neural machine translation (NMT) has achieved great breakthroughs and has become a new mainstream method in both methodology and applications. In this article, we conduct an overview of Transformer-based NMT and its extension to other tasks. Specifically, we first introduce the framework of Transformer, discuss the main challenges in NMT and list the representative methods for each challenge. Then, the public resources and toolkits in NMT are listed. Meanwhile, the extensions of Transformer in other tasks, including the other natural language processing tasks, computer vision tasks, audio tasks and multi-modal tasks, are briefly presented. Finally, possible future research directions are suggested. |
关键词 | Neural machine translation, Transformer, document neural machine translation (NMT), multimodal NMT, low-resource NMT |
DOI | 10.1007/s11633-022-1393-5 |
七大方向——子方向分类 | 其他 |
国重实验室规划方向分类 | 其他 |
是否有论文关联数据集需要存交 | 否 |
中文导读 | https://mp.weixin.qq.com/s/TO2E-JDtk_EAK9kvWCqLug |
视频解析 | https://www.bilibili.com/video/BV18x421Q7PM/ |
引用统计 | |
文献类型 | 期刊论文 |
条目标识符 | http://ir.ia.ac.cn/handle/173211/55992 |
专题 | 学术期刊_Machine Intelligence Research |
作者单位 | 1.National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China 2.School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100190, China |
第一作者单位 | 模式识别国家重点实验室 |
推荐引用方式 GB/T 7714 | Yang Zhao,Jiajun Zhang,Chengqing Zong. Transformer: A General Framework from Machine Translation to Others[J]. Machine Intelligence Research,2023,20(4):514-538. |
APA | Yang Zhao,Jiajun Zhang,&Chengqing Zong.(2023).Transformer: A General Framework from Machine Translation to Others.Machine Intelligence Research,20(4),514-538. |
MLA | Yang Zhao,et al."Transformer: A General Framework from Machine Translation to Others".Machine Intelligence Research 20.4(2023):514-538. |
条目包含的文件 | 下载所有文件 | |||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 | ||
MIR-2022-09-288.pdf(1415KB) | 期刊论文 | 出版稿 | 开放获取 | CC BY-NC-SA | 浏览 下载 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论