Knowledge Commons of Institute of Automation，CAS
| A Survey on Negative Transfer | |
| Wen Zhang; Lingfei Deng; Lei Zhang; Dongrui Wu | |
| Source Publication | IEEE/CAA Journal of Automatica Sinica
 |
| ISSN | 2329-9266 |
| 2023 | |
| Volume | 10Issue:2Pages:305-329 |
| Abstract | Transfer learning (TL) utilizes data or knowledge from one or more source domains to facilitate learning in a target domain. It is particularly useful when the target domain has very few or no labeled data, due to annotation expense, privacy concerns, etc. Unfortunately, the effectiveness of TL is not always guaranteed. Negative transfer (NT), i.e., leveraging source domain data/knowledge undesirably reduces learning performance in the target domain, and has been a long-standing and challenging problem in TL. Various approaches have been proposed in the literature to address this issue. However, there does not exist a systematic survey. This paper fills this gap, by first introducing the definition of NT and its causes, and reviewing over fifty representative approaches for overcoming NT, which fall into three categories: domain similarity estimation, safe transfer, and NT mitigation. Many areas, including computer vision, bioinformatics, natural language processing, recommender systems, and robotics, that use NT mitigation strategies to facilitate positive transfers, are also reviewed. Finally, we give guidelines on NT task construction and baseline algorithms, benchmark existing TL and NT mitigation approaches on three NT-specific datasets, and point out challenges and future research directions. To ensure reproducibility, our code is publicized at https://github.com/chamwen/NT-Benchmark. |
| Keyword | Domain adaptation domain similarity negative transfer positive transfer transfer learning |
| DOI | 10.1109/JAS.2022.106004 |
| Citation statistics | |
| Document Type | 期刊论文 |
| Identifier | http://ir.ia.ac.cn/handle/173211/50848 |
| Collection | 学术期刊_IEEE/CAA Journal of Automatica Sinica |
| Recommended Citation GB/T 7714 | Wen Zhang,Lingfei Deng,Lei Zhang,et al. A Survey on Negative Transfer[J]. IEEE/CAA Journal of Automatica Sinica,2023,10(2):305-329. |
| APA | Wen Zhang,Lingfei Deng,Lei Zhang,&Dongrui Wu.(2023).A Survey on Negative Transfer.IEEE/CAA Journal of Automatica Sinica,10(2),305-329. |
| MLA | Wen Zhang,et al."A Survey on Negative Transfer".IEEE/CAA Journal of Automatica Sinica 10.2(2023):305-329. |
| Files in This Item: | Download All | |||||
| File Name/Size | DocType | Version | Access | License | ||
| JAS-2022-0331.pdf（2739KB） | 期刊论文 | 出版稿 | 开放获取 | CC BY-NC-SA | View Download | |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment