CASIA OpenIR  > 智能交互
FOCUSING ON ATTENTION: PROSODY TRANSFER AND ADAPTATIVE OPTIMIZATION STRATEGY FOR MULTI-SPEAKER END-TO-END SPEECH SYNTHESIS
Ruibo Fu1,2; Jianhua Tao1,2,3; Zhengqi Wen1; Jiangyan Yi1; Tao Wang1,2
2020-05
Conference NameICASSP2020
Conference Date2020-5
Conference Place网上虚拟会议
Author of SourceIEEE
Publisherieee
Abstract

End-to-end speech synthesis can generate high-quality synthetic speech and achieve high similarity scores with low-resource adaptation data. However, the generalization of out-domain texts is still a challenging task. The limited adaptation data leads to unacceptable errors and the poor prosody performance of the synthetic speech.  In this paper, we present two novel methods to handle the above problems by focusing on the attention. Firstly, compared with the conventional methods that extract prosody embeddings for conditioning input, a duration controller with feedback mechanism is proposed, which can control the states transition in the sequence-to-sequence model more directly and precisely. Secondly, to alleviate the unmatching text-audio pairs’ impact on model, an adaptative optimization strategy which would consider the matching degree of the training sample is also proposed. Experimental results on Mandarin dataset show that proposed methods lead to an improvement on both robustness and overall naturalness.

Keywordprosody transfer optimization strategy speaker adaptation attention speech synthesis
Indexed ByEI
Language英语
Document Type会议论文
Identifierhttp://ir.ia.ac.cn/handle/173211/39596
Collection智能交互
Corresponding AuthorRuibo Fu
Affiliation1.National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences
2.School of Artificial Intelligence, University of Chinese Academy of Sciences
3.CAS Center for Excellence in Brain Science and Intelligence Technology
First Author AffilicationChinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing 100190, Peoples R China
Corresponding Author AffilicationChinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing 100190, Peoples R China
Recommended Citation
GB/T 7714
Ruibo Fu,Jianhua Tao,Zhengqi Wen,et al. FOCUSING ON ATTENTION: PROSODY TRANSFER AND ADAPTATIVE OPTIMIZATION STRATEGY FOR MULTI-SPEAKER END-TO-END SPEECH SYNTHESIS[C]//IEEE:ieee,2020.
Files in This Item: Download All
File Name/Size DocType Version Access License
icassp2020发表版本.pdf(154KB)会议论文 开放获取CC BY-NC-SAView Download
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Ruibo Fu]'s Articles
[Jianhua Tao]'s Articles
[Zhengqi Wen]'s Articles
Baidu academic
Similar articles in Baidu academic
[Ruibo Fu]'s Articles
[Jianhua Tao]'s Articles
[Zhengqi Wen]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Ruibo Fu]'s Articles
[Jianhua Tao]'s Articles
[Zhengqi Wen]'s Articles
Terms of Use
No data!
Social Bookmark/Share
File name: icassp2020发表版本.pdf
Format: Adobe PDF
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.