Knowledge Commons of Institute of Automation,CAS
WASE: LEARNING WHEN TO ATTEND FOR SPEAKER EXTRACTION IN COCKTAIL PARTY ENVIRONMENTS | |
Yunzhe Hao1,2; Jiaming Xu1,3; Peng Zhang1,3; Bo Xu1,2,3 | |
2021-06 | |
会议名称 | 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) |
会议日期 | June 6-11, 2021 |
会议地点 | Toronto |
出版者 | IEEE |
摘要 | In the speaker extraction problem, it is found that additional information from the target speaker contributes to the tracking and extraction of the target speaker, which includes voiceprint, lip movement, facial expression, and spatial information. However, no one cares for the cue of sound onset, which has been emphasized in the auditory scene analysis and psychology. Inspired by it, we explicitly modeled the onset cue and verified the effectiveness in the speaker extraction task. We further extended to the onset/offset cues and got performance improvement. From the perspective of tasks, our onset/offset-based model completes the composite task, a complementary combination of speaker extraction and speaker-dependent voice activity detection. We also combined voiceprint with onset/offset cues. Voiceprint models voice characteristics of the target while onset/offset models the start/end information of the speech. From the perspective of auditory scene analysis, the combination of two perception cues can promote the integrity of the auditory object. The experiment results are also close to state-of-the-art performance, using nearly half of the parameters. We hope that this work will inspire communities of speech processing and psychology, and contribute to communication between them. Our code will be available in https: //github.com/aispeech-lab/wase/ . |
DOI | 10.1109/ICASSP39728.2021.9413411 |
收录类别 | EI |
引用统计 | |
文献类型 | 会议论文 |
条目标识符 | http://ir.ia.ac.cn/handle/173211/48874 |
专题 | 复杂系统认知与决策实验室_听觉模型与认知计算 |
通讯作者 | Jiaming Xu; Bo Xu |
作者单位 | 1.Institute of Automation, Chinese Academy of Sciences (CASIA), Beijing, China 2.School of Future Technology, University of Chinese Academy of Sciences, Beijing, China 3.School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China 4.Center for Excellence in Brain Science and Intelligence Technology, CAS, Beijing, China |
第一作者单位 | 中国科学院自动化研究所 |
通讯作者单位 | 中国科学院自动化研究所 |
推荐引用方式 GB/T 7714 | Yunzhe Hao,Jiaming Xu,Peng Zhang,et al. WASE: LEARNING WHEN TO ATTEND FOR SPEAKER EXTRACTION IN COCKTAIL PARTY ENVIRONMENTS[C]:IEEE,2021. |
条目包含的文件 | 下载所有文件 | |||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 | ||
Wase_Learning_When_t(2034KB) | 会议论文 | 开放获取 | CC BY-NC-SA | 浏览 下载 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论