CASIA OpenIR  > 学术期刊  > Machine Intelligence Research
Adaptively Enhancing Facial Expression Crucial Regions via a Local Non-local Joint Network
Guanghui Shi1; Shasha Mao1; Shuiping Gou1; Dandan Yan1; Licheng Jiao1; Lin Xiong2
发表期刊Machine Intelligence Research
ISSN2731-538X
2024
卷号21期号:2页码:331-348
摘要Facial expression recognition (FER) is still challenging due to the small interclass discrepancy in facial expression data. In view of the significance of facial crucial regions for FER, many existing studies utilize the prior information from some annotated crucial points to improve the performance of FER. However, it is complicated and time-consuming to manually annotate facial crucial points, especially for vast wild expression images. Based on this, a local non-local joint network is proposed to adaptively enhance the facial crucial regions in feature learning of FER in this paper. In the proposed method, two parts are constructed based on facial local and non-local information, where an ensemble of multiple local networks is proposed to extract local features corresponding to multiple facial local regions and a non-local attention network is addressed to explore the significance of each local region. In particular, the attention weights obtained by the non-local network are fed into the local part to achieve interactive feedback between the facial global and local information. Interestingly, the non-local weights corresponding to local regions are gradually updated and higher weights are given to more crucial regions. Moreover, U-Net is employed to extract the integrated features of deep semantic information and low hierarchical detail information of expression images. Finally, experimental results illustrate that the proposed method achieves more competitive performance than several state-of-the-art methods on five benchmark datasets.
关键词Facial expression recognition, deep neural network, multiple network ensemble, attention network, facial crucial regions
DOI10.1007/s11633-023-1417-9
引用统计
被引频次:1[WOS]   [WOS记录]     [WOS相关记录]
文献类型期刊论文
条目标识符http://ir.ia.ac.cn/handle/173211/56042
专题学术期刊_Machine Intelligence Research
作者单位1.School of Artificial Intelligence, Xidian University, Xi'an 710000, China
2.Applied Research Laboratory, SenseTime, Xi'an 710000, China
推荐引用方式
GB/T 7714
Guanghui Shi,Shasha Mao,Shuiping Gou,et al. Adaptively Enhancing Facial Expression Crucial Regions via a Local Non-local Joint Network[J]. Machine Intelligence Research,2024,21(2):331-348.
APA Guanghui Shi,Shasha Mao,Shuiping Gou,Dandan Yan,Licheng Jiao,&Lin Xiong.(2024).Adaptively Enhancing Facial Expression Crucial Regions via a Local Non-local Joint Network.Machine Intelligence Research,21(2),331-348.
MLA Guanghui Shi,et al."Adaptively Enhancing Facial Expression Crucial Regions via a Local Non-local Joint Network".Machine Intelligence Research 21.2(2024):331-348.
条目包含的文件 下载所有文件
文件名称/大小 文献类型 版本类型 开放类型 使用许可
MIR-2022-11-364.pdf(3926KB)期刊论文出版稿开放获取CC BY-NC-SA浏览 下载
个性服务
推荐该条目
保存到收藏夹
查看访问统计
导出为Endnote文件
谷歌学术
谷歌学术中相似的文章
[Guanghui Shi]的文章
[Shasha Mao]的文章
[Shuiping Gou]的文章
百度学术
百度学术中相似的文章
[Guanghui Shi]的文章
[Shasha Mao]的文章
[Shuiping Gou]的文章
必应学术
必应学术中相似的文章
[Guanghui Shi]的文章
[Shasha Mao]的文章
[Shuiping Gou]的文章
相关权益政策
暂无数据
收藏/分享
文件名: MIR-2022-11-364.pdf
格式: Adobe PDF
所有评论 (0)
暂无评论
 

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。