Utterance independent bimodal emotion recognition in spontaneous communication

	Utterance independent bimodal emotion recognition in spontaneous communication
	Tao, Jianhua; Pan, Shifeng; Yang, Minghao; Li, Ya; Mu, Kaihui; Che, Jianfeng
发表期刊	EURASIP JOURNAL ON ADVANCES IN SIGNAL PROCESSING
	2011
页码	1-11
文章类型	Article
摘要	Emotion expressions sometimes are mixed with the utterance expression in spontaneous face-to-face communication, which makes difficulties for emotion recognition. This article introduces the methods of reducing the utterance influences in visual parameters for the audio-visual-based emotion recognition. The audio and visual channels are first combined under a Multistream Hidden Markov Model (MHMM). Then, the utterance reduction is finished by finding the residual between the real visual parameters and the outputs of the utterance related visual parameters. This article introduces the Fused Hidden Markov Model Inversion method which is trained in the neutral expressed audio-visual corpus to solve the problem. To reduce the computing complexity the inversion model is further simplified to a Gaussian Mixture Model (GMM) mapping. Compared with traditional bimodal emotion recognition methods (e.g., SVM, CART, Boosting), the utterance reduction method can give better results of emotion recognition. The experiments also show the effectiveness of our emotion recognition system when it was used in a live environment.
关键词	Bimodal Emotion Recognition Utterance Independent Multistream Hidden Markov Model Fused Hidden Markov Model Inversion
WOS标题词	Science & Technology ; Technology
关键词[WOS]	FACIAL EXPRESSION ANALYSIS ; AUDIOVISUAL AFFECT RECOGNITION ; HIDDEN MARKOV-MODELS ; IMAGE SEQUENCES ; SPEECH ; DATABASES
收录类别	SCI
语种	英语
WOS研究方向	Engineering
WOS类目	Engineering, Electrical & Electronic
WOS记录号	WOS:000294848600001
引用统计	被引频次：2[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://ir.ia.ac.cn/handle/173211/40929
专题	多模态人工智能系统全国重点实验室_智能交互
推荐引用方式 GB/T 7714	Tao, Jianhua,Pan, Shifeng,Yang, Minghao,et al. Utterance independent bimodal emotion recognition in spontaneous communication[J]. EURASIP JOURNAL ON ADVANCES IN SIGNAL PROCESSING,2011:1-11.
APA	Tao, Jianhua,Pan, Shifeng,Yang, Minghao,Li, Ya,Mu, Kaihui,&Che, Jianfeng.(2011).Utterance independent bimodal emotion recognition in spontaneous communication.EURASIP JOURNAL ON ADVANCES IN SIGNAL PROCESSING,1-11.
MLA	Tao, Jianhua,et al."Utterance independent bimodal emotion recognition in spontaneous communication".EURASIP JOURNAL ON ADVANCES IN SIGNAL PROCESSING (2011):1-11.