CASIA OpenIR  > 智能感知与计算研究中心
Learning Content and Style: Joint Action Recognition and Person Identification from Human Skeletons
Wang Hongsong(王洪松)1,2,3,4; Wang Liang(王亮)1,2,3,4
Source PublicationPattern Recognition
2018
Issue81Pages:23-35
Abstract
Humans are able to simultaneously identify a person and recognize his or her action based on biological motions. Previous work usually treats action recognition and person identification from motions as two separate tasks with different objectives. In this paper, we present an end-to-end framework to perform these two tasks together. Inspired by the recent success of deep recurrent neural networks (RNN) for skeleton based action recognition, we propose a new pipeline to recognize both actions and persons from skeletons extracted by RGBD sensors. The structure includes two subnets and is end-to-end trainable. The former is skeleton transformation, which accommodates viewpoint changes and noise. The latter is multi-task RNN for joint learning and various architectures are explored including a novel architecture that learns the joint probability between the two output variables. Experiments on 3D action recognition benchmark datasets demonstrate the benefits of multi-task learning and our method dramatically outperforms existing state-of-the-art in action recognition.
KeywordContent And Style Action Recognition Person Identification From Motions Skeleton Transformation Multi-task Rnn
Document Type期刊论文
Identifierhttp://ir.ia.ac.cn/handle/173211/21037
Collection智能感知与计算研究中心
Affiliation1.Center for Research on Intelligent Perception and Computing (CRIPAC)
2.National Laboratory of Pattern Recognition (NLPR)
3.Institute of Automation, Chinese Academy of Sciences (CASIA)
4.University of Chinese Academy of Sciences (UCAS)
Recommended Citation
GB/T 7714
Wang Hongsong,Wang Liang. Learning Content and Style: Joint Action Recognition and Person Identification from Human Skeletons[J]. Pattern Recognition,2018(81):23-35.
APA Wang Hongsong,&Wang Liang.(2018).Learning Content and Style: Joint Action Recognition and Person Identification from Human Skeletons.Pattern Recognition(81),23-35.
MLA Wang Hongsong,et al."Learning Content and Style: Joint Action Recognition and Person Identification from Human Skeletons".Pattern Recognition .81(2018):23-35.
Files in This Item: Download All
File Name/Size DocType Version Access License
Learning content and(1622KB)期刊论文作者接受稿开放获取CC BY-NC-SAView Download
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Wang Hongsong(王洪松)]'s Articles
[Wang Liang(王亮)]'s Articles
Baidu academic
Similar articles in Baidu academic
[Wang Hongsong(王洪松)]'s Articles
[Wang Liang(王亮)]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Wang Hongsong(王洪松)]'s Articles
[Wang Liang(王亮)]'s Articles
Terms of Use
No data!
Social Bookmark/Share
File name: Learning content and style Joint action recognition and person identification from human skeletons.pdf
Format: Adobe PDF
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.