CASIA OpenIR  > 模式识别国家重点实验室  > 先进时空数据分析与学习
Joint spatial temporal attention for action recognition
Tingzhao Yu1,2; Chaoxu Guo1,2; Lingfeng Wang1; Huxiang Gu1; Shiming Xiang1; Chunhong Pan1
Source PublicationPattern Recognition Letters
2018
Issue112Pages:226-233
Abstract

In this paper, we propose a novel high-level action representation using joint spatial-temporal attention model, with application to video-based human action recognition. Specifically, to extract robust motion representations of videos, a new spatial attention module based on 3D convolution is proposed, which can pay attention to the salient parts of the spatial areas. For better dealing with long-duration videos, a new bidirectional LSTM based temporal attention module is introduced, which aims to focus on the key video cubes instead of the key video frames of a given video. The spatial-temporal attention network can be jointly trained via a two-stage strategy, which enables us to simultaneously explore the correla- tion both in spatial and temporal domain. Experimental results on benchmark action recognition datasets demonstrate the effectiveness of our network.

KeywordAction Recognition Spatial-temporal Attention Two-stage
Language英语
Document Type期刊论文
Identifierhttp://ir.ia.ac.cn/handle/173211/23618
Collection模式识别国家重点实验室_先进时空数据分析与学习
Corresponding AuthorTingzhao Yu
Affiliation1.National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences
2.School of Computer and Control Engineering, University of Chinese Academy of Sciences
First Author AffilicationChinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing 100190, Peoples R China
Corresponding Author AffilicationChinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing 100190, Peoples R China
Recommended Citation
GB/T 7714
Tingzhao Yu,Chaoxu Guo,Lingfeng Wang,et al. Joint spatial temporal attention for action recognition[J]. Pattern Recognition Letters,2018(112):226-233.
APA Tingzhao Yu,Chaoxu Guo,Lingfeng Wang,Huxiang Gu,Shiming Xiang,&Chunhong Pan.(2018).Joint spatial temporal attention for action recognition.Pattern Recognition Letters(112),226-233.
MLA Tingzhao Yu,et al."Joint spatial temporal attention for action recognition".Pattern Recognition Letters .112(2018):226-233.
Files in This Item: Download All
File Name/Size DocType Version Access License
[Tsingzao]Joint spat(1133KB)期刊论文作者接受稿开放获取CC BY-NC-SAView Download
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Tingzhao Yu]'s Articles
[Chaoxu Guo]'s Articles
[Lingfeng Wang]'s Articles
Baidu academic
Similar articles in Baidu academic
[Tingzhao Yu]'s Articles
[Chaoxu Guo]'s Articles
[Lingfeng Wang]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Tingzhao Yu]'s Articles
[Chaoxu Guo]'s Articles
[Lingfeng Wang]'s Articles
Terms of Use
No data!
Social Bookmark/Share
File name: [Tsingzao]Joint spatial-temporal attention for action recognition.pdf
Format: Adobe PDF
This file does not support browsing at this time
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.