Adversarial Self-Supervised Learning for Semi-Supervised 3D Action Recognition | |
Si, Chenyang1,2![]() ![]() ![]() ![]() | |
2020 | |
会议名称 | European Conference on Computer Vision (ECCV) |
会议日期 | 2020.8.23-2020.8.28 |
会议地点 | Online |
摘要 | We consider the problem of semi-supervised 3D action recognition which has been rarely explored before. Its major challenge lies in how to effectively learn motion representations from unlabeled data. Self-supervised learning (SSL) has been proved very effective at learning representations from unlabeled data in the image domain. However, few effective self-supervised approaches exist for 3D action recognition, and directly applying SSL for semi-supervised learning suffers from misalignment of representations learned from SSL and supervised learning tasks. To address these issues, we present Adversarial Self-Supervised Learning (ASSL), a novel framework that tightly couples SSL and the semi-supervised scheme via neighbor relation exploration and adversarial learning. Specifically, we design an effective SSL scheme to improve the discrimination capability of learned representations for 3D action recognition, through exploring the data relations within a neighborhood. We further propose an adversarial regularization to align the feature distributions of labeled and unlabeled samples. To demonstrate effectiveness of the proposed ASSL in semi-supervised 3D action recognition, we conduct extensive experiments on NTU and N-UCLA datasets. The results confirm its advantageous performance over state-of-the-art semi-supervised methods in the few label regime for 3D action recognition. |
收录类别 | EI |
七大方向——子方向分类 | 图像视频处理与分析 |
文献类型 | 会议论文 |
条目标识符 | http://ir.ia.ac.cn/handle/173211/44299 |
专题 | 模式识别实验室 |
通讯作者 | Si, Chenyang |
作者单位 | 1.University of Chinese Academy of Sciences 2.CRIPAC & NLPR, Institute of Automation, Chinese Academy of Sciences 3.Department of ECE, National University of Singapore |
第一作者单位 | 模式识别国家重点实验室 |
通讯作者单位 | 模式识别国家重点实验室 |
推荐引用方式 GB/T 7714 | Si, Chenyang,Nie, Xuecheng,Wang, Wei,et al. Adversarial Self-Supervised Learning for Semi-Supervised 3D Action Recognition[C],2020. |
条目包含的文件 | 下载所有文件 | |||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 | ||
ECCV20.pdf(1288KB) | 会议论文 | 开放获取 | CC BY-NC-SA | 浏览 下载 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论