Stacked Memory Network for Video Summarization | |
Wang, Junbo; Wang, Wei; Wang, Zhiyong; Wang, Liang; Feng, Dagan; Tan, Tieniu | |
2019 | |
会议名称 | ACM International Conference on Multimedia |
会议日期 | 2019-10 |
会议地点 | Nice, France |
摘要 | In recent years, supervised video summarization has achieved promising progress with various recurrent neural networks (RNNs) based methods, which treats video summarization as a sequence-to-sequence learning problem to exploit temporal dependency among video frames across variable ranges. However, RNN has limitations in modelling the long-term temporal dependency for summarizing videos with thousands of frames due to the restricted memory storage unit. Therefore, in this paper we propose a stacked memory network called SMN to explicitly model the long dependency among video frames so that redundancy could be minimized in the video summaries produced. Our proposed SMN consists of two key components: Long Short-Term Memory (LSTM) layer and memory layer, where each LSTM layer is augmented with an external memory layer. In particular, we stack multiple LSTM layers and memory layers hierarchically to integrate the learned representation from prior layers. By combining the hidden states of the LSTM layers and the read representations of the memory layers, our SMN is able to derive more accurate video summaries for individual video frames. Compared with the existing RNN based methods, our SMN is particularly good at capturing long temporal dependency among frames with few additional training parameters. Experimental results on two widely used public benchmark datasets: SumMe and TVsum, demonstrate that our proposed model is able to clearly outperform a number of state-of-the-art ones under various settings. |
语种 | 英语 |
七大方向——子方向分类 | 图像视频处理与分析 |
文献类型 | 会议论文 |
条目标识符 | http://ir.ia.ac.cn/handle/173211/28360 |
专题 | 模式识别实验室 |
作者单位 | 1.Center for Research on Intelligent Perception and Computing, National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences 2.University of Chinese Academy of Sciences 3.School of Computer Science, The University of Sydney |
推荐引用方式 GB/T 7714 | Wang, Junbo,Wang, Wei,Wang, Zhiyong,et al. Stacked Memory Network for Video Summarization[C],2019. |
条目包含的文件 | 下载所有文件 | |||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 | ||
MM2019.pdf(700KB) | 会议论文 | 开放获取 | CC BY-NC-SA | 浏览 下载 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论