Television programs structured and abstract are two fundamental problems in multimedia content analysis. They are of great value to broad applications, including content-based retrieval. non-linear browsing, etc. Although with the efforts on the research for many years, great progress has been made on television programs structured and abstract, there are still many open problems to resolve to general method of them. In this thesis, we study method of the television programs structured and abstract. In comparison with previous approaches that handle scenes and topic units separately, the proposed method deals with them in a general framework. Based on the structured logical units logical unit, new approaches of still-image abstract and visualization against different genres of TV-program are presented. The main contributions of this thesis include the following: 1.In this paper UniformLBP feature is employed to describe the basic information of images. This feature is more sensitive in gradual transition case than other features, but it is as robustness as other feature in the same shot. Graph-model is used by calculating the difference of image sequences, which can emphasizes difference signal and suppress influence of the local disturbance. Finally, the shot boundary is identified by the SVM classifier. 2.According to the structure characteristics of logical unit, a general framework for logical unit segmentation is presented in this paper. By defining four types of shots, the problem of logical unit segmentation is formulated as a problem of identifying the type of shot. Such a framework is easily applicable to different genres of TV-program. To identify the labels, conditional random field is employed and each shot is represented by four semantic features: shot difference, scene transition, shot theme and audio type. Because conditional random field technique adequately utilizes the context information of neighboring shots, it delivers significantly more accurate results than previous methods. 3.This paper present a still-image abstract method based on the result of logical unit segmentation. Using the information of shot clustering, shot theme and camera motion, the still-image abstract method is designed against movie and TV-series, news and documentary. These abstracts are appropriate for non-linear browsing. Moreover, a comic-like layout method is employed to show the still-image abstracts according the production rule of movie and TV-serie...
修改评论