This dissertation revolves about the main part of HCI ---human's partial and whole body, in view of the applied environment and its user's actual demand of digital entertainment, researches deeply the theory, fast approach and robust technology of computer vision based human feature extraction and motion anal- ysis, and then applies and the results to develop typical digital entertainment applications. And exploit the approach to syncretize vision based interactive technology and digital entertainment. The main contributions of this dissertation are as follows: 1. In order to generate personalized 3D face model, facial features detection and tracking are firstly discussed in this dissertation. we presented a fast personalized face model generation approach based on face features and developed the applied system. With a scheme of data transmission and 3D generation, this system can generate personalized 3D face model for multiuser in networked applications in real time. 2. For realize natural HCI using two hands of human, the motion and colour based approach to detect and track two fits is discussed in this dissertation. We used the color of face region in image to generate skin color model, and apply image time difference to get motion information. By combining color and motion information, two fists can be detected and tracked accurately with high running speed. Based on the proposed fists tracking technique, we designed and developed a driving and a flying simulative game applications. 3. In order to achieve more common interaction, human body can be used as a whole interaction tool. So, image time difference based human motion detection and background segment based human body extraction and MHI(Motion History Image) based motion analysis techniques are also discussed in this dissertation. Applying these techniques, we developed several natural interactive games using one single common PC camera as input device. At the same time, we also developed a new kind of interactive media based on infrared image ---allowing the participants to affect the projected image by the motion and gesture of their bodies. In this dissertation, our goal is to researched and develop fast, robust and low cost approaches of computer vision based partial and whole human body features extraction and motion analysis, which adapt to entertainment applications. The presented tests and typical applications prove that these techniques and ideas have high feasibility and practicality.
修改评论