CASIA OpenIR  > 模式识别国家重点实验室  > 图像与视频分析
Chat with illustration
Jiang, Yu; Liu, Jing; Lu, Hanqing
AbstractInstant messaging service is an important aspect of social media and sprung up in last decades. Traditional instant messaging service transfers information mainly based on textual message, while the visual message is ignored to a great extent. Such instant messaging service is thus far from satisfactory in all-around information communication. In this paper, we propose a novel visual assisted instant messaging scheme named Chat with illustration (CWI), which presents users visual messages associated with textual message automatically. When users start their chat, the system first identifies meaningful keywords from dialogue content and analyzes grammatical and logical relations. Then CWI explores keyword-based image search on a hierarchically clustering image database which is built offline. Finally, according to grammatical and logical relations, CWI assembles these images properly and presents an optimal visual message. With the combination of textual and visual message, users could get a more interesting and vivid communication experience. Especially for different native language speakers, CWI can help them cross language barrier to some degree. In addition, a visual dialogue summarization is also proposed, which help users recall the past dialogue. The in-depth user studies demonstrate the effectiveness of our visual assisted instant messaging scheme.
KeywordInstant Messaging Service Text-to-picture Layout
WOS HeadingsScience & Technology ; Technology
Indexed BySCI
Funding Organization973 Program(2010CB327905) ; National Natural Science Foundation of China(61272329 ; 61273034
WOS Research AreaComputer Science
WOS SubjectComputer Science, Information Systems ; Computer Science, Theory & Methods
WOS IDWOS:000368828500002
Citation statistics
Document Type期刊论文
AffiliationChinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing, Peoples R China
Recommended Citation
GB/T 7714
Jiang, Yu,Liu, Jing,Lu, Hanqing. Chat with illustration[J]. MULTIMEDIA SYSTEMS,2016,22(1):5-16.
APA Jiang, Yu,Liu, Jing,&Lu, Hanqing.(2016).Chat with illustration.MULTIMEDIA SYSTEMS,22(1),5-16.
MLA Jiang, Yu,et al."Chat with illustration".MULTIMEDIA SYSTEMS 22.1(2016):5-16.
Files in This Item: Download All
File Name/Size DocType Version Access License
Chat with illustrati(1788KB)期刊论文作者接受稿开放获取CC BY-NC-SAView Download
Related Services
Recommend this item
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Jiang, Yu]'s Articles
[Liu, Jing]'s Articles
[Lu, Hanqing]'s Articles
Baidu academic
Similar articles in Baidu academic
[Jiang, Yu]'s Articles
[Liu, Jing]'s Articles
[Lu, Hanqing]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Jiang, Yu]'s Articles
[Liu, Jing]'s Articles
[Lu, Hanqing]'s Articles
Terms of Use
No data!
Social Bookmark/Share
File name: Chat with illustration.pdf
Format: Adobe PDF
All comments (0)
No comment.

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.