Knowledge Commons of Institute of Automation,CAS
Chat with illustration | |
Jiang, Yu; Liu, Jing; Lu, Hanqing | |
发表期刊 | MULTIMEDIA SYSTEMS |
2016-02-01 | |
卷号 | 22期号:1页码:5-16 |
文章类型 | Article |
摘要 | Instant messaging service is an important aspect of social media and sprung up in last decades. Traditional instant messaging service transfers information mainly based on textual message, while the visual message is ignored to a great extent. Such instant messaging service is thus far from satisfactory in all-around information communication. In this paper, we propose a novel visual assisted instant messaging scheme named Chat with illustration (CWI), which presents users visual messages associated with textual message automatically. When users start their chat, the system first identifies meaningful keywords from dialogue content and analyzes grammatical and logical relations. Then CWI explores keyword-based image search on a hierarchically clustering image database which is built offline. Finally, according to grammatical and logical relations, CWI assembles these images properly and presents an optimal visual message. With the combination of textual and visual message, users could get a more interesting and vivid communication experience. Especially for different native language speakers, CWI can help them cross language barrier to some degree. In addition, a visual dialogue summarization is also proposed, which help users recall the past dialogue. The in-depth user studies demonstrate the effectiveness of our visual assisted instant messaging scheme. |
关键词 | Instant Messaging Service Text-to-picture Layout |
WOS标题词 | Science & Technology ; Technology |
DOI | 10.1007/s00530-014-0371-3 |
关键词[WOS] | TEXT ; SYSTEM |
收录类别 | SCI |
语种 | 英语 |
项目资助者 | 973 Program(2010CB327905) ; National Natural Science Foundation of China(61272329 ; 61273034 |
WOS研究方向 | Computer Science |
WOS类目 | Computer Science, Information Systems ; Computer Science, Theory & Methods |
WOS记录号 | WOS:000368828500002 |
引用统计 | |
文献类型 | 期刊论文 |
条目标识符 | http://ir.ia.ac.cn/handle/173211/10667 |
专题 | 紫东太初大模型研究中心_图像与视频分析 |
作者单位 | Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing, Peoples R China |
第一作者单位 | 模式识别国家重点实验室 |
推荐引用方式 GB/T 7714 | Jiang, Yu,Liu, Jing,Lu, Hanqing. Chat with illustration[J]. MULTIMEDIA SYSTEMS,2016,22(1):5-16. |
APA | Jiang, Yu,Liu, Jing,&Lu, Hanqing.(2016).Chat with illustration.MULTIMEDIA SYSTEMS,22(1),5-16. |
MLA | Jiang, Yu,et al."Chat with illustration".MULTIMEDIA SYSTEMS 22.1(2016):5-16. |
条目包含的文件 | 下载所有文件 | |||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 | ||
Chat with illustrati(1788KB) | 期刊论文 | 作者接受稿 | 开放获取 | CC BY-NC-SA | 浏览 下载 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论