CASIA OpenIR  > 毕业生  > 博士学位论文
关于图文理解的认知研究
袁小红
1997-04-01
学位类型工学博士
中文摘要图在人们的交流与推理中起着重要的作用,因此,图示表示与推理在近几年 引起人工智能、心理学及计算机学界的广泛兴趣,得到迅速发展。本文的研究 是在对图示表示与推理的研究热涨这一背景下展开的。 本文强调在问题理解中图与文相互作用的重要性,为此,提出了关于图文理 解的认知假设,并根据这个假设建立了关于图、文及图文混合描述理解的认知 模型. Paivio的双重编码理论、Tulving的情景记忆与Schank的语言理解理论、以 及Navon的“总体先于局部”的原理,是本文所讨论的图文理解的心理学基础。 根据这些心理学研究结果,本文提出了图文理解的认知假设,其要点是:在图 或文字理解的过程中,存在着图与文之间的相互联想,即对图的理解需要联想 到文字,反之亦然。而在文字的理解过程中会想象出整体的、具体的画面,对 图的理解依从整体到局部的顺序.对图文混合描述的理解,则需要建立图中信 息与文中信息之间的对应关系。 基于这个假设我们建立了图、文及图文混合描述理解的认知模型,并详细分 析了文字与图理解的过程: (1)文字的理解过程中会想象出完整的、具体的图,并且这个想象的图在 对文字顺序理解的过程中不断得到修改和补充; (2)图的理解是先由总体特征把握其整体意义,再在关于整体的知识的引 导下注意局部细节。 在图文混合描述理解过程中,图与文相互补充信息并相互去除冗余,这就是 图文互补作用。这个作用是:对于图文混合描述,图消除或减少了对文字理解 的不确定性或错误,并补充了信息;而文字能帮助确定图的整体意义,消除对 图的理解的不确定性,引导对图的聚焦及补充信息。
英文摘要Diagrams play an important role in human communication and reasoning.In recent years the research of diagrammatic representation and reasoning has aroused an extensive interest in artificial intelligence,cognitive psychology and computer science, mad has made much progress.The work reported here is initiated by this line of research. In this thesis the importance of the roles of diagram and sentences to each other in problem understanding is emphasized,and a cognitive conjecture regarding the understanding of diagram,sentences and diagram-sentence combinations is proposed. Based on this conjecture, a cognitive model for understanding diagram, sentences and diagram-sentence combination is established. Paivio's dual code theory,Tulving's episodic memory and Schank's language understanding theory,and Navon's"Global precedes local"theory,are the psychological basis for our discussion.Based on these psychological results,a conjecture concerning the understanding of diagram,sentences and diagram-sentence combination is presented,which is summarized as follows:In the course of understanding diagram or sentences,association between diagram and sentences exists, that is,diagrams are imagined in the course of understanding sentences,and vice versa. In understanding sentences,a global and concrete diagram is imagined,while in understanding diagram,the global feature of the diagram is perceived before the local parts.In understanding diagram-sentences combination,the coreference between information in the diagram and that in the sentences must be established. Based on this conjecture,the processes of understanding diagram and text are further analyzed in detail: (1)In understanding text,a global and concrete diagram can be imagined and it will be increasingly modified and supplemented till reaching the end of the text. (2)In understanding diagram,people first try to recognize the global meaning of the diagram by its global feature,then focus their attentions to the local parts of the diagram directed by knowledge concerning the global meaning. In understanding diagram-sentences combination,the diagram and sentencessupplement information to each other, and reduce redundancy in each other.This is called the complementary role of diagram and sentences to each other, which is illustrated as follows:The diagram reduces the indeterminacy or the mistakes in understanding the sentences,and supplements information;while the sentences help to decide the global meaning of the diagram,reduce the ambiguity in the diagram, guide attention focusing and supplement information. At the end of the thesis,a computer system for simulating the understanding of diagram, text and diagram-text combination are described.
关键词直接表示 图示表示与推理 图文混合描述 认知建模 Direct Representation Diagrammatic Representation And Reasoning Diagram-sentence Combined Description Cognitive Modeling
语种中文
文献类型学位论文
条目标识符http://ir.ia.ac.cn/handle/173211/5668
专题毕业生_博士学位论文
推荐引用方式
GB/T 7714
袁小红. 关于图文理解的认知研究[D]. 中国科学院自动化研究所. 中国科学院自动化研究所,1997.
条目包含的文件
条目无相关文件。
个性服务
推荐该条目
保存到收藏夹
查看访问统计
导出为Endnote文件
谷歌学术
谷歌学术中相似的文章
[袁小红]的文章
百度学术
百度学术中相似的文章
[袁小红]的文章
必应学术
必应学术中相似的文章
[袁小红]的文章
相关权益政策
暂无数据
收藏/分享
所有评论 (0)
暂无评论
 

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。