Diagrams play an important role in human communication and reasoning.In recent years the research of diagrammatic representation and reasoning has aroused an extensive interest in artificial intelligence,cognitive psychology and computer science, mad has made much progress.The work reported here is initiated by this line of research. In this thesis the importance of the roles of diagram and sentences to each other in problem understanding is emphasized,and a cognitive conjecture regarding the understanding of diagram,sentences and diagram-sentence combinations is proposed. Based on this conjecture, a cognitive model for understanding diagram, sentences and diagram-sentence combination is established. Paivio's dual code theory,Tulving's episodic memory and Schank's language understanding theory,and Navon's"Global precedes local"theory,are the psychological basis for our discussion.Based on these psychological results,a conjecture concerning the understanding of diagram,sentences and diagram-sentence combination is presented,which is summarized as follows:In the course of understanding diagram or sentences,association between diagram and sentences exists, that is,diagrams are imagined in the course of understanding sentences,and vice versa. In understanding sentences,a global and concrete diagram is imagined,while in understanding diagram,the global feature of the diagram is perceived before the local parts.In understanding diagram-sentences combination,the coreference between information in the diagram and that in the sentences must be established. Based on this conjecture,the processes of understanding diagram and text are further analyzed in detail: (1)In understanding text,a global and concrete diagram can be imagined and it will be increasingly modified and supplemented till reaching the end of the text. (2)In understanding diagram,people first try to recognize the global meaning of the diagram by its global feature,then focus their attentions to the local parts of the diagram directed by knowledge concerning the global meaning. In understanding diagram-sentences combination,the diagram and sentencessupplement information to each other, and reduce redundancy in each other.This is called the complementary role of diagram and sentences to each other, which is illustrated as follows:The diagram reduces the indeterminacy or the mistakes in understanding the sentences,and supplements information;while the sentences help to decide the global meaning of the diagram,reduce the ambiguity in the diagram, guide attention focusing and supplement information. At the end of the thesis,a computer system for simulating the understanding of diagram, text and diagram-text combination are described.
修改评论