CASIA OpenIR  > 学术期刊  > Machine Intelligence Research
Text Difficulty Study: Do Machines Behave the Same as Humans Regarding Text Difficulty?
Bowen Chen1; Xiao Ding1; Yi Zhao1; Bo Fu2; Tingmao Lin2; Bing Qin1; Ting Liu1
Source PublicationMachine Intelligence Research
ISSN2731-538X
2024
Volume21Issue:2Pages:283-293
AbstractWith the emergence of pre-trained models, current neural networks are able to give task performance that is comparable to humans. However, we know little about the fundamental working mechanism of pre-trained models in which we do not know how they approach such performance and how the task is solved by the model. For example, given a task, human learns from easy to hard, whereas the model learns randomly. Undeniably, difficulty-insensitive learning leads to great success in natural language processing (NLP), but little attention has been paid to the effect of text difficulty in NLP. We propose a human learning matching index (HLM Index) to investigate the effect of text difficulty. Experiment results show: 1) LSTM gives more human-like learning behavior than BERT. Additionally, UID-SuperLinear gives the best evaluation of text difficulty among four text difficulty criteria. Among nine tasks, some tasks′ performance is related to text difficulty, whereas others are not. 2) Model trained on easy data performs best in both easy and medium test data, whereas trained on hard data only performs well on hard test data. 3) Train the model from easy to hard, leading to quicker convergence.
KeywordCognition inspired natural language processing, psycholinguistics, explainability, text difficulty, curriculum learning
DOI10.1007/s11633-023-1424-x
Citation statistics
Document Type期刊论文
Identifierhttp://ir.ia.ac.cn/handle/173211/56039
Collection学术期刊_Machine Intelligence Research
Affiliation1.Research Center for Social Computing and Information Retrieval, Harbin Institute of Technology, Harbin 150001, China
2.Fundamental Technology Center, China Construction Bank Financial Technology Co., Ltd., Beijing 100033, China
Recommended Citation
GB/T 7714
Bowen Chen,Xiao Ding,Yi Zhao,et al. Text Difficulty Study: Do Machines Behave the Same as Humans Regarding Text Difficulty?[J]. Machine Intelligence Research,2024,21(2):283-293.
APA Bowen Chen.,Xiao Ding.,Yi Zhao.,Bo Fu.,Tingmao Lin.,...&Ting Liu.(2024).Text Difficulty Study: Do Machines Behave the Same as Humans Regarding Text Difficulty?.Machine Intelligence Research,21(2),283-293.
MLA Bowen Chen,et al."Text Difficulty Study: Do Machines Behave the Same as Humans Regarding Text Difficulty?".Machine Intelligence Research 21.2(2024):283-293.
Files in This Item: Download All
File Name/Size DocType Version Access License
MIR-2022-11-338.pdf(1796KB)期刊论文出版稿开放获取CC BY-NC-SAView Download
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Bowen Chen]'s Articles
[Xiao Ding]'s Articles
[Yi Zhao]'s Articles
Baidu academic
Similar articles in Baidu academic
[Bowen Chen]'s Articles
[Xiao Ding]'s Articles
[Yi Zhao]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Bowen Chen]'s Articles
[Xiao Ding]'s Articles
[Yi Zhao]'s Articles
Terms of Use
No data!
Social Bookmark/Share
File name: MIR-2022-11-338.pdf
Format: Adobe PDF
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.