Knowledge Commons of Institute of Automation,CAS
社会媒体上下文感知的序列行为建模 | |
黄晓雯 | |
2020-05-30 | |
页数 | 154 |
学位类型 | 博士 |
中文摘要 | 互联网的高速腾飞让大众进入网络世界,社会媒体在互联网的沃土上蓬勃发展。社会媒体应用已经渗透到人们生活的各个角落,影响着人们的日常生活。用户是社会媒体内容的生产者,也是其服务的终极目标。互联网上的各种应用为用户提供便捷服务的同时,也记录着用户的行为数据。用户行为是用户兴趣偏好的潜在表示,对用户行为进行建模,可以捕获用户在社会媒体中的兴趣偏好,支撑不同的下游应用,如个性化推荐系统、个性化搜索等。用户行为具有时序性,对用户在社会媒体中的序列行为建模,是有效跟进用户动态兴趣演变,捕捉用户长短期兴趣偏好的重要手段。此外,目前用户序列行为建模还存在几个关键性问题,如用户在社会媒体上产生的内容具有多模态性、用户行为的异构多义性、复杂的交互关系以及用户行为建模的典型应用缺乏可解释性。在本研究中,我们将从社会媒体用户序列行为建模的四个关键问题切入,对序列行为建模进行研究,提高用户兴趣建模的高效性和准确率,为下游应用提供有力的支撑。本文的研究内容和主要贡献如下: |
英文摘要 | The rapid development of the Internet allows the masses to enter the online world. Social media is flourishing on the fertile ground of the Internet. Social media applications have penetrated into people's lives, affecting people's daily lives. Users are the producers of social media content and the ultimate goal of their services. Various applications on the Internet provide users with convenient services while also recording user behavior data. User behavior is a potential expression of user interest preferences. Modeling user behaviors can capture user's interest preferences in social media and support different downstream applications, such as personalized recommendation systems and personalized search. User behaviors on social media change dynamically over time. Modeling on users' sequential behaviors in social media is an important means to effectively follow the evolution of users' dynamic interests and capture their long-term and short-term interest preferences. In addition, there are still several key issues in the modeling of user sequential behaviors, such as the multi-modality of the content generated by users on social media, the heterogeneity and polysemy property of user behaviors, the complex interaction between users and items, and the typical applications of models lack Interpretability. In this thesis, we aim to tackle four key issues of user sequential behavior modeling on social media, to improve the efficiency and accuracy of user interest capturing, and provide strong support for downstream applications. The major contributions of this thesis are as follows: 1. Research on multi-modal content modeling on social media. The basis of sequential behavior modeling is to model the multi-modal content of user behavior. Social media is full of multi-modal content, such as text, images, video, audio, and more. When designing various applications that serve users, multi-modal content is raw materials. Analysis of multi-modal content and the extraction of useful information for the task are beneficial to mining the underlying patterns to improve the performance of the applications. Therefore, we study two aspects of multi-modal content modeling, laying the foundation for follow-up research. The first one is to model user behaviors based on multi-modal content. We propose a method to automatically predict the popularity of pictures posted by users on Flickr by the stacking model and the specially designed explicit and implicit features. The second one is to model social relationships based on multi-modal content. We propose an effective social relationship labeling model with the specially designed multi-modal similarity features constructed from metadata and the relationship of users' Twitter list, to assist in the construction of social networks. 2. Contextual sequential behavior modeling based on user's heterogeneous and polysemy behaviors. A user's sequential behaviors can reveal the evolution of user interests. The sequential recommendation is an important task for user-oriented online services. There are many characteristics of user behaviors on social networks: user behaviors are inherently heterogeneous, user behaviors have the polysemy property, and user behaviors are dynamically context-dependent. we propose a unified contextual self-attention network to address the three properties. Heterogeneous user behaviors considered in our model are projected into a common latent semantic space. Then the output is fed into the feature-wise self-attention network to capture the polysemy of user behaviors. Besides, the forward and backward position encoding matrices are proposed to model dynamic contextual dependency. The proposed method can effectively capture the dynamic interest expression of user behavior, and can greatly improve the computing efficiency of the model. 3. Interactive heterogeneous information network enhanced comprehensive sequential behavior modeling. The existing sequential recommendation algorithms usually use historical sequential behaviors to model user preferences, which only take into account local information about user behaviors, so that it has limited expressive power in capturing complex user preferences. We propose a meta-path augmented context-aware sequence recommendation method, which introduces heterogeneous information networks and meta-path mechanism into the recommendation system, and builds global context that contains the potential dependencies between users and items, which is helpful for users to expand their interest through the dense connections in the network in a reasonable manner. The proposed approach introduces meta-paths from a heterogeneous information network to capture the global context information, and the position-based self-attention mechanism is adopted to model the local preference representation efficiently. Compared with the methods which only consider the local preference, our proposed method takes the advantages of incorporating global context information which extracts structural features that captures relevant semantics to construct users’ global preference representation for the sequential recommendation. We further adopt the co-attention mechanism to model complex interactions between the global context and users’ historical behaviors for better user representations. 4. Explainable sequential behavior modeling based on knowledge graph (KG) reasoning. The current neural network-based methods have achieved high accuracy in recommendation tasks. However, most methods have not considered providing a reasonable explanation for users while making recommendation decisions. We propose a novel explainable interaction-driven user modeling algorithm to exploit the knowledge graph for constructing an effective and explainable sequential recommender. Qualified semantic paths between specific user-item pair are extracted from KG. Encoding those semantic paths and learning the importance scores for each path provides the path-wise explanation for the recommendation system. Different from traditional item-level sequential modeling methods, we capture the interaction-level user dynamic preferences by modeling the sequential interactions. It is a high-level representation that contains auxiliary semantic information from KG. Furthermore, we adopt a joint learning manner for better representation learning by employing multi-modal fusion, which benefits from the structural constraints in KG and involves three kinds of modalities. The proposed algorithm achieves impressive performance in terms of endowing sequential recommendation systems with accuracy and Explainability. |
关键词 | 社会媒体 序列行为建模 用户建模 序列推荐 多模态 异构信息网络 知识图谱 可解释性 |
语种 | 中文 |
七大方向——子方向分类 | 多模态智能 |
文献类型 | 学位论文 |
条目标识符 | http://ir.ia.ac.cn/handle/173211/39195 |
专题 | 多模态人工智能系统全国重点实验室_多媒体计算 |
推荐引用方式 GB/T 7714 | 黄晓雯. 社会媒体上下文感知的序列行为建模[D]. 中国科学院自动化研究所. 中国科学院大学,2020. |
条目包含的文件 | ||||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 | ||
Thesis-eprint无签名版.pd(12820KB) | 学位论文 | 开放获取 | CC BY-NC-SA |
个性服务 |
推荐该条目 |
保存到收藏夹 |
查看访问统计 |
导出为Endnote文件 |
谷歌学术 |
谷歌学术中相似的文章 |
[黄晓雯]的文章 |
百度学术 |
百度学术中相似的文章 |
[黄晓雯]的文章 |
必应学术 |
必应学术中相似的文章 |
[黄晓雯]的文章 |
相关权益政策 |
暂无数据 |
收藏/分享 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论