Theme-Aware Aesthetic Distribution Prediction With Full-Resolution Photographs | |
Jia, Gengyun1,2; Li, Peipei3; He, Ran1,2,4 | |
发表期刊 | IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS |
ISSN | 2162-237X |
2022-03-03 | |
页码 | 15 |
摘要 | Aesthetic quality assessment (AQA) is a challenging task due to complex aesthetic factors. Currently, it is common to conduct AQA using deep neural networks (DNNs) that require fixed-size inputs. The existing methods mainly transform images by resizing, cropping, and padding or use adaptive pooling to alternately capture the aesthetic features from fixed-size inputs. However, these transformations potentially damage aesthetic features. To address this issue, we propose a simple but effective method to accomplish full-resolution image AQA by combining image padding with region of image (RoM) pooling. Padding turns inputs into the same size. RoM pooling pools image features and discards extra padded features to eliminate the side effects of padding. In addition, the image aspect ratios are encoded and fused with visual features to remedy the shape information loss of RoM pooling. Furthermore, we observe that the same image may receive different aesthetic evaluations under different themes, which we call the theme criterion bias. Hence, a theme-aware model that uses theme information to guide model predictions is proposed. Finally, we design an attention-based feature fusion module to effectively use both the shape and theme information. Extensive experiments prove the effectiveness of the proposed method over state-of-the-art methods. |
关键词 | Aesthetic quality assessment (AQA) full resolution region of image (RoM) pooling theme |
DOI | 10.1109/TNNLS.2022.3151787 |
关键词[WOS] | IMAGE ; PHOTO |
收录类别 | SCI |
语种 | 英语 |
资助项目 | National Natural Science Foundation of China[U20A20223] ; Beijing Nova Program[Z211100002121106] |
项目资助者 | National Natural Science Foundation of China ; Beijing Nova Program |
WOS研究方向 | Computer Science ; Engineering |
WOS类目 | Computer Science, Artificial Intelligence ; Computer Science, Hardware & Architecture ; Computer Science, Theory & Methods ; Engineering, Electrical & Electronic |
WOS记录号 | WOS:000767831600001 |
出版者 | IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC |
七大方向——子方向分类 | 图像视频处理与分析 |
引用统计 | |
文献类型 | 期刊论文 |
条目标识符 | http://ir.ia.ac.cn/handle/173211/48021 |
专题 | 智能感知与计算研究中心 |
通讯作者 | He, Ran |
作者单位 | 1.Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing 100049, Peoples R China 2.Chinese Acad Sci, Ctr Res Intelligent Percept & Comp, Inst Automat, Natl Lab Pattern Recognit, Beijing 100190, Peoples R China 3.Beijing Univ Posts & Telecommun, Sch Artificial Intelligence, Beijing 100876, Peoples R China 4.Chinese Acad Sci, Inst Automat, CAS Ctr Excellence Brain Sci & Intelligence Tech, Natl Lab Pattern Recognit,Ctr Res Intelligent Per, Beijing 100190, Peoples R China |
第一作者单位 | 模式识别国家重点实验室 |
通讯作者单位 | 模式识别国家重点实验室 |
推荐引用方式 GB/T 7714 | Jia, Gengyun,Li, Peipei,He, Ran. Theme-Aware Aesthetic Distribution Prediction With Full-Resolution Photographs[J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS,2022:15. |
APA | Jia, Gengyun,Li, Peipei,&He, Ran.(2022).Theme-Aware Aesthetic Distribution Prediction With Full-Resolution Photographs.IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS,15. |
MLA | Jia, Gengyun,et al."Theme-Aware Aesthetic Distribution Prediction With Full-Resolution Photographs".IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2022):15. |
条目包含的文件 | ||||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 | ||
Theme-Aware_Aestheti(10845KB) | 期刊论文 | 作者接受稿 | 开放获取 | CC BY-NC-SA | 浏览 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论