What Are the Differences Between Bayesian Classifiers and Mutual-Information Classifiers?

	What Are the Differences Between Bayesian Classifiers and Mutual-Information Classifiers?
	Hu, Bao-Gang
发表期刊	IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS
	2014-02-01
卷号	25 期号:2 页码:249-264
文章类型	Article
摘要	In this paper, both Bayesian and mutual-information classifiers are examined for binary classifications with or without a reject option. The general decision rules are derived for Bayesian classifiers with distinctions on error types and reject types. A formal analysis is conducted to reveal the parameter redundancy of cost terms when abstaining classifications are enforced. The redundancy implies an intrinsic problem of nonconsistency for interpreting cost terms. If no data are given to the cost terms, we demonstrate the weakness of Bayesian classifiers in class-imbalanced classifications. On the contrary, mutual-information classifiers are able to provide an objective solution from the given data, which shows a reasonable balance among error types and reject types. Numerical examples of using two types of classifiers are given for confirming the differences, including the extremely class-imbalanced cases. Finally, we briefly summarize the Bayesian and mutual-information classifiers in terms of their application advantages and disadvantages, respectively.
关键词	Abstaining Classifier Bayes Cost-sensitive Learning Entropy Error Types Mutual Information Reject Types
WOS标题词	Science & Technology ; Technology
关键词[WOS]	NEURAL-NETWORKS ; CLASSIFICATION ; RULE ; PERFORMANCE ; ERROR
收录类别	SCI
语种	英语
WOS研究方向	Computer Science ; Engineering
WOS类目	Computer Science, Artificial Intelligence ; Computer Science, Hardware & Architecture ; Computer Science, Theory & Methods ; Engineering, Electrical & Electronic
WOS记录号	WOS:000330040800001
引用统计	被引频次：22[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://ir.ia.ac.cn/handle/173211/2855
专题	多模态人工智能系统全国重点实验室_多媒体计算
作者单位	Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing 100190, Peoples R China
推荐引用方式 GB/T 7714	Hu, Bao-Gang. What Are the Differences Between Bayesian Classifiers and Mutual-Information Classifiers?[J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS,2014,25(2):249-264.
APA	Hu, Bao-Gang.(2014).What Are the Differences Between Bayesian Classifiers and Mutual-Information Classifiers?.IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS,25(2),249-264.
MLA	Hu, Bao-Gang."What Are the Differences Between Bayesian Classifiers and Mutual-Information Classifiers?".IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 25.2(2014):249-264.

条目包含的文件
文件名称/大小	文献类型	版本类型	开放类型	使用许可
Hu14.pdf（1314KB）	期刊论文	作者接受稿	开放获取	CC BY-NC-SA	浏览下载