Cerquides J.

Abstract

Tree Augmented Naive Bayes (TAN) has shown to be competitive with state-of-the-art machine learning algorithms [Friedman97]. However, the TAN induction algorithm that appears in [Friedman97] can be improved in several ways. In this paper we identify three shortcomings in it and introduce two ideas to overcome those problems: the multinomial sampling approach to learning bayesian networks and it local bayesian model averaging. These ideas approaches are generic and can thus be reused to improve other learning algorithms. We empirically test the new algorithms, and conclude that in most of the cases they lead to an improvement in accuracy in the classification and in the quality of the probabilities given as predictions.

[Cer99] Cerquides J.. Applying General Bayesian Techniques to Improve TAN Induction. In Proceedings of the International Conference on Knowledge Discovery and Data Mining - KDD99, 1999.

KDD 99 Version ( 90K, PostScript ).
Extended version ( 807K, PostScript ).