The Naive Bayes classifier is a simple and accurate tool. By using Bayesian model averaging and the principle of indifference, a new classifier has been developed that is just as simple but more accurate and well-founded.