A Technical Note on the Dirichlet-Multinomial Model

Walter, Gero (4. October 2012): A Technical Note on the Dirichlet-Multinomial Model. The Dirichlet Distribution as the Canonically Constructed Conjugate Prior. Department of Statistics: Technical Reports, No.131

Abstract

This short note contains an explicit proof of the Dirichlet distribution being the conjugate prior to the Multinomial sample distribution as resulting from the general construction method described, e.g., in Bernardo and Smith (2000). The well-known Dirichlet-Multinomial model is thus shown to fit into the framework of canonical conjugate analysis (Bernardo and Smith 2000, Prop.~5.6, p.~273), where the update step for the prior parameters to their posterior counterparts has an especially simple structure. This structure is used, e.g., in the Imprecise Dirichlet Model (IDM) by Walley (1996), a simple yet powerful model for imprecise Bayesian inference using sets of Dirichlet priors to model vague prior knowledge, and furthermore in other imprecise probability models for inference in exponential families where sets of priors are considered.

• Item Type: Paper
• Keywords: Dirichlet distribution, conjugate priors, Bayesian inference
• Faculties: Mathematics, Computer Science and Statistics; Mathematics, Computer Science and Statistics > Statistics; Mathematics, Computer Science and Statistics > Statistics > Technical Reports
• Subjects: 500 Science > 510 Mathematics
• Language: English