Skip to main content

Mathematical Statistics II · Bayesian inference and decision rules

A categorical probability vector (P₁,P₂,P₃) has a Dirichlet prior with parameters (1,2,3)

Problem

Mathematical Statistics II practice problem

A categorical probability vector (P1,P2,P3)(P_1,P_2,P_3) has a Dirichlet prior with parameters (1,2,3)(1,2,3). Conditional on this vector, observations are independent categorical draws. The observed counts are (3,0,2)(3,0,2).

For positive parameters (a1,a2,a3)(a_1,a_2,a_3), the Dirichlet density on the simplex is proportional top1a1−1p2a2−1p3a3−1.p_1^{a_1-1}p_2^{a_2-1}p_3^{a_3-1}.Find the posterior parameters.

Now define the grouped probability and within-group fractionR=P1+P2,W=P1P1+P2.R=P_1+P_2,\qquad W=\frac{P_1}{P_1+P_2}.Find the posterior distributions of RR and WW, and determine whether they are posterior-independent. Calculate the posterior predictive probability that the next observation belongs to category 1 or 2.

Show that updating only the grouped counts gives the same posterior for RR. Does that mean the detailed counts provide no information about WW?

Hint

Hint

Add the observed category counts to the prior exponents.

Check your work

Work the problem yourself first. Then open it in Training to check your answer and read the full worked solution.

The answer check and full solution for this problem come with ProofAnvil Practice membership ($19 USD monthly). See membership. Or start with the free Mathematical Statistics II sample problem: Try the free sample problem.

More Mathematical Statistics II practice problems