Skip to content

Information Criteria for Risk Models


Definition

For a fitted likelihood model with maximized log-likelihood ℓ^\hat\ell, kk estimated parameters and sample size nn, Akaike's information criterion is AIC⁡=−2ℓ^+2k\operatorname{AIC}=-2\hat\ell+2k, and Bayesian information criterion is BIC⁡=−2ℓ^+klog⁡n\operatorname{BIC}=-2\hat\ell+k\log n. Smaller values are preferred when models use comparable likelihoods on the same observations.


Interpretation

The fit improvement from extra parameters must compensate for their penalty. Stepwise selection searches neighbouring models and need not find the best model among all possible subsets.

Stacked bars for models A and B: the fit term −2ℓ̂ (100 and 96) plus the penalty 2k or k log n, giving AIC 104 and 102 and BIC 109.21 and 109.82, the smaller of each pair in green.

The figure draws the Examples case with n=100n=100; the vertical axis starts at 90. Model B fits better, so its fit term −2ℓ^-2\hat\ell is 4 lower, but it has one more parameter. AIC charges 2 for that parameter, so B wins with 102 against 104; BIC charges log⁡100≈4.61\log 100\approx4.61, more than the fit gain of 4, so A wins with 109.21 against 109.82 (B's BIC penalty is 3log⁡100≈13.823\log 100\approx13.82).

Change the maximized log-likelihoods ℓ^\hat\ell, the parameter counts and nn: AIC prefers model B here, while BIC, which charges log⁡n\log n per parameter, prefers model A once nn exceeds e4≈54.6e^4\approx54.6.

Maximum likelihood estimation supplies the maximized log-likelihood ℓ^\hat\ell. When comparing fitted generalized linear model specifications with different rating predictors on the same observations, an extra coefficient can improve fit but also increases the parameter-count penalty.


Key Results

  • Count all estimated likelihood parameters, including an estimated dispersion parameter where applicable.
  • For n>e2n>\mathrm{e}^2, BIC penalizes each added parameter more than AIC.
  • AIC and BIC are selection aids, not evidence of causal interpretation or predictive validation.
  • Ordinary likelihood-based AIC is not directly available from a quasi-Poisson mean–variance specification alone.

Examples

With n=100n=100, model A has ℓ^=−50\hat\ell=-50, k=2k=2, while B has ℓ^=−48\hat\ell=-48, k=3k=3. AIC values are 104 and 102, favouring B; BIC values are about 109.21 and 109.82, favouring A.


Prerequisites



Sources

Aliases: AIC, BIC, Schwarz criterion, Akaike information criterion, Bayesian information criterion, information criterion, Akaike's information criterion, Schwarz Bayesian criterion, Schwarz information criterion Keywords: stepwise model selection, AIC = -2ℓ̂ + 2k, BIC = -2ℓ̂ + k log n, model selection, parameter penalty

Last updated: 17 October 2026 21:53