Pseudo R-Squared Measures

In the linear regression model, the coefficient of determination, R 2, summarizes the proportion of variance in the dependent variable associated with the predictor (independent) variables, with larger R 2 values indicating that more of the variation is explained by the model, to a maximum of 1. For regression models with a categorical dependent variable, it is not possible to compute a single R 2 statistic that has all of the characteristics of R 2 in the linear regression model, so these approximations are computed instead. The following methods are used to estimate the coefficient of determination.

  • Cox and Snell's R 2 1 is based on the log likelihood for the model compared to the log likelihood for a baseline model. However, with categorical outcomes, it has a theoretical maximum value of less than 1, even for a "perfect" model.
  • Nagelkerke's R 2 2 is an adjusted version of the Cox & Snell R-square that adjusts the scale of the statistic to cover the full range from 0 to 1.
  • McFadden's R 2 3 is another version, based on the log-likelihood kernels for the intercept-only model and the full estimated model.

What constitutes a “good” R 2 value varies between different areas of application. While these statistics can be suggestive on their own, they are most useful when comparing competing models for the same data. The model with the largest R 2 statistic is “best” according to this measure.

Figure 1. Pseudo r-squared measures
Table of pseudo R-square measures, showing a value of .298 for Cox and Snell, .328 for Nagelkerke, and .149 for McFadden.

Here, the pseudo r-squared values are respectable but leave something to be desired. It will probably be worth the effort to revise the model to try to make better predictions.

Next

1 Cox, D. R., and E. J. Snell. 1989. The Analysis of Binary Data, 2nd ed. London: Chapman and Hall.
2 Nagelkerke, N. J. D. 1991. A note on the general definition of the coefficient of determination. Biometrika, 78:3, 691-692.
3 McFadden, D. 1974. Conditional logit analysis of qualitative choice behavior. In: Frontiers in Economics, P. Zarembka, eds. New York: Academic Press.