Logistic regression diagnostics: understanding how well a model predicts outcomes

JAMA

14 March 2017 - In the 8 March 2016, issue of JAMA, Zemek et al used logistic regression to develop a clinical risk score for identifying which paediatric patients with concussion will experience prolonged post-concussion symptoms. 

The authors prospectively recorded the initial values of 46 potential predictor variables, or risk factors—selected based on expert opinion and previous research—in a cohort of patients and then followed those patients to determine who developed the primary outcome of prolonged post-concussion symptoms (PPCS). In the first part of the study, the authors created a logistic regression model to estimate the probability of PPCS using a subset of the variables; in the second part of the study, a separate set of data was used to assess the validity of the model, with the degree of success quantified using regression model diagnostics. 

The rationale for using logistic regression to develop predictive models was summarised in an earlier JAMA Guide to Statistics and Methods article. In this article, we discuss how well a model performs once it is defined.

Read JAMA Guide

Michael Wonder

Posted by:

Michael Wonder