The Centers for Medicare and Medicaid Services (CMS) publishes quality ratings on a scale of one to five stars for thousands of US hospitals. However, the method used to calculate these ratings is problematic, according to Chicago Booth’s Dan Adelman. To address some of its limitations, Adelman developed the Efficient Frontier Hospital Ratings system, an alternate method of generating quality scores. To illustrate how his system compares, he inputted the same data (collected over 2014–18) that the CMS used for its February 2019 release and scored more than 3,700 individual hospitals. A searchable database showing how each of these hospitals fared under the two systems is now available here on the Chicago Booth Review website.
The most influential rating system rests on some faulty calculations, affecting millions of people and billions of dollars.
Hospital Ratings Are Deeply Flawed. Can They Be Fixed?The CMS and other reviewers use mostly the same data, but the results they come up with can be very different. The Johns Hopkins Hospital, for example, was, in 2019, ranked as the No. 3 hospital in the country by US News & World Report and received a top-5-percent designation from Healthgrades. But it received a B in the fall from Leapfrog and only three stars from the CMS.
While the CMS rates US hospitals as a single homogeneous group, Adelman introduced a way to put hospitals into subgroups with similar characteristics, and then recalculate their ratings. These subgroups include:
The example below, highlighting a set of scores for Johns Hopkins, illustrates this type of grouping. As an alternative to rating it against a full, nationwide list of 3,720 hospitals (in which it lands in the 37th percentile), Adelman’s system makes it possible to rate Johns Hopkins among a narrower grouping of 138 peer institutions—all teaching hospitals with at least 400 beds—in which it stands in the 69th percentile. (Search the full Efficient Frontier database.)
Adelman, 2020
A Q&A with Chicago Booth’s Zhiguo He on the idiosyncrasies of the Chinese property market
Expect a Slowdown for the Chinese Economy, but Not a Crash
Monetary policy can play a role in reducing employment inequality, research indicates.
Why Rising Interest Rates Could Particularly Hurt Black Workers and Women
How researchers helped JD.com improve the efficiency of its fulfillment warehouses.
Smarter Algorithms Stop Factory Robots from CollidingYour Privacy
We want to demonstrate our commitment to your privacy. Please review Chicago Booth's privacy notice, which provides information explaining how and why we collect particular information when you visit our website.