President Obama’s kicking off his health care reform today in the worst possible way: with a mischaracterization of data.
“The cost of health care now causes a bankruptcy in America every thirty seconds," according to remarks prepared for the president to open his White House forum on health care reform. The problem: That claim, based on a 2001 survey, is simply unsupportable.
The figure comes from a 2005 Harvard University study saying that 54 percent of bankruptcies in 2001 were caused by health expenses. We reviewed it internally and knocked it down at the time; an academic reviewer did the same in 2006. Recalculating Harvard’s own data, he came up with a far lower figure – 17 percent.
A more recent study by another group, approaching it another way, indicates that the number of Americans living in families that have filed for bankruptcy as a result of medical costs at about eight-tenths of one percent. That rings a little less loudly than “one every 30 seconds.”
The extrapolation of Harvard’s data to “a bankruptcy every 30 seconds,” which Obama also mentioned in his address to a joint session of Congress last month, comes, per the White House, from a 2005 Washington Post op-ed by Prof. Elizabeth Warren, a co-author of the Harvard paper. Fact-check.org has noted that even using Harvard’s numbers, it’s more like a bankruptcy every minute; indeed if you add up all bankrputcies in a year you barely get one every 30 seconds. (I've e-mailed Warren for comment.) But more to the point is that the Harvard data are clearly inflated, or at best, mischaracterized.
A good part of the problem is definitional. The Harvard report claims to measure the extent to which medical costs are “the cause” of bankruptcies. In reality its survey asked if these costs were “a reason” – potentially one of many – for such bankruptcies.
Beyond those who gave medical costs as “a reason,” the Harvard researchers chose to add in any bankruptcy filers who had at least $1,000 in unreimbursed medical expenses in the previous two years. Given deductibles and copays, that’s a heck of a lot of people.
Moreover, Harvard’s definition of “medical” expenses includes situations that aren’t necessarily medical in common parlance, e.g., a gambling problem, or the death of a family member. If your main wage-earning spouse gets hit by a bus and dies, and you have to file, that’s included as a “medical bankruptcy.”
When I asked the lead author, Dr. David Himmelstein, about his definitions of medical bankruptcy back in 2005, he said, “It’s a judgment call,” and added that any death, for example, “to our mind is a medical event.”
A last problem was sampling: The Harvard researchers surveyed bankruptcy filers in five federal court districts accounting for 14 percent of bankruptcies nationally; projecting this to the other 86 percent is sketchy. Said Himmelstein: “Obviously the extrapolation is rough.”
Of such rough extrapolations are presidential pronouncements made.
Worth keeping in mind is the fact that no one (apparently) disagrees about the pain medical expenses can cause to uninsured Americans. Prof. David Dranove of Northwestern University, who wrote the 2006 paper picking apart the Harvard study, noted that he has a new paper in the works showing that uninsured people who have a severe illness lose a substantial portion of their retirement assets.
"There is general agreement: Being uninsured and getting sick in the United States is really a bad thing,” Dranove told me today. “But for academics the validity of the research matters.” In the Harvard paper, he says, "The methods were so poor they gave cover to those who want to dismiss the problems of the uninsured – they can say the only paper out there uses a suspect method."
There’s been a fair amount of academic back-biting about this issue. On one hand Himmelstein, the lead Harvard researcher, is a co-founder of Physicians for a National Health Program, created to promote a government-run single-payer health system. On the other, Dranove took $5,000 from the nation’s health insurance industry for his report, which he says he now regrets for the criticism of his impartiality it’s engendered. Both papers were peer-reviewed.
“It stinks to be uninsured. I don’t want to be quoted saying anything else,” Dranove says. “But there are correct studies, and incorrect studies. For academics, the validity of the research methods matters.”
It should for the rest of us, too.