By David Tuller, DrPH
What does it mean that the top investigators in a field of research have collectively and consistently misrepresented a seminal figure in their purported domain of expertise? I’m talking about all those who present themselves as authorities on the topic of so-called “medically unexplained symptoms” (MUS) but have found it difficult to accurately cite a study that examined the purported costs of these conditions to the National Health Service. (This phenomenon was initially pointed out to me by an observant sleuth; I first wrote about it here.)
The study in question, Bermingham et al, is called “The cost of somatisation among the working-age population in England for the year 2008-2009.” It was published in 2010 in the journal Mental Health in Family Medicine. As one of its core findings, it estimated something very specific: NHS costs for patients of working age identified as “somatising” to even a minor extent accounted for around 10% of the total costs for that demographic category. In paper after paper, “experts” in MUS have translated that straightforward data point this way: Patients with MUS accounted for 10% of total NHS costs. The effect of that error is to more than triple the apparent impact of MUS on the NHS budget.
(Special Note for MUS experts reading this post: References to Bermingham et al’s age parameters are in mentioned in the title of the paper itself.)
It is unclear why these thought leaders have been so statistically challenged across so many years. I assume the mistake has been unintentional. Nonetheless, it has served to support the argument for desired policy outcomes, which could explain why it went unnoticed by the authors as well as any like-minded colleagues who peer reviewed the papers in question. If health officials wrongly believe that costs related to MUS account for 10% of their budgets, they would presumably be more amenable to ramping up psychological services along the lines of the ones proposed by those disseminating the false information.
I have recently been engaged in an exchange with Professor Robin Murry, one of the two top editors at the venerable journal Psychological Medicine. At issue is a paper that once again includes the false statement about NHS costs. I have also written separately to the senior author, Professor Anthony David, since a previous paper he co-authored was corrected for the exact same mistake 18 months ago.
I have not heard back about a correction from either Professor Murray or Professor David. I sent Professor Murray a follow-up message this morning. I have shared it below.
Two workweeks have passed since I contacted you about the significant error in “Characteristics of patients with motor functional neurological disorder in a large UK mental health service: a case-control study.” (The authors are O’Connell, Nicholson, Wessely, & David.) You indicated you would check with the authors.
In reality, it should take the authors no more than a few minutes to review the mis-cited study, Bermingham et al, as well as the other papers in which the exact same mistake has already been corrected. That is even more the case since Professor David, the senior author, was also a co-author on one of the previously corrected papers. Moreover, I cc’d the corresponding author of Bermingham et al in my e-mail communications, in case of any lingering confusion about the meaning of the study findings.
I am therefore surprised that I haven’t heard back from you yet about the correction. Perhaps this seems like an insignificant matter or a minor irritation to you and the authors. However, as I have noted, investigators who study so-called “medically unexplained symptoms” have spent a decade disseminating a false account of the findings of this seminal research in their own field of purported expertise. Coincidentally or not, this mistake aligns with these experts’ professional interests in promoting more services for people who would meet their diagnostic criteria for MUS.
When the peer review process fails repeatedly to catch the same substantive error in publication after publication, journal editors should be alarmed. Perhaps the lesson is this: If a school of researchers appears to be engaging in what might be called groupthink by, for example, collectively misrepresenting a key data point in the medical literature, it would be wise to extend peer review invitations to a wider circle of readers and to ensure that references are cross-checked against claims being made.
I look forward to a prompt update on the forthcoming correction to O’Connell et al. As I have suggested, I hope the correction also includes an explanation for the 18-month delay since the previous paper co-authored by the senior author was corrected for the exact same mistake.
David Tuller, DrPH
Senior Fellow in Public Health and Journalism
Center for Global Public Health
School of Public Health
University of California, Berkeley
5 responses to “Trial By Errors: Why Have Experts in MUS Spent Ten Years Mis-Citing a Study about Costs to the NHS?”
Wouldn’t anyone who is concerned to make sure that the scientific record is accurate respond to such issues as quickly as possible and within days at the most? These delays speak volumes to me.
Also won’t you expect a journal and/or an author who has been forced to publish a correction for this already would automatically check their other related articles for the same mistake.
It is almost as if they don’t care that they made such an error, and only make any corrections when absolutely forced too.
Keep their feet to the fire – your polite and civil letters should make the RIGHT people put an end to the scammers – eventually.
But it is water trying to wear a hole through the rock, and most of us ME/CFS types have little water to spare.
To make it perfectly clear to those who haven’t been able to follow this closely, the mis-citing error or sleight-of-the-written word or whatever it is that Tuller is talking about here is of the order of £9BILLION in terms of the current NHS budget.
NINE BILLION UK pounds….
…. and yet seemingly nobody rushes in to correct this false claim immediately, not even Professor Sir Simon Wessely, an apparent guardian of the mental health of our (UK) nation, who has made this error himself.
Doesn’t that speak volumes?
I think an immediate correction AND apology is in order from each author and editor who has been responsible for this appalling mis-cite.
This is very good work by Dr. Tuller.
Although I know nothing about what contracts Wessely et al might have signed, I will note that it is quite common for research contracts to say that the researchers aren’t allowed to publish anything at all about the project without giving the source of the money 30 days advance notice of what is going to be published, with the source of the money having the option to censor anything they don’t like. In practise, a researcher may be able to negotiate a quicker turnaround with something uncontroversial that has a good excuse for needing to be expedited.
You might think such contracts are a bit dubious, in that they could potentially lead to embarassing discoveries being suppressed.
I could see researchers being put in an embarrassing position in situations similar to this one. Here, I think the correction is relatively unproblematic. The more problematic version goes like this:
Researcher to government: (draft of paper)
Government to researcher: We don’t like your conclusions. We’ll only let you publish if you spin the results to look more positive. By the way, if you say anything without our approval, you’re fired.
Reseacher to journal: (version of paper with more spin)
Dr. Tuller to researcher: Hey, have you noticed that your data don’t actually support the conclusions of your paper?
Researcher to self: Crap.