(This post originally appeared on the Open Health Care Blog)
At Open Health Care we believe in Evidence Based Medicine.
Which is why we create digital health services that support research.
Unfortunately the current infrastructure supporting evidence based medicine has some shortcomings. One of these is that when a research paper is retracted because, for example, the author made up the results, there is little or no means to propogate this update in the wider medical literature.
Supposing, as a doctor, I look to a systematic review on the management of heart attacks to inform how I treat my patient, I sadly have no assurance that the systematic review does not rely on research papers that have been retracted. This is suboptimal.
Open access, post-publication peer review, and better version control would be three useful features that a modern scientific publishing model optimized to enable good science should support.
In the meantime, inspired by a lunchtime conversation with our friend and director Ben Goldacre (it was all his idea), we pondered the question:
What is the most cited retracted paper?
It turns out PubMed already has a nice API that can return a list of PubMed ids for papers that have been retracted. Next we needed a means of knowing how many times each retracted paper was cited. There are a few ways of doing this but we went with using google scholar after Alf Eaton told us about it on twitter. It’s possible to search google scholar for the articles citing a particular pubmed id, here’s an example.
Finally, we used wget to download all of the google scholar search results. This infamous paper ‘Ileal-lymphoid-nodular hyperplasia, non-specific colitis, and pervasive developmental disorder in children.’ was the winner with 2070 citations!
Here’s the top ten:
You can reproduce our results or view our workings over on Github.
There are of course many reasons other than the author making up the results for a paper to be retracted. There are also many circumstances in which citing a retracted paper is legitimate. For a more nuanced discussion of retractions there’s a nice Comprehensive Survey of Retracted Articles from the Scholarly Literature in PLOS and the excellent Retraction Watch covers the details of individual retractions as they happen.
Anyway, it was fun to examine retractions. We’d love to explore this further so if we can be of service to you do get in touch.
Perhaps a project for NHS Hack Day?Go Top