The papers that most heavily cite retracted stories
In January, a review paper1 about solutions to detect human ailments by inspecting the notice seemed in a convention complaints printed by the Institute of Electrical and Electronics Engineers (IEEE) in New York Metropolis. But neither its authors nor its editors observed that 60% of the papers it cited had already been retracted.
The case is indubitably one of the crude observed by a enormous mission to salvage papers whose outcomes would be in quiz on legend of they cite retracted or problematic study. The mission’s creator, pc scientist Guillaume Cabanac at the College of Toulouse in France, shared his data with Nature’s news crew, which analysed them to salvage the papers that most heavily cite retracted work yet haven’t themselves been withdrawn (see ‘Retracted references’).
Chain retraction: easy solutions to halt unfriendly science propagating by the literature
“We’re no longer accusing anybody of doing one thing contaminated. We’re correct searching at that in some bibliographies, the references were retracted or withdrawn, meaning that the paper would be unreliable,” Cabanac says. He calls his tool a Feet of Clay Detector, relating to an analogy, before every little thing from the Bible, about statues or edifices that collapse as a result of their feeble clay foundations.
The IEEE paper is the 2nd-perfect on the list assembled by Nature, with 18 of the 30 stories it cites withdrawn. Its authors didn’t acknowledge to requests for comment, but IEEE integrity director Luigi Longobardi says that the writer didn’t know in regards to the disclose unless Nature asked, and that it is investigating.
Cabanac, a study-integrity sleuth, has already created gadget to flag thousands of problematic papers within the literature for disorders similar to pc-written textual exclaim or disguised plagiarism. He hopes that his most modern detector, which he has been developing over the last two years and describes this week in a Inform article in Nature, will present one other manner to halt unfriendly study propagating by the scientific literature — about a of it false work created by ‘papermill’ corporations.
Extra scrutiny
Cabanac lists the detector’s findings on his online online page, but in numerous places on-line — on the paper-review attach of living PubPeer and on social media — he has explicitly flagged better than 1,700 papers that caught his notice as a result of their reliance on retracted work. Some authors comprise thanked Cabanac for alerting them to problems in their references. Others argue that it’s unfair to effectively solid aspersions on their work as a result of retractions made after newsletter that, they are saying, don’t comprise an impact on their paper.
Scientific sleuths space dishonest ChatGPT utilize in papers
Retracted references don’t definitively tag that a paper is problematic, notes Tamara Welschot, share of the study-integrity crew at Springer Nature in Dordrecht, the Netherlands, but they are a indispensable signal that a paper may maybe well maybe furthermore procure pleasure in extra scrutiny. (Nature’s news crew is honest of its writer, Springer Nature.)
Some researchers argue that retraction of references in a myth review — which describes the insist of research in a field — doesn’t essentially invalidate the customary paper. But when stories assessed by a systematic review or meta-diagnosis are withdrawn, the outcomes of that review may maybe well maybe furthermore merely peaceable always be recalculated to attend the literature as a lot as this level, says epidemiologist Isabelle Boutron at Paris Metropolis College.
Selecting up fraudsters
One of the fundamental crucial papers that cite high proportions of retracted work are authored by identified tutorial fraudsters who comprise had many of their accept as true with papers retracted.
These comprise engineering researcher Ali Nazari, who used to be disregarded from Swinburne College of Technology in Melbourne, Australia, in 2019, after a university misconduct investigation into his actions. He previously worked at Islamic Azad College in Saveh, Iran, and his most modern whereabouts are unclear. After Nature told publishers about his extant papers2,3 topping Cabanac’s lists — collectively with Elsevier and Fap-Unifesp, a non-revenue foundation that supports the Federal College of São Paulo in Brazil — they acknowledged that they would gape into the articles. One of many related journals used to be discontinued in 2013, Elsevier noted.
Cabanac’s detector also flags papers4 by Chen-Yuan Chen, a pc scientist who worked at the Nationwide Pingtung College of Training in Taiwan unless 2014. He used to be slack a syndicate that faked see review and boosted citations, which came to light in 2014 after an investigation by the writer SAGE. Some of Chen’s papers which would be peaceable within the literature had been printed by Springer Nature, which says it hadn’t been attentive to the disclose but is now investigating. Neither Chen nor Nazari answered to Nature’s requests for comment.
One other flagged stare5 is by Ahmad Salar Elahi, a physicist affiliated with the Islamic Azad College in Tehran who has already had dozens of his papers retracted, in diverse cases as a result of crude self-quotation and circumstances of faked see review. In 2018, the web online page Retraction Ogle (which also wrote in regards to the Nazari and Chen cases) reported that according to Mahmoud Ghoranneviss, then-director of the Plasma Physics Compare Centre the attach Elahi worked, Elahi used to be more likely to be disregarded from the university. Now, Ghoranneviss — who has retired — says that Elahi used to be barred ideally suited from that centre and no longer the relaxation of the university. Elahi continues to submit papers, on occasion itemizing co-authors collectively with Ghoranneviss, who says he wasn’t attentive to this. Neither Elahi nor the university answered to Nature’s queries. The IEEE and Springer Nature, publishers of the journals that ran the Elahi papers, convey they’re investigating.
Sad authors
Some authors are sad about Cabanac’s work. In Would possibly maybe well well maybe also merely 2024, editors of the journal Scientific and Translational Oncology positioned an expression of disclose on a 2019 review paper6 about RNA and childhood cancers, warning that it may maybe maybe well maybe no longer be first payment on legend of it cited “diverse articles which were retracted”. The journal’s publishing editor, Ying Jia at Springer Nature in Washington DC, says the crew used to be alerted by indubitably one of Cabanac’s posts on social media last 300 and sixty five days.
Cabanac’s diagnosis finds that correct below 10% of the article’s 637 references were retracted — with reference to all after the review used to be printed. Nonetheless, the paper’s corresponding creator, María Sol Brassesco, a biologist at the College of São Paulo, says that taking away these references doesn’t trade the conclusions of the review, and that she has despatched the journal an up as a lot as now version, which it hasn’t printed. For the reason that cited works had been retracted after newsletter, the expression of disclose “felt fancy we had been being punished for one thing that we may maybe well maybe furthermore no longer see forward”, she says. Jia says that editors felt that collectively with the awareness used to be the most appropriate motion.
In other cases, authors disagree about what to diagram. Nature examined three papers7,8,9 throughout which between 5 and 16% of the references comprise now been retracted, all co-authored by Mohammad Taheri, a genetics PhD student at Friedrich Schiller College of Jena in Germany. He says that criticisms of his work on PubPeer “lack solid scientific foundation”. But, in Would possibly maybe well well maybe also merely, a co-creator of two of those works, Marcel Dinger, dean of science at the College of Sydney in Australia, told Retraction Ogle that he used to be reassessing review papers that cited retracted articles. He now says that his crew has submitted corrections for the works, but Frontiers, which printed one paper, says it hasn’t bought the correspondence and may maybe well maybe furthermore merely review. Elsevier — which printed the opposite two papers — also says that it is inspecting the disclose.
Catching problems early
Examples throughout which papers cite already-retracted work point out that publishers may maybe well maybe furthermore diagram a smarter job of screening manuscripts. For occasion, 20 stories cited by a 2023 review paper10 about RNA and gynaecological cancers in Frontiers in Oncology had been retracted before the article used to be submitted. Review co-creator Maryam Mahjoubin-Tehran, a pharmacist at Mashhad College of Scientific Sciences in Iran, told Nature that her crew didn’t know in regards to the retractions, and would no longer idea to update or withdraw the paper. The writer, Frontiers, says it is investigating.
Till at the moment, publishers comprise no longer flagged citations to retracted papers in submitted manuscripts. Nonetheless, many publishers convey they are attentive to Cabanac’s tool and video display disorders he raises, and some are bringing in identical screening instruments.
Closing 300 and sixty five days, Wiley announced it used to be checking Retraction Ogle’s database of retracted articles to flag disorders in reference lists, and Elsevier says it is also rolling out a tool that assesses manuscripts for red flags similar to self-citations and references to retracted work. Springer Nature is piloting an in-home tool to gape for retracted papers in manuscript citations and Longobardi says the IEEE is serious about collectively with Feet of Clay or identical solutions in its workflow. A working crew for the STM Integrity Hub — a collaboration between publishers — has also tested the Feet of Clay Detector and “chanced on it indispensable”, says Welschot.
Scientific model
Scientific reviews that cite stories in areas later shown to be tormented by fraud are a routine theme in Cabanac’s findings.
In idea, meta-analyses or systematic reviews must be withdrawn or corrected if work they’ve cited goes on to be retracted, according to a protection issued in 2021 by the Cochrane Collaboration, a international crew identified for its gold-fashioned reviews of medical treatments.
Boutron, who directs Cochrane France in Paris, is the utilize of Cabanac’s tool to name systematic reviews that cite retracted work, and to evaluate the impact the retracted stories had on the final outcomes.
Nonetheless, a 2022 stare11 means that authors are principally reluctant to update reviews, even after they are told the papers cite retracted work. Researchers e-mailed the authors of 88 systematic reviews that cited now-retracted stories in bone smartly being by a Japanese fraudster, Yoshihiro Sato. Simplest 11 of the reviews had been up as a lot as now, the authors told Nature last 300 and sixty five days.
Retraction signals
Authors aren’t routinely alerted if work cited in their previous papers is withdrawn — though in most modern years, paper-administration instruments for researchers similar to Zotero and EndNote comprise included Retraction Ogle’s originate database of retracted papers and comprise begun to flag papers which were taken down. Cabanac thinks publishers may maybe well maybe furthermore utilize instruments fancy his to make identical signals.
In 2016, researchers at the College of Oxford, UK, started developing a tool called RetractoBot, which routinely notifies authors by electronic mail when a stare that they’ve previously cited has been retracted. The gadget for the time being shows 20,000 retracted papers and about 400,000 papers, printed after 2000, that cite them. The crew slack it is working a randomized trial to see whether or no longer papers flagged by RetractoBot are therefore cited lower than those no longer flagged by the tool, and may maybe well maybe furthermore merely submit its outcomes subsequent 300 and sixty five days, says mission lead Nicholas DeVito, a integrity researcher at Oxford.
The crew has alerted better than 100,000 researchers to this level. DeVito says that a minority of authors are pissed off about being contacted, but that others are grateful. “We’re merely trying to make a service to the community to diminish this prepare from taking place,” he says.
References
-
Sandhiya, M. & Aneetha, A. S. ninth Intl Conf. Orderly Struct. Syst. 1–4 (2023).
-
Nazari, A. Mater. Res. 15, 383–396 (2012).
-
Nazari, A., Khalaj, G. & Riahi, S. Math. Comput. Model. 55, 1339–1353 (2012).
-
Shih, B.-Y., Chen, T.-H., Cheng, M.-H., Chen, C.-Y. & Chen, B.-W. Nat. Hazards 65, 1637–1652 (2013).
-
Salar Elahi, A. & Ghoranneviss, M. IEEE Trans. Plasma Sci. 41, 334–340 (2013).
-
Viera, G. M. et al. Clin. Transl. Oncol. 21, 1583–1623 (2019); editorial expression of disclose 26, 1806 (2024).
-
Taheri, M. et al. Exp. Molec. Pathol. https://doi.org/10.1016/j.yexmp.2021.104602 (2021).
-
Taheri, M. et al. Front. Mol. Biosci. https://doi.org/10.3389/fmolb.2021.665199 (2021).
-
Ghafouri-Fard, S. et al. Biomed. Pharmacotherapy 137, 111279 (2021).
-
Rezaee, A. et al. Front. Oncol. 13, 1215194 (2023).
-
Avenell, A., Bolland, M. J., Gamble, G. D. & Grey, A. Fable. Res. 31, 14–37 (2022).