Academic Publishing Guest post Smut Clyde

Dark Satanic Papermills

Smut Clyde investigates two more Chinese paper mills. One teamed up with an obscure Italian publisher, the other offers access to respectable society journals. How much of published and allegedly peer reviewed science is real?

If you enjoyed Smut Clyde’s masterpiece about a Chinese paper mill, currently covering over 400 papers (I know you enjoyed it!), here is your follow-up, with two more paper mills. Their customers are Chinese doctors and academics, who know how to game a crooked system with an impressive-looking research output, all without ever entering a lab.

The investigation was done by Smut Clyde, helped by Elisabeth Bik, Morty and Tiger BB8. For background, please read the Papermill 1 story, which was complemented by Elisabeth’s Bik blogpost, “The Tadpole Paper Mill“. Not a single paper of the currently over 400 has been retracted so far.

The new papermill lists are available for your perusal here: Papermill 2 and Papermill 3. There are also pdf copies:

The first paper mill seems to have partnered with the obscure Italian scholarly publisher Verduci Editore, which is run by Mariella Verduci and which issues the European Review for Medical and Pharmacological Sciences (ERMPS). The journal is edited by two internal medicine professors of Università Cattolica del Sacro Cuore, most other editorial board members are Italian university doctors, many from the same Sacred Heart Catholic University in Rome, but there are also several Chinese names.

54 entirely artificial, made-up papers were recorded there, out of the total of 69 fabrications Smut Clyde attributes to that Chinese paper mill. The Verduci journal boasts an Impact Factor of 2.7 and has a price list which works according to word count, if you are in a hurry, there is a Fast Track for €1800 plus VAT, or more. The publisher warns: “The accepted articles must be paid before the publication and not over 5 months, otherwise, it will be withdrawn.” But do not be fooled that ERMPS is Open Access because even “Paper reprints shall be charged“. Copyright must be signed over to Verduci Editore already at submission stage:

The original completed Copyright Transfer Agreement must be signed by the corresponding Author and sent by e-mail to European Review for Medical and Pharmacological Sciences.”

Which means, the papermill operators organised the payment and signed copyright transfer, because as Smut Clyde found out, the corresponding authors’ email addresses are as trust-inspiring as their science. However, there is also an editorial ethics statement which concludes with:

European Review for Medical and Pharmacological Sciences disapproves any kind of malpractice and unethical practice.

Maybe it is a typo, and Verduci Editore meant to say “ERMPS approves any kind of malpractice and unethical practice as long as we are paid on time”?

The other paper mill seems to be more professional, presently 57 papers were attributed to it by Smut Clyde. It fabricates papers about the amazing medical efficiency of Traditional Chinese Medicine (TCM), just as the Communist Party of China likes it. Smut Clyde suspects that the owners might be working at the Affiliated Hospital of Qingdao University, in Shandong, China.

Whereas it is quite possible that some of that papermill’s target journals, like Verduci’s ERMPS or Elsevier’s Biomedicine & Pharmacotherapy or Life Sciences have no qualms about publishing fraudulent rubbish, other scholarly publishers in the list should have known better. How did ever the German Society of Experimental and Clinical Pharmacology and Toxicology (DGPT) or the American Association for Anatomy become party to the scam?

Left: Fig 1D Lin et al Life Sciences 2019. Right: Figure 1d Wang et al, Naunyn-Schmiedeberg’s Archives of Pharmacology 2019. No common authors.

What if nobody cares, as long as the journal pages are filled with something at least distantly resembling a kind of science, and as long as the publication charges are paid?

Update: as Roland Seifert, Editor-in-Chief of Naunyn-Schmiedebergs Archives of Pharmacology, explained below, his journal routinely uses iThenticate software to screen for textual overlap. And yet all of these papermill productions apparently passed the test, which means they have been each purposefully written to evade editorial text plagiarism checks (there is no established software to detect image reuse). Quality forgeries, Made in China.


Dark Satanic Papermills

By Smut Clyde

We live in interesting times. The role of academic ‘papermills’ within the bogus science ecosystem – facilitating and benefiting from the flow of funding from governments to publishers – has become a topic for academic research in its own right (Christopher, 2018; Byrne & Christopher, 2020, Bik, 2020). Things have changed since Nature and Science both rejected Guillaume Filion’s (2014) discovery of a meta-analysis papermill (later reported in in Scientific American by Charles Seife). I expect this research area to grow, and readers must decide whether this post is really the product of my own investigation, or written by a papermill (commissioned to fabricate the results because I was too busy with administrivia).

First a few general points. When the suspicion arises that someone has built their scientific career upon unofficial methods of constructing results, a whole corpus of data is available for close scrutiny to check for creative recycling. Papermills are harder targets because their duplications are distributed across confections signed with different clients’ names.

We can make some distinctions. The lower end of the market is shared among chancers who once worked as pipette jockeys in a real lab, before departing with a stash of purloined images from their single area of training, plus a willingness to improvise wildly about whichever other forms of data are demanded by the conventions of the biomed-paper genre (undeterred by unfamiliarity with them). They get away with it because journal editors don’t care.

At the high end are people with established, well-funded laboratories, who can access archives of images of (say) fluorescent mice and tissue-cultured cell spheroids. They supplement their incomes by moonlighting, providing bespoke papers to anyone whose CV has fallen stagnant, drawing on these archives for illustration. These cases only come to light through a combination of accident, and mad phrase-searching google-fu.

H/t Raymond M. Schiffelers

So we are only “scraping the surface of the iceberg” (h/t BBB Scientist). Really there is no excuse to get caught at all, but the bogus papers often strew clues to betray themselves. Perhaps the papermill studios think it is more sporting to provide an honest chance to spot the imposture, or else they are afflicted with some kind of gaes.

Anyway, the NIH PubMed indexing database is a useful research resource. People talk trash about PubMed for extending its aegis over predatory journals and bottom-of-the-barrel newsletters of desperation… wasting public money, while lending an imprimatur of approval to papers that are no more than paid press releases. I agree, publishers like ‘e-Century’ – one guy in Wisconsin selling a cheap way for his Chinese colleagues to say they published in an International Journal – are equal parts heinous and hilarious; and if I were a US resident, I would want to know why federal funds are spent hosting the scammer’s website and subsidising his operation.

But in the defense of PubMed, the “Similar Articles” option on its front-end is invaluable for multiplying the number of examples: provide it with one papermill production as the target and you hit the JAK/STAT jackpot every time, more cases spill out across the floor until you are knee-deep in them.

This uncanny accuracy is not really a tribute to the sophistication of the similarity algorithm, and more a reflection of the formulaic, template-based nature of papermill composition, where not only the titles are constructed by Mad-Libs. The similarities are glaring, in other words, except to the journals’ editors and reviewers.

Bik Title Generator

Papermill 2: Italian catering

The first atelier to concern us today uses a single journal as the conduit for most of its torrent of fabrications (there is no telling whether the productions were tried elsewhere but were rejected). This limits the extent of damage the atelier can wreak upon the integrity of the larger scientific edifice, but it still deserves our attention as an instructive microcosm of the industry.

The entrepreneurs evidently began with a small repertoire of Annexin-V / Propidium Iodide FACS files (measuring the proportion of dying cells in a cell culture), these being quite possibly genuine, which they customise from one manifestation to the next with additional stippling of points around the edges.

These stand in contrast to the papermill we met a few weeks ago, with its risibly unrealistic “Death-Star-&-Cigar” speculations of what a real FACS plot might look like.

Though that previous papermill sent over 400 known papers down the pipeline, while only 70 have been identified from the present subject of inquiry, so implausibility is not an obstacle and editorial skepticism is only hypothetical.

The studio also possesses a stock of EdU / SSC flow-cytometry data-files, which are sometimes collapsed down to a single horizontal axis to be plotted as a histogram, while at other times they manifest as a pair of lungs (e.g. Wei et al 2019; Dong et al 2019).

Original WB generator: Swift [1726]

Western Blots are the key distinguishing feature. Like the previous papermill, this one lacks a library of stock images (as well as any clear notion of the actual gamut of Western Blot variation). Their chosen style for faking them is a grid of geometrical thick and thin blobs, drawn on a featureless flat gray background. Initially these were high-contrast and sharp-edged, like Morse Code messages painted by Miró with black ink on chrome…

…but in 2019 the studio shifted to a softer-focus version where faint wisps of smoke hang in the foreground. Presumably this was an aesthetic choice, as overcoming the skepticism of peer-reviewers is not really an issue here.

Of the 69 productions so far identified from this studio, 54 appeared in the European Review for Medical and Pharmacological Sciences (ERMPS). The journal’s Editors and peer-reviewers have an expansive mental conception of “What Western Blots should look like” which includes these present examples. The ERMPS Editors also display a high-minded unconcern as to the ways that authors might identify themselves: in many, many cases there is no discernible connection between the Corresponding Author’s name and their email address. With an e-address like “ppfrrbfbrt@sina.com” there is no discernible connection to anything except a sound-effect of Bill the Cat blowing raspberries.

It is almost as if the papermill sometimes creates an identity and email account to handle manuscript submission for one customer (it is best to keep the nominal authors of ghost-written manuscripts locked out of the submission / revision / re-submission loop; their involvement in the cycle never ends well), then sees no reason to change these details when submitting another manuscript (or the same one) in the name of a second client. The alternative explanation is that a surprising number of Chinese academics prefer to handle their academic correspondence using their Tinder accounts. From the perspective of the journal, none of this matters as long as their cheques clear to pay the APCs.

The customers are distributed across China, with no obvious epicentre.

Papermill 3, the society insiders

PubPeer contributor “Xylocampa Areola” called attention to the third of the papermills. I created a spreadsheet to match but it is a work in progress, with only 35 38 42 48 entries to date, though that will grow and the seam is far from mined out.

To generalise from the present limited sample: this oeuvre is marked by an unusual level of internal self-citation. That is, commissioning a paper is an entire package that includes citations of one’s “work” accruing from later papers bought by other customers. This provides another way of finding new examples, when the PubMed ‘Similar Papers’ option runs dry.

In consequence these papers form a kind of self-referencing, internally-consistent canon of Alternative Molecular Biology. It is as if a textbook fell out of a parallel universe and into what we like to call “reality”: another universe in which the pharmacopoeia of Traditional Chinese Medicine works and cures cancer, and all that remains is to determine the mechanisms. So the title template is [traditional-herb-extracted phytochemical / secondary metabolite] [promotes apoptosis / abrogates metastasis / deters proliferation] of [hepatoma / colorectal carcinoma / lymphoma / glioma / other cancer-cell-line].

I note parenthetically that a minority of entries in the spreadsheet use different Worship Words from a different paradigm to convince editors that the discoveries are important. Specifically, LncRNA-XIST appears twice in this corpus, and miR-137 once. The favourite cancer-curing phytochemicals are Physcion (17 papers), Euxanthone (6), Alpinumisoflavone (6) and Hispidulin (5). Amentoflavone, Xanthoangelol, Soyasapogenol, Resibufogenin, Chrysophanol and Icaritin / icariin appear twice each; Furowanin A, FL118 and PTTG once each. Those authors are riding the miRNA / lncRNA bandwagon, which shares TCM’s advantage that there is no reputational damage from failures to replicate one’s report that “miRNA XXX affects Y through pathway Z”.

A major driver of the rising tide of biomed forgery was the decision by the Chinese Central Committee, in their collective wisdom, that TCM shall be made to work. This created well-remunerated careers for researchers willing to deliver progress reports towards that destination, with the prospect that the PIs will have been elevated to the Academy of Sciences by the time that each once-promising research avenue is quietly abandoned and never mentioned again. Their decision also spawned journals to accommodate those progress reports.

Every so often in this neo-herbalist literature one encounters papers where the WBs and flow-cytometry plots and IHC-stained tissue slides are not recycled or blatant fakes, for there are researchers who may be inventing their positive results, while still conducting experiments to provide cherry-picked illustrations for those illusory claims. But in general, who would bother?

Putting that digression behind us, we can consider the unifying diagnostic features of this papermill oeuvre (these are also insights into the image archives in the millers’ possession, and into their laboratory resources). They have a good enough supply of Western Blots that they do not need to fabricate them, and if they sometimes reprise these images due to pride in their perfection, who am I to cavil?

Evidently the limiting resources are:

1. Images of Matrigel migration / invasion assays and scratch migration assays.

2. A few excised xenograft tumors on black backgrounds, measured to quantify growth rates.

3. Immunofluorescence microphotography.

4. The stock of IHC tissue slides is small so they must be creatively relabelled and arranged in many combinations, without the luxury of settling on a single tumour type or protein or treatment regimen. If I showed more examples here, someone would accuse me of flogging a dead horse with another dead horse.

5. One recurring suite of flow-cytometry apoptosis plots has an ominous, thundercloud appearance. Perhaps the Society for the Prevention of Cruelty to Dead Horses will forgive me for this montage.

This evolved into a second suite which is customised more between appearances, with the upper-right quadrants of the plots becoming venues for fiestas of clone-tool stamping, or a kind of Space Invaders game.

The reviewers can be forgiven for not comparing the figures in the manuscript before them with others in the literature, but it is harder to understand how they remained so oblivious when lightly-tweaked versions of the same panels appear in multiple adjacent figures within a single paper. I had heard that sciences other than physics are just stamp-collecting, but that doesn’t mean that rearranging stamps in a collection is enough to make it science.

A third suite has shown up less often.

The evidence suggests that the millers are not just catering to clinicians, for whom an English-language publication is a one-off: a quaint prerequisite for graduation, like hiring a formal academic gown for the ceremony, though more expensive. They also have a clientele of actual academics, frequent fliers who are paying repeatedly and buying entire research careers (and CVs). The scale of cross-citation is one reason for this belief (I). In addition:

II. Authors’ names repeat, even in this small sample.

III. Many affiliations are to research institutions or to hospitals at a high level, rather than to specialised clinical departments.

The most frequent names are in fact a group from Qingdao Hospital. They were authors of the earliest papers in this corpus, in 2016, in e-Century outlets (before the studio’s ambition grew and they advanced to the giddy empyrean of purportedly non-predatory journals from the Elsevier stable) – creating the unexpected spectacle of highly-cited e-Century papers. Their papers displayed many forms of illustration before these were manifested elsewhere, and they have been known to sign papers with actual institutional email addresses. In fact I would not be surprised if the Qingdao team are the papermill… originally forging for their own papers in an amateur capacity, before they succumbed to the blandishments of friends and colleagues brandishing cash, and turned professional.

Their output is not concentrated in any one journal. No-one will be surprised by the prominence of Elsevier journals (nine papers in Biomedicine & Pharmacotherapy; six in Life Sciences; four in Pharmacological Reports). Less expected are the seven in Naunyn-Schmiedeberg’s Archives of Pharmacology – the “official journal of the German Society of Experimental and Clinical Pharmacology and Toxicology” (published by Springer). And surely a story lies behind the acceptance of four of these anatomy-free pharmacological fantasies by Anatomical Record, brought to us by the American Association for Anatomy, and published by Wiley. I have not examined the archives of these journals systematically; I don’t do “systematic”.


The two papermill lists are available for your perusal here: Papermill 2 and Papermill 3.

Donate!

If you are interested to support my work, you can leave here a small tip of $5. Or several of small tips, just increase the amount as you like (2x=€10; 5x=€25). Your generous patronage of my journalism will be most appreciated!

€5.00

10 comments on “Dark Satanic Papermills

  1. The Editor-in-Chief of Naunyn-Schmiedebergs Archives of Pharmacology, Roland Seifert, wrote to me that he “has implemented a number of measures to retract the fake papers and avoid future fake papers immediately after he had learned about the severity and magnitude of the problem. He is shocked that this could happen in this journal staffed with excellent and rigorous editors.”

    Like

    • Another message from Naunyn EiC Seifert:

      “I am really shocked about the fakes from China because routinely, every paper submitted to Naunyn-Schmiedebergs Archives of Pharmacology is analyzed with the Ithenticate software. We implemented this already in 2018. After the analysis, the paper is submitted into my folder and I make a first decision about further processing of the paper based on this analysis. All papers with a significant text overlap in any text section (except Materials and Methods, of course) are rejected. Only papers with no text overlap go into the next round. We have also an English language check. Thus, all Associate Editors and myself start the review process with the assumption that the paper is an honest piece of research. I also would like to point out that none of our Associate Editors is part of a “Chinese connection”. I ask for your understanding that I will not publicly discuss the measures that I have undertaken to avoid future fraud. This would most likely facilitate “adaptation” of the fraudsters to the new rules. To answer your question: Yes, the fraudsters know Ithenticate very well and apparently know how to pass this barrier it. This software does not provide the security that we hoped to have. This is important for all journals.”

      Like

      • and another message from Seifert:

        “In the various excellent texts on paper mills the question is discussed why Naunyn-Schmiedebergs Archives of Pharmacology has become a target for fake papers. I oppose the assumption that we simply want to fill pages with pseudo-scientific content. We actually look for quality and good science. We do not look for perceived “impact” or “novelty”.

        The journal has a long tradition of publishing papers in the field of phytopharmacology. Our Instructions for Authors show that we have very stringent rules for such studies. These rules are rigorously implemented. The Chinese science policy to push TCM fits well to the scope of our journal. Therefore, we receive many papers from this field from China. In the past, we have received many papers on complex plant mixtures. Such papers are immediately rejected. However, many of the fake papers deal with pure active components of medical plants and fit to the scope of the journal. This focus which is different from the focus of other pharmacological journals such as BCP, JPET or BJP renders our journal, most unfortunately, an attractive and “natural” target for fraudsters who want to “develop their careers”. Most of the fake papers deal with medical plant constitutents. It was actually our phytopharmacology editor who initially made me aware of the fakes.”

        Like

  2. Pingback: Un po' di serietà, tra parentesi - Ocasapiens - Blog - Repubblica.it

  3. Smut Clyde

    Papermill #3 is boutique in scale, with (I guess) a three-digit production count, but well-run. They’re not ambitious in scope, no dramatic breakthroughs. They only fake small, incremental jigsaw pieces, which other people incorporate in their complete jigsaw puzzles… for these papers are cited! – not just in other productions from the same mill, but also in review papers about the importance of miRNA-XXX or apoptosis pathway YYY. The deal is that you (as customer) specify the herbal extract molecule central to your fake-research career. They dip randomly into their bag of flow cytometry plots, WBs, immunofluorescence and IHC-stained tumor slices, and weave a new story around them about how that molecule controls cancer ZZZ through immunomodulation.

    Individually, each fake only subtracts slightly from our net knowledge. But they add up

    Like

  4. “A major driver of the rising tide of biomed forgery was the decision by the Chinese Central Committee, in their collective wisdom, that TCM shall be made to work.”

    You have to laugh. There does seem to be a shit storm for the Chinese authorities in the media at present. Winnie the Pooh was seen wearing a face mask, except Winnie the Pooh has been banned. As we all know Xi is sylph-like and not at all like Winnie the Pooh.

    https://www.theguardian.com/world/2018/aug/07/china-bans-winnie-the-pooh-film-to-stop-comparisons-to-president-xi

    Like

  5. Smut Clyde

    One example of a loyal customer is Xiaoping Pan, whose research career consists of three papers purchased from mill #3.
    https://www.researchgate.net/scientific-contributions/2120022211_Xiaoping_Pan

    He is even credited in other papers from the mill, for sharing his non-existent transfection vectors!
    https://www.ncbi.nlm.nih.gov/pubmed/30153494

    “The DNMT1 and Sp1 overexpressing vector were kindly provided by Dr. Pan’s Lab[28].”

    Liked by 1 person

    • Funny thing is that this Xiaoping Pan (潘小平)is a Chief Doctor specialized in cardiovascular interventional therapy at Wuhai People’s Hospital (Pan is also a Vice President for the hospital) in Inner Mongolia in China. How come he also has the expertise publishing on cellular research evaluating some compound on liver cancer cells?

      That’s very talented for a single doctor to be specialized in both clinical cardiology and basic science lab research on oncology pharmacology, and obviously TCM.

      http://inews.nmgnews.com.cn/system/2016/11/26/012198475.shtml

      Like

  6. Monumental piece of work. Deeply impressed.

    In a system where critical thinking is punished what do you expect?
    The economic reforms (adopting old-fashioned capitalism) mean than the system will not collapse economically. The Party will not give up power (trials in the morning, executions in the afternoon). It will likely continue in the same direction, or worse, Winnie the Pooh (Xi) is not cuddly.

    Like

  7. Smut Clyde

    The favourite cancer-curing phytochemicals are now Physcion (23 papers), Alpinumisoflavone (9), Euxanthone (7), Hispidulin (7) and Amentoflavone (5). Xanthoangelol, Soyasapogenol, Resibufogenin, Chrysophanol, Icaritin / icariin and Furowanin A appear twice each; FL118 and PTTG once each.

    Like

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

This site uses Akismet to reduce spam. Learn how your comment data is processed.

%d bloggers like this: