Guest post Medicine Research integrity Smut Clyde

Texas Photoshop Massacre (in Nature)

The team around the paediatric oncologist Nabil Ahmed at Baylor College of Medicine in Houston, Texas, discovered a way to engineer T-leukocytes to bypass the blood-brain barrier at attack otherwise untreatable brain cancers. Their amazing technology to get this published in Nature was brazenly insolent data fakery.

The Nobel Prize in medicine was awarded in October 2018 for a technology of designing T-cells of the immune system to attack cancer, to scientists from Japan and Texas, USA. Incidentally just days before, Nature published a breakthrough article where some other scientists from Texas discovered a way to engineer T-leukocytes to bypass the blood-brain barrier and attack otherwise untreatable brain cancers. A lease to life and a hope for cure, for millions of brain tumour sufferers, many of them children, all thanks to the team around the paediatric oncologist Nabil Ahmed at the Texas Children’s Hospital at Baylor College of Medicine in Houston. His lab might be small, but Dr Ahmed engaged a huge team of colleagues from Baylor College and elsewhere in Houston, Harvard, Canada and even Children’s Cancer Hospital in his home country Egypt, where the first author Heba Semaha is affiliated.

The scientific technology to get there, to spare you the complicated specialist jargon, is brazenly insolent data fakery. That, and Nature‘s tremendous impact factor, is apparently how we will defeat cancer. Smut Clyde will guide you though it, but even he has no clue how to transfer that degree of fraudulent photoshopping into clinic.

Texas Photoshop Massacre (in Nature); by Smut Clyde

Like the Force, and like duct-tape, the new digital media of science publishing have two sides. There is an admirable, encouraging trend for research reports to provide access to the experimental data with links to an archive. Over on the Dark Side, though, freed from the pressure of page space to enforce discipline and difficult choices, Figures are bloating out into unstructured, unselective omnium-gatherums. Multiple panels form a smorgasbord of cell-biology methods, depicting all aspects of an experiment in different plotting techniques, with no unifying theme or graphical coherence: grasping the logic of any one panel brings you no closer to understanding the next one.

A homing system targets therapeutic T cells to brain cancer

This recent Samaha et al Nature 2018 paper illustrates both trends. The 16 Figures (six in the main article and 10 in Supplementary Data) are like David Salle post-modernist / neo-figurative paintings: juxtapositions of multiple graphic styles, without privileging any one style as higher-priority than the others. They give me a headache. It is as if the 27 authors all contributed something, and between their 25 academic affiliations they could not agree on what to leave out.

The paper holds out the prospect of effective immunotherapy of otherwise-intractable brain cancers, by redesigning immune cells for better penetration of the blood-brain barrier. Spotting its potential as a source of citations and an adornment to the journal’s reputation, the Nature editors singled it out for headlines in the News and Views column (“T cells engineered to home in on brain cancer“), and extending the cruise-missile metaphor, as a Research Highlight in the Nature Immunology section (“Missile guidance for brain tumors“). With so many institutions claiming credit for it, the press release was circulated and went prokaryotic viral across the science-churnalism sites.

In an Update on October 25 the paper acquired the Scarlet Letter of Shame in the form of an “Editor’s Note”, which may or may not have been meant as a passive-aggressive form of an “Expression of concern”. Even now the authors will be trying to work out which of them (and how many) were responsible, and how much of the paper is salvageable. Quite possibly it will be cited often in years to come, but not in a favourable way. For as well as illustrating the trends I began with, it is also a showcase of different ways of fabricating results. One could prepare an entire Data-Faking Masterclass around it.

The critical discussion thread at PubPeer is currently up to 46 comments. It began on October 16 — six weeks after the publication date of September 6 — when ‘Gymnopilus Purpureosquamulosus‘ observed the presence, within the line-ups of fluorescent murine corpses, of some identical-twin pairs of mice.


The reuse of a few mouse portraits could be an innocent error, from researchers paying too little attention to mouse individuality. This is Nature, so duplicated images could in fact be convergent evolution. But the commentator also remarked on many other repetitions within the Figures. Subsequent commentators explored further connections, and alternative methods of dramatising the data-integrity concerns. I have picked out a few subthreads.

Readers come to ‘For Better Science’ expecting to see dodgy Western-Blot electrophoresis gels, and I am happy to oblige. G. Purpureosquamulosus pointed out a triplicated gel lane within Supplementary Figure S2A, supposedly representing the expression of a certain protein in different cell lines. Not just any protein, but the Activated leukocyte cell adhesion molecule (ALCAM), which is the central point of this whole exercise in Nature.


Leucanella Acutissima‘ extended this to Figure S2A, noting that “Many of the lane similarities are partly obscured by vertical or horizontal squishing, or by flipping”, while increasing the contrast of both images with a pseudocolour gradient map to emphasise the replications.


‘Salsola Zygophylla‘ preferred to regroup the lanes to show their family relationships.

Any attempt to redesign T-cell signalling will involve flow cytometry and FACS plots: histograms (or two-dimensional distributions) of how many cells are found with different levels of some protein (or proteins) expressed on the outside of their cell membranes. Cells of the desired kind are cultured under the desired conditions, and decorated with fluorescent flags attached to those proteins so that they can be measured and counted as they are pumped down a narrow pipeline.

If identical histograms result from completely different cell lines, treated in different ways, then there is something seriously wrong. Unless you are an Italian university rector, then duplications are perfectly scientific.

Below at left here is G. Purpureosquamulosus‘ original observation of identical two-dimensional cell-count plots in Figure 6A. At right is an extension from ‘Pseudonocardia Adelaidensis‘, where certain plots have been coloured either red or blue, and then overlapped with semi-transparency, so that dots (cells) with identical protein levels (coordinates) in both plots appear as purple.

When more points overlap than chance could explain — the vast majority of points, perhaps — this could be a clue that both plots come from the same raw file of flow-cytometry data, but with different “gating” parameters for excluding spurious signals. Unless of course you are a certain Italian university rector, then FACS improbability is your friend.

A white patch slapped over a FACS histogram, and The Nature is fooled.

While on the topic of raw data, we have already noted the admirable trend to provide or link to raw data. This opens up new possibilities for colour-coding, as here for the Source Data for Figs 4c and 4d, to emphasise values which appear (a) unexpectedly often, or (b) in parallel between columns that come from different experiments and should be independent.

Or one can just graph the values from any two columns in a scatter-plot, expecting a chaotic cloud of points because of that independence. Certainly not expecting a diagonal line.

Which reminds me of how a scatter-plot appears twice in the paper, illustrating different associations between protein expression. Somehow the same distribution of points is summed up by two different correlations.

In Figures 4g and S5d, each panel is a kind of distribution of distributions. The goal is a statistical comparison, within each panel, between the populations of normal, control T-cells and altered, HS-expressing cells — the left-hand and right-hand columns respectively.

g, Characterization of migrating T cells through collective quantification of actin MFI, focal adhesions, area of spreading, and podosynapse formation by high-throughput deconvolution microscopy at HS–ALCAM interface in a representative donor (n = 200–800 cells per condition). Each column represents cells in one well.


Although the panels show different measurements, sets of columns recur (with some variation in the horizontal NT and HS bars, i.e. which columns are included in which group for statistical purposes). This phenomenon could be described in several ways but “admirable thriftiness” is as good as any.

These repetitions are glaringly obvious once they have been pointed out. They are impossible to unsee. It is tempting to criticise the reviewers, and the authors of the approbative side-columns in Nature, for not spotting them… they should be looking at themselves and thinking about their poor life choices. But we need to ask ourselves here, “Would I have done any better without image-enhancement and prompting and priming?”


Is it reasonable to expect peer-reviewers to spot the cyclic repeating snaggle-teeth of Figure 1c? ‘Condylocarpon Amazonicum‘ noted this “scenic plot” of “autumnal forest colours”, “the forest march[ing] on in regular step”, but that observer was already in ‘data sleuth’ mode: assuming that the data are flawed somewhere and should be scrutinised until the flaws are found. Should this adversarial approach become part of a reviewer’s duties?

I have hardly started on the bewildering succession of enhanced and highlighted diagrams within that PubPeer thread. You should read the whole thing; it will help you imagine the plight of the peer-reviewers, confronted with a bewildering succession of diagrams in the original manuscript.

Data malfeasance is not a new phenomenon, of course. It may or may not be encouraged by the new possibilities of digital publication… or by a third trend, where funding bodies are encouraging researchers to network themselves into large-scale collaborations across institutions and across countries. This is just a particularly high-profile case, thanks to the publisher’s decision to broadcast the paper through press releases and science churnalists.

We eagerly await the outcome of the editorial investigation into the paper’s integrity (announced on October 25), to see who will be singled out as a scapegoat. It is hard to believe that a single rogue author could have faked so many different modes of data collection / presentation.

Update 20.02.2019. The paper has been retracted today. Only the first author Samaha did not sign the retraction:

“The authors are retracting this paper to correct the scientific literature, due to issues with figure presentation and underlying data. The authors cannot confirm at present the results in the affected figures and thus would wish to retract the paper”.


Update 20.05.2020

What did Nature learn from that affair? Nothing. Nabil Ahmed and his coauthor of the retracted Nature paper Michael Taylor from University of Toronto just published in Nature Medicine. This appeared on 27 April 2020:

Donovan et al Locoregional delivery of CAR T cells to the cerebrospinal fluid for treatment of metastatic medulloblastoma and ependymoma Nature Medicine (2020) doi: 10.1038/s41591-020-0827-2

The paper contains exactly same kind of fake mice as the previous one.


If you are interested to support my work, you can leave here a small tip of $5. Or several of small tips, just increase the amount as you like (2x=€10; 5x=€25). Your generous patronage of my journalism will be most appreciated!


46 comments on “Texas Photoshop Massacre (in Nature)

  1. I am afraid there are many more problematic issues in publications from the research institutions behind this Nature “article”. Expect to see a landslide of problematic issues posted at Pubpeer!

    It is really sad to think about all the resources wasted, but the worst is that these guys are heading for the clinic. Would you like to send your kid for experimental treatment based on fakery?

    The affiliation lists for the authors are equally impressive as the magnitude of fakery:

    Nabil Ahmed:
    Center for Cell and Gene Therapy, Texas Children’s Hospital, Houston Methodist Hospital and Baylor College of Medicine.
    Interdepartmental Program in Translational Biology and Molecular Medicine, Baylor College of Medicine.
    Department of Pediatrics, Baylor College of Medicine.
    Texas Children’s Cancer and Hematology Centers, Texas Children’s Hospital, Baylor College of Medicine.
    Department of Pathology and Immunology, Baylor College of Medicine.


  2. Weissmüller

    The paper has been retracted.


  3. The authors are retracting this paper to correct the scientific literature, due to issues with figure presentation and underlying data. The authors cannot confirm at present the results in the affected figures and thus would wish to retract the paper. Authors Antonella Pignata, Kristen Fousek, Jun Ren, Fong W. Lam, Fabio Stossi, Julien Dubrulle, Vita S. Salsman, Shanmugarajan Krishnan, Sung-Ha Hong, Matthew L. Baker, Ankita Shree, Ahmed Z. Gad, Thomas Shum, Dai Fukumura, Tiara T. Byrd, Malini Mukherjee, Sean P. Marrelli, Jordan S. Orange, Sujith K. Joseph, Poul H. Sorensen, Michael D. Taylor, Meenakshi Hegde, Maksim Mamonkin, Rakesh K. Jain, Shahenda El-Naggar and Nabil Ahmed agree with the Retraction. Author Heba Samaha disagrees with the Retraction.
    ’nuff said.


  4. Finally! Congratulations to all the scientists that do care about science and actively reporting research misconduct.

    Translation: “Issues with figure presentation and underlying data” = “fraud”


  5. I hear the NEJM review featuring this paper was retracted as well. Bummer for the authors, who accepted the commission in good faith. Of course they should have noticed that this turkey was fake from soup to nuts. As should all of the authors.


    • It’s easy to comment and see the fakeries after people have pointed out the problems, but I wonder how many people with real jobs, busy scientists, who were asked to write a review of the work would have scrutinized it that closely to find the errors.

      The high horses of some the Internet warriors can be almost as gag-inducing as the fraudulent scientists.


      • Somebody else

        @ BosSciGuy
        For you, these people have real jobs, but paying attention to what they write is not part of it. If they don’t know what they are talking about, why do they accept to write a review in the NEJM? Maybe to raise their H index, which keeps them busy. The whole system is rotten.


  6. I review lots of papers. First thing I do is look at the figures without even reading the legends. I would have sniffed that turkey out in seconds. But then I do flow cytometry, western blots, microscopy, etc. with my own hands. High-level operators who have no clue about technical details should never be let near a review. Or at least they should hand the paper on to underlings who know the score. This paper was clearly kept away from anyone who knew anything about what was done therein throughout its entire gestation, evaluation and publication. Good thing somebody eventually read it. By Nature standards this is a lightning retraction, which speaks to what a total failure it is.


    • “High level operators who have no clue about technical details should never be let near a review.”

      I find that interesting because above you voiced your dissatisfaction with those who authored the NEJM piece and their inability to sniff out the obvious fakery. The NEJM isn’t soliciting post docs or lab technicians to write these pieces. They’re soliciting busy lab heads who generally aren’t taking a paper’s digital images of westerns blots and running them through photo editing tools to help suss our image manipulation.

      My point is – it’s easy to pass blame on busy reviewers when you have the luxury of seeing the story unfold before your eyes. We can only take your word for your real world track record on this stuff. I simply urge a little bit of humble pie. I actually liked the one commenters suggestion that a 3rd party review it for fakery. I think the journals, especially the prestigious ones, should pay for that.


  7. “They’re soliciting busy lab heads who generally aren’t taking a paper’s digital images of westerns blots and running them through photo editing tools to help suss our image manipulation.”
    Precisely my point – these people are technically incompetent. And apparently never heard of PubPeer, either.
    Of course the journal failed here. Their editors are primarily concerned with sniffing out hot papers, not checking for veracity. That is well proven. Thank the gods for JBC, JCI and the (few) other competent outlets.
    The one who really needs a big slice of humble pie here is the first author of the massacre, still clinging to a fantasy.


  8. the paper has been retracted. but the story behind remains obscure. no further explanation? what is the consequence for the authors? no aftermath?


  9. Blame it on the postdoc/student/RA and carry on. Ahmed is too big to fail, like Boeing.


  10. So which lessons did Ahmed draw from the Nature retraction? That his university is behind him, his other 10 papers on PubPeer were not a problem at all. There were not even corrections, one measly expression of concern in Journal of Clinical Investigation from August 2019, which is obviously never going to be resolved.

    And now Nature Medicine did two interesting things. First, they accepted a paper from Ahmed despite his previous retraction for fraud in Nature (similar to how Nature Medicine published a paper from Carlos Lopez-Otin after he retracted for fraud in Nature Cell Biology). Accepted without looking, because the paper was utterly fake, with no less than 49 image duplications. All Ahmed had to do is hide himself among the co-authors.

    Laura K. Donovan, Alberto Delaidelli , [….] , Poul H. Sorensen, Nabil Ahmed, Michael D. Taylor Locoregional delivery of CAR T cells to the cerebrospinal fluid for treatment of metastatic medulloblastoma and ependymoma Nature Medicine (2020) doi: 10.1038/s41591-020-0827-2 

    Here are some of the 49 duplications:

    So the second thing which Nature Medicine did was to issue a correction for that fake paper, reminding you that conclusions remain unaffected. And Ahmed is now restored as corresponding author, meaning he can draw even bigger grants from it now.

    This is how the Corrigendum, published on 27 April 2021, started:

    “In the version of this article initially published, a corresponding author (Nabil Ahmed) was not identified as such. The correct citation should include an ‘envelope’ icon that links to the following email address:

    There were 49 duplication or placement errors in BLI images (Figs. 1, 3 and 4 and Supplementary Figs. 2, 3, 4, 6, 7, 10, 13 and 15) and H&E images (Supplementary Figs. 1, 2, 4, 7 and 15). The correct images are now provided, and a complete list of the images that were corrected is included in the table here. These errors happened during the preparation of the final version of the figures, which comprised over 2,500 BLI and H&E image panels, and did not affect the results of the paper, as quantification was done using primary data acquired at the same time as the imaging and was independent of images presented in the figures.”


Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

%d bloggers like this: