Over 30,000 Published Studies Could Be Wrong Due To Contaminated Cells (sciencealert.com) 106
An anonymous reader quotes a report from Science Alert: Researchers warn that large parts of biomedical science could be invalid due to a cascading history of flawed data in a systemic failure going back decades. A new investigation reveals more than 30,000 published scientific studies could be compromised by their use of misidentified cell lines, owing to so-called immortal cells contaminating other research cultures in the lab. The problem is as serious as it is simple: researchers studying lung cancer publish a new paper, only it turns out the tissue they were actually using in the lab were liver cells. Or what they thought were human cells were mice cells, or vice versa, or something else entirely. If you think that sounds bad, you're right, as it means the findings of each piece of affected research may be flawed, and could even be completely unreliable.
Horback and fellow researcher Willem Halffman wanted to know how extensive the phenomenon of misidentified cell lines really was, so they searched for evidence of what they call "contaminated" scientific literature. Using the research database Web of Science, they looked for scientific articles based on any of the known misidentified cell lines as listed by the International Cell Line Authentication Committee's (ICLAC) Register of Misidentified Cell Lines.There are currently 451 cell lines on this list, and they're not what you think they are -- having been contaminated by other kinds of cells at some point in scientific history. Worse still, they've been unwittingly used in published laboratory research going as far back as the 1950s.
Horback and fellow researcher Willem Halffman wanted to know how extensive the phenomenon of misidentified cell lines really was, so they searched for evidence of what they call "contaminated" scientific literature. Using the research database Web of Science, they looked for scientific articles based on any of the known misidentified cell lines as listed by the International Cell Line Authentication Committee's (ICLAC) Register of Misidentified Cell Lines.There are currently 451 cell lines on this list, and they're not what you think they are -- having been contaminated by other kinds of cells at some point in scientific history. Worse still, they've been unwittingly used in published laboratory research going as far back as the 1950s.
Re: (Score:2)
Bannon... is that you?!?!
This is what happens (Score:5, Funny)
This is what happens when you don't let scientist harvest live humans for research... sheesh; and they thought *I* was mad.
Re: (Score:3)
I'm more curious about how many cases that have been contaminated with the HeLa [wikipedia.org] strain which is one of the most known immortal strains out there. Fun fact is that the scientists have grown about 20 tons of that strain so far - that's a huge woman.
Re: (Score:3)
Re: (Score:2)
Re: (Score:1)
Would not make a difference. They switched human lung and human liver cell as well as many other human cells.
Whew (Score:2, Insightful)
The HL-60 line isn't listed there. That's what I used in my research back in the day.
Re: (Score:2)
Re: (Score:3)
Is this [HL-60] the one that contaminated everything? /i?
I am not a biiochemist, but... That seems to be a human leukemia line.
Are you maybe thinking of HeLa - the very hardy immortalized cervical cancer cell line that was the first to be successfully grown in bulk?
I hear there was a model for the progression of cancer that had to be scrapped, because it was really the result of HeLa cells, escaped into laboratory environments, eventually contaminating virtually any cancer cell culture experiment and repla
New revolutionary cure for lung cancer discovered! (Score:5, Funny)
30000 out of how many (Score:2, Interesting)
What percentage of published studies are affected? Sure, 30,000 seems like a ton, and if there is critical work in there it is certainly bad, but if this is 30,000 out of 300 million or some arbitrarily large number of studies, it isn't as catastrophic as the headline suggests.
Re:30000 out of how many (Score:5, Informative)
0,8% - the paper is open access if you want the details.
http://journals.plos.org/plosone/article?id=10.1371/journal.pone.0186281
Re: (Score:3)
0,8% - the paper is open access if you want the details. http://journals.plos.org/ploso... [plos.org]
What percentage of the population is affected by that seemingly small impact?
How many billions (or trillions) in costs are associated with that seemingly small impact?
Risk mitigation relies on asking the right questions. Unfortunately, TFA starts to answer my questions. Oncology is the field most contaminated by a large margin. I'd say it's pretty damn important to understand just how fucked our studies are related to one of mankinds most pervasive killers. Cancer affects a hell of a lot more than 0.8% o
Re: (Score:3)
Re: (Score:2)
You kind hit at the problem in your own answer. I don't give a f*ck if MY wonder drug cures some other cancer. I want it to cure MY particular cancer. If the basic lab research was botched then there will be some very disappointed (and desperate) cancer patients when it comes time for the human trials.
ALL of that is going to cost a big pile of money and make everything more expensive. The successes will have to subsidize the failures (as they always do).
You will end up having to pay a lot more, or your insu
Re: (Score:2)
Re: (Score:2)
FDA GLP/GMP inspections are no joke...
When validating basic research turns into a joke creating 30,000+ contaminated documents, other vetting processes tend to become rather irrelevant.
...New cancer treatments don't come directly out of some pottering professor's lab where the hung over grad students throw something together in the centrifuge after sacrificing a few mice.
After finding 30,000+ mistakes, they might as well have.
Re: (Score:2)
Re: (Score:2)
You will end up having to pay a lot more, or your insurance company will, or your government health care entity will just say "fuck it" and leave you to die because the meds are too expensive.
Looking for the answer in the Medical Industrial Complex fueled by relentless greed?
D) All the above
Re: (Score:2)
Re: (Score:3)
It is important to note that immortalized cell lines are essentially cancer cells in culture. So while using the wrong line due to contamination hurts the direct usefulness of research, it doesn't render that research useless, because the data is still about whether or not the compound of interest killed cancer cells... just different ones than you thought. This sort of thing could be the reason that so many treatments that seem promising in academia fail to pan out when they move to industry with more funding for quality control.
I completely agree with your point. Even though the cells in researches were contaminated, it doesn't render those researches completely useless as long as they can identified what cells they were using in their research. If they could identify the cells they used in their research, then they just need to update the conclusion of their research.
However, the nature of science researches is to cite/refer to previous research results. That said, some (if not most) contaminated cell researches could become less
Re: (Score:2)
Before it was used clinically there would have been in vivo trials, no? I doubt anybody died from this.
Re: (Score:3)
Re: (Score:2)
https://www.youtube.com/watch?... [youtube.com]
The coffee conundrum (Score:2)
Re:The coffee conundrum (Score:5, Funny)
No, that's just the centuries-old fight between coffee-drinking scientists and tea-drinking scientists. There's also a third party of insane scientists who advocate drinking dihydrogen monoxide but they're a minority so you rarely hear from them.
Re: (Score:3)
Re: (Score:2)
That's sort of the whole point of the article though. The author discovered evidence that (amonst other things) historical research findings on tea and coffee related fatalities may have used samples with dihydrogen monoxide contamination that previously went unnoticed all the way back to the 1950s. while correlation does not equal causation, there's a strong body of evidence that anyone who ingests large quantities of dihydrogen monoxide eventually dies.
How much dihydrogen monoxide contamination did the
Re: (Score:2)
Now don't go and quote me on this, but I've heard that even the temperature of said dihydrogen monoxide can skew the results, by a lot.
Henrietta (Score:5, Interesting)
Re: (Score:1)
Shenanigans in ANY science undermine ALL sciences.
You sound like a battered wife trying to defend her husband. The correct response to being abused to lied to is to be distrustful and flee. It's not to make excuses.
Time to get Silicon Valley involved (Score:2)
This is a problem that could be addressed by improved medical databases. Of all the ways in which SV could 'disrupt' medical research and practice, this would be the least controversial.
Re: (Score:1)
Yes, but what is the reimbursement model for that!?! It doesn't involve microtransactions, nor push notification.
I suppose it could.... hmmm....
Re: (Score:3)
Improved medical databases? Blockchain!
Re: (Score:2)
Here, they looked at "research" results. As soon as you have "medical" results, you're constrained by law, not technology. Disrupting laws sometimes works (Uber), but usually not (Theranos).
Re: (Score:2)
I don't believe this for a second (Score:2)
This is exactly the sort of thing that would have been caught during the rigorous, diligent, inherently skeptical peer review process.
But seriously, no wonder most studies can't be replicated by others [bbc.com] -- the odds are high that either the cells in the original study, the attempted follow-on, or both were screwed up.
Re: (Score:2)
* whoosh *
Re: (Score:3)
This is exactly the sort of thing that would have been caught during the rigorous, diligent, inherently skeptical peer review process.
erm... while you seem to be taking a dig at peer review, and I'll happily bend your ear for ages over the flaws of it, this isn't really one of them.
Peer review even at its best is basically a test of "seems legit" before publishing to avoid obvious sloppy mistakes, bad stats, unwarranted conclusions. If someone says "we did X, tested hyothesis Y, got results Z and rejected
Re: (Score:2)
Peer review even at its best is basically a test of "seems legit" before publishing to avoid obvious sloppy mistakes, bad stats, unwarranted conclusions. . . . Peer review is an indication that something is not obviously bogus.
I think you're talking about the idealized version of what peer review was originally intended to be. As we're all aware, over the past few decades the mantra "peer reviewed articles in highly regarded journals" has become one of the prominent measuring sticks used to present whatever topic is currently catching grant dollars as "settled" and try to shut down debate. That's pretty much the polar opposite of "not obviously bogus," and that's what I was taking a dig at.
Re: (Score:1)
What a relief (Score:2, Offtopic)
Re: (Score:1)
Aren't you jealous of their tenure track, though?
Makes me happy... (Score:2)
Still, I wonder how many primary cell lines become contaminated with immortalized in labs where both are cultured in the same space?
Re: (Score:3)
Re: (Score:2)
Re: (Score:2)
Black is white, up is down and short is long.
Re: (Score:2)
His hibachi dealer told him.
This is beyond hard to believe (Score:2)
Can someone who knows more about this process comment how this could possibly be? It smells so much like somebody is feeding us fake information. First off, if this has been a problem since the 1950s, why is it suddenly news that makes it sound like nobody knew of any problems till yesterday? Or is it more like every year we find some bad cells and we need to go back and redo those experiments... and someone decided to add up all problems for the last 100 years and make a write up about it?
Re: (Score:3)
Re:This is beyond hard to believe (Score:5, Interesting)
This has been known for a while, but perhaps not broadly known, and not by "the general public". The link to the ICLAC in TFS is evidence of that.
The actual paper [plos.org] will answer your questions, but briefly: people make mistakes in maintaining cell lines, and contamination is easier than you think, particularly in primary cell lines.
I didn't see the authors mention if reproducibility sorts this out, if someone can't reproduce the results in another cell line or in an animal model, the original results are considered context dependent.
Re:This is beyond hard to believe (Score:5, Informative)
It is a problem that has been known for a long time. Initially we lacked tests to validate the origin of the cell lines. Now we have an established panel of markers that can be used to cheaply and reliably confirm the identity of cell lines. The National Institute of Health, which is the major funding source for biomedical research in the US, requires all funding applications to have a plan for authenticating biological materials including cell lines.
Most of the literature using misidentified cell lines is probably old, although there are still people doing research who are either oblivious to the issue or just don't care. I think the conclusion that all these studies are invalid is an overstatement. Many if not most of these works are likely investigating fundamental biological processes that would be the same regardless of the cell line. The studies that are questionable would be the ones relying on the cell line fatefully preserving the characteristics of the original cell, like studies trying to develop therapies for various diseases or investigating processes carried out by specialized cell types.
There are many other problems that are associated with cell lines that I would think are more serious than the mis-authentication. For starters cells change when they are placed in the dish and loose many of the important characteristics of the originating cell. This means people need to be really careful when deciding if a particular experiment can be done on a cell line. Then there are examples of low level microbial contamination that goes unnoticed by the people growing the cells, but can clearly be detected in gene expression data if you look for it (https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4239086/ if you look at figure 2 of the paper you can see that some labs are consistently sloppy). There is also a host of technical issues that can impact the conclusions of cell line studies ranging from the quality and source of reagents, to the experience of the staff and the techniques used to maintain the cells. These tend to vary a lot across labs and rarely documented in the publications.
Re: (Score:2)
It's not that hard to believe. In every field, and computer science is one as well, many scientific papers are completely wrong with their analysis, and most of the time, it is pretty hard to detect unless you're an absolute expert in the field. Peer-review is supposed to detect bad papers, but finding experts is not always easy, and sometimes everything you read in the paper seems consistent, so unless you try to reproduce it, you can only say "that looks like good work".
Now, that's not the end of the wor
Classic. (Score:3)
This is classic.
The bane of modern utopia.
Efficiency and fragility are directly correlated.
This goes for any system and society.
If there is one thing that has a large chance of being modern societies demise, it is this.
Scary, if you think about it.
Just imagine: One replenishing bioculture that goes back some decades turns out to be labled wrong and all of a sudden countless biological studies are beyond worthless.
Long story short: Do not over-optimize. And question the status-quo once in a while. Especially with systems that seem to run flawlessly indefinitely.
Wouldn't be a problem... (Score:3)
... if all studies were replicated at least twice by other teams in other institutions (and preferably funded by different sponsors).
Re: (Score:3)
Re: (Score:2)
Every working scientist would love to see this happen.
Even if it compromises (perhaps significantly) their publication rate / bonuses / career path? I'd love to see a survey or two on that.
Re: (Score:2)
Re: (Score:2)
I think the scientists would like to see the publish or perish schema go away as well...
Helpless victims one and all, I'm sure.
Re: (Score:2)
Re: (Score:2)
Who cares about surveys? Fund some grants to reproduce results. I guarantee there will be takers.
Not that many. You will never get great publications merely replicating results. Sure it's a grant now, but at the penalty of your future career.
Re: (Score:2)
and they both order their tissue cultures from the same place? or from different suppliers selling the same wrong one?
Re: (Score:3)
On step #4, they may be using the same suppliers. How many suppliers are there for experimental cell lines?
Re: (Score:2)
Re:I call schenanigans (Score:4, Insightful)
4. Other scientist recreate the process that proved or disproves the theory
4.5. Other scientists buy cells from the same misidentified cell line to use in their "repeatability" study. ...
6. Rinse and repeat.