Catch up on stories from the past week (and beyond) at the Slashdot story archive

 



Forgot your password?
typodupeerror
×
Science

'There is a Scientific Fraud Epidemic' (ft.com) 148

Rooting out manipulation should not depend on dedicated amateurs who take personal legal risks for the greater good. From a story on Financial Times: As the Oxford university psychologist Dorothy Bishop has written, we only know about the ones who get caught. In her view, our "relaxed attitude" to the scientific fraud epidemic is a "disaster-in-waiting." The microbiologist Elisabeth Bik, a data sleuth who specialises in spotting suspect images, might argue the disaster is already here: her Patreon-funded work has resulted in over a thousand retractions and almost as many corrections. That work has been mostly done in Bik's spare time, amid hostility and threats of lawsuits. Instead of this ad hoc vigilantism, Bishop argues, there should be a proper police force, with an army of scientists specifically trained, perhaps through a masters degree, to protect research integrity.

It is a fine idea, if publishers and institutions can be persuaded to employ them (Spandidos, a biomedical publisher, has an in-house anti-fraud team). It could help to scupper the rise of the "paper mill," an estimated $1bn industry in which unscrupulous researchers can buy authorship on fake papers destined for peer-reviewed journals. China plays an outsize role in this nefarious practice, set up to feed a globally competitive "publish or perish" culture that rates academics according to how often they are published and cited. Peer reviewers, mostly unpaid, don't always spot the scam. And as the sheer volume of science piles up -- an estimated 3.7mn papers from China alone in 2021 -- the chances of being rumbled dwindle. Some researchers have been caught on social media asking to opportunistically add their names to existing papers, presumably in return for cash.

This discussion has been archived. No new comments can be posted.

'There is a Scientific Fraud Epidemic'

Comments Filter:
  • I think the reason there is such a "relaxed attitude" is that the problem will solve itself. People will just learn to ignore anything published by the Chinese. Citing a Chinese paper will just reduce your own credibility, regardless of what journal it's published in. If this hasn't happened yet, it will.

    • by Njovich ( 553857 ) on Monday November 27, 2023 @11:49AM (#64035383)

      People will just learn to ignore anything published by the Chinese.

      That's wishful thinking. People will just ignore anything published, not just chinese sources if the scientific process gets discredited.

    • by Brain-Fu ( 1274756 ) on Monday November 27, 2023 @11:52AM (#64035391) Homepage Journal

      That is clearly a bad solution that would deprive the world of the benefits produced by one of the most scientifically active countries on the planet.

      The root cause here is incentives, not nationality. Science costs money, and anything that costs money needs either a profit motive, a charity motive, or taxpayer funding. As it stands, the profit motive is the primary motive funding most science, and it is extremely selective: only research that shows practical results gets the funding. Research that eliminates wrong theories is just as important, but doesn't give anything that anybody wants to pay for, so anyone who does THAT research winds up starving in the street.

      The same goes for this proposed group of science police. Who is going to pay for that, and more importantly, WHY are they going to pay for that? Clearly, there is no way to profit off of that, so it will have to be charity funded or taxpayer funded.

      So, that is what I propose, anyway: a government group of science police, in addition to a whole lot more government and/or charity funded science that doesn't consider it a failure when bad hypothesis are shown not to work, so long as there was good reason to try.

      • by XanC ( 644172 )

        This police force could be funded by having an associated TV show. It would be like CSI expect for real!

        • I think that would have the exact opposite effect, the profit motive here would be to show there was fraud, since that would be more entertaining. If 9 times out of 10 nothing was dubious, then that would be a boring show.

          Even if they did edit out the good science, that would give a false impression of how bad science was, there would give the impression to people that almost all science was bad, if show after show showed fraud in science. Just like CSI give you the impression that murder is everywhere wher

      • Re: (Score:2, Interesting)

        That is clearly a bad solution that would deprive the world of the benefits produced by one of the most scientifically active countries on the planet.

        Ok, Xi. Whatever you say. Considering China has still not provided a truthful accounting of the number of people infected and killed by covid, and that it destroyed the earliest examples of the virus, anything they say or claim should be taken with a shit ton of salt.

        Speaking of accounting, how many people did you run over with tanks or gun down in
        • "Speaking of accounting, how many people did you run over with tanks or gun down in Tiananmen Square back in 89?"

          How many people did the US kill in Iraq? Afghanistan? Libya? Over a thousand people are killed by police [statista.com] in the US every year. What point are you trying to make? And what does it have to do with scientific papers?

      • by kackle ( 910159 )

        The same goes for this proposed group of science police. Who is going to pay for that,

        I don't know, Coast Guard?

    • by methano ( 519830 )
      I would tend to agree with this. First, because of publisher greed, there are way too many journals. The good stuff was always getting published. When you increase the number of publications 10-fold, we know which side of the bell curve the increased publications are falling on. I'm looking at you ACS, Nature, Cell, etc.

      The second reason is the old "publish or perish" rule. In most of the world, it's sort of enforced by peers. In some parts of the world, it's more likely enforced or monitored by political
    • The problem is more broad than you see it. Shared scientific knowledge bank let you track other nations progress in some areas of interest. The problem is that fraud is not only about personal benefits, but in many situations is designed to mislead other nation's research efforts as well. There is no such thing as freelance scientists who work on their own for free for the sake of pure truth and helping humanity. We all work in organized scientific research groups and we all bound to some source of money an
    • by hdyoung ( 5182939 ) on Monday November 27, 2023 @12:35PM (#64035553)
      More likely that the problem is self-reinforcing rather than self-limiting.

      The core problem is that there's been an absolutely explosion in research productivity in the past 20 years, both legit AND fraudulent. Meanwhile, the number of reputable, legit journals have stayed roughly the same. The result is the legit journals getting absolutely swamped in submissions. They take a flame-thrower approach to sorting the submissions, which means that you only get your paper published in a strong journal if:

      1. You win the journal lottery
      2. Youre a member of a "favored" research group, which isn't supposed to be a thing but absolutely is.
      3. You fabricate or plagiarize, thus betraying your field, dumping your honesty, your ethics, your self-esteem, and probably tanking your career because when/if it gets found, youre done.
      4. You actually have groundbreaking research, which only happens once, maybe twice, in the lifetime of a researcher.

      If you're an honest, legit, mid-teir researcher producing decent-but-not-worldshaking papers, you get the privilege of submitting them to the Q1 journals and enduring a string of rejections, working your way down the journal ladder hoping you win the lottery. Meanwhile, you're constantly second guessing yourself and trying to avoid dipping into predatory-journal territory where the publication will actually subtract from your CV rather than add to it.

      In a balanced world, this would result in a sorting process that effectively ranks papers for impact. In reality, you wind up with top-tier journals that are constantly getting targeted by dishonest researchers, and a huge number of low-mid-tier journals that are dealing with a massive mix of good ones, soso-ones, and junk and fake papers.
      • The core problem is that there's been an absolutely explosion in research productivity in the past 20 years,

        Also the way the funding and jobs work selects for people who spam papers and "round up" results as it were to a better class of results. You can afford to not play that game if you're (a) an established professor or (b) as you say insanely lucky.

        If you don't play the game, you find yourself out of a job. Many people choose the latter, trouble is that leaves nothing but the game players.

        Thing is the e

    • Racist brain finds incorrect pattern.

      • by Calydor ( 739835 )

        The summary itself points out China has a disproportionately huge number of fraudulent papers submitted ...

        • That doesn't mean the best or only solution is to wall off all of China.

        • And btw, I have suffered because of a Chinese fake research .. spent maybe 3 to 4 months on it and wasted interns time trying to build on and reproduce something in one of their papers. Yet I am not bitter .. there's lots of good stuff coming from there too. The problem is there are a lot of bad individuals but its unfair to punish collectively.

    • by guruevi ( 827432 )

      No, the problem is that it is self-perpetuating. Even these studies on scientific fraud are rife with problems since the funding institutions that they are dependent on requires headlines for further funding. If your study makes news headlines, it is 3x more likely to get future funding. There are a quite a few criteria from DEI to news to team size, to even the University it is associated with, all of which have literally nothing to do with the science but influence your likelihood of funding significantly

    • It's not just the Chinese though. Academic dishonesty happens every day at top US universities. Professors put their names on their students papers routinely, after not only not working on them but not understanding them. Professors take work from one student and give it to another student. Some professors have very fragile egos and will lie and cheat to get back at students they believe disrespected them, and nothing keeps those professors in check.

      The whole system is corrupt.

  • The scientific community finally decided to catch up with the rest of society and base most of their work on fraud! Fraud science for a fraud world run by fraud politicians doing fraudulent things to their citizens for massive personal gains! It's frauds all the way down! We're almost there. Just a little more and we can give up reality altogether!

  • by Bruce66423 ( 1678196 ) on Monday November 27, 2023 @12:12PM (#64035447)

    Whenever a false paper is revealed, the university / lab / company for which the researchers worked should be given negative marks. All articles published should record how many negative marks the institution has against it. This would rapidly encourage them to address cultural issues leading to such misbehaviour, and to check the papers being published from their labs. If they fail to do anything about it, funding bodies will become ever less willing to offer them money...

  • "Oxford university *psychologist*"

    There SHOULD BE no difference between an unreplicated paper and a false paper.

    Until Psychology deals with that and TRIES to be a science, PSYCHOLOGY IS BUNK.
  • by MobyDisk ( 75490 ) on Monday November 27, 2023 @12:23PM (#64035497) Homepage

    Corporations that are subject to regulations often hire auditors. Some have an entire department dedicated to this purpose, that has a different reporting structure from the R&D or manufacturing departments. That way, when the manufacturing department boss tells their people "I don't care what it takes, I need 100 widgets per hour to make our numbers!" the quality auditors people do not report to that boss.

    Do universities have something equivalent?

    • No. Universities have things like "publish or perish" and "minimum publishable increment".
    • Do universities have something equivalent?

      Many papers do not come from universities. In fact most of the shitty papers in question do not come from universities. And those which do often come from universities that already have a shithouse reputation.

  • Yes. Since there are rarely any repercussions, there's no reward/punishment motivation. So, laws? Jail time? Is that what you really want?
  • It turns out, they don't care what you publish.

    • It turns out, they don't care what you publish.

      Kind of reminds me of the Wall Street ratings agencies circa 2008. We know what that greedy ignorance resulted in.

  • by Koreantoast ( 527520 ) on Monday November 27, 2023 @01:07PM (#64035677)
    One of the tragedies is that this unregulated fraud undermines the scientific community's credibility, giving ammunition to the anti-science crowd to dismiss any scientific study that they disagree with (e.g. climate change, vaccines, etc.). Even if the science is established, this gives just enough doubt that they can hide behind it to dismiss any scientific criticism of their beliefs.
  • Predatory journals (Score:5, Informative)

    by Uncle_Meataxe ( 702474 ) on Monday November 27, 2023 @01:13PM (#64035701)

    Can't read the paywalled article, but it's Interesting that the summary doesn't mention predatory scientific journals. These journals will publish anything for a page fee (e.g., $500/page). These journals advertise that they have a review process but this is clearly not the case. For respected journals, the review process can take months or even up to a year.

    The temptation for scientists is immense. Example: a colleague submitted one of our papers to a respected, long-established journal but it was rejected for what seemed like lame reasons. We had waited six months to get that verdict. Rather than go through that process again with another quality journal, he decided to send it to a journal I had never heard of, but which advertised a fast turnaround time. This journal was published by MDPI, based in India, which publishes hundreds of journals. By the time I had figured out this scam, the journal had already concluded their "review," accepted the paper and our payment (less than two weeks for the entire process).

    Here's the thing -- this was a decent paper, written by a highly respected leader in his field. Since then, I've seen lots of excellent scientists publish solid papers in these lame journals. But, since these journals will publish anything from anybody, you need to be careful. Apparently their business model is working and the result is a polluted scientific literature. Beall's List — https://beallslist.net/ [beallslist.net] -- has a list of predatory publishers. Interestingly, Beale removed MDPI from the list, but warns authors to carefully consider submitting to their journals. See Wikipedia for details.

  • by RobinH ( 124750 ) on Monday November 27, 2023 @01:36PM (#64035803) Homepage
    We're talking about a culture where the phrase "If you can cheat, then cheat" is commonplace. We can't integrate China with the west and the core values of honesty the western civilization was built on if we don't take these cultural difference into account. Yes, there are cheaters in the west, and always have been, but since there is a strong cultural norm against lying and cheating that we instill in our kids from a very young age, then the magnitude of the problem has always been manageable until now.
    • by evanh ( 627108 )

      And I remember the Internet before the Web. Or more specifically, before commercialisation of the Web.

      When the most significant measure is money, then the strongest behavioural response will be greed.

  • Just learned about this, worth spreading:

    http://slow-science.org/

  • I often quote Goodhart's law: when a measure becomes a target, it ceases to be a good measure.

    Researchers must publish or perish, whether they have something to publish or not.
    Thus there is a strong incentive to publish poor quality (though non fraudulent) research just to get a publication out.
    Then there is pressure to optimise your metrics, which is easier though fraud.
    And if you have nothing publication worthy to publish, you have to get your publication material from somewhere,
    hence the incentive for fraud.

    What you see is an evolving system adapting to match the metrics it's designed to optimise.

  • They might be better equipped in a given domain, but ultimately the bell curve includes the same amount of detritus as any other group. Some will be dishonest, opportunistic, incompetent, and otherwise questionable - exactly the same as auto mechanics, medical doctors, and teachers. No group is immune. And no degree ensures competency. Having said that, the people to lead the charge against shitty scientists are capable, ethical scientists.

  • by J-1000 ( 869558 ) on Monday November 27, 2023 @04:33PM (#64036493)

    Would a meta publication help this? A non-profit curation of believed-to-be-legit studies previously published in other journals. No submissions taken. I assume these exist? It might be helpful to have a multitude of these for geographic regions, to ensure diversity and to allow reputation to be built on a broader scale over time. Then you could have higher-level publications that further filter and conglomerate them into larger regions, and to blacklist publications that are breaking the rules.

    Disclaimer: I don't even read scientific journals. Just thinking with keystrokes.

  • Come on, name and shame. Once you exclude China and India, how many fake papers do you see?

A committee takes root and grows, it flowers, wilts and dies, scattering the seed from which other committees will bloom. -- Parkinson

Working...