Stories
Slash Boxes
Comments

News for nerds, stuff that matters

Slashdot Log In

Log In

Create Account  |  Retrieve Password

Miscalculation Invalidates LHC Safety Assurances

Posted by timothy on Wed Jan 28, 2009 07:07 PM
from the philosophy-of-science dept.
KentuckyFC writes "In a truly frightening study, physicists at the University of Oxford have identified a massive miscalculation that makes the LHC safety assurances more or less invalid (abstract). The focus of their work is not the safety of particle accelerators per se but the chances of any particular scientific argument being wrong. 'If the probability estimate given by an argument is dwarfed by the chance that the argument itself is flawed, then the estimate is suspect,' say the team. That has serious implications for the LHC, which some people worry could generate black holes that will swallow the planet. Nobody at CERN has put a figure on the chances of the LHC destroying the planet. One study simply said: 'there is no risk of any significance whatsoever from such black holes.' The danger is that this thinking could be entirely flawed, but what are the chances of this? The Oxford team say that roughly one in a thousand scientific papers have to be withdrawn because of errors but generously suppose that in particle physics, the rate is one in 10,000."
+ -
story

Related Stories

[+] Black Holes From the LHC Could Last For Minutes 672 comments
KentuckyFC writes "There is absolutely, positively, definitely no chance of the LHC destroying the planet (or this way either) when it eventually switches on some time later this year. And yet a few niggling doubts are persuading some scientists to run through their figures again. One potential method of destruction is that the LHC will create tiny black holes that could swallow everything in their path, including the planet. Various scientists have said this will not happen because the black holes would decay before they could do any damage. But physicists who have re-run the calculations now say that the mini black holes produced by the LHC could last for seconds, possibly minutes. Of course, the real question is whether they decay faster than they can grow. The new calculations suggest that the decay mechanism should win over and that the catastrophic growth of a black hole from the LHC 'does not seem possible' (abstract). But shouldn't we require better assurance than that?"
This discussion has been archived. No new comments can be posted.
The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.
 Full
 Abbreviated
 Hidden
More
Loading... please wait.
  • Voodoo Science (Score:5, Insightful)

    by alain94040 (785132) * on Wednesday January 28 2009, @07:07PM (#26646369) Homepage

    This is voodoo science. And I don't mean the LHC experiments.

    I mean the TFA that in essence claims that because an expert may be wrong, any probability the expert assigns to a risk can be ignored and inflated by as much you feel like it. Talk about bias.

    --
    The 5 Steps to a Great Startup Idea [fairsoftware.net]

    • by madsenj37 (612413) on Wednesday January 28 2009, @07:13PM (#26646455)
      If they are correct, what are the chances they are wrong (or right)?
    • Re:Voodoo Science (Score:5, Insightful)

      by caffeinemessiah (918089) on Wednesday January 28 2009, @07:22PM (#26646603) Journal

      This is voodoo science. And I don't mean the LHC experiments.

      It's not science, it's just probability. It's senseless to try to assess any statistical estimates *themselves* based on Physics, just the probability that they could be wrong based on some very broad assumptions. Specifically, any estimate is arrived at by a chain (rather, DAG) of logic. What you CAN estimate is the probability that any Physics-oriented estimate is based on incorrect assumptions, by (presumably) analyzing that chain of reasoning down to first principles and assuming that a "logic error" might have been made at any point. I hope that the authors aren't taking it further than this, in which case, this is statistical masturbation.

      • Re:Voodoo Science (Score:5, Insightful)

        by orclevegam (940336) on Wednesday January 28 2009, @07:32PM (#26646737) Journal
        Essentially their argument boils down to because people make mistakes and we can calculate the odds of them making a mistake, if they calculate the odds of something and it's greater than the odds of them having made a mistake then you have to use the odds of them making a mistake as the probability of the event happening. Of course this reasoning is total bullshit, and just the sort of abuse statistics gets a bad name for. By that sort of reasoning we should all go play the lotto as clearly the odds of someone miscalculating the chances of winning the lottery are much better than the calculated odds of winning, never mind the fact that even if they made a mistake in calculating the odds it wouldn't shift the calculation enough either way to get it anywhere near the odds of them having made a mistake.
        • Re:Voodoo Science (Score:5, Insightful)

          by KagatoLNX (141673) <kagato@ s o u j a.net> on Wednesday January 28 2009, @07:48PM (#26646969) Homepage

          Actually, this isn't that much voodoo.

          It's just saying that, if someone has a 1/10,000 chance of being wrong, their assurance that there is a 1/1,000,000,000 chance of something isn't that good of a bet. In other words, if you want the latter level of certainty, you don't really have it, because of the fallibility of the research itself.

          This is actually rather obvious. If Jimbo tells you that there's a 1% chance that your tire will go flat if you don't fix it, that's not 1% if Jimbo is wrong 50% of the time. At best, it's 50.5%. Or something like that.

          Assuming his brother Jethro is just as bad (but uncorrelated) with him, then their dual recommendation that it will go flat only gets you 25.25% certainty, not 1% (or 0.01%). The numbers may not be exactly right (my stats are rusty), but you get the point.

          Basically, they're saying that the research provides a wider error bound than it may claim, assuming that scientists uniformly make logical mistakes--which they very probably do.

          The implication, then, is that the LHC estimates should be independently done by other teams. This is, well, the basis of the scientific method, so essentially this study provides a statistical analysis of what we already know--after enough work, science gets results. Of course, the base theories assumed by all of the researchers could be wrong, which would be unfortunate, but the LHC is going to nail that one pretty quickly. :)

          This is not surprising, but not voodoo either.

        • Re:Voodoo Science (Score:5, Insightful)

          by IorDMUX (870522) <mark.zimmerman3@g m a il.com> on Wednesday January 28 2009, @08:09PM (#26647193) Homepage

          then you have to use the odds of them making a mistake as the probability of the event happening.

          This isn't what the actual study states, though the summary seems to hint that way. To quote from one-of-the-FA's:

          Which means we are left with the possibility that their argument is wrong which Ord reckons conservatively to be about 10^-4, meaning that out of a sample of 10,000 independent arguments of similar apparent merit, one would have a serious error.
          Of course, this doesn't mean that the LHC is dangerous, only that there is no reasonable assurance of safety which, as Mark Buchanan writing in New Scientist this week says, is not the same thing at all.

          To sum it up, they say that if a researcher predicts an occurrence rate for an event that is less than the researcher's own error rate, then the occurrence rate remains unknown ('cannot be assured')... not that it is equal to the researcher's error rate.

    • Re:Voodoo Science (Score:5, Insightful)

      by Bob-taro (996889) on Wednesday January 28 2009, @07:27PM (#26646669)

      I mean the TFA that in essence claims that because an expert may be wrong, any probability the expert assigns to a risk can be ignored and inflated by as much you feel like it. Talk about bias.

      Bias? Hype, maybe. Actually, this does make some sense, IMO. Say I was offering to shoot an apple off the top of your head and I told you I'd calculated there was only a 1 in 1 million chance of the bullet hitting you instead. Now if you knew (somehow) that there was a 1 in 10 chance I'd gotten the calculation wrong, you're going to look at it as more of a 1 in 10 chance of getting hit ... or at least way more than one in 1 million.

    • Re:Voodoo Science (Score:5, Insightful)

      by bhagwad (1426855) on Wednesday January 28 2009, @07:39PM (#26646837)
      I agree. Just look at this statement: "The focus of their work is not the safety of particle accelerators per se but the chances of any particular scientific argument being wrong." Can you get any broader than that? What they're essentially saying is that anything can be wrong - Including their own paper.
  • by QuantumG (50515) * <qg@biodome.org> on Wednesday January 28 2009, @07:09PM (#26646399) Homepage Journal

    Maybe I just like Romulans, but when I hear that the LHC will be making black holes I don't think about "woo, the earth is gunna get swallowed!" I wonder if there are any cool ways to use them for power generation.

    • by TheMeuge (645043) on Wednesday January 28 2009, @07:13PM (#26646439) Homepage

      There is.

      Matter being drawn into the black holes should be accelerated to damn close to the speed of light, and will emit massive amounts of gamma radiation, with a conversion rate that's higher than even fusion.

      If we could harness the energy of the gamma emissions around artificial black holes, we'd be have vast energy generating capability, without the pesky fast neutrons that most fusion reactions generate.

  • by zappepcs (820751) on Wednesday January 28 2009, @07:20PM (#26646547) Journal

    The purpose of the LHC is noble, and results could be what we need to get off this rock and really dominate the galaxy. If they destroy the Earth... meh, it was a good try. Maybe next time.

  • by squoozer (730327) on Wednesday January 28 2009, @07:22PM (#26646587) Homepage

    and I don't think it's the assurance that the LHC won't produce black holes that swallow the earth. There reason the whole LHC black hole rubbish is dismissed out of hand is simply because we have already obvesrved particles colliding with much higher energies than the LHC can produce and they didn't form black holes. Where did we observe these collions - in earth atmosphere. We built the LHC so that we could study the collisions in a controlled manner not because they are of particularl high energy.

  • by bluefoxlucid (723572) on Wednesday January 28 2009, @07:25PM (#26646641) Journal

    Opponent: Oh crap, you're whacking things together, it could destroy the earth, crazy scary technology we don't understand!

    Proponent: That could never happen.

    Opponent: OMG yes it could you don't know wtf you only have studied this shit your whole life you're not a sane normal rational person like the boys in Alabama!

    Proponent: Look, we've done tons of calculations; we've compared this against real-world natural occurrences; we've considered the number of times the conditions we've come up with have occurred in our lifetimes, and it's huge. We're just scaling it down to a laboratory level so we can observe it in a controlled environment. It can't break anything.

    Opponent: BUT YOU COULD BE WRONG!!!!

  • by Sponge Bath (413667) on Wednesday January 28 2009, @07:29PM (#26646697)

    My retirement fund is pretty much crushed at this point.
    Being consumed by black holes created by a multibillion dollar scientific whiz-ma-gig is sounding like a pretty good exit plan.

  • LHC is used as an example, misleading headline written by Fox News. -1

    ~kulakovich
  • by BeardedChimp (1416531) on Wednesday January 28 2009, @07:36PM (#26646787)
    "Anyone Who Thinks the LHC Will Destroy the World is a Twat"

    He's a particle physicist from my physics department (Manchester), and hence let it be known Oxford physicists are twats!
  • by dangitman (862676) on Wednesday January 28 2009, @07:36PM (#26646789)

    'If the probability estimate given by an argument is dwarfed by the chance that the argument itself is flawed, then the estimate is suspect,'

    But if the improbability is large enough, and you hook it up to a nice, hot cup of tea; then we'll travel instantaneously through every point of the Universe, and possibly create a worried-looking whale and a bowl of petunias.

  • Sensationalist BS (Score:5, Insightful)

    by ceoyoyo (59147) on Wednesday January 28 2009, @07:46PM (#26646939)

    The article is a pile of BS topped by a sensationalist (and completely wrong) headline. The paper abstract is interesting, but that's it.

    Essentially the blog article makes the jump from 1 in 1000 papers being withdrawn because of "an error", any error, to the idea that the safety of the LHC is "invalid" due to a "massive miscalculation."

    How can a hypothetical miscalculation be "massive?" Anyway, you can't just take an average retraction rate for papers and assume it applies to anything you like. The arguments for the LHC being safe are based on well established science. That is, for the LHC to destroy the world not only would ONE paper have to be wrong, but a LOT of papers would have to be wrong, and all in the same direction.

  • by DrVomact (726065) on Wednesday January 28 2009, @08:03PM (#26647131) Journal

    If the probability estimate given by an argument is dwarfed by the chance that the argument itself is flawed, then the estimate is suspect.

    The headline says "Miscalculation Invalidates LHC Safety Assurances", yet the quote from the abstract seems to say that because arguments are sometimes "flawed" (terribly squishy word, that), it follows that for crucially important calculations we have to...well, the abstract doesn't say what we should do, and there's no link to the actual article. (Maybe there's a good reason for the latter.)

    This amounts to the assertion that if an estimate is about something very important, then we can't trust the estimate, because some estimates are mistaken. In other words, we can't make estimates about important things—just trivial ones.

    Unless someone produces the article in question, and unless it actually makes a more substantial argument than I quoted, I vote this a waste of my time on the part of whoever submitted it. May the rats eat your mail.

    • by Xtravar (725372) on Wednesday January 28 2009, @07:25PM (#26646637) Homepage Journal

      I STILL don't think the LHC will kill us all but the fact we're debating it says something.

      I don't know what you're trying to imply here.

      People are still debating evolution.

    • by Thiez (1281866) on Wednesday January 28 2009, @07:45PM (#26646929)

      > I STILL don't think the LHC will kill us all but the fact we're debating it says something.

      Yes, it says that people are easily scared by things they do not understand. See also: wireless, mobile phones, things that have a 'chemical' smell... Ask some random people what would happen if the sun were to be replaced instantaneously by a black hole with a mass equal to that of the sun (moving in the same direction as the sun with the same speed, etc). Most people will reply that the earth would get 'sucked' in the black hole... if you don't even understand gravity you have no place in a debate concerning the LHC.

      Everyone is entitled to an _informed_ opinion.