Stories
Slash Boxes
Comments

News for nerds, stuff that matters

Slashdot Log In

Log In

Create Account  |  Retrieve Password

IBM Using Complex Math To Manage Natural Disasters

Posted by Soulskill on Thu Apr 03, 2008 06:59 PM
from the stopping-a-flood-with-natural-logs dept.
coondoggie brings us a NetworkWorld story about IBM's efforts to use complex algorithms to manage responses to natural disasters. Researchers are making use of recent increases in processor speed and algorithm efficiency to develop a scalable, flexible model capable of handling the complicated planning involved in reacting to a crisis. Quoting: "'We are creating a set of intellectual properties and software assets that can be employed to gauge and improve levels of preparedness to tackle unforeseen natural disasters,' says Dr. Gyana Parija. 'Most real-world problems involve uncertainty, and this has been the inspiration for us to tackle challenges in natural disaster management.' In the case of flooding, for example, the stochastic programming model would use various flood scenarios, resource supply capabilities at different dispatch locations, and fixed and variable costs associated with deployment of various flood-management resources to manage various risk measures. By assigning probabilities to the factors driving outcomes, the model outlines how limited resources can meet tomorrow's unknown demands or liabilities. In this way, the risks and rewards of various tradeoffs can be explored, IBM said."
+ -
story

Related Stories

This discussion has been archived. No new comments can be posted.
The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.
 Full
 Abbreviated
 Hidden
More
Loading... please wait.
  • It won't save us (Score:5, Informative)

    by Ethanol-fueled (1125189) * on Thursday April 03 2008, @07:02PM (#22958426) Homepage
    High-performance computing won't save us from idiots in high places, even during natural disasters. Case in point: Michael D. Brown [wikipedia.org], who was in charge of FEMA during the Hurricane Katrina ordeal. From the wikipedia article:

    "...Some members interviewed felt Brown showed an imperious attitude, and nicknamed him 'The Czar'."

    Heckuva job, Brownie! More optimistically, I hope that their algorithms could predict the 4 or 5 "wild"- fires in Southern California which are all started mysteriously(on the same day) "in season."
    • Re:It won't save us (Score:5, Interesting)

      by Carnildo (712617) on Thursday April 03 2008, @07:11PM (#22958526) Homepage Journal

      More optimistically, I hope that their algorithms could predict the 4 or 5 "wild"- fires in Southern California which are all started mysteriously(on the same day) "in season."


      Shouldn't be too hard. One of the things they discovered while studying line noise in telephone circuits is that the cause of the noise doesn't matter: it could be induction from nearby motors, bad connections influenced by the wind, or short-circuits triggered by someone dropping a screwdriver -- it all fits into the statistical patterns. In the case of fires, it doesn't matter if it's lightning, arson, or volcanic eruption, the pattens still hold.
      • it all fits into the statistical patterns. In the case of fires, it doesn't matter if it's lightning, arson, or volcanic eruption, the pattens still hold.
        It leads one to wonder whether being statistically significant, is itself statistically significant?
      • Re: (Score:3, Insightful)

        What you say may be true, but I can't help but think of Nassim Nicholas Taleb and his black swans. He would argue that while your wild fires might fit the existing statistical models, a REAL disaster, the kind with the potential to really knock the country on its ass, would be essentially impossible to predict. I'm not sure I entirely buy into his thinking, but you have to admit, it's usually the unexpected stuff that produces the greatest impact.
    • by c6gunner (950153) on Thursday April 03 2008, @09:19PM (#22959408)

      Heckuva job, Brownie! More optimistically, I hope that their algorithms could predict the 4 or 5 "wild"- fires in Southern California which are all started mysteriously(on the same day) "in season."
      What's your guess? Blackwater, with black helicopters, in the forest? I'm going with Col. Mustard, with the candle-stick, in the grasslands.
    • by gnick (1211984) on Thursday April 03 2008, @09:49PM (#22959614) Homepage

      I hope that their algorithms could predict the 4 or 5 "wild"- fires in Southern California which are all started mysteriously
      If there's enough money in it, I can predict a mysterious fire just about anywhere at any time.
    • More optimistically, I hope that their algorithms could predict the 4 or 5 "wild"- fires in Southern California which are all started mysteriously(on the same day) "in season."

      The algorithms aren't designed to predict disasters, but to manage the response to disasters in progress. (Which isn't actually very easy.)
  • by Runagate Rampant (602123) on Thursday April 03 2008, @07:02PM (#22958430) Homepage
    sqrt(-1) = natural disaster!
  • Government (Score:4, Insightful)

    by boris111 (837756) on Thursday April 03 2008, @07:04PM (#22958446)
    Can they model government indifference to the people's plight?
    • Easy (Score:5, Funny)

      by EmbeddedJanitor (597831) on Thursday April 03 2008, @07:17PM (#22958584)

      if(contribution_of_lobbiests_impacted > 100000000)
      do_something(); /* better respond to them */
      else
      ignore_poor_people(); /* who cares */
      • Re:Easy (Score:4, Funny)

        by Anonymous Coward on Thursday April 03 2008, @07:27PM (#22958660)
        PeopleWhoUseUnderscoresInTheirVariableAndFunctionNames = null; /* Okay, I'll get off your lawn. Sheesh. */
        • You didn't use Hungarian.
          • Re: (Score:3, Informative)

            First off, he was assigning them to null, not testing whether they are null, so the syntax is correct.

            Secondly, while I know it's somewhat rude make an issue of sigs, you are aware that actual children are harmed in the making of child pornography, right?
    • Why is P modded 'flamebait'? He asks a relevant question. The response of government officials may unfortunately be the biggest factor in calculating how to deal with a disaster.
    • Can they model government indifference to the people's plight?
      Is there any point to modeling another type of government?
      • "Can they model government indifference to the people's plight?"

        FTA: "The model allows all unforeseen challenges to be solved..."

        I hardly think that the government's indifference could be, ahem, classified as an unforeseen challenge.

        Though I suppose, if the problem is foreseen, it could also probably be dealt with as well.
  • Complex math? Aren't real numbers good enough for the job?
    • by sapphire wyvern (1153271) on Thursday April 03 2008, @07:09PM (#22958510)

      Complex math? Aren't real numbers good enough for the job?
      You need the imaginary axis to quantify FEMA's competency. :)
    • Re: (Score:3, Informative)

      I repeat: RTFA. This so-called "complex math" is _not_ about imaginary numbers! It's about stochastic programming and _complex algorithms_ (i.e. complicated). Why don't you mod me up (for a change) so you people can get this straight.

      "The idea is to use high-level math techniques, which IBM calls Stochastic programming, to help speed up and simplify complex tasks "
      • Re:Complex math? (Score:5, Informative)

        by jonadab (583620) <`ten.thgirb' `ta' `badanoj'> on Thursday April 03 2008, @11:51PM (#22960194) Homepage Journal
        > That's "complex" as in "complicated" math

        In mathematics, "complex" does not mean complicated any more than "proper" means correct or "rational" means sane or "group" means any old gathering or collection. These words have very specific meanings in mathematics, and using them for their general-English meaning, in the context of math, is at best confusing and at worst outright misleading.

        You can talk about a "complex algorithm", and people will generally understand you mean a complicated one, because the word "algorithm" lends more of a computer-science context. You can say "complex way of doing things" and convey the idea of complicatedness, because "way of doing things" is sufficiently general that it doesn't really imply any particular context at all. But saying "complex math" very much conveys the idea of the use of complex numbers (i.e., numbers with a real part and an imaginary part, either or neither or both of which may be zero for any given number) because the word "math" strongly implies a mathematics context and draws the math-jargon sense of the word "complex" to the forefront. Only someone who doesn't *know* what the word "complex" means in mathematics would think of any other meaning.

        It's like saying "hedge fund" and expecting people to get the idea that you're collecting money for shrubberies. Only someone with no idea what a hedge fund is would get that impression.
  • Patents (Score:4, Insightful)

    by LeoDavinci578 (795523) on Thursday April 03 2008, @07:10PM (#22958516)
    Oh man, I just loved this: "We are creating a set of intellectual properties and software assets that can be employed to gauge and improve levels of preparedness to tackle unforeseen natural disasters"

    Awesome, now they get to patent how to respond to natural disasters so that no one else can innovate... another victory for our wonderful patent process!
  • by icegreentea (974342) on Thursday April 03 2008, @07:15PM (#22958556)
    Before everyone starts smarting at this thing 'predicting' natural disasters, please read the summary carefully (I know your not going to read the article). The math and system is designed to help deal with natural disasters that do happen (like optimizing your relief delivery path, plotting the best places to contain/fight a forest fire, etc etc). It is also used to evaluate how best, and how well current resources could be used in a natural disaster by predicting (yes, there is it, a prediction) most likely challenges, problems, scale and the like. I think it's useful.
    <p>
    The new thing with this apparently is that they're using a new mathematical model that previously was too computationally expensive to do on a large scale. Computers are powerful enough to use these models now.
  • Natural disaster may be quantifiable, but do we really want some heartless machine deciding who lives and dies in the case of an emergency? Anyone see I-Robot?

    I don't mean to sound like a stereotypical paranoid geek, but we give too much power to machines they will start controlling our life.
    • Re:Quantifiable (Score:4, Interesting)

      by iminplaya (723125) <iminplayaNO@SPAMgmail.com> on Thursday April 03 2008, @08:11PM (#22958906) Journal
      ...but we give too much power to machines they will start controlling our life.

      You get either a machine or a bureaucrat. Take your choice. At least with a machine, you can turn it off. Just try to get rid of an incompetent bureaucrat or crooked politician who appoints him.
    • The current system (letting nepotically chosen subordinates with no experience in their field) doesn't seem to be working out that well, either. At least with a computer program, you can examine the criteria and decide if it makes sense.

      It something like triaging patients in a mass casualty - in the case of limited resources and nearly unlimited casualties, you spend the doctors & nurses time where it will do the most good. Saving a 5 year old with massive head trauma may make you feel all warm and fu

  • Obligatory (Score:3, Funny)

    by fixer007 (851350) on Thursday April 03 2008, @08:15PM (#22958942)
    I was told there would be no math...
  • by Anonymous Coward
    In the case of a natural disaster please check with your lawyer before responding.

    You may be infringing on a patent...
  • by creimer (824291) on Thursday April 03 2008, @08:24PM (#22959010) Homepage
    Natural Disaster + Presidential Photo-Ops = Great PR!
  • by AJWM (19027) on Thursday April 03 2008, @08:32PM (#22959068) Homepage
    From TFA: "to tackle unforeseen natural disasters"

    But then it goes on to talk about mostly foreseeable natural disasters. If you live on a flood plain or a low-lying coastal area subject to hurricanes, you're going to get flooded. In an earthquake zone you're going to get earthquakes. Lot of vegetation in an area that has dry spells, fires. And so on.

    Legitimately unforeseen natural disasters would be things like a comet impact [imdb.com], volcanoes erupting in downtown LA [imdb.com], or perhaps alien invasion [imdb.com]. Oh wait, that last would be an unnatural disaster, wouldn't it? But come to think of it, the ones I just mentioned have all been foreseen too.

    I guess I just don't foresee a need for this software. Maybe they should work on software for foreseeable disasters.
  • From what I could gather from the summary, this sounds like a glorified Monte Carlo simulation, not exactly something newsworthy..
  • Hat. Old. (Score:4, Interesting)

    by PJ The Womble (963477) on Thursday April 03 2008, @09:10PM (#22959340)
    I used to do Delphi stuff (I know) for a firm of insurance actuaries. They were writing code for (essentially) predicting how long it would take to pay out for natural disasters. They had some very clever Stochastics in there, along with some nice triangulation/vector stuff too: I remember the names Bornhuetter and Ferguson (sadly it's been a long time and there's been the odd small sweet sherry since, so life isn't that clear recently).

    What I do remember though, is that I mentioned to my superiors that a case-based reasoning engine would take a lot of the (non-discrete) math out of the whole thing. Because things happen and we learn from them. Has the nature of nature changed, or was I wrong in the first place?
    • It's just occured to me that my comment above is a nearly a good example for the discussion (on here? maybe) the other day about the desirability of more complex algorithms, versus the greater and greater amounts of data available, when data mining. Any thoughts?
  • And so the Federal government will spend $millions, probably $billions, on no-bid contracts for all kinds of fancy gear, but still won't fix the levees protecting New Orleans.
  • by theodp (442580) on Thursday April 03 2008, @10:33PM (#22959864)
    And thanks to IBM, responding to a crisis of 9/11 or Katrina magnitude strikes may constitute patent infringement. Big Blue has a patent pending for Optimizing the Selection, Verification, and Deployment of Expert Resources in a Time of Chaos [uspto.gov], which covers responding to 'episodes of profound chaos during hurricanes, earthquakes, tidal waves, solar flares, flooding, terrorism, war, and pandemics to name a few.' It's apparently this easy [flickr.com].
  • by YetAnotherOnlineAcct (1267424) on Friday April 04 2008, @01:19AM (#22960498)
    Back in the mid 90's I was working on some logistics systems. I remember seeing a software package from some Swedish company that used stochastic programming. The software did spare parts optimization. Tell it what sort of spares you need (Jet engines, parts for oil well), where you need them (O'Hare, an oil rig), how much they cost (I don't know!), how much they cost to store, where you have warehouses, how much storage costs, how long it takes to get one if you need to order it from Boeing or something, what's the interest rate if you need to borrow the money to buy the parts, how long it takes to get from the storage site to where it's needed, and of course the failure rate of the parts, and a few more things I can't remember......

    In other words, it took LOTS of data.

    But, once you entered the data, you could tell the system "I want 99.999% uptime" and it would give you the most cost efficient way to buy and store the parts needed. Or you could start with a budget and find out what sort of availability you could afford. Depending on the size of the operation and criticality of the availability you could save a lot of money or really help with availability.

    It sounds like this software does something similar. In the spares optimization, you don't know which airport your plane will be at when it's engine needs replacing. In the disaster scenario, you don't know where the disaster will strike. In the first case, you're optimizing spare part allocation. In the second you're optimizing recovery supplies and equipment. Either way you get the best probabilities you can and optimize the best you can.

    Yeah, I know. I read the article. AND posted an on-topic, very un-funny comment. I must be new here. Well, this user ID is new, at least.

  • stupid (Score:4, Insightful)

    by nguy (1207026) on Friday April 04 2008, @01:39AM (#22960580)
    "'We are creating a set of intellectual properties and software assets that can be employed to gauge and improve levels of preparedness to tackle unforeseen natural disasters,' says Dr. Gyana Parija.

    Many research groups are working on simulation and prediction of behavior, natural disasters, preparedness, etc. But the first words out of an IBM researcher's mouth are "intellectual properties and software assets".

    Shame on you.
    • Re: (Score:3, Interesting)

      Why shame on them? They're not government, and they're not academics. They wouldn't be doing the research if there wasn't a way to make a buck off of it. If you don't want to shell out for their knowledge or their 'software assets,' then feel free to turn to one of the many other research groups who aren't working for a profit.
  • Oh, yet another SD article completely composed of BS! Geeez, can we stop with the "I'm using really, REALLY complex (math/algorithms/hardware/physics/chemistry/lollipops) so therefore, my research can do this impossible task that nobody else can do. What's funny, in a year or two, all is forgotten about said "complex algorithms" ...blah..blah...blah...
  • The current financial market crisis is considered by many economists and finance professionals to be due in part to the failure of such computationally-intensive risk-management models as those it sounds like IBM is creating.
      • Re: (Score:3, Interesting)

        Want to know something REALLY funny about your comment? The reality is that what they are talking about is typically applied to financial modeling. Though part of the problem we have right now is that the quants ("really smart") guys screwed up the analysis and underdid the risk.

        Thus the reason why they are with IBM doing analysis using stochastic modeling is because they failed in the financial industry. They did not improve returns and thus needed another industry that they could tap for money.

        I work in t
        • Funny, I recall IBM going into chem-pharm consulting about two decades too late and trying to pull exactly that trick there as well...
    • Re: (Score:3, Insightful)

      It's not about predicting the disasters per se, but about modeling the best way to respond to the disasters.

      In other words, it's concerned with how you get drinking water to the Superdome long enough to get everyone out; it's not concerned with determining where the hurricane lands to begin with.