The Scientific Internet 70
ManicDeity writes "'Forget the Matrix. It's time for the Grid-' From the good people at CERN who brought us the WWW comes a new network designed for scientific use named GriPhyN (Grid Physics Network). Loosely described 'as a Napster for scientist' it is being developed to handle the massive amounts of information created from the highest energy experiment to date. The article can be found at Space.com. " It was my understanding that this was part of what I2 was supposed to do - but this looks cool as well.
Re:The tragedy of the commons. (Score:2)
I think you are overestimating the effect of the free rider problem. Obviously, just like Napster or Gnutella, people can use more resources than they provide, but as long as each participant has a priority on their own machines, they are likely to overall gain more than they lose. Because you are likely to have access to more computer resources when you need it, and you only give up resources that you don't need.
(Offtopic digression into Middle Ages)
Actually, from what I've learned of the middle ages, the commons where used as a place to go crops for the entire village. They were established after northern farmers developed a heavy plow that could work through the rougher soil of northern Europe. The heavy plow required a huge number of team of oxen and not only could every farmer not afford such a team, but it had an enormous turning radius, and so it was much more difficult to individually plow each farmer's small plot. The commons system began to fail as horses and calvary became more popular. (People were only considered free if they could fight, and few people could have their own horse so they had to pledge to a Lord and become their vassal.) Perhaps herders used the communal system as well, but it was afaik developed out of agrarian interests).
For some real info (Score:1)
http://grid.web.cern.ch/grid/ [web.cern.ch]
And yes, it'll run on Linux (at CERN anyway, they're quickly getting rid of all the "legacy RISC" platforms here)
It's not really about having fast pipes all over Europe, it's more like having software you can run to have your applications running on thousands of nodes around the world and also managing all of it.
Warning (Score:1)
Grids are basically meant to be wide area networks allowing services that were previously available in local area networks only, such as load balancing between different supercomputing servers and real time analysis and visualization of several terabytes of simulation data.
I am aware of two such projects, one in the US, and the other one
Of course the technology will be there to be made available - at a later stage - to the general public, but don't hold your breath.
--
Re:Metalication (Score:1)
Re:Doesn't sound like napster (Score:2)
I work on a related project the Particle Physics Data Grid and can correct this a little.
It can be true that the data gets pushed (on PPDG the clients do actually pull quite directly, but that's an unimportant distinction), but only after a definition of the data that would be useful for that system (here we mean system as either a box, or a cluster, or whatever... Some set of resources). So it's a bit like Napster in that you say what you are interested in, but with pretty complex access to meta-data and, of course, vastly larger return sets.
So while the data pushing seems a bit less Napster like, the fact is it's really only confusing because of the timing of events. The idea of data caches and drawing datasets from wherever they might be available is a fair analogy to draw.
The Grid? (Score:3)
We won't get fooled again.
-Chris
Re:Science? Or something else.... (Score:2)
One would surmise that the good lord would build something a little more tolerant of change
How that proves there is a diety.. I dunno..
A study shows that over 90% of people who died of cancer in the last 20 years ate carrots throughout their lives. So carrots cause cancer?
Re: (Score:2)
Berners-Lee in league with Gore. (Score:2)
Third Paragraph: "In late 1990, Tim Berners-Lee, a scientist at CERN, the European Laboratory for Particle Physics near Geneva, Switzerland, invented the World Wide Web."
Uh... pardon me, but... no... he didn't. He invented http, which combined with tcp/ip, hard and software out the wang, and a small pinch of timing, allowed the WWW to come into being over the next several years.
$WWW != 'http';
my $WWW = "A vast number of sites, on a vast number of computers, all strung together over miles of cable, all glued together by http and tcp/ip, and allowing for communication, collaboration, and personal expression on a scale never before seen.";
But that's just me. I could be wrong. If Gore has anything to do with it, I guess I am.
Paragraph Seven: "Petabytes of data means a thousand trillion bytes. This is the amount of data that can be stored by a million personal computer hard drives." Oh really. A million, eh? I guess the size of the drive doesn't matter then? W/o doing the actual math, I suppose I could fit a petabyte on a million of my old 120MB drives, just as easily as on a million of my new 75GB drives...
Audience, schmaudience...
This looks more like Gnutella... (Score:1)
Colin Winters
and the algorithms? (Score:1)
For instance, the human genome project, which is often sited as a potential application of the GRID, suffers more from lack of knowledge, not not number crunching. We only need to to assemble the bits of the genome once, and when its done, it's a few gig of data lying around on our hard drive. The problem is more that we don't fully understand how the body gets from a DNA sequence to a properly folded protein, let alone, what the resulting lump of atoms actually does. More crunch won't help - deeper insights will.
Secondly, what generally happens when you do a lot of processing of discrete bits of data, is that you end up with another database holding the results. Then, you have to sift through that database.... Crunch is all very well, but unless you know what to do with the results, it's a waste of time.
Distributed Computing (Score:2)
Re:What happened to Internet2? (Score:5)
http://www.ucaid.edu/abilene/
Re:What happened to Internet2? (Score:1)
If the article had listed the partner sites for GriPhyN we would have seen that they are all Internet2 institutions...
If you want more information, here is the GryPhyN homepage
http://www.phys.ufl.edu/~avery/mre/
--Dan
Grid vs Matrix (Score:1)
Those of us who've taken math know that a grid is a matrix.
Re:Doesn't sound like napster (Score:2)
s/napster/peer-to-peer/;
--
secrets (Score:2)
Re:Napster? (Score:1)
What this is all about (Score:2)
It's not just a file servers and bandwidth (Score:2)
On a more personal level, It's simply staggering how well everyone has managed to keep Moore's law chugging along since I got into things back in the early 1980s. I wrote a web page to compute disk prices [tsrcom.com] back in 1991, and I keep having to revise it to be more optimistic every 2-4 years!
--Mike--
How much iron is 11.9 million dollars going to buy (Score:1)
Even if this happens, what if some scientist from geneva wants to use all this distributing power to give his distributed.net scores a boost? It's supposed to be as easy as using the electrical grid. "When scientists submit a processing job to this worldwide network of computers, the only thing they care about is that the job gets done. They don't know which machine (or machines) the work gets farmed out to." Who's going to pay for all this processor time? I guess they will have to install meters on the side of the scientist's building, and someone will have to come check it monthly.
Something tells me the author of this article, Katherine Freese, had to sit down and listen to alot of frustrated but free-publicity-loving people give metaphors so she could begin to comprehend.
Scientist says : "No, if we do this the ship won't fall over the edge of the earth, the earth is round."
She writes : "Scientists develop new technology to allow ships to stick to the bottom of the earth."
Re:How much iron is 11.9 million dollars going to (Score:1)
The 11.9 million bucks is for R&D only - it will pay mostly for people. There will be some clusters purchased with this dough, but just for development. The money to purchase the big iron will come from a separate grant, which is just beginning to be negotiated.
Even if this happens, what if some scientist from geneva wants to use all this distributing power to give his distributed.net scores a boost? It's supposed to be as easy as using the electrical grid. "When scientists submit a processing job to this worldwide network of computers, the only thing they care about is that the job gets done. They don't know which machine (or machines) the work gets farmed out to." Who's going to pay for all this processor time? I guess they will have to install meters on the side of the scientist's building, and someone will have to come check it monthly.
I believe there is no answer yet to the questions "how do we guarantee that only `grid` jobs run on the network?" or "how do we bill the grid customers (if at all)?".
Cheers,
Craig
Re:Use of existing technology (Score:1)
As much as I'd like to say that scientists are naturally skeptical of the gee-whiz hype associated with new technologies, it really isn't true.
I'm not associated with GriPhyN, but my boss is one of the principle investigators. There was a distributed computing project called Nile [cornell.edu] which did suffer (IMHO) from pushing some new technologies where it wasn't really needed. The result was slowed development, the initial prototype came out a lot later than it should have, and the whole project suffered.
So I think the decision to go with proven tech was due to a lesson learned the hard way.
---
#include "disclaimer.h"
Correction: CERN did not bring us GriPhyN... (Score:1)
Not true - CERN is neither responsible for GriPhyN [griphyn.org] (which is an NSF project), nor the invention of the data grid concept. The experiments at CERN (and other places) "merely" drive the need for something like GriPhyN.
That said, there is a European project similar in scope to GriPhyN, which CERN is a part of: the DataGrid Project [web.cern.ch].
For a book about Grids, you can look for "The Grid: Blueprint for a New Computing Infrastructure", edited by Ian Foster and Carl Kesselman. Both are on the GriPhyN project: Dr. Foster is a principle investigator on GriPhyN, and Dr. Kesselman is one of the Senior Personnel.
Open it up to everyone (Score:1)
Re:What happened to Internet2? (Score:1)
Come off it! (Score:1)
The "Napster for scientists" thing is probably a dumb thing for someone to say in the first place. But even beside that, I think what bothers me is "Note how scientists are encouraged/enabled to share ideas/data/information. Note how the hoi polloi are not."
This may shock you, but COPYRIGHTED MUSICAL WORKS AND SCIENTIFIC INFORMATION ARE NOT THE SAME THING. Believe it or not, your making "Uncle John's Cabin" available on the web does not help anybody, unless by help you mean, "allow people to pirate Grateful Dead tunes." There is no reason for you and a thousand other people to go over it and try to figure out what brand of guitar is being played. The sharing on Napster is a way to get around paying for music, and nothing more. No matter how you sugar coat it, that's what it is.
On the other hand, this "Napster for scientists" has a couple of big differences. First off, the people who generate the data are the ones putting it up. It's not like someone got ahold of someone else's data and thought, "You know. This is really good data. I want some more," went out, found pirated copies of the data on Napster, and downloaded it. This is a fundamentally different situation, and it didn't bear the comparison in the first place. The comparison having been made, though, it certainly didn't require your comments about how this is another example of the intelligentsia beating up the proles.
Re:"Napster for scientists" (Score:2)
The sharing of information has been around for a while. In the automobile industry, open standards, and the absence (to a degree) of secrecy, has made the industry.
Re:"Napster for scientists" (Score:2)
I see. So how many petabytes spare capacity have you got? This is serious data here. All we are talking about is a community of people using the Internet to do their job.
So, some Universities have got together and are planning on using it for research, as was originally intended. What's the problem with that? They'll publish when they're ready, else the funding will dry up.
Re:"Napster for scientists", semi-off topic (Score:1)
Actually, although it is true that scientists publish their results in peer-reviewed publications available to the general public as well as the scientific community, most scientists I know who compete in a particular field generally hold of on the sharing of data amongst themselves as long as they can to avoid being "scooped" by their colleagues. This is IMHO a major problem concerning the current funding model for publicly funded research grants. The lack of cooperation between researchers, due to the intense competition for research funding, leads to wasted repetition of effort and IMHO generally holds back progress, as well as making science less fun for all involved.
Scientists do share more than industry does; but they could share more than they are.
Re:What happened to Internet2? (Score:1)
I2 had nothing to do with distributed computing model as described in this article.
Re:Science? Or something else.... (Score:1)
Don't assume that 1-13 are effects of a god. Merely causes for the effect of life.
Re:Science? Or something else.... (Score:1)
The tragedy of the commons. (Score:2)
This is also called zero sum gaming in which everyone wins a little if they all play fair, but the first one to cheat will win everything and the rest will lose.
If all universities equally share their computers, then they all win a little. But if my university scrimps on their computer budget then I can save a lot of money, and still get all my computing done using other peoples computers. My university wins a lot.
Also people will be lazy in writing their algorithms because they know that their code will still run, it will just need more processors on more machines to execute.
Eventually it is possible that all universities stop paying for a computer budget, every thinking that they can save money by using other peoples computers, but in the end there is not enough computing power to share.
A more fair system would be similar to how your electric meter works. The university reimburses those other computer systems based on how many cycles of processing are used. This would also tend to force people who want to do this work to use efficient code algorithms thus saving even more money overall.
Was it Heinlein that said There Is No Such Thing As A Free Lunch (TINSTAAFL)?
petabytes? (Score:1)
What happened to Internet2? (Score:1)
(Sorry if it's offtopic, but if I2 did take off it would be ideal for everyone...)
Richy C. [beebware.com]
--
Re:What happened to Internet2? (Score:1)
Richy C. [beebware.com]
--
Internet2 and Data Grids (Score:2)
Looks like the author of the article is confused about the difference between networks and applications. Research and Education networks, such as Internet2, are there to facilitate existence of advanced applications, such as various data grids, teleimmersion, LBE bulk data transfers, etc.
Appearence of new applications reinforces the need for advanced networks, not the other way around. In fact, we (Internet2) work with the U.S. counterparts of the described European project
Perhaps a lot of students don't realize this, but all traffic between Internet2 participating Universities goes over Abilene (Internet2 backbone).
More information about Internet2 and its activities can be found at:
Re:Metalication (Score:1)
Re:i dont know why, (Score:1)
Re:Metalication (Score:1)
Re:secrets (Score:1)
For that matter, there's a very detailed description of how to build a fusion bomb that was published in one of Tom Clancy's novels (I think it was called "An Ominous-Sounding Title" but I'm not sure). At any rate, only the technological implementation of nuclear fusion or fission can be considered a secret. As if it matters; our current stockpile of missiles is still fully capable of wiping humanity from the face of the earth. What difference is one or two more going to make, honestly?
Re:Science? Or something else.... (Score:1)
Re:Science? Or something else.... (Score:2)
But wait, you're ignoring two simple facts: the other explanation for this amazing set of coincidences is that we have evolved within the conditions you describe and are therefore perfectly comfortable.
Who says that life must have liquid water?
Who says that life must have 70% nitrogen?
Who says that planets must have perfectly circular orbits?
Who says that cosmic rays are bad for life? They're bad for us. But that's just us.
What characteristics of water are essential for life?
How is the thickness of the crust designed? How do you know what it would be like if it were thinner, or thicker?
You have no other examples of life, intelligent or otherwise, to display. So none of what you say means much to me. There are billions of other star systems, around which there may be billions of other planets. Your string of amazing coincidences is an appeal to a very small sample. We do not know what conditions are like in most of the rest of the universe. More specifically, YOU do not know. I am certainly not going to listen to your opinion on a matter of which you have displayed such profound ignorance.
Your argument is that of a four-year-old child who cannot see past the end of his own nose. Because I have a four-year-old I am familiar with the condition and imagine that someday you'll mature enough to realize that there is more to the universe than you are prepared to understand. I don't particularly care if you do, of course. Evolution will take care of those who cannot adapt to reality.
Re:Science? Or something else.... (Score:2)
Re:secrets (Score:2)
Re:Science? Or something else.... (Score:1)
Metalication (Score:2)
psssss... No one tell Larz...pass it on....
Re:Metalication (Score:2)
BTW get over the IP thing, most scientists will be the first ones to tell you that information should be free.
Re:i dont know why, (Score:2)
Re:Metalication (Score:1)
Doesn't sound like napster (Score:2)
Re:For more info about the GriPhyN check here (Score:1)
You could also read the original project summary [griphyn.org] for the Grid Physics Network.
Although the site linked by the story (or click here [ufl.edu] for your One-Link (tm) GriPhyN info, in case you're too lazy to check the article out) has more new info that the original one, and it's more easily understood.
(Grrr. It's Preview, not Submit. It's Preview, not Submit).
For more info about the GriPhyN check here (Score:3)
Here's what they're proposing to use the GriPhyN for: The four physics experiments are about to enter a new era of exploration of the fundamental forces of nature and the structure of the universe. The CMS and ATLAS experiments at the Large Hadron Collider will search for the origins of mass and probe matter at the smallest length scales; LIGO (Laser Interferometer Gravitational-wave Observatory) will detect the gravitational waves of pulsars, supernovae and in-spiraling binary stars; and SDSS (Sloan Digital Sky Survey) will carry out an automated sky survey enabling systematic studies of stars, galaxies, nebulae, and large-scale structure.
The race i$ on!!! (Score:2)
Napster? (Score:1)
Re:Napster? (Score:1)
This seems less like Napster... (Score:3)
-------------
Use of existing technology (Score:1)
It's a lesson millions of Microsoft ME and 98 buyers could have done well with.
Oh great, another Napster. (Score:2)
"Remember, corporate greed comes before ethics!" -TBWA/Chiat/Day board meeting
Re:The tragedy of the commons. (Score:1)
Re:Science? Or something else.... (Score:1)
Millions of woman were raped.
Every year thousands of children are shot by guns.
etc etc...
Yeah, praise the Lord!
Re:Science? Or something else.... (Score:2)
2. If the rotation of the earth took 4 more hours, I could get 10 hours of sleep each night and still spend 18 hours working/partying.
3. Um... nearly circular orbits are the norm for any forming solar system. Take any cloud of gas, start to condense it in free space, and bingo!
4. These same gases cause Venus to be a raging cauldron of heat.
5. And if it were only 60 feet away, it would plow over all tall buildings, making construction of anything more than mud huts very dangerous.
6. Damn. I just dug a hole in my back yard. Guess we're all gonna die now.
7. The tropics experience no appreciable change in climate due to the tilt of the axis. They always recieve direct sunlight. Stuff still grows there.
8. Venus also has an atmosphere. So does Jupiter, so does Saturn...
9. Well, who put those meteors out there in the first place, eh?
10. What is to say that a different sized planet would not simply give rise to a different form of life?
11. Again, see previous comment. Essential to all forms of life that we know. Seeing as we have a very limited experience, this isn't really fair.
12. Sorry, I'm running out of snarky comments.
13. Again, life as we know it.
You're probably bored of reading this by now, but if you are not, consider this: In an infinite universe of infinite possibilities, assume there is a finite chance that the conditions necessary for life will arise. This leads to an infinite number of worlds which will support and contain life, and of course, at least one person who will insist that HIS world is special, that it was manually created by some greater being specifically for HIM.
you know... (Score:1)
BTW...I KNOW ITS DAN QUALE. SHUT UP
"sex on tv is bad, you might fall off..."
They don't stop to think if they should. (Score:1)
"Napster for scientists" (Score:4)
The difference is that when scientists starting publicizing their ideas for the purposes of testing and priority, they also unwittingly tapped into the REAL benefit (to society): knowledge is power. Sure, you can make money off of things that you know that I don't. But that's chump change compared to what we can do if we share what we know. Non-scientific fields have yet to figure this out.
The first society to allow (mandate?) free sharing of ideas to everyone (while still giving scientific-priority-style credit to the originator) is going to look back at us and laugh: "They thought they could advance by keeping secrets! What fools!"
--
nonsense. (Score:2)
I'll be happy with the 'old' one.
what do you think ?
Re:You forget there are sinners (Score:1)
Re:The tragedy of the commons. (Score:1)
Re:Seti@home vs. GriPhyN (Score:1)