Slashdot Log In
AI Going Nowhere?
Posted by
CmdrTaco
on Tue May 13, 2003 09:54 AM
from the prolog-hackers-unite dept.
from the prolog-hackers-unite dept.
jhigh writes "Marvin Minsky, co-founder of the MIT Artificial Intelligence Labratories is displeased with the progress in the development of autonomous intelligent machines. I found this quote more than a little amusing: '"The worst fad has been these stupid little robots," said Minsky. "Graduate students are wasting 3 years of their lives soldering and repairing robots, instead of making them smart. It's really shocking."'"
This discussion has been archived.
No new comments can be posted.
The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.
What use is AI without an operating platform (Score:5, Insightful)
I understand his frustration in general progress. But, those grad students are building a strong foundation for their later work that may very well meet the goals he is espousing. No need to have design flaws in implementation down the road because the engineer wasn't properly educated in physical design as well as logical design.
-Rusty
Thats a load of rubbish (Score:5, Insightful)
Building any form of AI system is not easy, but copping out of it by building toys is not the answer. We already have platforms for AI; they're called line terminals. Things like pattern matching do not require a fully autonomous robot, after all.
Minsky is right; whats new to come out of actual AI research in the last 30 years?
Parent
Re:Thats a load of rubbish (Score:5, Insightful)
If a human (or any animal) were left to grow with no senses and no method of communication (or the most very basic input/output, analogous to your line terminal), what sort of intelligence would develop? Probably nothing very coherent.
BTW, AI is most certainly not pure math.
Parent
MOD PARENT UP (Score:5, Insightful)
I am an AI researcher and the parent poster is speaking truthfully.
The main challenges in AI at the moment do not concern building the physical robots -- e.g. a piece of kit on wheels with IR sensors or such things.
The main challenges in AI concern applying some very complicated math to solve problems like pattern recognition, density estimation and other forms of machine learning.
It seems to me that a large number of AI PhD students spend their lives tinkering with the mechanics and electronics of the robots that will ultimately be used to test their algorithms. This is wasted time; a good electronics graduate should be able to do the tinkering, it shouldn't require a prospective AI PhD student to do it.
I can see the point in the PhD student learning a little about the hardware that they want to run their algorithms on (so that they know the limitations and common problems with real hardware), but they should not spend all their time doing that and wasting the opportunity to spend their time contributing to their field (i.e. AI, not mechanics or electronics).
That said, many AI labs do not have the funding to be able to pay full time hardware technicians, so in many cases the PhD student *has* to do the tinkering
Parent
Re:What use is AI without an operating platform (Score:4, Informative)
Parent
Re:What use is AI without an operating platform (Score:4, Interesting)
Parent
About Minsky... (Score:5, Insightful)
Re:About Minsky... (Score:5, Interesting)
Oh, say, Rod Brooks, Tomas Lozano-Perez, Hal Abelson, Gerry Sussman, Eric Grimson, Pat Winston, Tom Knight
The difference between Minsky and the rest is precisely as the first poster asserted. Having read Minsky's books, known him professionally and personally, and having taken his course, I must agree that the amount of weight placed on his words are not equal to their value. As others have observed (I forget whom and where), Minksy's original contributions were interesting ramblings at the edge of a new field which happened to pinpoint rich veins of research in some cases, and kill off valuable paths in others (think perceptrons which are, yes, in fact, very useful things, and yes, in fact, do model real neurons reasonably well, and no are not computationally impoverished unless you abide by Minsky and Papert's artifice of only single layers). In otherwords, in some cases, he got lucky, in others he fell flat. This initial success led him to continue pontification (think "Society of Mind", a book of little real contribution), while doing marginally small amounts of actual research. Rod Brooks, in contrast, has made far more, and far deeper, contributions working on his subsumption architecture.
Minsky's course (at the advanced graduate level) consists of students listening to his musings and ramblings which he often repeats through the term, since he has no syllabus, no agenda, and no apparent desire to teach. When he gives talks, they are all extemporaneous; someone like Churchill could pull that off, Minksy's stream-of-consciousness style keeps his acolytes happy, but leaves those with real thirst for knowledge quite parched. Does this not fit the accusation?
So what if Minksy thinks graduate students shouldn't be soldering robots? Does that matter? So what if the current AI field isn't following his pet projects, is he making any contributions himself? We've made tremendous strides in AI over the past decade; they just haven't been where Minksy thinks they should be, despite his questionable over-all track record. Exactly why should anyone care that much?
Parent
Why do you say AI is going nowhere? (Score:5, Funny)
of course it's going no where... (Score:5, Funny)
That's OK... (Score:5, Funny)
I don't see NON-ARTIFICIAL intelligence progressing a whole hell of a lot either...
Maybe the problem is Minsky himself? (Score:5, Interesting)
Re:Maybe the problem is Minsky himself? (Score:5, Insightful)
Now Minksy, never wanting to admit his life's work has been a dead end, comes out saying that it's all these other researchers working in other directions that are at fault for there being no progress. I imagine he believes that if only they'd all climb the tree with him, the trip to the moon could really start.
Parent
Re:Maybe the problem is Minsky himself? (Score:4, Insightful)
But the real AI comes when you create a 'stupid' system that is able to become smart through learning and training. He feels dissapointed because nobody (or almost nobody) is focusing in this direction.
You have smart toys ala Aibo, and smart systems ala Eliza, and a lot of people is working towards creating smarter toys and smarter systems, but the real breaktrough will come when somebody manages to create the dumbest system possible.
Parent
Re:Maybe the problem is Minsky himself? (Score:4, Interesting)
Parent
Two unknowns dont make stuff work (Score:4, Insightful)
I very much enjoy the works of Markram and Tsodyks. What they mainly analyze is how two nerve cells can interact with each other. They showed how they change their connection weights and how the timing of spikes, nerve impulses, affect how neurons connect to each other and how they transmit information.
While these studies tell us a lot about the underlying biology they do not tell us what these modes of information transmission are used for. For years it had been known that synapses have complex nonlinear properties. Biology pretty much does not constrain what functions neurons compute.
Thats why I do not believe that such studies will bring us nearer to real AI anytime soon. The algorithms coming from these systems are severely underconstrained. A lot of modelling has followed the pioneering works of Markram and Tsodyks, one of them being Maas. All these algorithms are very fascinating and might yield insight into the functioning of the nervous system.
The algorithms however are lightyears from being applicable to real world problems. The field of AI is old and in some sense quite mature. None of the "biologically inspired" algorithms today can compete with state of the art machine learning techniques.
Parent
Intelligence isnt the problem (Score:5, Insightful)
reply to MYCROFTXXX@lunaauthority.com
Re:Intelligence isnt the problem (Score:5, Funny)
Parent
Biology First (Score:5, Insightful)
Re:Biology First (Score:5, Insightful)
And artificial intelligence doesn't necessarily have to reflect human intelligence.
Parent
disappointing (Score:5, Insightful)
This is the most interesting comment to me. Because we understand the nature of the process that produces supposedly 'intelligent' results, (and we don't understand the same process in ourselves), we perhaps rightly just view the resulting system as just an application.
Seems like Minsky is throwing all his toys out of the pram because he doesn't want to admit to what everyone else has been saying for a while: that whether a computer can think is at best an astonishingly difficult question to answer and at worst meaningless. I'm a grad student who's just spent a year looking at computational linguistics and semantics (amongst other things), and the most debilitating restriction on the semantic side of things is the problem of so-called 'AI-completeness', which essentially says that if you solve this problem you have a, externally at least, thinking computer. Really simple things like anaphora resolution are AI-complete in the general case. If we could have solved this problem by now, I think it's fair to say we would have done, given its massive importance. However, we know that the brute-force case is ridiculously intractable, and we can't figure out how to do it any more cleverly. Roger Penrose argues that this is due to the fundemental Turing-style restrictions that we place on our notion of computing. Until we get a paradigm shift at that level, we're likely never to solve the general case.
And I'm sure that Minsky is aware that attempts to solve constrained domain inference and understanding have been taking place for a good long time now. I just don't see why he's so upset that the field of 'AI' (which is a nebulous catch-all term at best) has shifted its focus to things that we stand a cat in hell's chance of solving, and that have important theoretical and practical applications (viz. machine learning). Replicating human thought is not the be-all and end-all, and you can argue that it's not even that useful a problem.
Robots, though, I agree with. Can't stand the critters
Henry
The Cyc project (Score:5, Informative)
Shocking, indeed! (Score:5, Funny)
What? Grad students are doing tedious, repetitive, mindless labor instead of making glamorous, thrilling, world-changing breakthoughs? This is an outrage!
Thank heaven I have a Ph.D. and got to spend this morning in the thrilling activity of drawing blood from 30 angry mice. I'm hoping to have the urine smell washed off before lunch.
But Robotics Must Precede AI (Score:4, Insightful)
Trying to program intelligence purely with software puts the researcher at a disadvantage, since even the most fundamental rules and attributes of things (fire is hot, water is wet) have to be explicitly entered as constant variables.
Once robotics advances to the point where mobility, vision, and speech recognition can be taken for granted, then AI can be programmed as an add-on.
Body first, mind second - That's how animals evolved on this planet, and it's how, I believe, Rodney Brooks approaches this field.
Pot, meet Kettle (Score:5, Insightful)
Yeah, much more shocking than the -- decades -- he (and others in the 'hard AI' camp) have been spending? They've made oh-so-much more progress, haven't they?
Rodney Brookes made more progress with his robots in the early nineties than the whole hard AI camp did in 3 decades. I remember seeing a documentary once comparing this huge robot which used a traditional procedural program to navigate through a boulder-strewn field. It took about 3 HOURS to decide where to put its foot next. Meanwhile, little subsumption architecture-based robots were crawling around like ants, in real-time. (Oh, and some of them had to learn to walk from first principles every time they were turned on -- only took about half an hour!) That's the most damning evidence of the failure of hard AI I can think of.
As others here have said, what good is a brain until we get a useful BODY working? Manueverability and acute senses are a must before an artificial intelligence can do anything useful, or learn from its environment effectively.
Minsky only has himself to blame. (Score:4, Insightful)
Promising subfields like perceptrons were intentionally quashed by him... he went out of his way to strangle investment and research in areas he considered to be a dead end. We're not literature majors: we can't just all say the same thing in a party over wine and cheese and call it progress.
Even bad ideas, when well explored, can give new meaning and better approaches to a field. And since this is research, noone knows the correct answer: even a dumb-seeming idea may turn out to be the right one-- or give us clues about features the right answer needs to have.
Of course we've had major advances in AI. One of the challenges of AI, as the article points out, is that once something is well understood, it is defined as being outside the AI field. Computer vision, face recognition, voice and speech recognition. Conversation engines like SmarterChild. No, this isn't HAL, but they are good, positive steps in the right direction.
Old guard moving out (Score:5, Interesting)
He comes across as affable but bitter. I found it strange that though he cointually complains about the leadership of the AI lab, he and his protege Winston were in control of it for some ~30 years without making any groundbreaking progress. In fact, Minsky's latest work "The Emotion Engine" is simply a retread of his decades-old "Society of Mind." I suspect that now that Brooks and the new guard are moving in, the old guard is looking for someone blame its lack of results on.
Minsky + Brooks (Score:4, Interesting)
"AI has been brain-dead since the 1970s."
I agree, unfortunately. At least, what was traditionally meant by "AI" has been brain-dead. There is very little focus in the field today on human-like intelligence per se. There is a lot of great work being done that has immediate, practcal uses. But whether much of it is helping us toward the original long-term goal is more questionable. Most researchers long ago simply decided that "real AI" was too hard, and started doing work they could get funded. I would say that "AI" has been effectively redefined over the past 20 years.
"The worst fad has been these stupid little robots."
Minsky's attitude towards the direction the MIT AI lab has taken (Rod Brooks's robots) is well-known. And I agree that spending years soldering robots together can certainly take time away from AI research. But personally, I find a lot of great ideas in Rod's work, and I've used these ideas as well as Marvin's in my own work. Most importantly, unlike most of the rest of the AI world, Rod *is*, in the long run, shooting toward human-level AI.
Curiously, just last month I gave a talk at MIT, tited "Putting Minsky and Brooks Together". (Rod attended, but unfortunately Marvin couldn't make it.) The talk slides are at
http://www.swiss.ai.mit.edu/~bob/dangerous.pdf [mit.edu].
In particular, I shoot down some common misperceptions about Minsky, including that he is focused solely on logical, symbolic AI. Anyone who has read "The Society of Mind" will realize what great strides Minsky-style AI has made since the early days. I also show what seem like some surprising connections to Brooks's work.
- Bob Hearn
Minsky is dangerous (Score:5, Insightful)
Before you yell flamebait or troll, let me explain.
I have been following the progress of various AI technologies, including neural nets and adaptive logic networks, for many many years now. Years ago perceptions were first developed and it was shown that they could learn simple patterns. Perceptrons were basically two layers of software simulated neurons. They worked, and researchers were fascinated and worked on them regularly.
Minsky, being the "highly regarded" and "leader" in AI, wrote a paper that proved that these perceptrons could never learn more complicated patterns, and threw a bunch of math at the reader. So people stopped. After all, there was a mathematical proof that perceptrons weren't going anywhere. Research skidded to a halt for decades because of Minsky.
Of course, then someone developed the (gasp!) THREE layer perceptron/neural net and sure enough with the right formula it could learn much more complicated tasks.
Minsky, in my opinion, does this regularly. The problem is, that he has a reputation in the industry as being a leader (I'm not sure why).
He's already lost us two or three decades of research because of his "leadership" -- I am terrified that he might cost us more development into the future.
Where could we have been if Minsky wasn't always going around half cocked, screaming that he is right? "Robots are useless!" is history repeating itself and him trying to get more press. Keep developing guys, just ignore the peanut gallery. There's always someone who says it can't work (ahem, Minsky) -- it can and it will.
Critical? (Score:5, Insightful)
People just accept it, and progress is delayed.
Why is it his fault that there are so many followers? If anything is to be blamed is that these researchers just blindly follow whatever he's saying rather then take a good critical look at what is going on.
If his math and theory "proved" that an area of AI was a dead end, and it wasn't, his math/theory was wrong. It is a sad state when nobody dare challenge the status quo.
Parent
Missing Minskey Quote (Score:4, Funny)
"How the hell am I ever going to be able to download my brain into these damn little robots if they don't hurry up and make them smarter? I running out of time, dammit!!!"
Don't build robots, simulate them (Score:5, Interesting)
Human Level AI's Killer Application - Interactive Computer Games, John E Laird and Michael van Lent American Association for Artificial Intelligence AI Magazine Summer 2001 pp 15-25
My summary of the above - the AI in games might not be too hot (some would dispute with the academics about that but let it go), but game environments themselves are complex enough to pose a challenge for state-of-the-art AI researchers.
I went to a "BOOM" conference at Cornell... (Score:5, Interesting)
So I found myself standing in front of a computer screen. It was a worm swimming through water! In 3D! In real time! After I pushed my jaw shut, I began to ask the genius student some questions...
"Is that real-time?" "Well, actually, no, that is a 10 second looping clip that took a week to calculate."
"Well, I see a neural map there. Is that complete?" "Well, actually, no, that is a simplified version of the real nematode nervous system, on the order of about 1 simulated neuron to 10 actual neurons."
"So you simulate neurons! That's awesome. Let's see the code." (He proceeds to flip through 4-5 pages of very sophisticated-looking mathematical equations to describe the behavior of ONE neuron.)
What a let-down! No wonder Minsky is pissed, real AI is HARD!
Software is behind, not hardware (Score:5, Interesting)
AI winter II ? (Score:5, Insightful)
"AI winter" [216.239.51.104] is the name given to the collapse of strong AI as a business model in the mid 80's - expert systems and symbolic AI in general didn't deliver on their promises, and so the money went away. As a guy who got his doctorate in AI in 1985, I can tell you all about it.
One of the major causes of AI winter was researcher hubris - lots of people hacked up systems that appeared to solve 80 percent of certain complex problems and then said "all that stands between us and a complete solution is money and time". For many of those systems, solving the last 20 percent would have taken 2000 percent of the time, if it could have been done at all. The tragedy of AI winter, though, is that basically all of symbolic AI was abandoned, though some of it is creeping back out into the light with obfuscated syntax (see my
What Minsky sees here is a lot of people heading down the same path, but with neural nets and small robots instead of expert systems. The new systems are doing some interesting things relative to the old symbolic AI systems (though they do have the advantage of 20 years of Moore's law to help them). But, will they scale up? Right now, nobody knows. If they don't, the last thing the field needs is another cycle of overpromise/underdeliver/abandon.
Maybe AI is just plain hard, and cracking it will take longer than one or two computer industry business cycles.
i thought it was about al gore (Score:5, Funny)
well duh!
what idiot made the lowercase L and uppercase I look the same?
but, since we're on the subject, did you know Al Gore invented the field of AI?
Re:Will we ever have *real* AI? (Score:5, Informative)
One could argue that our brains are just synapses firing. Each one on it's own knows absolutely nothing. However, it's the SYNERGISTIC effects of all the synapses working together that creates our brain, which allows us to reason, etc (Note: This is without religion getting in the way, I'd personally not go there...)
Steve
Parent
Re:Will we ever have *real* AI? (Score:5, Interesting)
Parent
Re:Will we ever have *real* AI? (Score:5, Funny)
My parents had no problem producing a brain; four in fact. Maybe I'll create some myself some day. I could tell you how but I'd need a signed note from your mom
Creating brains isn't hard; creating artificial brains is.
Parent
Re:Will we ever have *real* AI? (Score:4, Funny)
Parent
Re:Will we ever have *real* AI? (Score:5, Interesting)
Define "real, true intelligence"
> You can try to simulate that, but so far
> simulation consists of what amounts to a
> gazillion 'if' tests
That's what tradiditonal AI school is doing. Yes, you are correct. It won't go anywhere. On the other hand spiking neural networks are very promising. Search google for "liquid state machine". These researches are making progress novadays, not Minsky.
Parent
Re:Will we ever have *real* AI? (Score:5, Insightful)
* One might claim LTP or LTD as some sort of neuronal knowledge. Ok, that's fair, but my point stands if you apply it to the building blocks of neurons. Do ion channels "know"? Do amino acids? It's turtles all the way down.
Parent
Sour Grapes (Score:5, Insightful)
Parent
Re:Sour Grapes (Score:5, Insightful)
He's right. Theoretical work has ground to a halt in the U.S. Universities have succcumbed to business-oriented research to make money -- although, given all that cash, it's amazing that tuition keeps skyrocketing.
Government is now pretty much owned by corporate people, and they aren't metering out grant money to loing-haired theory about AI. Grant-driven University research is no pretty much a free source of corporate R&D.
Minsky's right: AI as science has died, not because it was impossible to improve the theories, but because it wasn't making any money.
Parent
Re:What about my AIBO? (Score:4, Insightful)
to an extent yes it has decent pattern recognition. can it pick you out from the rear? no. side? no.
Can it simulate and fool you into thinking it is showing emotions ? yes. is it anytihng but an expensive toy? no.
the Abio is amazing, but it hardly does what people think it does. and that is the key with the abio.. it does alot of things that fool humans quite well.
it will get better, but it is hardly near AI material.
Parent
Re:What about my AIBO? (Score:5, Insightful)
My dog can do the same thing.
Parent
Re:What about my AIBO? (Score:5, Insightful)
Parent
Re:What about my AIBO? (Score:5, Insightful)
It doesn't work this way, and yes, there is a difference. Having an outward appearance of intelligence is not enough to show intelligence. Read Searle and Block's discussions on the Chinese Room argument -- it's a fascinating and eye opening read (I think it was Block that -- quite convincingly, IMHO -- makes the case that most of our intelligence is innately biological, and "strong AI" not even possible with what we know today).
IMHO one of the problems with AI is that we don't even know what human intelligence is, and until there is a fundamental advance (not technological but in our understanding of our human/biological mind) then it seems to me the most we can hope for are machines that mindlessly ape intelligent behavior, but are not intelligent in any but very superficial ways or by very loose definitions.
Something that mimics the outward appearance of intelligence is a far cry from what, hopefully we'll be capable of in the (probably still distant?) future.
Parent
Re:What about my AIBO? (Score:4, Interesting)
What about pattern recognition? How long do parents spend holding up pictures of various animals or various shapes for their children to identify?
When it gets right down to it, every one of us has been significantly programmed by our parents, teachers, and government. I am not arguing against the system, just saying that's how it is. I don't believe AI as anticipated will ever truly exist because the degree of creativity and imagination desired exists only in humans either because of an all-knowing, all-powerful creator or millions of years of mutations.
Parent
The 'A' stands for artificial! (Score:4, Funny)
You can't get that much out of most humans!
Parent