Slashdot Log In
Brain Interface Lets Monkeys Control Prosthetic Limbs
Posted by
timothy
on Thu May 29, 2008 08:21 AM
from the what-did-you-do-at-the-lab-today-bonzo dept.
from the what-did-you-do-at-the-lab-today-bonzo dept.
himicos was one of many readers to point out one recent success of scientists working to develop working brain-machine interfaces, writing "A team at the university of Pittsburgh has finally advanced a 2002 technology enough for use in prosthetic limbs, the targeted application all along. Training computer models to the firing patterns of the neurons in the parts of the brain that control motion, they are able to project the intentions of a monkey to a robotic arm, which follows the will of the animal.
The sad thing about the articles is that the beauty of the mathematics used to create and train the models is totally ignored." Reader phpmysqldev adds a link to coverage at the BBC, and writes "This of course brings significant hope to amputees and other other people with physical disabilities." (Note that this research has been going on for quite some time.)
Related Stories
[+]
Robotic Arm Controlled By Monkey Thoughts 327 comments
mallumax writes "The BBC reports that Pittsburgh University scientists have succeeded in creating a robotic arm, controlled by probes inserted into the brain of monkeys. The probes interpret signals from individual nerve cells in the motor cortex. Monkeys were able to grasp and hold food with the robotic arm. Since the number of nerve signals for even small movements is huge the scientists used an averaging algorithm to obtain the movement signals."
[+]
Hardware: Monkey's Thoughts Make Robot Walk 146 comments
geekbits writes "For all those who have at one time or another been too lazy to get up off the couch and go to the fridge and get a beer, heat up some pizza, or change the channel when the remote is missing, we may be one step closer to being able to keep our tushes parked just a little while longer. There may also be some slightly more noble implications here. According to an article in The New York Times, in an experiment at Duke University, a 12-pound, 32-inch monkey made a 200-pound, 5-foot humanoid robot walk on a treadmill using only her brain activity. She was in North Carolina, and the robot was in Japan."
[+]
"Manhattan Project" For Prosthetic Arms 76 comments
cortex tips us to a story about a nationwide effort to incorporate advanced technology into the next generation of prosthetic arms. Researchers for the DARPA-funded project are developing feedback techniques that range from sensors on the surface of the user's skin to electrodes implanted on the inside of the user's skull that intercept and interpret signals from the motor cortex. Quoting:
"'Think about taking a sip from a can of soda,' Harshbarger says. The complex neural feedback system connecting a native limb to its user lets that user ignore an entire series of complicated steps. The nervous system makes constant automatic adjustments to ensure, for example, that the tilt of the wrist adjusts to compensate for the changing fluid level inside the can. The action requires little to no attention. Not so for the wearer of current prosthetic arms, for whom the act of taking a sip of soda precludes any other activity. The wearer must first consciously direct the arm to extend it to the correct point in space, then switch modes to rotate the wrist into proper position. Then he must open the hand, close it to grasp the soda can (not so weakly as to drop it but not so hard as to crush it), switch modes to bend the elbow to correctly place the can in front of his mouth, rotate the wrist into position, and then concentrate on drinking from the can of soda without spilling it."
Submission: Brain Controlled Prosthetic Limbs by Anonymous Coward
[+]
Hardware: The Future of Mind Control of Physical Objects 176 comments
mattnyc99 writes A month ago we discussed the accomplishment when researchers got monkeys to feed themselves with a robotic arm controlled by their brains. But after all the recent successful experiments with brain-computer interfaces, will the technology ever make it out of the lab and into hospitals — or even into our hands, for the closest thing imaginable to The Force? Popular Mechanics takes a look at the future of mind-machine control, speculating on several theoretical applications once brains can adapt to devices via direct communication between, say, synapse and prosthetic. Quoting the field's leading neuroscientist: 'For the foreseeable future, the main benefit is for rehabilitation. But the research is showing that the brain can act independently of the body. One day, you could be sitting in an office and controlling a device from across the room — or in another building. And it's not just flicking a switch. It could be a nanotool that's moving through a tiny environment, and you can control it and see what it's seeing.'"
This discussion has been archived.
No new comments can be posted.
The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.
Full
Abbreviated
Hidden
Loading... please wait.
And just like that... (Score:5, Funny)
Re: (Score:3, Funny)
Re: (Score:3, Funny)
I'll call Bruce Campbell!
Add Glen Campbell and make it 'Monkey Robot Overlords: The Musical!'
Re:And just like that... (Score:5, Insightful)
Of course some experimentation will be needed when they move to human subjects, but a monkey's brain is similar enough to ours that they can get a starting point to experiment around, rather than working blind on a human subject.
One other thing to note, there are no touch/pain receptors within the brain itself - people have brain surgery done while awake so the doctors can keep them talking and know they aren't accidentally removing something important. Once you've got an opening into the skull (which would be done under anaesthetic) you can poke and prod at the brain all you want without the subject feeling a thing.
Oh, and its on the news because its interesting and something of a step forward scientifically. Quit it with the conspiracy theories please.
Parent
Re: (Score:3, Interesting)
Now, as a strict materialist, I see no reason to think that this baboon does--or should--feel any remorse for its actions. They were clearly the result of mindless evolutionary processes, just like your own feelings about animal experiments. You feel bad because your species' biological evolution compels you to feel bad. With any luck, it will also compel you to feel bet
sci-fi pondering (Score:2, Interesting)
Re:sci-fi pondering (Score:4, Insightful)
Parent
Re:sci-fi pondering (Score:4, Funny)
Parent
Forget Replacement Limbs... (Score:5, Insightful)
Re:Forget Replacement Limbs... (Score:5, Insightful)
Speaking from experience, it is because the grant money is better. If you say you need money to research brain/machine interfaces for prothetic limbs to help disabled people, you are more likely to get it than when you say you need the research to give yourself/your_cyborg_army superhuman appendages to be used for world domination.
Parent
Re:Forget Replacement Limbs... (Score:4, Funny)
Fair enough, but can't this research be directly applied to my one-man-cyborg-army-of-the-apocalypse idea, even though that's not the PR angle they're going for?
Once this technology advances to the stage where we can get genuine Darth Vader(tm) brand prosthetics after our various lightsaber mishaps, I'm just hoping that some entrepreneurial young Doctor will implant the control chips in perfectly healthy people for a fee, which you could then hook to the hardware of your choice. Of course, this may have to take place in a third world country where the FDA doesn't hold back novel ideas just because they aren't "medically necessary", or because it's an "abomination before God", or some such drivel.
Parent
Re: (Score:3, Insightful)
Speaking from experience, it is because the grant money is better. If you say you need money to research brain/machine interfaces for prothetic limbs to help disabled people, you are more likely to get it than when you say you need the research to give yourself/your_cyborg_army superhuman appendages to be used for world domination.
You have GOT to be kidding! Getting government grants to find military applications for otherwise harmless things is a staple of the defense program. If you have an answer to "How many Commies/Terrorists can it kill", you've got grant money.
So go ahead and build your cybernetic superhumans to do your bidding, but you might have to sign a contract that says you'll do the bidding of the US government, too.
Re:Forget Replacement Limbs... (Score:4, Funny)
Sure, go ahead and sign the contract.
Just remember that when all's said and done, you're the one with the army of cyborg supersoldiers.
Parent
Re:Forget Replacement Limbs... (Score:5, Interesting)
Of course, because of the "abomination before God" factor, nobody in the medical establishment will ask this question officially for years, if ever. But I'm sure some geek amputee will start playing around with modding his new arm/leg/ear, and if he doesn't turn into a bloodthirsty cyborg, or get lynched by fundamentalists, he'll become very rich and famous by enabling us to reach way beyond what we thought our full potential was.
Parent
Re:Forget Replacement Limbs... (Score:5, Insightful)
An alternative might be the use muscles in the face to control extra limbs. Frowning would perform one action with the prosthetics, smiling another, etc. But this would be considerably more clumsy than the intended use- replacing a limb that doesn't exist on the physical body, but does have a designated place in the brain that controls it.
Parent
Re:Forget Replacement Limbs... (Score:4, Insightful)
Personally, I see this problem as more the case that we've only been conditioned to handle that many limbs over years of experience versus any sort of hard limit being imposed. (Not to mention it kind of runs across the grain of that whole "evolution" thing being needlessly debated...)
There have been numerous examples demonstrating that our brains are not only highly adaptive to new situations (such as the brain redistributing certain functions to different areas to overcome damaged areas), but are also highly receptive to new forms of input from external sources (such as invasive probing of the brain to create crude brain-to-computer interfaces to control simple devices, such as an on-screen cursor.)
The larger issue is really more of a case of creating a proper and convenient interface for cyborg-like add-ons. For example, do we necessarily have to invade the brain directly, or can we simply use existing connections by connecting jumper cables to the nerves running down the spine. And if that isn't an option, can we create or add extra, custom nerve sets to the spine and create connections to the brain that way?
Considering all that, a "third arm", or similar contraption is probably within the realm of possibility, but it may take time to adapt to and fine tune the system before it becomes effortless (or closer to that) to use. It's actually not all that dissimilar to the steps you have to go through for setting up a decent voice recognition system.
Parent
Re:Forget Replacement Limbs... (Score:4, Insightful)
I'm sure that's wrong.
We extend our mental maps to include vehicles, devices and tools that we operate on a regular basis. Believe me, some of us even feel pain when we ding our car on something. Some even feel pain if they get shot in a video game.
The fact that many people can be trained to see with their _tongue_ means the brain is very adaptable.
The Seeing Tongue:
http://findarticles.com/p/articles/mi_m1200/is_9_160/ai_78681631
Just because you start seeing with your tongue does not mean you lose sight in your eyes. So I do not believe that we are limited to controlling 4 limbs. When people use a tool they are skilled in, that tool becomes an extension of their body - and it does not even have to be physically connected to their body - ask people who do stunts with RC helicopters, or play FPS/RTS games.
Once you practice enough, it becomes learnt and integrated into your brain, you no longer think "Ah I must press this to do X", you just think "I need to go here" and you do whatever it takes to get it done.
A skilled typist does not think of each key stroke independently, the typist just thinks of the phrase (or sees stuff to type) and all the 8 fingers and 2 thumbs get it done. So controlling more than 4 limbs shouldn't be a huge problem.
However, just like when you concentrate on something a lot, say drawing an intricate design, you may lose awareness of what's going on with your little toe (until something significant happens to it, or even is about to happen to it - incoming object via peripheral vision - in which case the rest of your brain brings it to your attention).
Parent
Adapting the technology (Score:5, Funny)
Specifically, I'm thinking of adapting a laser prosthetic arm, to be used by the poor, armless sharks
It's just an idea
Other other... (Score:2, Funny)
PLEASE tell me it makes them type faster (Score:4, Funny)
Re: (Score:2, Insightful)
http://science.slashdot.org/comments.pl?sid=567543&cid=23585235 [slashdot.org]
Re: (Score:2)
Re: (Score:3, Funny)
Other X-creatures (Score:4, Funny)
Re:Other X-creatures (Score:4, Funny)
Parent
hope to amputees (Score:5, Funny)
As long as they don't mind carrying a monkey to control their prosthetic arm...
So will that mean (Score:2)
No typing required! (Score:4, Funny)
OnTopic? (Score:2)
-- just what is this doing on Slashdot?
Monkey's opinion (Score:4, Insightful)
Re:Monkey's opinion (Score:5, Funny)
Parent
Almost (Score:3, Interesting)
I knew a guy in college who was working in this field. He went on to do master's work at Cornell. Incidentally he had no arms.
This will be great to improve the standard of living for many of the returning soldiers.
Re: (Score:3, Interesting)
This will be great to improve the standard of living for many of the returning soldiers.
You would be surprised how people adapt. For many amputees this is a non-issue, and they move on. The key is time and the correct mental attitude.
I have a prostetic leg, but I like my crutches. I'm agile on my crutches. I can do interesting things on my crutches I can't with a real leg. If I had to choose between my artificial leg and crutches, there is a good chance I would choose my crutches.
If you look at a person who has an amputated arm, if they go for a prosthesis it is often "the hook." I
When servicing the equipment... (Score:3, Funny)
Not impressed. (Score:5, Funny)
Prosthetics Don't Have to be Replacements (Score:3, Insightful)
The really cool thing that they're totally missing is that prosthetic limbs aren't limited to replacements.
Research has shown that the brain has the ability to handle additional limbs and/or senses. So if an amputee can learn to control a replacement arm, then a normal person could also learn to control an extra pair of arms. The neat thing is that the brain would just adapt to it and it would seem natural.
The Real Sad Thing (Score:4, Informative)
The sadder thing is that the discovery of response patterns of amputated limbs being mapped to other parts of the body is totally ignored.
A man had his arm removed. A psychiatrist attending happened to note that the man claimed to "feel" things in his missing hand when other parts of his body were touched. After careful mapping, three different response maps were found -- one each on his arm, chest and back. Each was so sensitive that individual fingers could be stimulated and he could correctly tell which.
This major discovery in neural plasticity makes it totally unnecessary to try to decode signals from electrode either drilled through the skull, or else placed on the surface and reading signals though the scalp, skull and dura mater, which reduces the signal by 3 orders of magnitude. Either way, these signals require some massive processing because a significant command/response signal (ie. an electrical response representing a single Hebbian cellular assembly that can be clearly decoded to an intent as stated in the article) comes from 0.3% to 3% of the neurons in the region being detected, the vast majority of the signal needing rejection as false positive or noise. Using the mapped response regions allows for signal analysis based on EMG patterns that are not expected at all in the area under the electrodes, making detection and analysis trivial.
TFA and most such research is not about giving amputees mobility. It is about decoding and using neural signals. If it were about the former, easier ways would have been used and the job already accomplished. It is about the latter because such things make more news, get more recognition, and therefore result in more grant application success.
The resulting technology will only be applied to prosthetics as a secondary result. Its primary use will be in such as hands-off controls for fighter pilots (see Clint Eastwood's "Firefox" for your obligatory Slashdot sci-fi/movie reference), tank crews and mobile missile launchers. Maybe this is the saddest part of all, but ignoring a more certain path to success as far as prosthetics is a sad piece.
Also sad, with a touch of irony, is the fact that the weaponry applications will be untenable because of the heuristic nature of neural processing -- getting it close but error prone will be fast, getting it right will be no faster or require less effort than hand operated controls. The slow speed and so the ability to use real-time perceptual feedback with prosthetics will make that far more successful. It remains to be seen whether after the war applications fail the research continues (ie. there is adequate funding offered) with respect to prosthetics. If someone like the US Veterans Administration picks it up when DARPA drops it, it might. I'm not hopeful.
The portion of the above that's assertion or opinion is based on the same professional experience as the portion that's not. That experience includes development of some of the "beautiful" maths decried as being ignored. Having been prosthetic-wrist deep in the research and from both directions, I find that a minor point to consider as "sad".
Re:Explain the beauty? (Score:5, Insightful)
Parent
Re: (Score:2)
Re: (Score:3, Interesting)
Re: (Score:3, Insightful)
Re:Explain the beauty? (Score:5, Informative)
Any good data communications textbook would have some nice examples in it, and actually that wikipedia article posted is very readable and informative.
Parent
Re: (Score:3, Insightful)
Re:Explain the beauty? (Score:5, Funny)
- I for one welcome our very hard mathematics doing overlords
- I for one welcome our new bionic monkey overlords
In Soviet Russia the same league isn't even in THEM!!!!Parent
Re:Explain the beauty? (Score:5, Insightful)
On the topic, I am not entirely sure about the exact math used in the said experiment but based on the fact that the link points to the notion of "information content", here is my guess how it should work (at least in principle). I will try just because no one else seems to. Feel free to correct me.
The state of the neurons of the relevant area of the brain (relevant for the goal in the experiment - say pick marshmallows or open the door) could be modeled as a random variable. The first problem when trying to figure out what a certain electrical activity in brain represents would be to figure out whether you are looking at a random electrical activity (brain doing lots of background work maybe) or some order (brain trying to focus and activate the subroutine for "move hand and open door"). This difference between order and chaos is captured in a neat formula describing the entropy or the information content of the random variable. Naturally, the less the entropy the more the order. I have no idea what possibly goes on after this step.
In any case, now coming to the "beauty" part. Of course you need an eye to appreciate beauty for the notion is quite subjective. The remarkable thing is that a simple formula captures the vague notion of "order" that we all have. The formula might not be the most beautiful thing because as I understood from the article, the log term is somewhat forced to make sure different things add up nicely. But then, one could think of this very fact (the extra log term) as a neat mathematical representation of the notion that disorder should be able to be combined with another disorder to create something bigger.
I hope my response is better than "drop whatever you are doing and go do a PhD in math before you can understand the beauty of math".
Parent
Re: (Score:2, Funny)
Re: (Score:3, Funny)
Re:How long until.... ? (Score:4, Funny)
Parent
Re: (Score:3, Informative)
Re: (Score:3, Informative)
That's a difficult engineering problem because it's a complicated chemical process. Nerves talk along their length by depolarization, which is essentially an electrochemical process. A nerve pumps sodium and potassium ions in opposite directions across its cell membrane to form a gradient -- think potential energy, like an anvil sitting on a table -- and when t