BrainPort Allows People To Reclaim Damaged Senses 216
Karma Star writes "There is a news article on a new device called a BrainPort, which is special device that
is worn like a helmet, with a strip of tape containing an array of 144 microelectrodes
hanging off the headset which is placed on the tongue. The BrainPort then sends signals
to the tongue which are then picked up by the brain, allowing the user to regain otherwise
lost sensory input.
More at the NY Times
(soul stealing subscription required)."
Thats great (Score:5, Funny)
Re:Thats great (Score:5, Funny)
Re:Thats great (Score:2)
His feedback probe didn't go on the user's tongue...
Re:Thats great (Score:2)
All I need is input (RTFA) and output [sourceforge.net].... oh, and, maybe Gaim and Mozilla plugins, and BitchX scripts.
Now, if I could throw a laptop with 802.11 and packet radio on my back, I'd be good from anywhere, until the battery died.
A laptop with two battery compartments that lets you hot-swap batteries without losing power could solve that, if I had an infinite supply of batteries.
Infinite supplies aren't too hard to come by. The backpack could charge itself from the sun [slashdot.org] and, with a cr
Just one question. (Score:5, Funny)
Big deal (Score:5, Funny)
Plus, I didnt have to wear a helmet when I dropped acid.
Re:Big deal (Score:4, Funny)
No, but it might have been a good idea. :-)
Re:Big deal (Score:2)
Drugs are like roller coasters. Exciting the first time, but nothing new.. get over it.
Confused senses (Score:5, Funny)
Tastes Great (Score:3, Funny)
But you'll still be stuck in engineering while a guy with a positronic brain gets all the action.
Re:Confused senses (Score:3, Informative)
Re:Confused senses (Score:5, Interesting)
I'm fortunate that my case is very mild; if it hadn't been for a number of conversations in early adolescence where I tried to describe something using adjectives that made perfect sense to me but not to others, I would never have known I'm different. In high school orchestra, most of the other kids could understand when I'd describe the sound of a viola as warm, or a piccolo as cold... but they'd have no idea what I meant when I started describing the grain of the viola sound (looks a lot like highly-polished oak under a tungsten lamp), or the brilliant white light of a b# played in second position on a violin's E string.
I read years ago in the Washington Post about a case of a fellow who was much more severely affected than I. Instead of seeing the sounds overlayed on the 'normal' visual field, and being able to easily distinguish what was seen with the eyes vs what was seen through hearing, his senses were so crosswired that this was no longer possible. The anecdote given in the story was that he stopped to buy something from a street vendor (ice cream, I think). But when the vendor spoke, his voice looked to the synaesthete like charcoal bricks falling out of the guy's mouth. The article said he hadn't been able to eat ice cream (or whatever the food was) since then. Like I said, I'm fortunate. My symptoms are thoroughly enjoyable & have never presented problems like that.
Re:Confused senses (Score:2)
I think a lot of people can associate imagery with music; for what purpose do you think compositions like Vivaldi's Four Seasons and Prokofiev's Peter and the Wolf exist?
I call B.S. on this unless you have a serious complex. I also think that the use of verbiage like "b# p
Re:Confused senses (Score:2)
It depends on the key the music is in, right? I mean, yeah, B# and C are the same note, but the notation depends on the key. The key of C# has a B# and the key of F# has an E#, if I'm not mistaken.
I guess with the context of his message, we can't tell if he meant a B# as a part of a song, or by itself.
Re:Confused senses (Score:2)
Re:Confused senses (Score:2)
Re:Confused senses (Score:2)
The strings of most instruments have different diameters for each string, and all are wound differently; ainsi even at the same pitch (b#)and amplitude (volume) the sound can change.
The smaller diameter (higher pitched) strings on a violin produce fewer complex overtones, even for an identical pitch, than
Re:Confused senses (Score:2)
There is also a difference of some notes that ought to be the same. This is based on the temperamant of the tuning.
A piano normally uses Equal Temperament Tuning. In this case an A# and a Bb are the same note. This is not the case with the tuning of other instruments and many attempts have been made to deal with this. There are pianos that have the black key for A# /Bb actually split in two (front and back) to try and deal with this.
Other tuning temporaments have also been developed, such as mean-tone
Re:Confused senses (Score:2)
Re:Confused senses (Score:3, Informative)
While I have no idea if this guy is telling the truth about his own condition, "synesthesia" is a real neurological condition. It can be brought on by drugs, such as LSD, or it can occur naturally...
http://web.mit.edu/synesthesia/www/synesthesia.ht
Re:Confused senses (Score:3, Interesting)
When most people "associate imagery" with music, that is exactly what we do - we connect some image that seems suitable, with the music, coloured by our experiences, what we know a
Re:Confused senses (Score:5, Interesting)
Anyway, I'm interested in your challenge, but I don't understand what you mean by 'You have to tell me which version each recording represents'. As you pointed out, C and B# are the same thing. As far as finger position, I don't really care if it's fourth-finger in 1st position or 1st finger in 3rd position, it's still the same note with the same color and shape. No, I wouldn't be able to tell the difference. I don't claim to have perfect pitch-- or anywhere near it, for that matter, which is why I never went beyond high school orchestra.
As much as I love Vivaldi's Four Seasons, particularly the Presto from Summer, I can't really agree that the compositions you mention are visual at all. Beethoven's Egmont Overture has moments where it's extremely visual, but not those two.
Interestingly, one bit of music that always has the same visual dynamics for me isn't classical at all. It's Genesis' The Brazillian (the last track on Invisible Touch). I've tried to paint it and/or draw it a few times, but lack the talent to do so properly; the only description I can give of it is that it has the dynamics of a water show with the speed and versatility of a laser-light show. Listen to it some time when you have a spare three minutes (about all the time it takes to play it). There are certain auditory cues in the track that I actually see-- a synthetic drum playing a sound that I can only describe as looking like Edgerton's frozen milk-drop photograph, for instance (except not frozen in this case, just slow-motioned).
I have no ability to prove you wrong in your challenge that I see sounds. You have no way to prove me wrong when I assert that you see the color blue the same way I see the color red. So, how many angels can dance on the head of a pin?
Re:Confused senses (Score:2)
but you raise a very interesting topic:
Interestingly, one bit of music that always has the same visual dynamics for me isn't classical at all. It's Genesis' The Brazillian (the last track on Invisible Touch)
I'm downloading this right now (via mldonkey ;) - I should have it tommorow.
In fact I'm no
Re:Confused senses (Score:3, Interesting)
Re:Confused senses (Score:2)
As others have noted, B# and C may well not be the same note, depending on the key. For example, C as the mediant in the context of A flat major should be about 15 cents below an even tempered "C", while B sharp as the leading tone in the context of C sharp major would be
Re:Confused senses (Score:2)
At the risk of sounding like the Aspies over on kuro5hin, I'll make the comment that I have had similar experiences. I frequently perceive pain as sound, and sometimes color as well. I do sometimes see a color with certain sounds.
I assumed, and still do, that everyo
Re:Confused senses (Score:3, Funny)
And I frequently perceive sound as pain, especially when it's Gangsta Rap or Country & Western.
You might enjoy this story (Score:2)
I first read it in a paperback [amazon.com] but when I saw this slashdot post, I remembered it and found it online.
Enjoy.
Re:You might enjoy this story (Score:2)
For a non-synaesthete, the author does a wonderful job of presenting the senses. I've read that many synaesthetes have their senses of taste, smell and touch (which is actually several senses-- temperature, pressure, texture, etc), involved. I've always been a little jealous of those people, as the only senses I get crossed regularly are vision and hearing, and even those aren't 100% dependable. The things I see & h
Re:Confused senses (Score:2)
LUCKY! I'm a normal dude, so that's exactly why I did a lot of acid in high school. I got visual feedback for sense of touch, very strange. Good times though.
Re:Confused senses (Score:3, Funny)
Re:Confused senses (Score:2, Funny)
Re:Confused senses (Score:2)
That movie frightens me tho, coz even now, I watch it, and somehow, they made sigourney weaver attractive. Nothing scares a man like being attracted to sigourney weaver...
Re:Confused senses (Score:2)
Mmmmm (Score:3, Funny)
Re:Mmmmm (Score:2)
Yes but (Score:4, Interesting)
Re:Yes but (Score:5, Funny)
Re:Yes but (Score:3, Informative)
I hope they have a good attorney (Score:2, Funny)
Prior art? [google.com]
Re:I hope they have a good attorney (Score:2)
There *is* prior art, but a good lawyer should be able to argue around it. In one example, visual sensations of auditory input (ie, sound) were generated by applying electrical stimulation to the outside of the head. Reading through the patent, and surmising how much external electrical stimulation it takes to create an effect i
Of course... (Score:2)
This reminds me... (Score:3, Funny)
Re:This reminds me... (Score:3, Funny)
It was controlled by a "probe".
Already exists (Score:5, Funny)
Re:Already exists (Score:3, Funny)
Re:Already exists (Score:2, Interesting)
Re:Already exists (Score:2, Funny)
Yes, but if unreliable internet sources have taught me anything, it's that 3 people die each year from trying this! That's almost as scary as this hydrogen dioxide problem!
Taste (Score:3, Interesting)
Im sure having some gadget sticking in your mouth and a huge helmet on your head would make you a hit with the ladies too!
Seriously though.. I could see applications for this.
Picture this:
Fighter helmet with mouth piece that sits against the pilots tongue. When the computer detects a threat it can stimulate the pilots tongue in relation to the direction and distance of the target. After a little training this sort of thing would really increase reaction time.
Though it would make a conversation with the tower a bit tough
Re:Taste (Score:3, Funny)
What would it taste of?
Normal day: "Mmmmmmm beer"
Real emergency: "EWWWWW SPROUTS!!! GET ME OUT OF HERE!"
Re:Taste (Score:5, Funny)
>
> Fighter helmet with mouth piece that sits against the pilots tongue. When the computer detects a threat it can stimulate the pilots tongue in relation to the direction and distance of the target. After a little training this sort of thing would really increase reaction time.
>
> Though it would make a conversation with the tower a bit tough
You must taste... in Russian!
In Thoviat Rutthia, Firefoth flieth thoo? [imdb.com]
"Thyre rearwurdth mitthile, dammit!"
[nothing happens]
"Mmmmm.... Borscht!"
[*KABOOM*, second Firefox burninated]
"Better ithe up a cold one boyth, I'th comin' home!"
Re:Taste (Score:2)
Re:Taste (Score:3, Funny)
Re:Taste (Score:2)
The only problem with this (Score:5, Funny)
Re:The only problem with this (Score:3, Funny)
Dude, we DON'T want to hear about your porn preferences
Re:The only problem with this (Score:4, Funny)
Re:The only problem with this (Score:3, Funny)
In theory there is no difference between theory and practice. In practice there is. - Yogi Berra
In theory, there is no difference between Yogi Berra and Albert Einstein. In practice, there is.
Oh dear (Score:3, Funny)
Surgeons can feel on their tongues the tip of a probe inside a patient's body, enabling precise movements.
A whole new range of experiences for surgeons performing coloscopies, no doubt.
Re:Oh dear (Score:2)
I alwedy haf one of fese. (Score:4, Funny)
Summary: sensory substitution (Score:5, Informative)
The method used is called sensory substitution.
That is, one sense can be used to emulate the input that is usually provided by another sense. The tongue is one of the best places for input.
You have to wear the substitution device for it to work, although it is speculated that by training the brain areas for the lost sense, the working of that area can be improved, so it just might help restore a sense in the situation where the organ not working is parts of the brain.
I'd like to add that I heard blind people can go mad when you try to feed them visual stimuli through the eye nerves, probably because these brain parts have taken on other roles. I'd therefore like to suggest that babies born blind are provided with artificial visual stimuli, so that this part of the brain learns to work and can later operate fully, when there is the technology to provide fully working artificial eyes.
Re:Summary: sensory substitution (Score:2)
This is incorrect. Research has shown that the optic nerve can be directly stimulated to produce simple images.
On a related note, direct overstimulation of the optic nerve can result in siezures. This may be what you heard.
Biological Screen Saver? (Score:2)
Bad idea methinks.
Re:Biological Screen Saver? (Score:3, Interesting)
Overdeveloping happens when you adjust to the conditions around you so that you can continue to function.
If this doesn't actually provide better real sensory input, they'd still develop other abilities to compensate. If it does, then they don't need them.
I suppose you could say, "but then what would they do without the machine?" Well, a lot of people can't see without glasses. Should they be forced to not wear them so that their other senses can develop more fully? It seems always better
No screen saver. Viewing. (Score:2)
I was also thinking of brain implants, but The vOICe [seeingwithsound.com], which is similar to the website in the /. lead, changed my mind.
I think you are glorifying being blind out of PC'ness. I believe a blind with a sensory replacement aid will develop whatever senses they need just fine even if you give them another sense to work with.
I mean, it is fine to be able to per
More than just 'sensory substitution' (Score:2, Interesting)
This is why the lady who lost her sense of balance was able to go outside & dance around WITHOUT THE HELMET after the initial trial. Dr. Bach-y-Rita has a promo video showing this; I couldn't
Re:Summary: sensory substitution (Score:2)
Is there anyone else here who immediately thought, "Yeah, he's right. I had tortellini for lunch, and it wouldn't have tasted as good anywhere else...."
Re:Summary: sensory substitution (Score:2)
I haven't you given any evidence that I think otherwise.
The ignorance of others does not make you smart either.
I don't know why you're bringing this up. I'm only talking about his ignorance, aren't I?
Calling this idea "colossally stupid" is going too far. They may just not have the understanding your profess to have.
The way he frames his suggestion seems to assume understanding that I definitely do not profess to have. That's why I
Good technology looking for a home? (Score:3, Insightful)
Pilots confused by foggy conditions, in which the horizon disappears, can right their aircraft by monitoring sensations on the tongue or trunk. Surgeons can feel on their tongues the tip of a probe inside a patient's body, enabling precise movements
Sounds to me like an able bodied pilot or surgeon could just use the senses they already use. The pilot could still use the visual readout of the artificial horizon for example.
Is this really destined for common usage?
Re:Good technology looking for a home? (Score:2)
The article highlights the possibilities for blind people to regain some of their senses (There's a similar project [mindgames.mle.ie] focusing on allowing blind and deaf people 'see' and 'hear' though their tongues.)
So maybe not common usage but not as far out as some of the other examples given.
Eyes in the back of the head? (Score:3, Insightful)
Will the brain be able to interpret the forward and rearward vision simultaneously? Would a person be able to develop 360' vision? Even if not, I'd still like to have my own "rear view mirror" :)
There could be a huge market in wedgie prevention. :)
You just know.... (Score:5, Funny)
Ralph says (Score:5, Funny)
What's next.....? (Score:2)
-m
More info (Score:4, Informative)
University of Montreal news release [sciencedaily.com]
But wait, there's more cooler brain interfacing going on! Mystic Visions [nwbotanicals.org]
I see, in the very near future, big wads of $100 bills moving into my pocket from users of the APE(TM) helmet. A Psychedelic Experience! Users don the APE helmet and the core moderating frequencies of the brain are modulated to produce everything from the mystic experience (sans the nasty side effects of peyote, psylocibin, or X) to a full blown emulation of a trip on the finest of Dr. Hofmann's [isyours.com] concotions.
Franchise options available NOW!
Sensory Prosthetics (Score:4, Insightful)
Smellovision (Score:2)
You realize of course that this puts us one step closer to Smell-O-Vision.
Of course the pottential for abuse seems even greater with Taste-O-Vision.
She lucky (Score:2)
I have become a wobbler many times, or so I am told, usually after a large intake of Guinness and JD. Unfortunately however I am never able to remember this world turns wobbly point.
This sounds familure... (Score:3, Funny)
Buckaroo Banzai (Score:3, Funny)
Great for Pickups (Score:2)
Danger of choking to death? (Score:2)
They even mentioned military use. Imagine colliding into something and choking to death on the gizmo.
Why don't they just stick the stuff into a suitable part of the brain and let the brain figure it out? Yah I know the brain moves around, let the thing move and flex around with the brain too then - and make it the same density as the brain tissue.
I was actually thinking about this more than 10 years ago - but then I was thinking it'd work if you p
Re:Danger of choking to death? (Score:2)
Re:Danger of choking to death? (Score:2)
The electrodes on the tongue (Score:3, Funny)
Interesting how the brain adapts (Score:2, Interesting)
One interesting (at least to me) part was an experiment where he linked an ultrasonic distance sensor (worn on a hat) to his arm. As something got closer, the pulses became more rapid.
With his eyes open, he could sense the pulses, but not really make sense of them. When
Copy of the New York Times article (Score:3, Funny)
So science has had to look to other forms of art for inspiration and development of new technologies. Scientists at Brain-Port Inc have found their new beacon of innovation in that aging rocker, Ozzy Osbourne.
During the development of the Brain-Port tonque interface, it was code-named the "Fly High Helmet" after Ozzy's song, "Fly High Again" in which he asked the question -- "Swallowing colors of the sound I hear, am I just a crazy guy?"
Brain-Port is rumoured to be working on another product which they are calling the "Hagar Helmet." Expected to be a huge boon to the auto insurance industry, the Hagar Helmet is designed to prevent the wearer from exceeding the speed limit. The exact mechanism by which it ensures that the wearer can only drive 55 is considered one of Brain-Port's most valuable trade secrets.
the IP perspective (Score:4, Insightful)
Bear in mind that the good professor was supported by public money to do this research and the Univ. of Wisconsin similarly is state funded.
It seems just plain obvious to me that this research belongs to those who paid for it -- the public.
The idea that a university takes public money to use as venture capital with intent to profit is repulsive. Of course, it happens all the time in those branches of academe which connect to marketable products. But that doesn't make it right.
Re:the IP perspective (Score:2, Insightful)
"The public" as a whole does not benefit from this product - individuals do. Likewise, the public as a whole does not manufacture it, sell it, buy it, repair it, or improve it.
I don't know what the policies of the University of Wisconsin are, but it's likely they'll be getting
Re:the IP perspective (Score:3, Insightful)
None of the above. The research is public and should be freely available to anybody. If somebody wants to make a product and sell it, fine. No patent protection on publically funded research.
I think companies could make money this way if their product is good enough and,
Pattern Learning and Recall... (Score:3, Interesting)
The book goes into very great detail, but it presents a model of the neocortex fairly different from that of other models, while at the same time building upon earlier work (like neural networks). Hawkins isn't proposing to build a human mind, but rather an "artificial neocortex". He deliberately ignores (though while acknowledges them) the effects other areas of the brain has on the neocortex (I don't think it is because he thinks they don't have anything to do with thinking, or that they aren't needed - I think he simply wants to understand and be able to use the neocortex for machine thinking, which would be radically different from human). His model, while different in subtle ways, seems similar to experiments and devices Igor Aleksander [techdirections.com] has built (interestingly, you don't here much about this individual - he isn't presented in Hawkins' book, and other AI books I have read don't mention his work, either - I tend to wonder if these two individuals will go down like Charles Babbage did - thier work highly relevant, perhaps even precient - but not used because they became obscure - for instance, when ENIAC was designed and built, none of the people involved had heard of Babbage!).
What is really crazy, and I hesitate to link it, because this individual is known as an extreme crank in AI circles - alright, those of you who know who I am talking about will know who I mean, so I won't mention him by name or moniker - is that Hawkins' ideas and model seem to be very similar (though developed in a different way) to that other individual's model. While Mr. M's model is convoluted, and serial like (with attendent streams of information flowing facilitating recall of thoughts/ideas/abstractions) - Mr. Hawkin's model of the neocortex is very similar in scope - only doing the same type of learning and recall using strict hierarchical, interrelated networks of neurons.
He comes away showing how, in the neocortex, all patterns are the same, in that for instance, knowing how a sentence is written or spoken activates the same patterns. These patterns, while they are learned, and later played back - cause other patterns to fire off and playback (or be learned, if only slightly) - which is why a song or the taste of a certain food, sometimes brings back certain feelings and thoughts - because the playback of what the pattern of the taste of the food causes the same/similar triggers to cause playback of the patterns for those thoughts and feelings. The concept of feedback in learning is the important part...
I encourage *everyone interested in this kind of computing* to pick up Hawkins' book, as well as Aleksander's book (and, I would implore you to (re)read Mr. M's ideas with a fresh mind, in the context of the models presented by Hawkins and Aleksander, and see if you don't agree that all seem to be studying similar paths in the same goal of what creates consciousness and intelligence - you may come back surprised)...
Loss of Senses (Score:2, Interesting)
Re:Loss of Senses - anosmia (Score:3, Informative)
The nerve bundles do, according to my Neurologist, regenerate over time. "Time"being" being years and decades. Supplements of Zinc are thought to help.
In four years, I've gone from sm
someone named schlitz had trouble standing? (Score:2)
Re:NYT Article Text (Score:5, Informative)
New Tools to Help Patients Reclaim Damaged Senses
By SANDRA BLAKESLEE
Published: November 23, 2004
Cheryl Schiltz vividly recalls the morning she became a wobbler. Seven years ago, recovering from an infection after surgery with the aid of a common antibiotic, she climbed out of bed feeling pretty good.
"Then I literally fell to the floor," she said recently. "The whole world started wobbling. When I turned my head, the room tilted. My vision blurred. Even the air felt heavy."
The antibiotic, Ms. Schiltz learned, had damaged her vestibular system, the part of the brain that provides visual and gravitational stability. She was forced to quit her job and stay home, clinging to the walls to keep from toppling over.
But three years ago, Ms. Schiltz volunteered for an experimental treatment - a fat strip of tape, placed on her tongue, with an array of 144 microelectrodes about the size of a postage stamp. The strip was wired to a kind of carpenter's level, which was mounted on a hard hat that she placed on her head. The level determined her spatial coordinates and sent the information as tiny pulses to her tongue.
The apparatus, called a BrainPort, worked beautifully. By "buzzing" her tongue once a day for 20 minutes, keeping the pulses centered, she regained normal vestibular function and was able to balance.
Ms. Schiltz and other patients like her are the beneficiaries of an astonishing new technology that allows one set of sensory information to substitute for another in the brain.
Using novel electronic aids, vision can be represented on the skin, tongue or through the ears. If the sense of touch is gone from one part of the body, it can be routed to an area where touch sensations are intact. Pilots confused by foggy conditions, in which the horizon disappears, can right their aircraft by monitoring sensations on the tongue or trunk. Surgeons can feel on their tongues the tip of a probe inside a patient's body, enabling precise movements.
Sensory substitution is not new. Touch substitutes for vision when people read Braille. By tapping a cane, a blind person perceives a step, a curb or a puddle of water but is not aware of any sensation in the hand; feeling is experienced at the tip of the cane.
But the technology for swapping sensory information is largely the effort of Dr. Paul Bach-y-Rita, a neuroscientist in the University of Wisconsin Medical School's orthopedics and rehabilitation department. More than 30 years ago, Dr. Bach-y-Rita developed the first sensory substitution device, routing visual images, via a head-mounted camera, to electrodes taped to the skin on people's backs. The subjects, he found, could "see" large objects and flickering candles with their backs. The tongue, sensitive and easy to reach, turned out to be an even better place to deliver substitute senses, Dr. Bach-y-Rita said.
Until recently sensory substitution was confined to the laboratory. But electronic miniaturization and more powerful computer algorithms are making the technology less cumbersome. Next month, the first fully portable device will be tested in Dr. Bach-y-Rita's lab.
The BrainPort is nearing commercialization. Two years ago, the University of Wisconsin patented the concept and exclusively licensed it to Wicab Inc., a company formed by Dr. Bach-y-Rita to develop and market BrainPort devices. Robert Beckman, the company president, said units should be available a year from now.
Meanwhile, a handful of clinicians around the world who are using the BrainPort on an experimental basis are effusive about its promise.
"I have never seen any other device do what this one does," said Dr. F. Owen Black, an expert on vestibular disorders at the Legacy Clinical Research and Technology Center in Portland, Ore. "Our patients are begging us to continue using the device."
Dr. Maurice Ptito, a neuroscientist at University of Montreal School of Optometry, is conducting bra
Comment removed (Score:5, Insightful)
Re:NYT Article Text (Score:4, Interesting)
Same thing with writing and typing. I usually don't even think of the individual letters that I need to put down. I don't even deliberate over the words that I use. I just kinda think of the topic, and then my fingers move. When I want, I can then enact tighter control by switching my focus.
In fact, when typing, I usually don't even notice the keyboard, or most of the OS. Right now I guess I am thinking about interacting with this little box, not even noticing the rest of the page.
Re:NYT Article Text (Score:2)
Re:Sure, you get your senses back (Score:2)