Type With Your Eyes 199
hof writes: "Ever wanted to enter text by just looking at the screen? Take a look at Dasher. You enter text by looking or pointing to letters or words which the program thinks you are about to enter. I wonder how this can be optimized for coding -- a break for your wrists, and the code is available under GPL."
Bad for relationships (Score:2, Funny)
Am i getting fat?
Do you want to go to the mall?
What do you think of this dress?
etc etc etc etc...
Re:Bad for relationships (Score:2, Funny)
My last mobile phone had voice dialing on it, you simply say the name of the person you want to call.
It was fine whilst I was only seeing Karen.
It was when I started two-timing her with Sharon that the trouble started...
Re:you forgot 'Microsoft warns about security hole (Score:2, Funny)
WASHINGTON, DC--Citing the hot weather and a desire to go home for the day, FDA officials approved American Products Limited's "X-Ray Vision Pills" for commercial sale in the U.S. Monday. "After evaluating this and regulating that for months, we were really dying to cut out early, so we were all just like, 'Fuck it. Let's just approve this,'" FDA deputy commissioner Lester Crawford said. "Besides, nobody could think of a real good reason why X-ray-vision pills would be unsafe."
Re:You've got to know how to treat your woman (Score:1)
!!!!!! This will earn you a few nights on the couch. Your first sentence was sufficient.
Didn't /. already cover this? (Score:2, Informative)
Re:Didn't /. already cover this? (Score:3, Funny)
Not to actually use mind you; its absolute shit. If you use it to enter more than three workds you'll be cross eyed and ready to hurl your mouse across the room. No no, start Dasher up, and then leave it running while you get on with your work. Hilarity ensues! (Note: Hilarity may not ensue)
Re:Didn't /. already cover this? (Score:1)
Re:Didn't /. already cover this? (Score:2, Informative)
Re:Didn't /. already cover this? (Score:5, Funny)
Yes, but Timothy wouldn't be the Timothy
We love you Timothy! Keep posting old crap!
We love feeling intellectually superior to someone who gets paid to surf all day.
Smooches!
Re:Another cynical comment... (Score:2)
Is it just me, or is Slashdot often either "News in Review for Nerds, or Irrelevancies that don't matter"?
I do keep reading it however. Hmmm...
Yeah, I think it's a lot like Springer. You know it's going to be bad, but you watch it anyway.
(and, in all fairness, there have been some good articles/threads posted on
Re:Didn't /. already cover this? (Score:3, Funny)
&get_any_old_article("Timothy");
&post_it;
}
Geekstyle (Score:1)
Boy: No, Im coding.
Interesting concept... (Score:1)
Thanks, but no thanks, I'll stick with my broken (Ergonomic) keyboard for now, I can type just fine on it, and it doesn't hurt my wrists!
Re:Interesting concept... (Score:1)
Also at Nature.com (Score:3, Informative)
Duplicate (Score:1)
crossed eyes (Score:2, Funny)
Earlier discussion (Score:2)
Yes (Score:1)
I would much prefer RSI in my eyes than my wrists!
Incidentally, I assume a friend of
Re:Yes (Score:1)
On the other hand, I have been messing around with dasher- and I think as you get more familiar with it, and it with your style, it gets faster. What would be nice would be an option to increase the speed as you become more proficient...Its a nice concept and could go far with a little adaptation...
Re:Yes (Score:1)
I was being sarcastic, man.
where... (Score:1, Flamebait)
Good idea (Score:5, Funny)
I wonder if this will cause your eye muscles to get bigger?
Re:Good idea (Score:1)
Double Post... (Score:2)
A few thoughts (Score:4, Insightful)
Re:A few thoughts (Score:1)
Re:A few thoughts (Score:2)
Re:A few thoughts (Score:2, Interesting)
Imagine instead a 'phrase' keyboard. for, while, {, your variable names, and object method calls all floating towards you.
Pick and assemble you algorithm.
Brilliant. The applications go way beyond simple strings of letters.
I tried it, it really isn't that good (Score:1)
Good idea, bad implementation.
Re:I tried it, it really isn't that good (Score:1)
Re:A few thoughts (Score:2)
How fast can you go? (Score:2)
Re:How fast can you go? (Score:4, Funny)
Nice (Score:1, Flamebait)
Two finger^h^h^h^h^h^h eye typists... (Score:1)
be it letters or carrots
has got to be the silliest thing a person ever tried
along with trying to fly by flapping one's arms really hard.
Manipulation = hands. Ten fairly independent digits...
Adapted and selected for pointing, pushing, probing.
Nah... instead let's use our eyes.
Adaped and selected for video capture.
What's next? Reading with Braille for the masses?
I think even my two feet would type faster than my eyes.
This is just Technology For The Sake Of It.
The Underpants Gnomes of IT.
Step 1: make useless invention.
Step 2: ???
Step 3: profit!!!
Re:Two finger^h^h^h^h^h^h eye typists... (Score:1)
The words 'Dim' and 'Wit' spring to mind, but are typed, of course, the old fashioned way.
So I am just sitting here surfing (Score:5, Funny)
And that is why my screen is full of porn Mr smith. Please dont fire me. Its not my fault. Its this dang thing that uses my eyes to controll the computer instead of the keyboard.
Re:So I am just sitting here surfing (Score:1)
Re:So I am just sitting here surfing (Score:1)
(Score:-1, Didn't get the joke)
Re:So I am just sitting here surfing (Score:1)
Humpty Dumpty (Score:1)
This is actually VERY practical... (Score:5, Interesting)
He cannot write, type, or even speak. For the longest time, he actually used a board covered with the alphabet to 'talk'. He would look at the letters on the board, and you had to decifer what was being looked at. This way, he could spell out what he wanted to say. His parents were quite quick at it, and they could carry on a conversation very well.
He actually upgraded to a pair of glasses w/ a small laser on the frame a few years ago. He could then spell by looking at the keyboard, which was covered with photo-receptors. Then, the computer would talk to you Hawking-style. It was a groovy innovation. It was quite pricey, though.
Perhaps an open-source innovation such as this could open up doors for people like him. It would make equipment used for social interaction cheaper and more readily available.
Re:This is actually VERY practical... (Score:2, Troll)
Hm.. Just remembered that he *can* actually type with his odd wheelchair that's hooked up to all sort of things. I wonder if it runs Linux?
Re:This is actually VERY practical... (Score:2, Interesting)
The solution (Score:2, Interesting)
Furthermore, ERICA is integrated with Windows, so you can use it to completely control the computer and do almost anything you need (not sure how well it would work with Quake ;-) . And just to make it more interesting, it was made by the same guy [virginia.edu] that made Stephen Hawking's system!
Re:The solution (Score:2)
Now, on a keyboard, that's no good, particularly since you can't look at the keyboard and the screen at the same time. The numbers at the Dasher site seem to indicate that it works pretty well when using your eyes, though.
Problems when working in meetings... (Score:5, Funny)
"Then Bert, bloody hell is this guy boring, said 'I think we should start at the beginning oh for fucks sake and then continue to the end well done sodding einstein' this was agreed as bloody obvious, does that guy get paid for it, well hello nice legs shit what did he say very nice legs up down up down up down.....
a break for your wrists (Score:1)
Great for my wrists, but my EYES! (Score:3, Insightful)
While I recognise the benefits for someone with serious RSI in their wrists (I've suffered, I know what it's like), the additional strain for my eyes would send me screaming.
I don't know how it is for most of you, but I'm extremely sensitive to flicker. Having moved back to the US, I notice the flicker on TV all the time. I notice the flicker on monitors, in lights, etc.
Looking from letter to letter, word to word to type would kill me.
Even if I could get higher than my current 65 wpm, I think the additional eyestrain would cause me to avoid the technology.
Eye RSI (Score:2)
You couldn't just sit down have a beer and watch TV when you're too sore to work.
Re:Great for my wrists, but my EYES! (Score:2)
Re:Great for my wrists, but my EYES! (Score:2)
WTF? You notice the 30FPS flicker on your TV, but didn't notice the 25FPS (or whatever the hell it is) on PAL?
You notice the 60Hz flicker in US florescents, but not the 50Hz flicker wherever you were? (Unless you were somewhere on 60-cycle, in which case you are noticing a difference that doesn't exist . .
You need to donate your eyes and brain to medical science. Not when you die, right now.
The only complaint that could possibly hold any merit is if your video card/monitor was at 60Hz refresh which looks okay (not great) under 50Hz florescents but like total crap under 60Hz lights.
-Peter
Note to self: stop looking at anything (Score:1, Insightful)
How do you stop your eyes immediately jumping to the funniest or most surprising word visible instead of the one you really wanted?
I know I couldn't. Everything I typed would look like slashdot browsed at -1.
(Moderators: for supreme irony please mod this post down to -1)
A whole new reason for bloodshot eyes (Score:1)
"Woah, why are your eyes so red?"
Damn pr0n.
Re:A whole new reason for bloodshot eyes (Score:2)
Well, yeah, if you was writing pr0n novels, otherwise I can't see why your eyes should go more red than usual.
Re:A whole new reason for bloodshot eyes (Score:2)
Great, another reason why glasses will forever be a sign of low status with geeks.
Eyetracking (Score:1)
what is the matter with you guys? (Score:1, Insightful)
Please try to appreciate that this is just a try-out for another kind of interface, as an alternative to static, dumb keyboards. Personally, i think that trying to make computer interfaces more interactive, simple, and contex-sensitive is at least as important as the speed at which you can input text. If the horrible colours and wobbly interface (it really feels like some ancient arcade shooter) would be developed into something a little less tiresome to use, i think this might really be of use. For example, what about using it with children that are just learning to write? They have to form the words themselves, but are not limited by their (slow) writing/typing skills... And Dasher teaches you to spell correctly, too...
By the way, i personally know a lot of people who would actually be a lot faster and have more fun when using a dasher-like interface...
Re:what is the matter with you guys? (Score:1)
Why can't someone come up with a CHEAP way of doing mouse input by tracking the pupil. I'd gobble that up in a second.
Old software... (Score:1)
One of the most interesting features about this is how it "guesses" what you're trying to write. Don't move your mouse, just let it sit there and "type" for you. If you've started typing the first few letters of a word, it will bring the rest of the word up, so it's easier to write.
Believe it or not, the thing actually quoted Shakespeare for me once. I wonder how long it would take to do my homework (correctly) for me...
Re:Old software... (Score:1)
More importantly... (Score:1)
I wonder if this software could have spared her the isolation of not being able to communicate with her friends and family. I have nothing but admiration for Dr. Stephen Hawking and how long he has held on against this horrible scourge. I wonder if he is using something similar. There are too many people who could really use a tool like this to help them communicate. Just because someone is in a wheelchair (or mechanical bed) and can't speak doesn't mean that there isn't a mind in there desperate to be heard as a human being.
Unfortunately, I can see that there may still problems and issues with input devices like these. Not everyone can hold their eye focus on one point. Maybe the software could be optimized for situations like this. Unfortunately, I'm a terrible programmer, but I'm sure that the Slashdot community represents enough brain power to work out better solutions based on what we have today.
Anyone...?
Re:More importantly... (Score:2)
Same here - he has a serious disability and don't loose faith in his work (or life). That he is an excellent scientist isn't that important to me. I admire anyone with such disabilities and still have a hard time figuring out how they can motivate themselves to go on.
To answer your question, yeah, he has been using certain sensors very sensitive to touch on his fingers (perhaps not even all of them and just the thumbs or something like that). But with him possibly approaching the same fate as your friend, this invention could be useful. I don't know if he still communicates with his text-to-speech synthesis connected to very small finger movements.
Kinda trippy ... (Score:1)
(... and all that in just over a minute!)
Stephen Hawking (Score:2, Interesting)
Did anybody else think immediately about Stephen Hawking upon seeing this? I searched the site, and it says in the history [cam.ac.uk] that he was originally one of the mein targets for the project. Anything that can possibly help him to communicate faster would be wonderful, as well as for all other disabled people. Nice work so far!
Re:Stephen Hawking (Score:2)
Didn't know he *was* actually involved in this. Interesting
I think there's an excellent use for this tech... (Score:3, Insightful)
Re:I think there's an excellent use for this tech. (Score:2)
Focus follows eyes (Score:2)
This satisfies the HCI principle of least surprise, because you will by definition never be surprised by this strategy. It is also more efficient than sloppy focus or even 'focus-follows-eyes' because it allows the operator to do lightning fast focus changes without losing track.
How many of you type while looking elsewhere? I know I do so all the time, and even if I just glance away for a moment a simple 'focus-follows-eyes' will be more frustrating than any 'click-to-focus' or 'root-gets-focus' strategy.
So we have to hold out for the big prize, focus-follows-brain and not accept anything less. A decent implementation will follow the brain not only to a window, but to individual graphical elements like entry widgets and this textbox.
Bad for the eyes (Score:1)
Oh, and the program does not support cut-n-paste, so I have to type the last paragraph again so that I can put it on slashdot!
Markov chains (Score:3, Interesting)
Basically they use a markov chain which has in it the probabilities that one letter will appear after another. It's very similar to the disassociated press generators you can find out there.
For example, here [fourteenminutes.com] is one I wrote which generates new random words based on the probabilities of one pair of letters appearing after another pair. I used pairs because it generates more English-like words.
It was "taught" using the contents of /usr/dict/words and written in Perl.
Wow.. (Score:1, Funny)
Re:Wow.. (Score:2)
Fark.com (Score:1)
Re:Fark.com (Score:2)
Perhaps the editors are typing with their eyes?
utterly slow (Score:4, Insightful)
Type "a quick brown fox jumps over the lazy sleeping dog". Now, mentally write it by LOOKING at each letter on your keyboard, and thinking 'click' on each one.
1) visually - takes at least 3 times longer, at least for me.
2) doing that for even a few moments is already giving me a headache.
I don't think it's going to be the next 'sliced bread'.
Re:utterly slow (Score:4, Informative)
True - if that was how it worked.
Being bored and at work I downloaded Dasher to give it a go - and I'm pleasantly surprised. No, I wont be using it as a keyboard replacement any time soon, but for times where a keyboard is inconvenient, impractical, or simply impossible, it looks like it's be a worthy substitute.
The way it works is pretty cunning - the webpage suggests you use driving as a metaphor, which works very well. Rather than an onscreen keyboard, you "drive" down the route of the text you want to type. Think of it as a tree with 26 (OK, 27 with spaces, more with punctuation) branches at each level - so you would start at H, and then "drive" down the e, l, l, o branches. Aiding you in this is the software, which makes guesses as to what you're about to type and makes those "roads" more prominent and easier to "drive" down.
I'd really recommend people download this and give it a go. It's actually quite a lot of fun :)
PhilMotion Sickness (Score:1)
Funny (Score:2)
Re:Funny (Score:1)
Kind of a security hole doncha know!!
Stress (Score:1)
Re:Stress (Score:1)
When I'm high..... (Score:1)
Alright, pass me a joint. I'll be happy to beta test this
My brain don't work like that (Score:2)
But for me my brain just doesn't seem to work that way. Whenever I am faced with any kind of autocomplete, I find that it puts me off what I really wanted to type.
Normally I form in my mind the words that I want to type and just type them. Right now it seems that my typing is lagging about 3 words behind what I am thinking. With most predictive systems, the precise words that I want are not there at least half the time. This breaks my train of thought and feels like harder work than just typing.
Maybe I should give in and just accept a faster but more limited vocabulary.
Would be better as an eye-tracking mouse (Score:2)
But what could really speed me up in an eye-tracking mouse. Keyboard action applies to whatever you're looking at. Also turns the keyboard into an n-button mouse.
About coding... (Score:1)
Good for cursor, bad for text (Score:1)
I also remember an input technology that could be trained to understand brain impulses. Basically a clip over the finger. You think, "Click," and voila. I recall that the device was being used to also control cursor movement, but it was fairly inaccurate. If it could take dictation with a good deal of accuracy, it would be the next best thing since sliced bread.
Better for scrolling windows, maybe? (Score:2)
On the other hand, it would be really nice to use something like this for scrolling and changing pages. That way you could read things without moving anything except your eyes (which you obviously have to be moving anyway). That might actually make it nicer to read text on a good monitor than hard copy, because you don't have to change pages. You just get to the bottom of the page and glance at the corner, and then it flips to the next page. Or you could have the window scroll such that you continue looking at the same line as you move your eyes to the top of the window.
Canon cameras have had this (Score:2)
Optimise for coding (Score:2, Interesting)
For programming, it would have to be integrated with your IDE in an editor which is both syntax and semanitcally sensitive. Dasher uses some sort of a dictionary - usually in English - to predict what the next letter is most likely to be. This is obviously not a traditional dictionary, because it manages to predict across words.
For coding use, the dictionary, instead of being static, should be dynamic. Instead of having all the words in the English language, it should have only words (and symbols) which are semantically valid at the point the cursor is positioned in the edit buffer. Furthermore, it should weight them. Local variables are very likely, method variables are less likely, strange packages even less likely. In fact, it might subcategorise these into pseudo-letters, so that when writing (e.g.) Java, packages would appear as a single pseudo-letter. It could also add localisation-type information - entities referred to within a few lines are more likely to be accessed again soon. This doesn't change the sorting order used by Dasher, which is always alphabetic, but it does change "visual space" allocated to each letter in the search area.
You probably want an auto-beautifier i.e. new lines and indents/outdents are added automatically as needed.
This has some interesting side-effects. For example, you can only enter semantically valid programs. It has implicit auto-completion - once the following letters are unambigous, the remaining characters occupy the whole namespace.
The brackets case is also nice. The only close bracket that is ever possible is the close of the most recently opened, and that often has a very high probablity. Which means that inserting an open bracket implicity "arms" the system with the matching close bracket. The same applies for closing strings - the close string charager is always high probability.
For case significant languages there are some interesting effects. Obviously, in principle both upper and lower case must be present, though it may well be that a small minority of letters are accessible at any given instant. At a guesss, it would be better to split into Upper case and Lower case rather than interleave upper and lower - but that is something to experiment with.
Punctuation-type characters show minor problems - we all know alphabetic order, but does ";" come before or after "+"? I don't know. But I expect we could learn this - there aren't that many symbols.
One could also add a special pseudo-section for language-defined keywords, so you just chose a single prefix zone and then go straight to the set of all known keywords. Usuallly no more than 50 or so, and not usually all semantically valid, so you might get quite quick access to them.
Of course, there is a tradeoff with all these special zones. One of the points about Dasher is that you don't need any more specailised knowledge than having learned the alphabet to operate it. Adding language-sensitive zones and so on adds extra operator learning time. But since you have to learn the language anyway, I don't think it is that much of a burden.
I would expect this sort of strategy to (at least) double the input speed for Dasher for a particular programming language. Forget using your eyes - for the able at least - but it might make mouse-driven program-writing a lot faster. In fact, it might overtake typing for the special case of program input in a "known" language. Though I think the most valuable feature would actually be the inability to input a semantically erroneous program. Which means you "only" have to worry about logic bugs and not typing bugs.
A good place to try this would be to create a jEdit plugin. JEdit already has plugin Java browsers and beautifiers, so a lot of the code ought to be there already. A Java-style Dasher window would be a very interesting project. If anybody feels upt to doing this, I would like to help (I don't think I have got the time to lead such a project).
Tried it.... (Score:2)
This is damn cool! (Score:2)
Good stuff.
Download the DEMO !! (Score:2, Interesting)
Something amusing to try (Score:2)
Once you've done that, fire up Dasher and let the mouse sit in one place. You'll get a bunch of randomly generated Slashdot-esque gibberish.
Fun stuff.
Very usable! (Score:2)
Um, no source available. GPL, my arse! (Score:2)
Yet it claims to be under GPL. A GPL'd binary? Yeah, right.
this is amazing. (Score:2)
We are just one step closer to becoming one with our computers. I started using this and I kind of slipped into a trance, and my hand started to naturally, instinctively move the mouse in response to the letters my brain was thinking. I'll have to write a letter to a friend using this. It would be a practical purpose for it.
-Evan
This is actually pretty cool (Score:2)
It allows you to feed it training files in order to better guess what you might be inclined to express. This has interesting applications aside from alternative input methods. Seeing many choices at once put me into sort of an eerie creative process.
For some interesting results, throw a little short fiction or other creative text at the program, then let your mind wander a bit while using the interface... You may find yourself creating some interesting sentences.
I found that it had some side effects on me after using it for 20 minutes or so. When I went back to normal reading, I expected to see words move --wierd.
Anyway, this is creative software that is worth a few minutes of play time.
Try it out! (Score:2)