Watson Goes To Medical School 100
First time accepted submitter Kwyj1b0 writes "I.B.M's Watson is headed to the Cleavland Clinic Lerner College of Medicine of Case Western Reserve University for training. Clinicians and students will answer and correct Watson's questions, in an attempt to crowdsource its education. From the article: '“Hopefully, we can contribute to the training of this technology,” said Dr. James K. Stoller, chairman of the Education Institute at Cleveland Clinic. The goal, he added, was for Watson to become a “very smart assistant.” Part of Watson’s training will be to feed it test questions from the United States Medical Licensing Exam, which every human student must pass to become a practicing physician. The benefit for Watson should be to have a difficult but measurable set of questions on which to measure the progress of its machine-learning technology.'"
Re: (Score:2, Funny)
oops, looks like I couldn't bother verb there. I should get a /. editor job too.
Re:Watson - not for vets! (Score:5, Insightful)
Re: (Score:1)
In the medical profession we call those things Lists. A number of studies, based on original research at the UW Medical Center and VA hospitals, have found that check lists do wonders.
But ... we already do that. We even have iPads in VA Hospitals now. Watson is just doing checklists.
Re: (Score:2)
Sure, and I could get a team to spend a week performing analysis to determine appropriate staffing levels - dealing with tens of thousands of data points, with data at all sites varying on an hourly basis. Alternatively I could have a learning system that keeps far better track of these things than humans would, and presents its working for review before implementation.
Re: (Score:2)
Re:Watson - not for vets! (Score:5, Interesting)
Re: (Score:1)
Watson better learn to read crabby handwriting and minds. The fundamental issue in applying AI to medical data is the low information dataset. We are working on a couple of smaller AI projects in my hospital and finding that even when electronic, most entries in the record are narrative not discrete.
Applying ranges and logic to data pulled out of narrative records is tricky and leads to unusual responses. Even when discrete, the data set may be difficult to use. My favorite example seen nationally is blo
Re: (Score:2)
Re: (Score:2)
Older systems used expert systems (hierarchical knowledge systems). The new models use machine learning (neural network classifiers, ...).
The machine learning creates a generalized model based on small amount of data. Expert systems search the existing data and the data should be very accurate.
Re: (Score:3)
No one. Duh.
Re: (Score:1)
Cleavageland would have been a better typo!
They are (rightly) really proud of this at IBM. (Score:5, Interesting)
Repurpsose for Criminology (Score:5, Funny)
I'd like that.
Re: (Score:2)
Re: (Score:1)
Even better, set up multiple Watsons, have them work over the same sets of data to learn from, and then ask them all the same set of questions, and see how each system answers those questions...
Re: (Score:3)
And a little USB drive shaped like a pipe.
Yeah. That would be awesome.
Invert the logic... (Score:1)
...and call it Professor Moriarty
Re: (Score:1)
Then have them create scenarios for each other to solve.
Holmes here (Score:1)
Nurse: Doctor patient Parkison, has numbness in the groin area.
Web MD : Did the numbness come on suddenly?
Nurse: No.
Web MD: Does it affect both sides?
Nurse: Yes.
Web MD: Thoracic Spinal Stenosis
Watson: Parkinson's disease. (Patent Pending)
Really they've put the text through a crude parser and stuck it into a database similar to Web MD and now they'll patent the hell out of this. But they're using stock language parsing algorithms and stock medical look databases, and the only purpose for this is to generate
Re: (Score:2)
Sci-fi stuff (Score:1)
What is Toronto?????? (Score:2, Troll)
just wait for it to make a error like that in a Medical setting.
Re: (Score:1)
Re: (Score:1, Redundant)
Someday it will replace doctors.
Re: (Score:2)
That's what the free market capitalists like to say anyway.
but under the mitt romney no health care plan (Score:2)
Errors like that can get you on the pre-existing condition black list. Where after that your only doctor may be Watson ER
Re: (Score:2)
Re: (Score:2)
Could be great for medical diagnosis (Score:4, Insightful)
Particularly since the way it work is by probabilities. So a physician goes and inputs all the symptoms a patient reports, perhaps along with a confidence of how likely it is to be real. Watson could then spit out the likely causes, and the probability of each, as well as how to narrow it down. Then with additional tests, they can exclude things and get a re-factored list.
It won't remove the need for a medical professional with good judgement, but it could be a boon for searching through things and presenting possibilities. What's more each new case can be logged, improving its database.
So when someone presents with a rare disease, it would be much easier for a physician to diagnose it, even if they've never heard of it.
If implemented right, it could cut down on misdiagnosis a ton.
Re: (Score:3)
Re: (Score:1)
*citation needed
Whenever I hear anthropomorphizing phrases like "will take everything into account", my overstated-AI BS alarm goes off.
Can you elaborate on by what means or personal experience you assert that Watson does more than statistical analysis of the language it is "given", as essentially-arbitrary symbols, and, say, give some means (or even a data structure) by which it "knows" even what a "patient" is, such that it could draw inferences about such an entity in the absence of an existing chain of
Re: (Score:1)
Yes, for one, people can do "in a similar manner as" inferences that tend to be rather vicious things to represent flexibly enough in data or write a general algorithm for.
You may have seen such things in IQ tests for people, the "X is to Y as A is to B" questions...
"Tree is to forest as book is to _______".
It is not difficult for a human to pick an answer "library" from a multiple-choice list including, say, "cover", "magazine", and "pages". Having a computer score as well on a series of these, though, is
Re: (Score:1)
Re: (Score:2)
More than diagnosing the disease based on the symptoms, if you had a networked system available in every hospital or to every doctor, I'd like to see what kind of information you'd get out of following up with post-treatment symptoms, autopsies when things went wrong, detecting patterns that wouldn't be evident on a per-doctor or per-hospital scale.
Of course I'd imagine you'd need to hash the input case numbers or something to keep the privacy of the individuals while being able to add information later.
Als
Re: (Score:2)
Re: (Score:2)
Exactly What American Med Schools Want (Score:5, Insightful)
The real question is whether or not this is the best way to train our future health care professionals. While indeed there are some really good physicians coming out of our med schools - and even some of those who memorized their way through undergrad will be great physicians - we have also excluded from selection many who would have been excellent caregivers based on their inability to memorize quite as quickly as their classmates.
lots of colleges put to much on craming for tests (Score:3)
lots of colleges put to much on cramming for tests and not much on being able to do stuff in a real setting. Closed book / closed notes / no Google tests only test memorizing.
What professionals one who is real good at test cramming or on who knows most of the day to day stuff and how to lookup the other stuff that they need at the time they need it. is better?
Re: (Score:1)
Re: (Score:2)
In my engineering classes they are pretty much allowing us to use books, notes, homework, previous exams, and pretty advanced calculators like the nspire but the also give FAR more realistic problems.
The exams tend to be very difficult and sometimes have unrealistic time constraints (ie nobody in a class of 100 people or so finish the exam).
Pretty much the only thing we can't use is a laptop/cellphone etc or anything with an internet connection.
It would certainly be nice if I could use matlab, python or exc
Re: (Score:1)
Re: (Score:2)
Re: (Score:2)
The comments above are quite true and in no way exaggerated. Being a good physician after passing the USMLE or COMLEX is mostly coincidence. Then again ... I'm an idiot ....
IBM's health plan will demand it (Score:3)
No humans involved. Only computers and the occasional tech support call to Bangalore.
Dang, you had my hopes up (Score:1)
When I saw the twitter feed headline, I was hoping Lucy Liu was going to attend UW Medical School.
Sigh.
Dr. Watson, you're needed here!
Re: (Score:3, Funny)
It's always Lupus..
Re: (Score:2)
It`s never Lupus.
/. needs a watson editor (Score:2)
And if
Spelling check... please... (Score:1)
Virtual Doc: You've got: leprosy. (Score:2)
Virtual Doc: You've got: leprosy.
An Open Watson please! (Score:2)
What I would love to see is Watson's training interface on the Internet, as a service, with anyone able to pick a domain and contribute expert knowledge, whether in the form of questions Watson should ask, answers to those questions, or even just links to sources of relevant information. Through a crowd-sourced approach Watson's capacities could be so much more quickly developed. By keeping each user or group in sandboxes and maintaining knowledge in each domain more or less separately, there would be no pr
What a name! (Score:1)
Boy I am excited! (Score:1)
Soon we will have affordable, quality healthcare for all.
Next goal world peace!
Hermione! (Score:2)
Thought this was going to be about Emma Watson! /disappointed
Hospital Pay System (Score:1)
He might discover the complexities of designing a health department pay system, since IBM screwed up the Queensland system so badly.
Image of the beast (Score:2)
Stone/earth is what computers are made of and they run images of human/beast thought processes...... So what is coming is ......
There is more to life than just abstraction, which is what language is. There is more to reality than what our abstraction identify...
Some things worth considering.
What I want (Score:2)