Another Dementia Test Oversold 24
An anonymous reader writes: Many prominent news organizations, including the BBC, are reporting on a study (PDF) that claims a new blood test is 87% accurate in predicting which patients will develop cognitive impairment. It's hailed as a major step forward in efforts to fight dementia and Alzheimer's disease. Unfortunately, reality isn't quite so impressive. An article at MedPage Today explains all of the statistical facts that the mainstream press glosses over: "Only about 10% of patients of patients with MCI convert to clinical dementia per year. With nearly 30% of positive results false (remember, the specificity was 71%) as well as 15% of negative results false, most of the positive results in such a group will be false. Yes, it's time once again for a tutorial in positive predictive values. If we have 100 MCI patients and a 10% conversion rate, then 10 of them will develop dementia. These are the true positives. There will be 90 true negatives — the ones who don't convert. But with a specificity of 71%, the test will falsely identify 29% of the 90 true negatives, or 26, as positive. Meanwhile, with a false negative rate of 15%, only nine (rounding up from 8.5) of the 10 true positives will be correctly identified. ... It's easy to get a high negative predictive value when the annual event rate is 10%. If I simply predict that no one will convert, I'll be right 90% of the time."
Re:Basic statistics (Score:5, Interesting)
Or that they have learned, passed the test, and forgotten. There was quite an interesting read on exactly this subject on the BBC website this week, Do doctors understand test results? [bbc.com]:
In one session, almost half the group of 160 gynaecologists responded that the woman's chance of having cancer was nine in 10. Only 21% said that the figure was one in 10 - which is the correct answer. That's a worse result than if the doctors had been answering at random.
Re: (Score:1)
Sounds almost like they read the question wrong.
Re: (Score:2)
Re: (Score:3)
Learned is such a strong word. I teach evidence based medicine, including test evaluation to med students and residents. I also have to try and explain it to practicing physicians.
Re: (Score:2)
THis is basic statistics learned by every doctor in medical school. specificity and sensitivity, prevalence, pretest and post test probability and false positive/true negative, false negative/true positive. They all factor in to deciding to use a medical test. Every person who comes in and demands a test ussually gets a lecture on this (at least from me) (at work have to post as AC)
Statistics aside there are two more pressing questions: 1, are patients with MCI more likely to convert (10% or greater) in subsequent years? 2, is there a preventative process that can be used by those that test positive, that is safe for the general population? In other words, do we get to narrow our treatment focus with these results, even a little bit? We can piss and moan about statistics but at the end of the day, who really gives a fuck if you were right about the onset of someone's dementia, unl
How much closer (Score:1)
All the mainstream articles I've read, whilst as usual glossing over the stats, are presenting this as a vast improvement, not as something that should be rolled out clinically. Didn't read it as hype.
Is it a major step towards a viable test, or is that just not true?
Re: (Score:2)
The test looks for a set of 10 proteins in the blood. I suspect that part is fairly reliable which means the theory that those proteins are markers for Alzheimer's is probably incorrect or incomplete.
That leans towards just not true.
Re: (Score:2)
The test looks for a set of 10 proteins in the blood. I suspect that part is fairly reliable which means the theory that those proteins are markers for Alzheimer's is probably incorrect or incomplete.
Whether or not those 10 proteins are markers for Alzheimer's is not the issue at all. When you look for markers, the search goes this way: disease => chemicals. But when you start testing patients for markers, you're actually using the inverse of that relationship: chemicals => disease. If the disease is rare, false positives will vastly outnumber the number of patients really afflicted by the disease even though you test for the right markers.
There are 3 important percentages for disease tests:
- How
Re: (Score:2)
Yup (Score:2)
This is a generic problem with media reports of medical results. No understanding of the statistics.
Add in the lack of repeatability of many studies (for example just about anything claiming bad effects from low doses of bisphenol-A has proven to not be repeatable) and outright fraud (Wakefield) or attempts to push the data using questionable statistics (Séralini) and you have a giant problem with media and medical research results.
"Thank God!" (Score:1, Flamebait)
Surprise (Score:2)
Hey, the condescending article manages to not know what positive predictive values are!
Geeez (Score:1)
These sales people are demented, and I have the tests to prove it.
Doctors suck (Score:2)
A while back, a friend of mine went to the doctor complaining of fatigue. He was just constantly tired and unsure why. They checked him into the hospital for tests, and shortly declared he had Leukemia and needed to start chemotherapy right away. After several weeks, including a long stay in the ICU, the doctors declared the treatment a "success". He remained in the ICU and died yesterday.
Fucking quacks "practicing" medicine and performing "treatments" that have a proven low survival rate - but, hey, ev
many kind of lies (Score:1)