Please create an account to participate in the Slashdot moderation system

 



Forgot your password?
typodupeerror
×
Medicine AI Technology

Stanford Algorithm Decided To Vaccinate Only Seven of Its Frontline COVID-19 Workers, Out of 5,000 Doses (theverge.com) 126

An algorithm determining which Stanford Medicine employees would receive its 5,000 initial doses of the COVID-19 vaccine included just seven medical residents / fellows on the list, according to a December 17th letter sent from Stanford Medicine's chief resident council. The Verge reports: Stanford Medicine leadership has since apologized and promised to re-evaluate the plan. "We take complete responsibility for the errors in the execution of our vaccine distribution plan," a Stanford Medicine spokesperson said in a statement to The Verge. "Our intent was to develop an ethical and equitable process for distribution of the vaccine. We apologize to our entire community, including our residents, fellows, and other frontline care providers, who have performed heroically during our pandemic response. We are immediately revising our plan to better sequence the distribution of the vaccine." The residents' letter also alleges that the error in the algorithm was found on Tuesday but that leadership opted not to make changes to the plan ahead of its December 17th release.

The initial plan led to demonstrations from medical staff in addition to the letter sent by the chief resident council. Here's how the algorithm reportedly worked, according to NPR: "According to an email sent by a chief resident to other residents, Stanford's leaders explained that an algorithm was used to assign its first allotment of the vaccine. The algorithm was said to have prioritized those health care workers at highest risk for COVID infections, along with factors like age and the location or unit where they work in the hospital. Residents apparently did not have an assigned location, and along with their typically young age, they were dropped low on the priority list."

This discussion has been archived. No new comments can be posted.

Stanford Algorithm Decided To Vaccinate Only Seven of Its Frontline COVID-19 Workers, Out of 5,000 Doses

Comments Filter:
  • Not 7 out of 5000. 7 residents out of probably no more than a few hundred at most. God only knows what facts TFA actually reports.

    And yeah, the average, median, and probably 80th percentile resident is under 30 and unlikely to suffer the worst of the covid outcomes. So yeah, it was probably the correct call to start with.
    • by Scutter ( 18425 )

      The Chief Resident Council's response [documentcloud.org] to the Administration's algorithm includes both a breakdown and their demands. The first paragraph states

      There is still no articulated plan to vaccinate the remaining 1,300+ residents and fellows, including those on the front line directly treating
      COVID-19 patients.

      • Re: (Score:3, Insightful)

        by Xylantiel ( 177496 )
        I dunno, the reason this is being reported seems like privilege talking. I'm sure there are 100 other similar glitches in sorting out vaccine priorities across the nation, but this one gets reported because it's Stanford med residents. From the tiny amount of information in the summary and story it sounds like residents didn't get assigned to the proper contact risk category because their "location" wasn't included properly. It also sounds like the glitch was recognized but not considered critical becaus
        • by kenh ( 9056 )

          Older, sicker, and more at risk candidates were ahead of the young, healthy med students, and the healthy young med students think they take priority over an elderly orderly with diabetes and a heart condition that cleans up COVID patient rooms.

      • by kenh ( 9056 )

        So they got 5,000 doses, they have 6,300 workers - that's why they prioritized the vaccination assignments. Absent 1,300 additional doses, who do the young, healthy, med students feel shouldn't get vaccinated so that the residents can be? The janitors? Orderlies? Elderly staff? Who?

        They are just pissed because Stanford didn't get enough for everyone - who would the residents bump off the list for vaccines?

    • The correct call is those likely to spread it, not those likely to die from it.

      • Like in old folks homes. They need to vaccinate the cleaning people and staff, not the residents. The residents don't go anywhere. The maintenance people are probably the ones that spread it. Inoculate the other two and the other population should be fine.

        • Exactly wrong. Vaccinate those most as risk first. Going down the risk level scale until general availability.

          Especially since it is unknown if the vaccine prevents spread vs just making it so you do not get sick, but could still be a carrier / spreader.

          • If you build a wall of vaccinated people around the high risk people (nursing/care home residents don't travel), then you don't need to vaccinate the high-risk people.

            Use your brain, not your endorphins.

            The staff at these places are the ones generally responsible for these infections, since by definition the residents are sheltering-in-place.

            Vaccinate the ones that move, not the ones that don't. They're the ones exposing everyone.

            • If you build a wall of vaccinated people around the high risk people you have a corralled group who can't get away from a still infectious person. Which is no better than not vaccinating them at all. Vaccination doesn't create a magical Batfink style shield of steel that the virus just pings off.

              You vaccinate the ones that can't move first to protect them from those that can.

            • by kenh ( 9056 )

              5,000 doses, 6,300 workers - everybody isn't getting the vaccine in the first round, period. Young healthy med students, and a thousand other hospital workers didn't make the cut, boo hoo, so sad - it's science that put them outside the first 5,000 doses, so now they are making emotional arguments.

        • Re:Exactly! (Score:5, Informative)

          by Entrope ( 68843 ) on Monday December 21, 2020 @07:44PM (#60855396) Homepage

          That approach would work if the vaccines were proven to greatly reduce spread. They're not shown to provide sterilizing immunity in airways, so it's possible for a vaccinated person to get an infection and spread it. Their immunization should prevent the virus from spreading to the rest of their body, but the same barriers that keep almost all dust and germs out of your bloodstream also keep almost all of your antibodies and immune cells inside your body.

          So until we have enough data to understand the effect of vaccination on the spread of covid, the vaccines should be allocated preferentially to those expected to lose the most if they are not vaccinated.

          For reference:
          https://www.texastribune.org/2... [texastribune.org]
          https://www.nytimes.com/2020/1... [nytimes.com]
          https://www.chop.edu/centers-p... [chop.edu]

          • nailed it

          • by kenh ( 9056 )

            Exactly.

            Young healthy med students are less at risk, lower on the list, and didnt make the cut - tell me more about how hospital workers were ranked, maybe there's an issue - but I bet there isn't.

            • Young healthy med students are less at risk, lower on the list, and didnt make the cut - tell me more about how hospital workers were ranked, maybe there's an issue - but I bet there isn't.

              I see there are some mis-understandings about terminology in this thread. Resident Physicians, together with Fellows, are considered "House Staff". They are not Medical Students, they are doctors who have graduated, but cannot yet practice with full independence. They work in hospitals and clinics, under the supervision of Attending Physicians, and are the ones that do a lot of the routine physician stuff, often they will be the ones examining patients when they first come in, and then checking up on the

          • While you expressed the lack of evidence in the correct scientific way, I would like to point out that lack of evidence is not proof that it doesn't significantly reduce the spread of the virus. As you said, we need more data.
            I, for one, layman that I am, am optimistic. It would seem logical that primed and rained immune system should reduce he viral load n the mucous membranes, and hence reduce the spread.
          • So until we have enough data to understand the effect of vaccination on the spread of covid, the vaccines should be allocated preferentially to those expected to lose the most if they are not vaccinated.

            Hospitals run on three things -- Space, Stuff, and Staff. Space is probably the easiest to expand in an emergency, you set up a bunch of beds in a garage or tent and call it a field hospital. Won't be up to the usual standards, but it'll give you some place to stash the incoming crunch. Stuff depends on foresight and money (and lacking that, your ability to scavenge and improvise), the general public is well aware of PPE shortages but it's also categories of things like sedatives, bags of IV solution, CR

        • You also have to exclude everyone who is not vaccinated from entering said nursing home for any reason, including friends and family.

          Also it is far more accurate to say that "the residents can't go anywhere". If you imagine that nursing homes are actual prisons, and that normally people go in and are prevented from leaving for any reason you know nothing about them. People in nursing homes frequently require medical care not provided in the nursing home, if for no other reason.

          • by kenh ( 9056 )

            Resident means med students in this article, not long-term patients.

            • by Guppy ( 12314 )

              Resident means med students in this article, not long-term patients.

              Resident Physicians are not medical students, they are graduated doctors who do not yet have the full independent right to practice, and so they work in clinics and hospitals under the supervision of more experienced doctors.

    • by Ogive17 ( 691899 ) on Monday December 21, 2020 @06:49PM (#60855242)
      If there are only a few hundred residents, why not vaccinate 100%?

      Most of the public believes the hospital employees on the floor get top priority so I doubt there's be any complaints if they were 1st in line. I know I'd rather there be enough doctors and nurses available if I were to need hospitalization.
      • This is "Stanford Medicine" which includes the medical school, the main hospital campus, the children's hospital, the outpatient campus, the cancer center, and god knows what else. The reason you don't just vaccinate a few hundred complaining residents is that you've got at least 15k other people that also want to scrutinize everyone's place in line.
        • by kenh ( 9056 )

          6,300 workers, 5,000 doses - the young, healthy med students, and about a thousand other workers (presumably also young, healthy) didn't make the cut for the first round of vaccines. They feel their education should entitle them to preferential treatment.

      • by kenh ( 9056 )

        5,000 doses, 6,300 workers - can't vaccinate all workers in first round, simple math.

        Young healthy doctors want to bump older, sicker, more at risk non-doctors from the list to ensure they,the young healthy med students are protected.

        Wonder how many had COVID in past 90 days and thus have a reduced need for a vaccine?

    • "God only knows what facts TFA actually reports."

      Indeed.

      Since we couldn't possibly RTFA, perhaps a bloody newbie can enlighten us?

    • by sjames ( 1099 )

      On the other hand, as medical personnel working with COVID patients, they have a very high level of exposure.

      Meanwhile, senior faculty working from home (low exposure) were allocated vaccines. While senior, few were likely senior enough to fall into a high risk group (think older, still working not nursing home senior).

      • by kenh ( 9056 )

        Senior staff - with comorbidity conditions - working from home are at greater risk than spa young healthy med student working in the burn ward that NEVER sees a covid patient or visits the ICU.

        • by sjames ( 1099 )

          And how is that relevant? residents that were working with COVID patients were skipped over for the vaccine.

    • by Guspaz ( 556486 )

      The problem is that they were vaccinating doctors who have been working entirely from home for months, and not vaccinating residents who are directly treating multiple covid patients per day.

      Who is more likely to spread or contract Covid, the person working from home, or the person in direct contact with Covid patients?

      • by ghoul ( 157158 )
        Consider that the people working remotely are probably doing so as they are in a at risk group. Vaccinating them allows them to get back into the hospitals treating pateints hence increasing total available treatment capacity.
      • by kenh ( 9056 )

        I bet they have exactly SEVEN med students that interact with covid patients, that's why seven med students made the first round of vaccines.

        5,000 doses, 6,300 workers, do you assign vaccine on the basis of science (occupation, age, comorbidity) or do you simply go by title (drs, med students, nurses, etc. and bump the orderlies and staff workers)?

        Stanford chose science, and it offended the healthy young med students sense of self-importance.

    • by Bert64 ( 520050 )

      At this stage most of these frontline workers have probably already been infected and recovered so there is probably a very high level of natural immunity among such people... Unless you take extreme precautions, if you are working with infected patients every day there is a good chance of becoming infected yourself.

    • the average, median, and probably 80th percentile resident is under 30 and unlikely to suffer the worst of the covid outcomes.

      That may be but how many patients will suffer because they need treatment and there are not enough medical staff to treat them because they are off sick with Covid? How many already sick patients will be exposed to Covid because the doctor treating them had Covid but did not know? (and remember these people are at far more risk since they are already dealing with something else). There is more than the risk to the individual to consider when considering vaccinating medical staff and any decent algorithm sh

      • by kenh ( 9056 )

        Doctors that attend to covid patients don't also cover the pediatric ward and spread the disease to non-covid patients.

        Stanford had 5,000 doses and 6,300 workers, someone was going to miss out on the first round - only med students are protesting.

    • by kenh ( 9056 )

      Exactly. The clickbait headline reads like only 7 frontline healthcare workers were to be vaccinated, while I'm pretty sure they assigned all 5,000 doses to hospital workers, while only 7 went to young, otherwise healthy RESIDENTS (AKA student doctors) out of an unknown quantity of residents.

      From my sofa, I suspect everyone else that was assigned the first round of vaccine was older, had comorbidity conditions, and worked in areas that put them at greater risk.

      A young (27 year-old) resident working in pedia

  • AI Failure (Score:4, Insightful)

    by sdinfoserv ( 1793266 ) on Monday December 21, 2020 @06:44PM (#60855224)
    Sure, when it fails spectacularly, call it an “algorithm”. When you think it needs lots of VC money, call it “AI"
    • If you don't like this algorithm, I have others.

    • They had so little intelligent people in their management, that they resorted to "Artificial intelligence". However, they have none of this also.
      Management failure.
      Total failure.

      • by kenh ( 9056 )

        1,300 Stanford workers were not going to be vaccinated in the first round of 5,000 doses - simple math. These med students think they should be in the first round, perhaps they should go thru the list of employees and go tell the 1,300 they feel don't need the vaccine that they, as med students, are more important, more deserving, than the older, sicker, orderly workers on the list.

    • Sure, when it fails spectacularly, call it an “algorithm”.

      It was not just the algorithm that failed but also the people who chose to use its results without thinking. It's like the idiots who drive cars into lakes, oceans etc. because their GPS told them to. It takes a failure to think as well as a failure of the algorithm.

    • Sure, when it fails spectacularly, call it an “algorithm”. When you think it needs lots of VC money, call it “AI"

      I don't think the output was all that unreasonable. What's clearly unreasonable is that headline.

  • reset to healthcare for all mode and rerun

    • Re: (Score:2, Flamebait)

      by cygnusvis ( 6168614 )
      There is not enough healthcare available for this mode. The price is how we control access and prevent overuse.
      • so inmates get in front of non inmates and the cost is 0? so usa.

        try in Canadian mode

        • by kenh ( 9056 )

          Issue is constraint of vaccine in first round. How's the national vaccine program working in Canada these days?

      • by kenh ( 9056 )

        6,300 workers, 5,000 vaccine doses in first round - everyone can't get it, simple math.

        We can't vaccinate everyone all at once - we only have tens of millions of doses, not hundreds of millions of doses - patience.

  • by tgibson ( 131396 ) on Monday December 21, 2020 @07:07PM (#60855290) Homepage

    A committee of humans reviewed the algorithm's results and blessed it. The committee had nobody representing the residents. That's the problem: making decisions without all relevant parties represented in the decision-making.

    • by Sebby ( 238625 )

      A committee of humans reviewed the algorithm's results and blessed it.

      Yup. [twitter.com]

    • I think it's safest to blame everyone. Whoever made the algorithm, whoever used it, whoever blessed it, whoever is proceeding on that basis. ANY of those people could have willfully created this outcome, or it could have been a group effort between all of them.

    • by kenh ( 9056 )

      The point of the algorithm is to remove 'representation' from influencing the decision.

      Ideally, the data provided accurately describes the workforce, and when that data is run through a properly designed - scientifically-based - algorithm, the most at-risk employees will be vaccinated first, if that how the algorithm is structured.

      Personally, I'd like to hear more about the other hospital workers that didn't make the cut, there were 1,300 of them, but only the med school residents are protesting.

  • They should have taken the gig-economy buzzwords into consideration when making their algorithm

    • by hey! ( 33014 ) on Monday December 21, 2020 @07:25PM (#60855356) Homepage Journal

      No. The "algorithm" is a scapegoat that makes it sound like people weren't involved at all in setting priorities that put department heads working remotely ahead of residents and fellows actually treating COVID patients.

      • by kenh ( 9056 )

        Department heads (with comorbidity conditions) are at greater risk than the (young, healthy) med school student working in the burn ward that never goes near a covid patient.

        FFS this is round 1, are we pretending the other 1,300 Stanford workers will never be vaccinated? I bet they get sufficient vaccine in a couple weeks.

    • by ghoul ( 157158 )
      They did. They only considered employees not the Residents who are not employees (They are more like padi interns as they are still learning). Benefits are only for employees not contractors or interns.
      • by kenh ( 9056 )

        Or, they are younger, healthier, and aside from seven of them don't interact with covid patients at all. There are lots of other areas in the hospital aside from ICU covid cases.

  • Why would someone who claimed doctors are faking covid-19 deaths to make more money be one of the first people to get a vaccination [tumblr.com]?

    Why would a healthy 49-year old man, with no known underlying medical conditions, be one of the first people to get a vaccination after spending months claiming the pandemic is a hoax [tumblr.com]?

  • we have a health care industry.
  • Their life is not in danger if they use PPE, these words are not suitable.
    • Re: (Score:3, Informative)

      by belg4mit ( 152620 )

      They're not working in BSL4 facilities, they're wearing basic masks, etc. if they're lucky. PPE, like birth control, is not perfect. Furthermore, since mask effectiveness is probabilistic, risk increases with duration of exposure; these folks aren't ducking into a restaurant for take-out, they're spending long hours on shift in a hospital, some of them in close contact with infected patients.

  • As far as I am aware that are as yet no sentient artificial intelligences capable of reprogramming themselves beyond the boundaries of their original design. Therefore this "algorithm" didn't just spring out of the grave of Charles Babbage fully formed but was designed by human beings working to a specification which embodied assumptions, norms, and unstated goals as well as written targets.

    tl;dr: someone at Stanford wanted the results to come out this way and designed the magic "algorithm" to achieve that

  • by Goldsmith ( 561202 ) on Monday December 21, 2020 @09:50PM (#60855672)

    Stanford Decided To Vaccinate Only Seven of Its Frontline COVID-19 Workers, Out of 5,000 Doses

    That should fix it.

    • by kenh ( 9056 )

      They vaccinated 5,000 out of 6,300 employees and workers IN THE FIRST ROUND of vaccinations. They couldn't get to everyone, and most med students likely don't go near covid patients in ICUs, they likely work in Er, pediatrics, burn wards, physical therapy, cardiovascular, gastrointestinal, etc areas of the hospital and rarely (if ever) actually see covid patients.

      Every room in every hospital in every state is not full of covid patients, a fact the press won't likely point out until after Biden is in office.

      • I think you missed the point here.

        Yes, they vaccinated 5,000 people. Of the 5,000 people they vaccinated 4,993 were faculty and 7 were among the group of 1300 trainees.

        The point is that the university faculty put themselves at the front of the line and have tried to pass that terrible decision off on an algorithm.

        If you click through to the ProPublica article, you'll see that some of the faculty recognized what was going on and were pretty horrified by it. It's hypocritical and poor policy (or par for the c

  • an algorithm ate my homework.

  • by FeelGood314 ( 2516288 ) on Monday December 21, 2020 @10:59PM (#60855786)
    They have 5000 doses. They have thousands of doctors, nurses and other staff. They also had 1300 resident doctors. So they chose an algorithm that considered risk factors to complications from Covid-19 and found of the top 5000 most at risk people only 7 were residents. Since the residents are almost all young and they probably have 5000 people over 45 I suspect that this is a reasonable allocation.
    • by ghoul ( 157158 )
      Please upvote the parent. Young people are less affected by this. In fact many of the older doctors are probably working remote as they have co-morbidities and are at risk. Vaccinating them means they can come back into the hospital instead of working remote hence increasing capacity.
      • by Anonymous Coward
        Except this disease is opportunistic: the more exposure these young people experience, the more likely it is they'll catch it. Anyone - regardless of their other risk factors - who spends significant time directly exposed to infected patients needs to be inoculated first. The doctors at home should be inoculated before the general public so they can be used on the front lines, but not before currently active front line personnel.

        * Posting AC because I applied mod points.
    • by AmiMoJo ( 196126 )

      More details of the algo here: https://www.technologyreview.c... [technologyreview.com]

      The main issue seems to have been with the way it calculated risk. Residents were not assigned to any department (they move around) so did not get the department's risk added to their own.

      • by kenh ( 9056 )

        Maybe, that's ok - since they move around, their risk is reduced compared to an ICU nurse or orderly who is exposed to covid patients every hour of every work day.

    • That's if your only concern is whether the worker might die. A medical worker that contracts it is out of rotation for 2 weeks, and may end up with long-haul symptoms that generally aren't understood as well as the mortality risks. There's also just the added stress of worrying if you're going to contract it.

      It's a poor algorithm that only takes into account mortality here.

      • by kenh ( 9056 )

        So, do you know the algorithm, or just making up criteria so you can criticize what you imagine the algorithm is?

    • by kenh ( 9056 )

      5,000 doses, 6,300 workers. 1,300 workers were not included for a variety of reasons IN THE FIRST ROUND of vaccines - there will be a second round.

      I'd live to see the med student working in pediatrics go tell a 60 year-old orderly with diabetes and a bad heart condition that the med student will be taking his place on the vaccination list, and the orderly can wait for the next round.

  • Algorithms are only as good as the designers, and often their are implicit presumptions. Or more simply, like Professor Frink in the Simpson's would say "Oops, I forgot the carry." The sad thing is this can seriously impact people's lives and health.

  • Here it is:

    getPriority(person) {
      if (person.role == 'ADMIN') {
        return 1;
      } else {
        return 120 - person.age;
      }
    }

    It was reviewed by the administration and approved so what's the problem?

  • ...the bias is toward purported equitability.

    Decide what you want most.

    If it's efficacy, that may not necessarily jibe with equality.

    If all your doctors are white, then yes, you may have VERY good reasons for "giving it only to whites" at first.

  • An algorithm was developed, reviewed, and approved.

    But people weren't happy with the results because it didn't align with what they wanted to happen. So the algorithm is condemned, set aside, and an alternative will be decided upon ... by people who will find a politically adroit way of placating the loudest complainers.

    Think about that. Science continues to be sidelined for political expediency.

    • by kenh ( 9056 )

      They will put people of color ahead of whites (virus impacts people of color worse than whites, according to countless news stories repeated by countless politicians);

      They will put low income workers ahead of high-earners (virus disproportionately impacts low-income workers, according to press and politicians);

      They will put first-responders ahead of others, unless they are white or high-income earners (see above);

      They will prioritize healthcare workers ahead of others (unless white or high-earners, see abov

  • Of the 4,993 other folks, how many are actually seeing patients in person? I've read that many who are getting the vaccine are working from home and not seeing patients. That does seem a little funky even if due to age they are at higher risk. I would generally prioritize anyone seeing patients in person first since if those staff go down, we can't treat people.

    First round should have prioritized all in person treatment folks first and then future rounds can roll into the higher risk crowds. That would ensu

  • An algorithm chose who would be the first 5,000 in line. The residents said they were told they were at a disadvantage because they did not have an assigned âoelocationâ to plug into the calculation and because they are young, according to an email sent by a chief resident to his peers. Residents are the lowest-ranking doctors in a hospital. Stanford Medicine has about 1,300 across all disciplines.

    Being young, healthy, and not having assigned locations worked against them.

    But by having 'floating' assignments, aren't they at a lower risk than someone assigned to the ICU full time?

    Another resident, who asked not to be named, said a nurse who works in an operating room for elective surgeries has been notified sheâ(TM)ll get the vaccine in the first wave. âoeWe test people for COVID before elective surgeries, so by definition, we will know if those patients have COVID,â he said, so to him, it didnâ(TM)t make sense that that nurse would be prioritized.

    Doctors are more at risk than nurses? Who administers the Covid test before a procedure - a nurse, no doubt. This resident says, literally, Doctors (med school residents) are more important than nurses, and "it doesn't make sense" to vaccinate nurses?!?!

  • by Vadim Makarov ( 529622 ) <makarov@vad1.com> on Tuesday December 22, 2020 @05:47PM (#60858200) Homepage

    the vaccine queues for you.

    Seriously, in Moscow and its suburbs sputnik 5 is available for asking to anyone aged between 18 and 60. I got it two weeks ago. Today my spouse, 45, unemployed, went to the local clinic and had no problem sighing up for the vaccination. It's fun to see how the rest of the world is arguing who should get a vaccine first while the Russian government has difficulty using the available doses.

    • in Moscow and its suburbs sputnik 5 is available for asking to anyone aged between 18 and 60.

      The age restriction has been removed today [meduza.io]. It's now available to nearly everyone (barring a few medical restrictions) over 18.

You know you've landed gear-up when it takes full power to taxi.

Working...