Slashdot Log In
Computer Characters Tortured for Science
Posted by
ScuttleMonkey
on Wed Dec 27, 2006 02:39 PM
from the shocking-research dept.
from the shocking-research dept.
Rob Carr writes "Considered unethical to ever perform again with humans, researcher Mel Slater recreated the Milgram experiment in a immersive virtual environment. Subjects (some of whom could see and hear the computerized woman, others who were only able to read text messages from her) were told that they were interacting with a computer character and told to give increasingly powerful electric shocks when wrong answers were given or the 'woman' took too long to respond. The computer program would correspondingly complain and beg as the 'shocks' were ramped up, falling apparently unconscious before the last shock. The skin conductance and electrocardiograms of the subjects were monitored. Even though the subjects knew they were only 'shocking' a computer program, their bodies reacted with increased stress responses. Several of the ones who could see and hear the woman stopped before reaching the 'lethal' voltage, and about half considered stopping the study. The full results of the experimental report can be read online at PLoS One. Already, some (like William Dutton of the Oxford Internet Institute) are asking whether even this sanitized experiment is ethical."
This discussion has been archived.
No new comments can be posted.
The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.
Full
Abbreviated
Hidden
Loading... please wait.
Excellent... (Score:5, Funny)
Re: (Score:3, Funny)
seriously I read about it somewhere
Interesting Experiment (Score:5, Interesting)
Fun for everyone! (Score:4, Interesting)
Then ask them if they'd torture a criminal.
After the torture (for those who do volunteer) tell them that there was a mistake and that the guy was innocent. But their assistance is needed with the real criminal.
Parent
Re:Fun for everyone! (Score:5, Interesting)
The first and second groups act as they did in this study.
The second and third groups act as the first and second, but with a man.
The fourth and fifth groups act as the first and second, but with a man, but of a different race (black subjects get a white victim, etc).
The sixth and seventh groups act as the first and second, but with a man they are told is an enemy combatant.
There are a lot of variations of this, and I doubt any of them are very ethical. But being unethical doesn't make the results uninteresting or invalid, but without a sufficiently large group, any results would be generally untrusted (but still interesting!).
Parent
Milgram's own follow-ups explored this a little. (Score:5, Insightful)
By demonizing the subject as a criminal, you would definitely observe a higher incidence of going too far. Demonizing your enemies is a central tactic in all societies committing to war for a reason -- it makes it easier to kill the other guy when you don't see him as being the same as you.
Parent
There is a problem with ethics! (Score:5, Insightful)
Whether your "volunteer" has actually harmed someone or not, the psychological trauma is very real. That's the part where they describe the very real stress indicators. For those that don't know, the Nazi's kept free liquor flowing to the guards in the concentration camps. Why did they need liquor? Because of the emotional trauma associated with performing such vile acts on another human being.
It makes me wonder if the human subjects of this experiment truly trusted the statements of those in authority that they were NOT shocking real humans. Was something clicking in the backs of their heads warning them that they may be torturing real humans instead of electronic simulations?
Too bad Philip K. Dick is dead.
Parent
Re:There is a problem with ethics! (Score:4, Interesting)
Fast food workers torture co-worker [go.com]
Parent
Mirror Neurons (Score:5, Interesting)
Parent
Did subjects know about the Milgram experiment? (Score:5, Insightful)
The Milgram subjects almost certainly had no knowledge of whether the situation was real or what the purpose of the experiment was, and probably believed that they were "supposed" to follow orders.
Today's subjects may well have heard something. Even if they couldn't have named "Milgram" as the investigator, they may have had more than an inkling that the purpose of the experiment was to see whether they were virtual sadists, and may have suspected that, despite their instructions, the "approved" behavior was to not to follow orders.
Re: (Score:3, Interesting)
In order for the study to have been tightly-controlled and more importantly, valid, they would have had to control for that. They may have asked if the participants knew who Milgram was, but they would probably have not asked to if they had heard of the experiment, as it would have introduced a slight bias. Mind you, Milgram's experiment was ground-breaking in that it showed that even ordinary people can perform actions contrary to societal norms, which was the thesis based on the "I was only following orde
Re:Did subjects know about the Milgram experiment? (Score:4, Interesting)
It's perfectly possible that they asked questions like that after the experiment. That way they get their data and it doesn't put any ideas in the subjects' heads.
Parent
Re:Did subjects know about the Milgram experiment? (Score:5, Insightful)
That is true, but the authority exuded by the "researcher" in the Milgram experiment is similar. The person doing the shocking feels relieved of responsibility and has a figure to point to if things went sour. It's not like they're going down the street shocking people at random of their own volition, they're being told to in the context of a scientific experiment.
With this kind of disconnect, the results of the Milgram experiment weren't very "shocking".
Parent
Re:Did subjects know about the Milgram experiment? (Score:5, Insightful)
That's what is so ground-breaking/terrifying about Milgram. He showed you don't need all those coercive techniques to get "normal" people to do terrible things. You just need someone who is an apparent authority to guide them and absolve them while they're doing it.
He showed that you don't need a whole lot of evil people to do those evil things. You just need a lot of normal people with a few evil people in authority. There was nothing special about the Nazis - we are all (collectively) capable of attrocities, and it doesn't even take much prompting.
Parent
Re:Did subjects know about the Milgram experiment? (Score:5, Informative)
FTFA...
"For those 12 in the VC who wanted to stop before the end, 5 claimed to be well-acquainted with the original Milgram study"
The secondary objective was to test for the proportion of slashdot readers that RTFA.
Parent
MOD PARENT UP (Score:5, Insightful)
But it's not mentioned in the "methodology" section, and I think the paragraph you mention does cast some doubt on the validity of the results:
"For those 12 in the VC who wanted to stop before the end, 5 claimed to be well-acquainted with the original Milgram study, and therefore we cannot rule out the possibility that this influenced their behaviour. However, if we treat 'wanting to stop' as a binary response variable in order to test for differences between the proportions (using binary logistic regression) then the VC was significantly different from the HC (?2 = 6.691 on 1 d.f., P = 0.0097) whereas knowledge of Milgram did not have a significant impact (?2 = 1.525 on 1 d.f., P = 0.22) and there was no interaction effect between group and knowledge of Milgram."
In the first place, this seems a little bit like throwing in a statistical fudge factor, since it does not say in their methodology that they planned to ask about knowledge of Milgram after the experiment, and they seem to have applied this statistical test a posteriori, whereas statistical tests are only valid if the test to be performed is stated in advance.
In the second place, it's all very well to say that five of the subjects "claimed to be well-acquainted" with the Milgram experiment, but that does not take into account the number of subjects that, while not well-acquainted with it, might nevertheless have had some vague or even subconscious knowledge of it. The Milgram study has been around a long time and is practically in the folkways.
There are probably millions of people who would say they knew nothing about John B. Watson's experiments with rats, who nevertheless would be extremely familiar with the idea of running rats through a maze.
Parent
Mod Parent Up (Score:4, Insightful)
Parent
Re:Did subjects know about the Milgram experiment? (Score:5, Insightful)
Parent
Big Deal (Score:3, Funny)
What if it isn't really VR? (Score:5, Funny)
Why unethical? (Score:4, Insightful)
I don't see what's morally or ethically wrong with the experiment, even with a real human subject. I mean, the "victim" isn't actually being shocked, whether the "victim" is human or virtual.
Is the fear that the experiment desensitizes the subject to situations where they are asked to obey a command that they should refuse? But the results indicate that the subject is likely to already be in that state. If properly debriefed at the end of the experiment, the subject is more likely to refuse such a command in the future, rather than less.
So can someone explain to me what's unethical about this?
Re:Why unethical? (Score:5, Informative)
Essentially, in order for an IRB to approve a study to be performed using human subjects, one of two requirements must be met: either there is ABSOLUTELY NO RISK involved on the part of the subject (i.e. simple psychophysical tests of perception and so forth), or the risks must be outweighed by the potential gain in scientific knowledge that the experiment offers (i.e. clinical trials of drugs that, while risky, hold the promise of curing serious illnesses).
All studies require that subjects sign an IRB-approved consent form that enumerates the risks inherent in the experiment (or lack thereof), and IRBs require a submission of experimental intent and aim so that they may weigh the potential risks and benefits of the experiment. Some people would argue that *any* experiment is ethical as long as you can find subjects willing to be a part of them and sign a liability waiver, but the reality of the situation is that before any subject even has the option to sign their life away an IRB must first approve that such a situation would be ethically sound. Without IRB approval, you won't get published, and without being published, you won't get funding. That's the cycle.
Milgram's original experiments were deemed unethical because of the psychological trauma experienced by the subjects being ordered to up the voltage. They were put in the emotionally distressing situation of having to choose between following the experimenter's (i.e. authority figure's) orders and their own moral code, and this situation has since been deemed unacceptable. The reason for this is that the experiment's potential insights into the frailty of human morality in the face of authority simply weren't interesting or essential enough for the advancement of science to justify the risks of seriously traumatizing the subjects.
As far as I can tell, the reason this experiment is more experimentally justifiable is simply because the "victim" is explicitly virtual--a fact of which subjects are aware--so the situation, as it doesn't involve hurting actual people, isn't as emotionally traumatizing.
Parent
Re:Why unethical? (Score:5, Insightful)
It's the damage to the administrator of the virtual torture that's considered unethical. As long as that person has any common sense, they'll eventually discover that they are torturing the subject, and if they persist, they will be led to beileve that they have killed the subject. This should bring the administrator in conflict with their sense of morals, and the experiment is designed to break the virtues of compassion and human decency in a high-pressure situation.
We have all felt the pains of high pressure sales tactics, imagine the mistakes you could make if you were initially told that the test was harmless, then put under high pressure to continue it, eventually leading to the death (real in your point-of-view) of the subject? That's the Milgram experiment in a nut shell, and it relies on abusing the trust the administrator has in the researcher. The researcher deliberately lies to the administrator to achieve the desired results.
The fact that you're later debriefed won't console you because the experimenter lied to you, so they could lie to you about "it's all fake, after all". It also prevents resolution of the pain, because complaining about the stresses incurred while virtually torturing someone will either ostracize you from peers or be dismissed as non-real stress. If you actually tortured someone you could atone (if you wish to) for your actions by helping those you hurt, seeking forgiveness within your faith, or by deeds. But nobody understands redressing virtual wrongs; there's no avenue for repentance.
As a good Christian (in the best meaning of the phrase) can you condone the treatment of the real subjects, the ones administring the virtual shocks?
There's also other scientific grounds for dismissal. If the researcher deliberately manipulates the administrator to achieve the desired results, then is it science? In other "hard" science fields, manipulation of the experiment with a desire to achieve certain results would be a serious infraction of the scientific process, but in the near-voodoo corners of Psychology, it's considered a technique.
The news is that they've reproduced it. This one isn't nearly as reproducable as it claims to be, and the effect doesn't support what every Psychology student is told; that "You would do the same thing in the same situation." which (fortunately) isn't true according to the less fantastic failures to reproduce the same outcome.
Parent
Re:Why unethical? (Score:5, Insightful)
Funny. So were most of the original test subjects in Milgram's 1963 experiments. This stands an an irrelevant comment except to basically brag about how you feel morally superior to most people -- and then you have the sheer, unmitigated gall to ask that people "hold [their] slams." That's Pride. We are all sinners; remember that, and you'll do far better as a Christian than to parade around like a Pharisee waving your religiousity around like it's a badge, proclaming that you have "more ethics than average."
I don't see what's morally or ethically wrong with the experiment, even with a real human subject. I mean, the "victim" isn't actually being shocked, whether the "victim" is human or virtual.
The victims are the test subjects -- the people being pressured into harming other people in spite of their normal moral inclination to avoid such a thing. They are being put under stress and are being led to sincerely attempt to cause mortal harm to another to avoid the displeasure of an authority figure. They are caught between their conscience and the pressure to conform. In the end they are harmed in two ways: (a) they are put under immense stress, (b) they are led to commit a deeply wrong act that they would've never considered.
If tempting people to hurt others and causing distress and emotional turmoil (and in one subject seizures) aren't unethical in your worldview, then I think you need to hit the Good Book a little harder and work some more on those superior ethics of yours.
Parent
Re:Why unethical? (Score:5, Informative)
Interesting. You fall into the same trap as many of the psychologists who decried the experiments when they were published -- that the subjects must all be inherently flawed and that normal, good, decent people would never find themselves failing in the same manner. You ignore that in 1963, most of the test subjects were probably church-going Christians themselves. Even the researchers performing the experiment were convinced beforehand that no more than 1.2% of subjects would go all the way to deadly voltage.
In fact, 65% did. None stopped before 300 volts, and the shocks started at 45 volts and increased 15 volts each time. That means that a minimum of 16 shocks were delivered by every single subject. The experiment was stopped when the subjects either refused to continue or objected more than 4 times. The experimenters expected that most subjects would stop at 150 volts (8 shocks) and that no more than 4% would make it to 300 volts.
Let me repeat that again. Every single subject shocked people up to 16 times, well into the "dangerous" range on the dial. None of the subjects knew what they were getting into at the time. They were being led to believe that they were helping perform a test on memory of the "electocuted" actor.
Milgram got similar results in the 19 other experiments exploring variations on the theme. He found that increased emotional distance from the subject increased the willingness to go all the way while seeing and hearing the victim scream and writhe and having the authority figure be more remote decreased it. However, all replications of the original experiment got deadly shock results in the 61-66% range.
Now, what are the odds that 65% of Americans in 1963 were all rotten murderers and 100% were vicious torturers? Pretty bad if you believe that the populace isn't inherently ready to perform these kinds of acts without realizing it. The odds of getting so many latent torturers is pretty bad unless the percentage of latent torturers in the population is really, really high.
Quite frankly, you've never been tested like they have. You've probably never been put in a similar situation, and you have the advantage of knowing ahead of time to watch out for this sort of thing. Many of the subject expressed gratitude for having been in the experiment because it made them face what lies within them. At least one wrote back that when he was drafted for the Vietnam War, he was far more aware of what being put under someone else's authority would mean for him and how he was ready now to put the foot down if ordered to do something horrible.
Who knows, maybe you're actually more ethical than most, but I want you to remember your words every SINGLE time the temptation arises to cut corners to meet a boss' impossible deadlines, every time the temptation comes to make an excuse to the customer to avoid getting reported, every time the temptation comes to tell a white lie to avoid any form of disapproval from anyone for ANY reason.
Because the potential for evil lies within you too. It lies within us all.
Parent
Computer / Photoshopped Pornography (Score:4, Interesting)
And then there's the more obvious- kill or be killed- games that exist. Not to dip into the Matrix "Your mind makes it real" mentality that you see written into laws now adays targeting violent games but there may be some form of truth to that axiom. To some individuals that can not or will not socialize this may provide the tipping point that triggers their anti-social behaviour.
Interesting research. It'll be more interesting to see how the ethic committees respond.
Re:Computer / Photoshopped Pornography (Score:4, Informative)
Well, no, that's not true, at least not in the US.
There *was* a law passed which made possession of the mere depiction of child porn illegal. Even if it was a completely computer generated image, or line drawing, or even a young-looking adult dressed up in, say, a Girl Scout uniform, it would be every bit as illegal as actual photographs of the rape of a 5-year-old. All that was required was for the image to "appear" to be a minor engaged in sexual conduct. And, too, it wasn't just pictures, but any kind of depiction, like a written story.
The Supreme Court rightly determined that that law was unconstitutional. Several years ago. The case was Free Speech Coalition v. Ashcroft.
Parent
Big difference (Score:5, Insightful)
That's why the original experiment, IMHO, is so important: because it exposed the risks of "obedience-without-thinking".
But then again, I have little knowledge about the whole thing, so these are just my impressions.
Exposure to Video Games Important? (Score:5, Interesting)
I've got to wonder what the participants' exposure to video games or other "virtual environments" would have on their responses. To a gamer, I'm not sure rapid heart rate, and sweaty palms indicate increased anxiety. They might have just been "getting into the game."
I remember when Half-Life first came out my friend and I spent a lot of time running around beating the innocent bystanders with our crowbars and watching them beg for forgiveness. We weren't doing it because we were sadists, just curious gamers. We'd never seen NPC's react in such a realistic way before, and thought it was "cool". My girlfriend came into the room while we were doing this and was horrified, got really upset and asked us to stop. Not being as avid a gamer, I don't think she was used to dissociating her emotions from video game characters.
I don't think video game violence numbs players to real world violence, but it sure numbs them to video game violence. Seems to me like prior experience would play a major role in your reaction to this experiment.
Re:Exposure to Video Games Important? (Score:4, Insightful)
Parent
Too much time in virtual reality could be harmful (Score:3, Interesting)
I hear people talking about TV and movie characters (i.e. actors pretending to be people who don't exist in the first place) as if they are real. People pay real money for virtual goods. However, I've also heard soldiers (particular pilots) compare real combat to video games. It seems like the line between virtual reality and actual reality is pretty dim for some.
But given the amount of time people spend on TV, in front of computers, or playing video games, this is hardly surprising.
PETA (Score:5, Funny)
They didn't mention the other participants (Score:5, Funny)
Oh dear...in a hundred years time... (Score:4, Funny)
Re:Not torture. Entertainment. (Score:5, Funny)
Parent
Why it's fun (Score:4, Insightful)
In something like "GTA," killing the other characters is just another expected part of the game. In "Manhunt," it's damn near the whole point of the game. But it doesn't have the same appeal as when you think you just might be experimenting with aspects of a game that its mainstream players don't, or that the programmers might not have even been prepared for.
It's right up there with "Hot Coffee." The mod wasn't necessarily popular because the crude polygonal dry-humping was all that appealing in itself, but because it was a way to get soemthing out of your copy of "San Andreas" that the next guy wasn't, and see more of your game than the company expected.
If they released an official "47 new ways to kill your Sims Torture Pack," where it really was the focus of the game, it just might not be as appealing as it was.
Parent
Re:Not torture. Entertainment. (Score:5, Funny)
When he asks why I did it. I'll tell him it's the only way I can orgasm. [/Ichi]
I bet that'd throw his results off.
Parent
RTFA (Score:5, Informative)
Now, is it still unethical?
Parent
Re: (Score:3, Insightful)
In fact I'm not sure how this study ever received Institutional Review Board approval for human subjects research.
First I don't see what this study achieves. It recreates an immensely harmful and unethical study with some slight tweaks to make it less harmful. The Miligram study already exists, we don't need to re-try it to ensure that people will follow orders.
Second just because someone is consented to a study does not mean that it is acceptable to harm them. Just to discover how much harm a study do
Re:RTFA (Score:4, Informative)
Actually that's EXACTLY what needs to happen to be able to either verify, or dismiss any study. It either needs to be repeatable to a reasonable degree of certainty, or disproven. Repeatability is an intrinsic mark of science. Now perhaps the COST of repeating is so high as to never do it (physical or mental damage to the subjects), but just saying "it's been done" is not sufficient reason to deny recreating the study.
And adding an aspect where the subjects KNOW the pain is virtual... that's an interesting twist IMO, and well worth examining.
Parent
Re:Of course it's ethical (Score:5, Insightful)
John Dean (former aide to Nixon) treats this, and more, in his book "Conservatives Without Conscience", where he helps explain the reasons so many people blindly follow authority (and why some people so like to be blindly followed). Milgram's work was seminal in the study of authoritarian followers, and you do it no justice by blatantly misrepresenting it.
At any ate, the point of this study is that some people do not emotionally differentiate between virtual actions and real actions.
Parent
Re:Of course it's ethical (Score:5, Interesting)
This made me think of a personal antecdote. I don't know how many people played any games from the dungeon keeper series, but I used to play the first one a lot. One of the hallmarks of the game is that you're an evil character. However, as much as the ability to play a different persona appeals to me, every time I set out to play an evil character in any game I end up feeling remorse for killing innocents, even though they aren't real.
Anyway, in dungeon keeper (Real time strategy) you start out with a group of loyal imps. They are weak, small and do all of the mining and grunt work in your dungeon. They are unique in the game in that they can be created, and will always serve you no matter how poorly you treat them. The game allows you to slap creatures to make them work harder. There is little downside in doing this with imps since they won't flee the dungeon in anger and since they are poor fighters their health level isn't really important. Logically, all imps should be regularly slapped for maximum dungeon efficancy. And in fact, the computer controlled rival keepers do just that.
But I couldn't really do it as a matter of course. I actually felt bad, knowing full well that they weren't real. They made noises like they were in pain but of course thats just the computer. It was only when I was in a dire spot (doing a fast gem seam grab at the start of the map and then fortifying the walls to hold off an attack) that I would slap them, and even then I felt kind of bad.
So I can sort of understand how the results are similar to the original experiment. Its evoking an emotional response, and playing it again logic.
Parent
Re: (Score:3, Informative)
Re: (Score:3, Insightful)
Ask any current or former soldier and see how they felt when they went to war the first time. Some handle it, some handle it well, some handle it very poorly, but it makes an indellible impress
Re:Unethical? (Score:4, Insightful)
Of course, in the original experiment the people were eventually told "it's okay, it was just a simulation"... but they may still have felt a deep guilt for a short time, and were probably very emotionall conflicted during the experiment. I've watched some of the footage of the experiment, and it is quite interesting and somewhat scary at times. Some subjects end up begging to the "research authority" to let the experiment end, because they are worried about killing the actor. The anguish and concern in the subjects is quite obvious. (It is also quite scary how many of them continued zapping the actor, even after all their protests, simply because someone in a lab coat kept repeating "please continue with the experiment protocol".)
Though the pain was simulated, the emotional repercussions to the subjects were real. Some may have felt a guilt that continued well after the experiment. ("I know it was just an experiment... but if it had have been real I would have acted the same way... does that make me a bad person?")
This new twist on the experiment (where the subject can very easily tell that the pain they are 'inflicting' is virtual) is interesting. One would naturally assume that the emotional repercussions would be non-existant in such a case, yet this research shows that people nevertheless feel some amount of stress.
Parent
Re:Unethical? (Score:4, Funny)
"What? You're kiding me, I don't believe it!"
"Really Sir, his name is John Row, he's a method actor from
"Lalalalala, I can't hear you."
"Sir? Sir?"
"God damn scientists, take away my fun."
Parent
Re:Unethical? (Score:4, Insightful)
Spoken like a man who is incapable of the empathy to understand how believing for a moment that you've killed a man through electroshock might make someone else feel. The Milgram experiment made many of the participants believe for a short time that they were guilty of murder due to peer pressure. That's not something that leaves you to be forgotten for the rest of your life.
Neither is having the self-delusion in one's inherent morality stripped away by being pressured into committing an atrocity merely by being told "the experiment must continue" by a man in a lab coat. Finding out that you're essentially a sheep who will harm others just to avoid the disapproval of an authority figure would be a scarring experience for those involved. The damage done to the subjects' worldviews is a large part of what makes it unethical.
Plus, even if the effects weren't long lasting, causing undue stress on a subject and heavy use of deception are generally considered unethical in psychology experiments. I mean, one of the subjects did get so stressed out that they had a seizure.
Parent
Re:Unethical? (Score:4, Interesting)
Parent
Re: (Score:3, Informative)
Re:Different subjects in the experiment... (Score:4, Funny)
Parent