When the Hiring Boss Is an Algorithm 245
Hugh Pickens writes "Joseph Walker writes at the WSJ that although personality tests have a long history in hiring, sophisticated software has now made it possible to evaluate more candidates, amass more data and peer more deeply into applicants' personal lives and interests. This allows employers to predict specific outcomes, such as whether a prospective hire will quit too soon, file disability claims, or steal. For example after a half-year trial that cut attrition by a fifth, Xerox now leaves all hiring for its 48,700 call-center jobs to software. Xerox used to pay lots of attention to applicants who had done the job before. Then, an algorithm told the company that experience doesn't matter. It determined what does matter in a good call-center worker — one who won't quit before the company recoups its $5,000 investment in training. By putting applicants through a battery of tests and then tracking their job performance, Evolv has developed a model for the ideal call-center worker (PDF). The data recommend a person who lives near the job, has reliable transportation and uses one or more social networks, but not more than four. He or she tends not to be overly inquisitive or empathetic, but is creative. 'Some of the assumptions we had weren't valid,' says Connie Harvey, Xerox's chief operating officer of commercial services. However, data-based hiring can expose companies to legal risk. Practices that even unintentionally filter out older or minority applicants can be illegal under federal equal opportunity laws. If a hiring practice is challenged in court as discriminatory, a company must show the criteria it is using are proven to predict success in the job."
One step closer to Manna I read about here (Score:3, Interesting)
http://marshallbrain.com/manna1.htm
One massive computer controlled database that marks you hireable or not hireable.
Tell me about it (Score:5, Interesting)
I had a hell of a time landing a federal position in the department that I had been working for years as a contractor because the automated system at OPM kept kicking my resume out of the candidate pool. If you fail to get past that, then local hiring managers aren't even aware you have applied, and have no recourse. A co-worker finally gave me pointers on "faking out" the word filters, and I went from "unqualified" to "highly qualified" overnight.
Re:Reason is simple: U.S. Workers are stupid (Score:2, Interesting)
That couldn't possibly be due to years of massive overproduction of American STEM graduates, now could it.
Re:presence on social networks as a predictor (Score:4, Interesting)
Meh. I consider it a heuristic that I use to filter out the employer if they require read access to my Facebook. My Facebook is locked the fuck down; they'd find my name but not much more. If that's a problem, well, I have recruiters emailing me every day, so good luck with your search.
Re:Tell me about it (Score:5, Interesting)
I actually just recently applied for a part time state position teaching computer science to high school students online. The requirement was that you have a BS in CS and have a teaching credential. I was automatically rejected immediately, for not having a temporary credential. The requirement for a temporary credential? Having been offered a teaching position inside of the state. So, a req that has been open for almost a year remains unfilled because they can't hire someone with a computer science degree who doesn't have a teaching credential already. How many people are there that have a CS degree that want to teach high school? Probably not many. I thought it would be a great way to give back to the community (the pay is terrible), but I guess not. I can't even get past the computer, unless I lie about having a temporary credential. If I lie about having a temporary credential, then the law says that (upon discovering the lie), the state is barred from hiring me. What a messed up and useless system. They will probably never fill that position.
It's too bad, too. I was willing to give up 5-10 hours a week to help out kids who want to learn. Anyone who is already teaching probably doens't want to spend that extra time with kids.
Re:Reason is simple: U.S. Workers are stupid (Score:5, Interesting)
Enforcing everyone passes education at the detriment of our more intelligent children does us no good.
Hiring Algorithms (Score:4, Interesting)
No article on hiring algorithms is complete without mentioning the secretary problem [wikipedia.org].
In brief, how do you decide that you've interviewed enough people and select a candidate, even though that means ignoring anyone you have yet to interview?
generic testing inherently flawed (Score:2, Interesting)
All generic tests for employment, whether marked by hand or by computer, are based on statistical likelihood of success based on past performance indicators. They therefore reduce the range of abilities of workers and guarantee stagnation.
In essence, saying "this appeared to work in the past therefore it's ideal in the future" is the antithesis of progress. And you can't monitor the usefulness of different characteristics because you've already rejected all the employees who don't conform to your ideal.
Big business in the West today is all about low risk mediocrity, i.e. just enough "cost cutting" and profit to maintain a few years of healthy executive bonus. Our performance shows it. The bright, naturally, remain in academia or ensure they have a sufficiently good reputation that they bypass all these stupid tests when entering the commercial world.
Some of the better tech firms understand this: MS abandoned most of its silly puzzles and Google had progressively reduced "college quiz" style interviewing (not quite there yet, though!). When IBM was king, it applied the most costly but effective way of selecting employees: huge probationary periods. Not sure what it does now. I wonder when the average company will catch up and learn?
Re:Reason is simple: U.S. Workers are stupid (Score:3, Interesting)
The U.S. ranks 23rd among developed nations in the percentage of students with undergraduate degrees in science or engineering who are employed in related fields
Gee, do you suppose that's somehow related to lost Science and Engineering jobs due to offshoring in the past decade?
It's wretched. (Score:4, Interesting)
I was sought out specifically by a government agency because of some research work I had done and some tools I had developed - they basically had a position that was an EXACT match for my skills, just in a broader scope.
I had to submit my CV to their automated system and was rejected because there was a typo in one of the filter criteria for their automated screening system. Then when they fixed it and I resubmitted, because I was found unqualified previously I was booted out.
They reset the job listing, triple checked the criteria, had me re-format my resume and submit it from a different email address just to make sure it wouldn't reject, but then when a human HR manager looked, she noted I had been rejected previously (but not why) and rejected it again.
Bottom line, you need smart people handling your hiring, and you need to make damn sure your automated systems are helping rather than hindering getting good people in there.
What's funny is that they wound up hiring me as a consultant (costing them at least 3x as much as hiring me on staff would cost) for the work, which worked out great for me since I was able to keep my old job and do the new work telecommuting with only the occasional trip to various sites.
If you cuaght your mother stealing... (Score:5, Interesting)
I was entirely unsure of what answer they were looking for. On one hand you would think they would want employees to be that dedicated to protecting their assets. But lets be real, is ruining your family worth your part time job, over a petty theft? Bitch at them and return the item to the store, yes...
I can't imagine anyone (who is 100% sane) would. This would indicate that anyone who answers yes is either a damned liar or not mentally stable. But by saying "no" means you may be immoral (yet, honest?).... so... which was correct? I answered "no" for the sake of honesty. And did not get the job. Not sure if that is why or not, but still wonder.
Re:Reason is simple: U.S. Workers are stupid (Score:4, Interesting)
Re:I work at Evolv (Score:5, Interesting)
I can't claim to be an industrial psychologist, but I have worked with them and written much of the software that does some of the predictive analysis that was mentioned. I can claim to have a lot of experience with how these tests work.
I have to disagree with you right off the bat here: Employment screening tests are not a sham, and there are many good things about them.
- Has value, but primarily to the employer
Some of the predictive factors that show immediate value are used to best utilize an employee: whether they prefer working solo or in a group, whether money or recognition motivates them, if they are highly detail oriented, or whether or not they'll rock the boat (which could be a good thing! - like suggesting a more efficient process to replace an old, tried, and true one). This helps a manager provide a working environment that best allows an individual to excel, or to position people in groups so any perceived faults are covered with an overlap.
What also ends up being really important in these tests - to employers at least - is whether or not these people tend to lie, steal, or cheat, to abuse drugs or alchol, or may simply be reliable or not. Yes, if you crunch the numbers, you can take a good guess and produce a weighted prediction about this just from a personality profile.
When you're hiring for Walmart or Home Depot or some other vast chain with a large population of unskilled workers, weeding out the likely-to-be-bad ones shows a real financial impact, tens or hundreds of millions of dollars a year, statistically proven. Though the damages may not reach into the millions, smaller business owners are even more impacted by this.
- Must be applied properly
Some businesses, like Keller Williams Reality, do not apply their personality profiling properly. They use a Jungian based personality matrix - simplified slightly - to pigeonhole an applicant. If you do not fit the hole specified for the job, you don't get the job. They even make a big deal about how everyone applying for every position is required to do this, even if it's the next CEO (which was probably a lie, but c'mon, these folks are salepeople at heart). However, they decide in advance which single personality a given job requires, and if you don't match it exactly, you're out. So if you apply for a programmer position, and you're an extrovert, you won't get the job. If you're creative - you don't get the job. You have to correspond to THEIR sterotype.
Obviously this is wrong.
As the parent poster can probably tell you, the proper way to do it is to have your current employees take a test, sort by role, and attempt to find people who are close to the personality traits that your star individuals have in common. You'll also have to update this over time as market or work environments change.
This works because we're producing sample data, isolating trends, and using it to predict success based on commonalities. It's simple statistics. This is how we can 'catch' drug abusers and thieves before the fact: using the personality profiling tests data from criminals, we can find people who match their common traits. It may sound harsh, but the false positive outliers are exactly that - outliers. The vast majority is predictable to a reasonable degree.
Application of this information is a standard practice in risk analysis. If you're hiring for a casino dealer, and your applicant shows up as being 80-90 out of 100 match with career criminals, maybe consider a bit more carefully or do a full background check, or maybe just don't hire them - find a less risky applicant.
- Can be gamed
Most of these tests are straightforward. There's rarely any tricks or clever 'gotchas'. This isn't like a police interrogation where they're trying to trap you. They're personality profiles, and they don't have 'correct answers'.
However, if you can successfully role take, you can determine the outcome without much guile. This is hard for many people to do, grante
Re:Reason is simple: U.S. Workers are stupid (Score:5, Interesting)
I have worked in Japan, this is VERY true. During much of the work day, and especially the late afternoon/early evening was almost official goof-off time. Then everyone buckled down and got to work in the overtime hours. And if you left before 9pm you were supposed to apologize to everyone. It was weird.
Also, many Japanese Engineers are still paid hourly instead of being salaried, so it is to their advantage to work long hours. Plus, white collar workers wore "uniforms" of some sort everywhere. Often it was just the same color pants and shirt for everyone. And it was a different color for females.
And then there was always the morning "chant" meeting where everyone gathered and did the weird company chant. Of course when I asked my co-workers about any of these things I was always told "It's a Japanese thing."
Re:If you cuaght your mother stealing... (Score:4, Interesting)
I was once asked (on a formal test, the last hoop) in a job interview for a big box store whether I would turn my mother in if I caught her stealing.
I was entirely unsure of what answer they were looking for. On one hand you would think they would want employees to be that dedicated to protecting their assets. But lets be real, is ruining your family worth your part time job, over a petty theft? Bitch at them and return the item to the store, yes...
I can't imagine anyone (who is 100% sane) would. This would indicate that anyone who answers yes is either a damned liar or not mentally stable. But by saying "no" means you may be immoral (yet, honest?).... so... which was correct? I answered "no" for the sake of honesty. And did not get the job. Not sure if that is why or not, but still wonder.
If I found myself in a similar position, and wasn't completely desperate for that job, I would reply by saying "that's an interesting question, would you ?".
If the interviewer says no, I would say "neither would I, as there are better ways of dealing with the situation" and elaborate if asked to do so.
If the interviewer says yes, he would have proved himself to be a sociopath, and I wouldn't want to work there. There's a good chance that I would not be able to resist asking him whether his mother is aware of his attitude, which would blacklist me forever.
If he declines to answer but still insists that I do, I would point out that the interview is a two-way process...
There may be other ways of handling such a question with a live and moderately competent and intelligent interviewer, like pointing out that it is a complex situation and suggesting alternatives (e.g., "I will confront her, get the reason for her actions, return the item(s) and offer additional compensation to the rightful owner, and make sure said mother got needed help and counseling so this will not happen again"), or even claiming that such an event is totally impossible (e.g., "my mother would never steal, she would rather die of starvation, so the question makes no sense. It's like asking: would you hit a newborn if it tried to kill your children with a chainsaw? The question is completely absurd and so is any possible answer").
However, if the expectation is that there is a "correct" Yes/No answer that you should provide, their hiring process is messed up.