We all tend to think we are a pretty good judge of skills.. if we measured results, though, most of us would have a bleak track record. For example, how many of us are in a second marriage, have mistakenly promoted a technician to manager or over estimated a friend’s job skills?
It’s normal to make mistakes. It’s foolish not to learn from them. And, it is irresponsible for hiring professionals not to strive to get better.
Ever heard it said that impressions are made within the first 30 seconds of meeting? Our brains come pre-programmed to evaluate others based on a quick “snapshot.” This tendency to form quick opinions might be time-efficient, but it is often highly inaccurate.
The following chart illustrates some of the most common selection methods and their average “predictability”. The numbers were gathered from hundreds of controlled studies.
Behind the Numbers
The next seven selection methods are slightly more predictive. As you can see self-assessment, projective tests, and traditional interviews are all self-presentations of how a person would like to be seen. These methods are easy to fake and provide little job-skill data. Grade point averages tend to predict grade point averages – useful for admission to grad school, but not for job performance. Expert recommendations, personality tests, motivation tests provide about the same percentage of usable data. They still aren’t great. Their low predictability either comes from “halo” or not understanding how personality affects performance.
The next four methods (reference checks, bio-data, situational interviews, and behavioral event interviews) are more accurate – not great, but several times better than the first 10 methods. If you look closely, these methods require more rigor, some training, are more focused on the elements of the job. This makes them more accurate and harder to fake. Still, as good as they seem, they leave about 90% to chance.
The last two methods are among the most powerful performance predictors. Unfortunately, if you look at mental alertness tests through a demographic filter, you will see a long history of adverse impact. Is this a problem? Not if you have done your homework. The government does not require you to hire unqualified people, but it does require you to show that intelligence test scores are correlated with acceptable job performance. That is good for both applicants and the organization.
Simulations are among the most accurate predictors. Simulations are widely used to qualify and train aircraft pilots, tank crews, ship crews, transport navigators, military specialists, sales people, managers, customer service reps, and a host of other occupations. Simulations are particularly good when specialized skills are needed for high job performance.