Performance Evaluations
Incremental steps that improve diversity in your organization can yield large gains. Diverse work groups perform better and are more committed, innovative, and loyal.
It’s time to go beyond just talking about the problem of workplace bias. Bias Interrupters is an evidence-based model that provides solutions. By taking small steps, Bias Interrupters can yield big changes.
We’ve distilled the huge literature on bias into simple steps that help you and your company perform better.
THE CHALLENGE
A study of performance evaluations in tech found that 66% of women’s performance reviews contained at least one negative personality criticism (“You come off as abrasive”) whereas only 1% of men’s reviews did.1 In our performance evaluation audit at a law firm, we found that people of color and white women were far more likely to have their personality mentioned in their evaluations (including negative personality traits). What’s optional for white men (getting along with others), appears to be necessary for white women and people of color. Case in point: 83% of Black men were praised for having a “good attitude” vs. 46% of white men, and 27% of white women were praised for being “friendly and warm” vs. 10% of white men.2
Research also shows that white men tend to be judged on their potential while “prove-it-again groups” (women, people of color, individuals with disabilities,3 members of the LGBTQIA+ community,4 older employees,5 and first-generation professionals) are judged (or scrutinized) on their performance. Small biases can have large effects: According to one study, women received significantly lower “potential” ratings despite higher job performance ratings and this accounted for 30-50% of the gender promotion gap.6
THE SOLUTION
1. Use Metrics
Data and metrics help you spot problems—and assess the effectiveness of the measures you’ve taken. Businesses use metrics to help them achieve any strategic goal.
Key metrics:
Do your performance evaluations show consistently higher ratings for majority men than for women, people of color, or other relevant groups?
Do your performance evaluations show consistently higher ratings for in-person workers than remote and hybrid workers?
Do women’s ratings fall after they have children? Do employees’ ratings fall after they take parental leave or adopt flexible work arrangements?
Do the same performance ratings result in different promotion or compensation rates for different groups?
Keep metrics by: 1) individual supervisor; 2) department; and 3) the organization as a whole.
2. Implement Bias Interrupters detailed in the drop-down menu below
· Begin with clear and specific performance criteria directly related to job requirements.
Try: “She writes maintainable code, tests her work thoroughly, offers clear and useful suggestions during code reviews, and communicates well with clients to gather requirements,” instead of: “She’s a great programmer.”
· Require evidence from the evaluation period that justifies the rating.
Try: “This year, he did a great job in helping us win X project, writing a clear client proposal that defined a tight scope and communicated our fee structure in a way that was carefully and strategically considered.” instead of: “He’s great at helping us win projects.”
· Consider performance and potential separately for each candidate.
Given the tendency for majority men to be judged on their potential while others are judged on their performance, the two criteria should be evaluated separately.
· Separate personality issues from skill sets for each candidate.
Personal style should be appraised separately from skills because a narrower range of behavior often is accepted from women and people of color. For example, women may be labeled “difficult” for doing things that are accepted in majority men.
The Center for WorkLife Law conducted an experiment with Dr. Monica Biernat at the University of Kansas examining the effects of reading our Identifying Bias in Performance Evaluations Guide. Participants completed reviews for hypothetical employees. Half of the participants were randomly assigned to a group that read the Bias Guide and listened to a brief audio recording summarizing the main messages; the other half received no further instructions.
Our findings indicate that reading the toolkit leads participants to give higher ratings, monetary bonuses, and promotion recommendations for both women and Black workers.
Before the next round of performance evaluations, have everyone on your team watch this short 2 minute video and read the Identifying Bias in Performance Evaluations Guide.
· Don’t eliminate your performance appraisal system.
Eliminating formal performance evaluation systems and replacing them with feedback-on-the-fly creates conditions for bias to flourish.
· Don’t accept global ratings without back-up.
Require evidence from the evaluation period that justifies the rating. Try: “In March, she gave X presentation in front of Y client on Z project, answered his questions effectively, and was successful in making the sale,” instead of: “She’s quick on her feet.”
In the performance evaluation experiment at a law firm (described above), we redesigned the form to focus on specific competencies that mattered to the organization and required that evaluators list 3 pieces of evidence to accompany every numerical rating. Doing so minimized the “halo-horns effect:” where white men are artificially advantaged by global ratings because they get halos (one strength is generalized into an overall high rating) whereas other groups get horns (one mistake is generalized into an overall low rating).
· Combat in-person favoritism.
With more companies transitioning to hybrid models of work, it is important to ensure that “face-time” in the office doesn’t translate to higher ratings on performance evaluations, quicker promotions, and increased compensation. Instead, when assessing employee performance, be sure to use output-based evaluation.
· Evaluations for remote/hybrid workers should be done through video conference or in-person.
To prevent any potential misunderstandings, it is important to have context such as facial expressions.
· Equip yourself and others involved in the evaluation process by keeping a copy of our Performance Evaluation Checklist nearby when writing and reviewing performance evaluations.
· Provide a bounceback.
Managers whose performance evaluations show persistent bias should receive a bounceback (i.e. someone should talk through the evidence with them).
What’s a bounceback? An example: in one organization, when a supervisor’s ratings of an underrepresented group deviate dramatically from the mean, the evaluations are returned to the supervisor with the message: either you have an undiagnosed performance problem that requires a Performance Improvement Plan (PIP), or you need to take another look at your evaluations as a group.The organization found that a few people were put on PIPs– but that over time supervisors’ ratings of underrepresented groups converged with those of majority men.The organization that used this found that all groups found performance evaluations equally fair.
In many organizations, managers meet to produce a target distribution of ratings or cross-calibrate rankings. Adding structure to these meetings can help you avoid common pitfalls.
1) Have managers read our Identifying Bias in Performance Evaluations Guide before they meet.
2) Pre-commit. Require all managers to fill out and submit their evaluations before they walk into the room. Registering responses in this way ensures that all managers feel empowered to speak up, and opinions won’t be swayed based on the evaluation of whoever speaks first.
3) Use a consistent rubric. Establishing key competency criteria will ensure that you evaluate each employee on the same job-relevant dimensions.
4) Stick to it. If the conversation strays away from the established competency criteria, steer everyone back to what is relevant. For example, if an employee’s personality is brought up, you can say “is this relevant to the rubric?”
5) Have Bias Interrupters play an active role. Have a trained Bias Interrupter in the room who can take responsibility for ensuring that the conversation sticks to the established criteria.
Some people feel more comfortable with self-promotion than others. This partly depends on how you were raised: some people were taught to be forthcoming about their accomplishments. Others grew up with the “modesty mandate”—to be self-effacing and underplay their accomplishments.
Individuals can
· Self-promote effectively by using our Writing an Effective Self Evaluation Guide, and handing it out to your reports (if you have them).
Managers and organizations can
· Level the playing field with respect to self-promotion by ensuring everyone knows they’re expected to do so and that they know how. Distribute our Writing an Effective Self-Evaluation Guide to help.
· Offer alternatives to self-promotion. Encourage or require managers to set up more formal systems for sharing successes, such as a monthly email that lists employees’ accomplishments.
Center for WorkLife Law. This work is licensed under a Creative Commons Attribution 4.0 International License.
Footnotes
- Snyder, K. (2014, August 26). The abrasiveness trap: High-achieving men and women are described differently in reviews. Fortune. Retrieved from http://fortune.com/2014/08/26/performance-review-gender-bias/
- Williams, J.C., Lewin Loyd, D., Boginsky, M., & Armas-Edwards, F. (2021). How One Company Worked to Root Out Bias from Performance Reviews. Harvard Business Review. https://hbr.org/2021/04/how-one-company-worked-to-root-out-bias-from-performance-reviews
- Ameri, M., Schur, L., Adya, M., Bentley, F. S., McKay, P., & Kruse, D. (2018). The disability employment puzzle: A field experiment on employer hiring behavior. ILR Review, 71(2), 329-364. doi: 10.1177/0019793917717474
- Pride and prejudice: Employment discrimination against openly gay men in the United States. American Journal of Sociology, 117(2), 586-626. doi: 10.1086/661653
- Cuddy, A. J. C., Norton, M. I., Fiske, S. T. (2005). This old stereotype: The pervasiveness and persistence of the elderly stereotype. Journal of Social Issues, 61(2), 265-283. doi: 10.1111/j.1540-4560.2005.00405.x
- Benson, A., Li, D., Shue, K. (2021). “Potential and the Gender Promotion Gap.” Working Paper.