It’s Rating Season. Time to Play “The Game”

It’s that time of year again, time for the most important part of performance management. It’s rating season. The time for playing nice is over—for optimistic plans, feedback, coaching, and development. It’s time for cold, hard, reptilian evaluation. Ratings are the raison d'être of traditional performance management (PM). And employees aren’t just rated, they are differentiated. Organizations grade on a curve. Regardless of the similarity of employee efforts and contributions, supervisors must differentiate them, however fine the distinctions, on whatever basis is necessary.

As someone who lived through more than 30 years of these cycles inside organizations, I can say with some confidence that most employees and supervisors dread this time of year. Supervisors dread delivering bad news, and lots of employees will receive bad news. In one study we conducted, 40% of employees received a lower rating than they felt they deserved. Bad news is an inevitable consequence of “PM math.” Only a small percentage of employees can get top ratings; reward budgets are fixed. Low ratings are required in order to give those with high ratings disproportionate rewards. And since most people believe they are above average anyway, they are disappointed when they don’t get them. [1] Employees work hard all year and their rating seems almost random. They don’t feel they have control over the rating they receive, and they don’t feel the process is fair.

Most supervisors actually keep score all year. Every employee has a scorecard that is continuously updated during the year with check marks and demerits. Employees get feedback on how they are trending, and this feedback is predominantly negative. Because top ratings are rationed and because so many employees will get bad news, supervisors monitor employee performance for signs of weakness. Any sign of weakness is used to justify lower ratings. In fact, some supervisors secretly breathe a sigh of relief when they find them and can justify low ratings.

While the past several years has seen widespread calls for an end to the practice of performance ratings and evaluations, few companies actually made the move. And recently, it feels like the pendulum is swinging back the other way, with writers concluding that going ratingless didn’t work or that it was just another fad that has run its course.[2] Never mind the fact that it seems odd to call a practice a fad that very few companies actually adopted. So, while people complain about ratings and PM at this time of year, most believe there is little that can be done about it, that pain and suffering are an inevitable part of a functioning meritocracy. PM creates a “headwind” in organizations, and while it is annoying and irritating, it isn’t fatal, like a small pebble in your shoe. Organizations learn to tolerate the noise from employees and supervisors and PM is something to be endured this time of year. No PM process will please everyone right? After all, the only thing worse than ratings, PM and meritocracy are the alternatives, right? Which leaves us where we started, a painful process, with lots of rationalization and fatalism, and no suitable alternatives.

Not so fast.

Let’s step away from the pendulum and examine the arguments being made to stick with performance ratings and the status quo:

• Organizations that abandoned ratings never really did. They pushed them downstream or they went underground. This lack of transparency isn’t fair to employees, so we should bring them back into the open.

• Organizations need ratings. Decisions need to be made about employees, chief among them rewards distribution. These decisions depend on ratings and ratings provide concrete feedback to employees on how they are doing.

• Ratings are fairer than the alternatives.

• Employees want to be rated; they want to know where they stand.

• Ratings motivate employees to work hard.

“The Game”

At the heart of these arguments to maintain the status quo is the presumption of a “game” organizations play with employees. The game goes something like this: Employees work for rewards. Rewards are distributed on the basis of individual performance. Performance is measured by supervisor ratings. Employees compete with one another for ratings and rewards. The winners get top ratings and a disproportionate share of the rewards, the losers resolve to try harder next year.

The game is predicated on a set of familiar assumptions and principles from classical economics, behavioral psychology, and labor economics:

• Behavior is controlled by its consequences--rewards and punishments, extrinsic motivators. Money is the chief consequence, the chief motivator.

• People are self-interested; they maximize their returns and minimize their efforts.

• The efforts of self-interested employees need to be aligned with the goals and interests of the company. This is done through external forces like performance contracts with reward contingencies, threats, and regular monitoring and surveillance.

• Rewards motivate when they are tied to individual performance and supervisor ratings are the only way to measure performance for most jobs.

• Rewards must be differentiated to motivate employees.

• Reward budgets are fixed so the game is a zero-sum game. These budgets must be allocated efficiently and effectively; they cannot be overspent.

• Competition for limited rewards motivates employees to work hard and employees need a transparent scorecard to know how they are doing.

Given this is the game (and there is little debate about this), arguments made by proponents of ratings make sense. Of course, organizations need ratings, the primary goal of traditional PM is to differentiate rewards, which requires ratings. [3] It also makes sense then that few companies abandoned ratings and those that did struggled. And it makes sense that employees say they want ratings (how else would you distribute rewards?) and transparency (if there is a game, employees need to know the score and they need to understand the rules). It also makes sense that organizations try to improve ratings, tinkering with rating scales, training raters, and adding raters through 360-degree reviews. And finally, it makes sense that companies adopt practices like mechanical rules translating ratings into rewards, forced/guided distributions, and calibration. These practices increase the predictability of rewards distribution and mitigate the risk of overspending massive rewards budgets.

While all these arguments make sense, we are still left with the fact that the game isn’t working. The problem with our approach to fixing PM is we have accepted the game as a given. Chris Argyris called this approach “single-loop” learning. [4] When you try something, and it doesn’t work, you try something different. Organizations have tried for 70 years to improve the game with little to show for it. Companies are as unhappy with PM as they were 70 years ago when famed organizational scholar Douglas McGregor wrote “An uneasy look at performance appraisal.” [5] His original article was published in 1957 and then published again in 1972. Maybe this article should be published every 15 years until the “uneasiness” disappears.

To fix PM, we need what Argyris called “double-loop” learning. When something doesn’t work, especially after repeated attempts to fix it (and 70 years of attempts ought to be enough), you step back and examine the values, assumptions, and beliefs behind your practices. When you engage in double loop learning, you don’t just question the practices, you question the game itself.

Our practices are breaking because the principles on which the game is based are decades if not centuries old. Scientists abandoned these principles decades ago. [6] Scientific evidence supporting our practices is increasingly lacking. I won’t take space to review that evidence in detail here as I have thoroughly documented it in other places. [7] Let it suffice to say that human beings are not tape measures; they are flawed measuring instruments and the judgments (ratings) they make can be problematic, inaccurate, and inconsistent. And what organizations are asking supervisors to do is nearly impossible. [8] Performance ratings are far too inaccurate to be the basis for distributing the estimated $345B in merit pay and bonuses each year (and this is just in the US). [9]And there is ample evidence showing employees don’t really want to be rated (despite what they say), and that comparing employees’ performance with one another can be harmful to performance, especially when collaboration and innovation are important. Other elements of the game also lack widespread support in the scientific literature. Basing rewards on individual performance, differentiating rewards, and creating large inequalities in pay have not been widely supported as effective ways to increase individual motivation and improve individual performance and organizational effectiveness, and they have side-effects that are often worse than the diseases they are intended to cure.

And research shows the game has additional, deeper consequences that should concern us. The game teaches our employees to value money. Research shows people are already biased to believe most people are motivated by extrinsic motivators like money.[10] And research shows playing the game changes our employees, teaching them to be extrinsically and instrumentally focused, destroying their natural intrinsic motivation, changing their values, making them more competitive and less cooperative. [11] And playing the game creates a vicious loop, its effects make playing the game more necessary, increasing our reliance on it to motivate employees. The game and the principles behind it are self-fulfilling, shaping our practices, creating the behaviors it predicts. [12]

The New World

It is problem enough that scientific evidence no longer supports the game and that the game may be changing our employees for the worse, and these should be reasons enough to abandon it. However, the bigger problem may be the fact that the old game doesn’t fit the new world. The old game works best with simple, routine, and stable jobs where detailed performance contracts can be established, and performance can be measured quantitively. It works best in hierarchical organizations with small spans of control, clear and distinct responsibilities, and co-located employees that the organization “owns.” It works best with bountiful, stable rewards budgets and with employees who accept the game.

Unfortunately, the new world of work isn’t like this. Simple jobs are gone; they have been outsourced or automated. Jobs that remain are more complex and dynamic because organizations face environments that are more volatile, uncertain, complex, and ambiguous (VUCA). It is difficult to establish detailed performance contracts that remain relevant for more than a few weeks or months for many jobs. For many employees today, the only constant is priorities will change, the work will change, and reward budgets will get cut. Agile is the rule for today’s organizations, and the old game depends on predictability. Organizations today are flatter with larger spans of control, making it difficult for supervisors to monitor the performance of all of their employees, especially when many of them may work remotely.

Complicating this picture further is the fact that organizations today don’t own all of the talent they need. Supervisors today manage the performance of gig workers, contractors, vendors, partners and fixed-duration employees along with full-time employees. You can’t play the old game with people you don’t own. And gone are the days when individual employees worked independently, and when organizations could rely on a few exceptional employees to drive their success. The old game is tailored to individuals, but the new world calls for teamwork. Work today is increasingly being done in teams and in teams of teams. Given the complexity of the problems organizations face today, they need everyone in order to be successful, not just the top 10%. And finally, the players are different today. They want different things and they have higher expectations that aren’t satisfied by old game. [13]

The New Game

The science of organization design, motivation and high-performance points to a new game. The new game doesn’t emphasize ratings and it doesn’t make PM a slave to rewards. It puts PM to work for the business, redefining it as a management process that translates business strategy and organizational goals into real work. It provides purpose, direction and alignment for employees and facilitates progress toward organizational goals. The new game isn’t about ratings, differentiation, and rewards, it’s about performance…for individuals, teams, and organizations. The new game is based on contemporary principles and practices from psychology (cognitive, social, and positive psychology), behavioral economics, and neuroscience. There is strong scientific evidence supporting these principles and practices. I won’t take space to here to present it since I have thoroughly documented it in other places. [14]

In the new game, employees are not coerced into performing, they are unleashed. Employees work for more than a paycheck. The new game taps into more powerful motives like purpose, progress, belonging, and mastery. Employees work hard for many reasons; lots of things beyond money are “rewarding.” They work hard because their work is meaningful, it has a larger purpose that is articulated through an effective PM process. Goals and the meaning they provide are at the center of the new game. Employees work hard because their efforts make a difference for the organization and its customers. They work hard because they are a part of something bigger than themselves.

The new game puts a premium on progress and positivity, reinforcing progress, celebrating success and leveraging strengths. And the new game is a team game. Employees have a deep-seated need to belong, so the new game emphasizes team goals, cooperation, and collaboration. Employees work hard because they don’t want to let their colleagues down. And while compensation is an important part of the new game, motivation does not equal money. In the new game employees are paid fairly relative to the market, their pay grows over time, and they share in the successes of the team and organization. In the new game, when we win, I win. [15]

With the new game defined, arguments to keep ratings and traditional PM ring hollow. Organizations don’t need ratings. Rewards (and other) decisions can be made without traditional PM ratings. Compensation can be managed effectively without ratings, pay-for-performance and differentiation. Employees don’t need ratings because they aren’t playing the old game. They don’t need to know the score because compensation isn’t tied to an individual score. What employees want is to make progress in meaningful work, and this doesn’t require ratings.[16] What it does require is support from supervisors and the organization. Progress requires feedback, information, problem solving, and resources. Employees don’t need ratings; they need supportive managers and real leadership from the organization.

I’m not naïve. I realize abandoning the old game won’t be easy, even if we admit it doesn’t work. In fact, it will be terrifying, and many business leaders and HR professionals would rather not go there. But ratings aren’t better than the alternatives because the alternative is a different game, and the new game is a better alternative.

End Notes

[1]Meyer, H. H. (1980). Self-appraisal of job performance. Personnel Psychology, 33, 291-295.

[2]See for example:

Goler, L., Gale, J., & Grant, A. (2016). Let’s not kill performance evaluations yet. Harvard Business Review, November.

McKinsey Quarterly. (2018). Straight talk about employee evaluation and performance management. Podcase, October.

Bersin, J. (2018). We wasted ten years talking about performance ratings. The seven things we’ve learned. Blog Post, November 16.

[3]See for example WorldAtWork (2017). WorldAtWork research report: Performance management and rewards 2017. Survey research report. Page 4.

[4]Argyris, C. (1990). Overcoming organizational defenses: Facilitating organizational learning. Boston: Allyn and Bacon.

[5]McGregor, D. (1957). An uneasy look at performance appraisal. Harvard Business Review, May-June, 89-94.

[6]The cognitive revolution that occurred in the 1950’s effectively overthrew behaviorism (stimulus-response psychology) as a sufficient explanation of behavior. In the late 1960’s and early 1970’s, people like Richard Thaler and Daniel Kahneman beginning to document problems classical economic thinking. Their research would give birth the field of behavioral economics, which would challenge many of the principles and assumptions underlying classical economics.

For a nice account of the cognitive revolution and the history of this time period from a psychological perspective, see Miller, G. A. (2003). The cognitive revolution: A historical perspective. Trends in Cognitive Science, 7, 141-144.

For a history of behavioral economics, see: Thaler, R. (2016). Misbehaving: The Making of Behavioral Economics. New York: Norton. And you can’t go wrong with Kahneman, D. (2012). Thinking, fast and slow. New York: Farrar, Strauss and Giroux.

[7]Colquitt, A. L. (2017). Next Generation Performance Management: The Triumph of Science Over Myth and Superstition. Charlotte: Information Age Publishing.

See also articles and blog posts here: https://www.alancolquitt.com/blog-1

[8]Consider what we are asking supervisors to do when they make performance ratings. Review a year’s worth of employee effort, behavior and accomplishments. Appropriately consider other factors that should and should not affect the evaluation. Boil this all down to one number that is objective, fair, complete, accurate, and honest. Adjust the number for how this person’s accomplishments compare to his/her peers. Rate the employee using the same process, criteria, and standards other supervisors use. Expert judges (e.g. Olympics judges) have a far simpler task and spend their career learning to do it and they still have trouble getting it right. How can we expect millions of amateur supervisors, who do it once a year, to get it right?

[9]Shaw, J. D., & Mitra, A. (2017). The science of pay-for-performance: Six facts that all managers should know. WorldAtWork Journal, Q3, 19-27.

[10]Heath, C. (1999). On the social psychology of agency relationships: Lay theories of motivation overemphasize extrinsic incentives. Organizational Behavior and Human Decision Processes, 78, 25-62.

Beer, M., & Katz, N. (2003). Do incentives work? The perceptions of a world-wide sample of senior executives. Human Resource Planning, 26, 3, 30-44.

[11]For example, see the following:

Deci, E. L., Ryan, R. M., & Koestner, R. (1999). A meta-analytic review of experiments examining the effects of extrinsic rewards on intrinsic motivation. Psychological Bulletin, 125, 627-668.

Vohs, K. D. (2015). Money priming can change people’s thoughts, feelings, motivations and behaviors: An update on 10 years of experiments. Journal of Experimental Psychology, 144, 73-85.

Burks, S., Carpenter, J., & Goette, L. (2006). Performance pay and the erosion of worker cooperation: Field experimental evidence. IZA Discussion Paper # 2013.

[12]Manzoni, J. F. (2008). On the folly of hoping for A, simply because you are trying to pay for A. Studies in Managerial and Financial Accounting, 18, 19-41.

Devoe, S. E., Pfeffer, J., & Lee, B. Y. (2013). Why does money make money more important? Survey and experimental evidence. Industrial Labor Relations Review, 66, 1078-1096.

Ferraro, F., Pfeffer, J., & Sutton, R. I. (2005). Economics language and assumptions: How theories can become self-fulfilling. Academy of Management Review, 30, 8-24.

[13]There are lots of articles and reports available about the changing nature of work. Here are a few of my favorites:

Johansen, B. (2017). The New Leadership Literacies. San Francisco: Berrett-Koehler.

Boudreau, J. W., Jesuthasan, R., & Creelman, D. (2015). Lead the Work. New York: Wiley.

Boudreau, J. W., & Jesuthasan, R., (2018). Reinventing Jobs. Boston: Harvard Business Press.

Deloitte (2017). Rewriting the rules for the digital age. Human capital trends report.

Deloitte (2018). The rise of the social enterprise. Human capital trends report.

[14]Colquitt, A. L. (2017). Next Generation Performance Management: The Triumph of Science Over Myth and Superstition. Charlotte: Information Age Publishing.

[15]There are lots of ways effective to manage compensation without ratings, pay-for-performance and differentiation. I have described specific practices and the research evidence supporting them in several places:

Colquitt, A. L. (2017). Next Generation Performance Management: The Triumph of Science Over Myth and Superstition. Charlotte: Information Age Publishing.

Colquitt, A. L. (2018). Performance management: Addressing ratings and compensation. Webinar with 15Five, August 22. https://www.15five.com/alan-colquitt-performance-management-webinar/

Colquitt, A. L. (2018). Rewards: The fly in the ointment of performance management transformation. Executive Networks webinar, March 29.

[16]I want to give credit where credit is due. This idea comes from Teresa Amabile’s work. See: Amabile, T., & Kramer, S. (2009). The progress principle. Boston: Harvard Business Review press.