Skip to main content
×
×
Home

Getting Rid of Performance Ratings: Genius or Folly? A Debate

  • Seymour Adler (a1), Michael Campion (a2), Alan Colquitt (a3), Amy Grubb (a4), Kevin Murphy (a5), Rob Ollander-Krane (a6) and Elaine D. Pulakos (a7)...
Abstract

Despite years of research and practice, dissatisfaction with performance appraisal is at an all-time high. Organizations are contemplating changes to their performance management systems, the most controversial of which is whether to eliminate performance ratings. The pros and cons of retaining performance ratings were the subject of a lively, standing-room-only debate at the 2015 Society for Industrial and Organizational Psychology conference in Philadelphia (Adler, 2015). Given the high interest in this topic, this article recaps the points made by the panelists who participated in the debate. The arguments for eliminating ratings include these: (a) the disappointing interventions, (b) the disagreement when multiple raters evaluate the same performance, (c) the failure to develop adequate criteria for evaluating ratings, (d) the weak relationship between the performance of ratees and the ratings they receive, (e) the conflicting purposes of performance ratings in organizations, (f) the inconsistent effects of performance feedback on subsequent performance, and (g) the weak relationship between performance rating research and practice in organizations. The arguments for retaining ratings include (a) the recognition that changing the rating process is likely to have minimal effect on the performance management process as a whole, (b) performance is always evaluated in some manner, (c) “too hard” is no excuse for industrial–organizational (I-O) psychology, (d) ratings and differentiated evaluations have many merits for improving organizations, (e) artificial tradeoffs are driving organizations to inappropriately abandon ratings, (f) the alternatives to ratings may be worse, and (g) the better questions are these: How could performance ratings be improved, and are we conducting the entire performance management process properly? The article closes with questions organizational members have found useful for driving effective performance management reform.

  • View HTML
    • Send article to Kindle

      To send this article to your Kindle, first ensure no-reply@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about sending to your Kindle. Find out more about sending to your Kindle.

      Note you can select to send to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be sent to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

      Find out more about the Kindle Personal Document Service.

      Getting Rid of Performance Ratings: Genius or Folly? A Debate
      Available formats
      ×
      Send article to Dropbox

      To send this article to your Dropbox account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Dropbox.

      Getting Rid of Performance Ratings: Genius or Folly? A Debate
      Available formats
      ×
      Send article to Google Drive

      To send this article to your Google Drive account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Google Drive.

      Getting Rid of Performance Ratings: Genius or Folly? A Debate
      Available formats
      ×
Copyright
Corresponding author
Correspondence concerning this article should be addressed to Seymour Adler, Aon Hewitt, 199 Water Street, New York, NY 10038. E-mail: seymour_adler@aon.com
References
Hide All
Adams, J. S. (1965). Inequity in social exchange. In Berkowitz, L. (Ed.), Advances in experimental social psychology (Vol. 2, pp. 267299). New York, NY: Academic Press.
Adler, S. (2015, April). Getting rid of performance ratings: Genius or folly? In S. Adler (Chair), Symposium presented at the 30th Annual Conference of the Society for Industrial and Organizational Psychology, Philadelphia, PA.
Aguinis, H. (2013). Performance management (3rd ed.). Upper Saddle River, NJ: Pearson/Prentice Hall.
Aguinis, H., Gottfredson, R. K., & Joo, H. (2013). Avoiding a “me” versus “we” dilemma: Using performance management to turn teams into a source of competitive advantage. Business Horizons, 56, 503512. Retrieved from http://mypage.iu.edu/~haguinis/pubs.html
Aguinis, H., Joo, H., & Gottfredson, R. K. (2011). Why we hate performance management—and why we should love it. Business Horizons, 54, 503507. Retrieved from http://mypage.iu.edu/~haguinis/pubs.html
Aguinis, H., & O'Boyle, E. Jr. (2014). Star performers in twenty-first century organizations. Personnel Psychology, 67, 313350.
Aguinis, H., & Pierce, C. A. (2008). Enhancing the relevance of organizational behavior by embracing performance management research. Journal of Organizational Behavior, 29, 139145.
Allen, D. J., & Griffeth, R. W. (2001). Test of a mediated performance–turnover relationship highlighting the moderating roles of visibility and reward contingency. Journal of Applied Psychology, 86, 10141021.
Antonioni, D. (1994). The effects of feedback accountability on upward appraisal ratings. Personnel Psychology, 47, 349356.
Austin, J. T., & Villanova, P. (1992). The criterion problem: 1917–1922. Journal of Applied Psychology, 77, 836874.
Balzer, W. K., & Sulsky, L. M. (1992). Halo and performance appraisal research: A critical examination. Journal of Applied Psychology, 77, 975985.
Banks, C., & Murphy, K. (1985). Toward narrowing the research–practice gap in performance appraisal. Personnel Psychology, 38, 335345.
Barankay, I. (2011). Rankings and social tournaments: Evidence from a crowd-sourcing experiment (Working paper). Philadelphia, PA: University of Pennsylvania.
Beck, J. W., Beatty, A. S., & Sackett, P. R. (2014). On the distribution of job performance: The role of measurement characteristics in observed departures from normality. Personnel Psychology, 67, 531566.
Beehr, T. A., Taber, T. D., & Walsh, J. T. (1980). Perceived mobility channels: Criteria for intraorganizational job mobility. Organizational Behavior and Human Performance, 26, 250264.
Benson, P. G., Buckley, R. M., & Hall, S. (1988). The impact of rating scale format on rater accuracy: An appraisal of the mixed standard scale. Journal of Management, 14 (3), 415423.
Bernardin, H. J., & Beatty, R. W. (1984). Performance appraisal: Assessing human behavior at work. Boston, MA: Kent.
Bernardin, H. J., & Buckley, M. R. (1981). Strategies in rater training. Academy of Management Review, 6, 205212.
Bernardin, H. J., & Pierce, E. C. (1980). Effect of rater training: Creating new response sets and decreasing accuracy. Journal of Applied Psychology, 65, 6066.
Bingham, W. V. (1939). Halo, invalid and valid. Journal of Applied Psychology, 23, 221228.
Blanes i Vidal, J., & Nossol, M. (2009). Tournaments without prizes: Evidence from personnel records. Paper presented at the CEP Labour Market Workshop, Centre for Economic Performance, London School of Economics and Political Science, London, United Kingdom.
Blume, B. D., Baldwin, T. T., & Rubin, R. S. (2009). Reactions to different types of forced distribution performance appraisal systems. Journal of Business Psychology, 24, 7791.
Bobko, P., & Colella, A. (1994). Employee reactions to performance standards: A review and research propositions. Personnel Psychology, 47, 129.
Bommer, W. H., Johnson, J. L., Rich, G. A., Podsakoff, P. M., & MacKenzie, S. B. (1995). On the interchangeability of objective and subjective measures of employee performance: A meta-analysis. Personnel Psychology, 48, 587605.
Borman, W. C. (1977). Consistency of rating accuracy and rating errors in the judgment of human performance. Organizational Behavior and Human Performance, 20, 238252.
Borman, W. C. (1979). Format and training effects on rating accuracy and rater errors. Journal of Applied Psychology, 64 (4), 410421.
Bracken, D. W., & Rose, D. S. (2011). When does 360-degree feedback create behavior change? And how would we know it when it does? Journal of Business & Psychology, 26, 183192.
Brockner, J. (1988). Self-esteem at work. New York, NY: Lexington Books.
Bryson, B., & Read, J. L. (2009). Total engagement: Using games and virtual worlds to change the way people work and businesses compete. Boston, MA: Harvard Business Press.
Buckingham, M., & Goodall, A. (2015, April). Reinventing performance management. Harvard Business Review. Retrieved from https://hbr.org/2015/04/reinventing-performance-management
Cadsby, C. B., Song, F., & Tapon, F. (2007). Sorting and incentive effects of pay for performance: An experimental investigation. Academy of Management Journal, 50, 387405.
Campbell, J. P., McCloy, R. A., Oppler, S. H., & Sager, C. E. (1993). A theory of performance. In Schmitt, N. & Borman, W. C. (Eds.), Personnel selection in organizations (pp. 3570). San Francisco, CA: Jossey-Bass.
Campion, M. A., Fink, A. A., Ruggeberg, B. J., Carr, L., Phillips, G. M., & Odman, R. B. (2011). Doing competencies well: Best practices in competency modeling. Personnel Psychology, 64, 225262.
Campion, M. C., Campion, E. D., & Campion, M. A. (2015). Improvements in performance management through the use of 360 feedback. Industrial and Organizational Psychology: Perspectives on Science and Practice, 8, 8593.
Carver, C., Sutton, S., & Scheier, M. (2000). Action, emotion, and personality: Emerging conceptual integration. Personality and Social Psychology Bulletin, 26, 741751.
Casas-Arce, P., & Martinez-Jerez, F. A. (2009). Relative performance compensation, contests, and dynamic incentives. Management Science, 55, 13061320.
Catano, V. M., Darr, W., & Campbell, C. A. (2007). Performance appraisal of behavior-based competencies: A reliable and valid procedure. Personnel Psychology, 60, 201230.
Cawley, B. D., Keeping, L. M., & Levy, P. E. (1998). Participation in the performance appraisal process and employee reactions: A meta-analytic review of field investigations. Journal of Applied Psychology, 83 (4), 615633.
Chamorro-Premuzic, T. (2011). Personality and individual differences. London, UK: Blackwell.
Chattopadhayay, R., & Ghosh, A. K. (2012). Performance appraisal based on a forced distribution system: Its drawbacks and remedies. International Journal of Productivity, 61 (8), 881896.
Church, A. H. (1995). From both sides now performance appraisals: Political tools or effective measures? Industrial and Organizational Psychologist, 33, 5765.
Cleveland, J. N., & Murphy, K. R. (1992). Analyzing performance appraisal as goal-directed behavior. In Ferris, G. & Rowland, K. (Eds.), Research in personnel and human resources management (Vol. 10, pp. 121185). Greenwich, CT: JAI Press.
Cleveland, J. N., Murphy, K. R., & Lim, A. (2007). Feedback phobia? Why employees do not want to give or receive it. In Langan-Fox, J., Cooper, C., & Klimoski, R. (Eds.), Research companion to the dysfunctional workplace: Management challenges and symptoms (pp. 168186). Cheltenham, UK: Edward Elgar.
Cleveland, J. N., Murphy, K. R., & Williams, R. (1989). Multiple uses of performance appraisal: Prevalence and correlates. Journal of Applied Psychology, 74, 130135.
Connelly, B. L., Tihanyi, L., Crook, T. R., & Gangloff, K. A. (2014). Tournament theory: Thirty years of contests and competitions. Journal of Management, 40, 1647.
Cooper, W. H. (1981a). Conceptual similarity as a source of illusory halo in job performance ratings. Journal of Applied Psychology, 66, 302307.
Cooper, W. H. (1981b). Ubiquitous halo. Psychology Bulletin, 90, 218244.
Corporate Leadership Council. (2012). Driving breakthrough performance in the new work environment. (Catalog No. CLC4570512SYN). Washington, DC: CEB.
Corporate Leadership Council. (2014). The millennial myth: Three strategies for effectively managing millennials in the workforce. Washington, DC: CEB.
Culbert, S. A., & Rout, L. (2010). Get rid of the performance review: How companies can stop intimidating, start managing—and focus on what really matters. New York, NY: Business Plus.
Culbertson, S. S., Henning, J. B., & Payne, S. C. (2013). Performance appraisal satisfaction: The role of feedback and goal orientation. Journal of Personnel Psychology, 12, 189195.
Cunningham, L. (2014). In big move, Accenture will get rid of annual performance reviews and ranking. The Washington Post. Retrieved from http://www.washingtonpost.com/blogs/on-leadership/wp/2015/07/21/in-big-move-accenture-will-get-rid-of-annual-performance-reviews-and-rankings/?tid=pm_pop_b
Curtis, A. B., Harvey, R. D., & Ravden, D. (2005). Sources of political distortions in performance appraisals: Appraisal purpose and rater accountability. Group & Organization Management, 30 (1), 4260.
Day, D. V., & Sulsky, L. M. (1995). Effects of frame-of-reference training and information configuration on memory organization and rating accuracy. Journal of Applied Psychology, 80, 158167.
DeCotiis, T., & Petit, A. (1978). The performance appraisal process: A model and some testable propositions. Academy of Management Review, 3, 635646.
DeNisi, A. S. (2006). A cognitive approach to performance appraisal. New York, NY: Routledge.
DeNisi, A. S., Cafferty, T., & Meglino, B. (1984). A cognitive view of the performance appraisal process: A model and research propositions. Organizational Behavior and Human Performance, 33, 360396.
DeNisi, A. S., & Pritchard, R. D. (2006). Performance appraisal, performance management, and improving individual performance: A motivational framework. Management and Organization Review, 2 (2), 253277.
DeNisi, A., & Smith, C. E. (2014). Performance appraisal, performance management, and firm-level performance. Academy of Management Annals, 8, 127179.
De Pater, I. E., Van Vianen, A. E., Bechtoldt, M. N., & Klehe, U. C. (2009). Employees’ challenging job experiences and supervisors’ evaluations of promotability. Personnel Psychology, 62 (2), 297325.
DeVaro, J. (2006). Strategic promotion tournaments and worker performance. Strategic Management Journal, 27, 721740.
Dipboye, R. L., & Pontbriand, R. (1981). Correlates of employee reactions to performance appraisals and appraisal systems. Journal of Applied Psychology, 66 (2), 248251.
Dorfman, P. W., Stephan, W. G., & Loveland, J. (1986). Performance appraisal behaviors: Supervisor perceptions and subordinate reactions. Personnel Psychology, 39, 579597.
Dweck, C. (2006). Mindset. New York, NY: Random House.
Efron, M., & Ort, M. (2010). One-page talent management. Cambridge, MA: Harvard Business Press.
Facteau, J. D., & Craig, S. B. (2001). Are performance appraisal ratings from different rating sources comparable? Journal of Applied Psychology, 86, 215227.
Fay, C. H., & Latham, G. P. (1982). Effects of training and rating scales on rating errors. Personnel Psychology, 35, 105116.
Ferris, G. R., Munyon, T. P., Basik, K., & Buckley, M. R. (2008). The performance evaluation context: Social, emotional, cognitive, political, and relationship components. Human Resource Management Review, 18, 146163.
Festinger, L. (1954). A theory of social comparison processes. Human Relations, 7, 117140.
Flint, D. H. (1999). The role of organizational justice in multi-source performance appraisal: Theory-based applications and directions for research. Human Resource Management Review, 9 (1), 120.
Giles, W. F., & Mossholder, K. W. (1990). Employee reactions to contextual and session components of performance appraisal. Journal of Applied Psychology, 75 (4), 371377.
Gilliland, S. W., & Langdon, J. C. (1998). Creating performance management systems that promote perceptions of fairness. In Smither, J. W. (Ed.), Performance appraisal: State of the art in practice (pp. 209243). San Francisco, CA: Jossey-Bass.
Goffin, R. D., Jelley, B. R., Powell, D. M., & Johnston, N. G. (2009). Taking advantage of social comparisons in performance appraisal: The relative percentile method. Human Resource Management, 48 (2), 251268.
Grey, R. J., & Kipnis, D. (1976). Untangling the performance appraisal dilemma: The influence of perceived organizational context on evaluative processes. Journal of Applied Psychology, 61, 329335.
Halim, A. H. (2011). Validation on behavioral competencies of a performance appraisal tool. Journal of Psychological Research, 6 (2), 281290.
Harris, M. M., & Schaubroeck, J. (1988). A meta-analysis of self-supervisory, self-peer, and peer-subordinate ratings. Personnel Psychology, 41, 4362.
Harrison, D. A., Virick, M., & William, S. (1996). Working without a net: Time, performance, and turnover under maximally contingent rewards. Journal of Applied Psychology, 81, 331345.
Heneman, H. G. (1974). Comparisons of self- and superior ratings of managerial performance. Journal of Applied Psychology, 59, 638642.
Ilgen, D. R., Barnes-Farrell, J. L., & McKellin, D. B. (1993). Performance appraisal process research in the 1980s: What has it contributed to appraisals in use? Organizational Behavior and Human Decision Processes, 54, 321368.
Ilgen, D. R., & Feldman, J. M. (1983). Performance appraisal: A process focus. In Cummings, L. & Staw, B. (Eds.), Research in organizational behavior (Vol. 5, pp. 141197). Greenwich, CT: JAI Press.
Ilgen, D. R., Peterson, R. B., Martin, B. A., & Boeschen, D. A. (1981). Supervisor and subordinate reactions to performance appraisal sessions. Organizational Behavior and Human Performance, 28, 311330.
Jelley, B. R., & Goffin, R. D. (2001). Can performance-feedback accuracy be improved? Effects of rater priming and rating-scale format on rating accuracy. Journal of Applied Psychology, 86 (1), 134144.
Johnson, J. W. (2001). The relative importance of task and contextual performance dimensions to supervisor judgments of overall performance. Journal of Applied Psychology, 86 (5), 984996.
Judge, T. A., & Ferris, G. R. (1993). Social context of performance evaluation decisions. Academy of Management Journal, 51, 709732.
Kluger, A. N., & DeNisi, A. S. (1996). The effects of feedback interventions on performance: A historical review, meta-analysis, and a preliminary feedback intervention theory. Psychological Bulletin, 119, 254284.
Kozlowski, S. W., Chao, G. T., & Morrison, R. F. (1998). Games raters play: Politics, strategies, and impression management in performance appraisal. In Smither, J. W. (Ed.), Performance appraisal: State of the art in practice (pp. 163208). San Francisco, CA: Jossey-Bass.
Landy, F. J., & Farr, J. L. (1980). Performance rating. Psychological Bulletin, 87, 72107.
Landy, F. J., & Farr, J. L. (1983). The measurement of work performance. New York, NY: Academic Press.
Latham, G. P., Almost, J., Mann, S., & Moore, C. (2005). New developments in performance management. Organizational Dynamics, 34 (1), 7787.
Latham, G. P., Fay, C. H., & Saari, L. M. (1979). The development of behavioral observation scales for appraising the performance of foremen. Personnel Psychology, 32, 299311.
Latham, G., & Wexley, K. (1977). Behavioral observation scales. Journal of Applied Psychology, 30, 255268.
Lawler, E. E., Benson, G. S., & McDermott, M. (2012). Performance management and reward systems. WorldatWork Journal, 21 (4), 1928.
Lazear, E. P. (1986). Salaries and piece rates. Journal of Business, 59, 405431.
London, M., & Wohlers, A. J. (1991). Agreement between subordinate and self-ratings in upward feedback. Personnel Psychology, 44, 375390.
Longenecker, C. O., Sims, H. P., & Gioia, D. A. (1987). Behind the mask: The politics of employee appraisal. Academy of Management Executive, 1, 183193.
McKay, P. F., & McDaniel, M. A. (2006). A reexamination of black-white mean differences in work performance: More data, more moderators. Journal of Applied Psychology, 91 (3), 538.
Menefee, J., & Murphy, R. (2004). Rewarding and retaining the best: Compensation strategies for top performers. Benefits Quarterly, 20, 1320.
Mercer. (2013). Global performance management survey report: Executive summary. Retrieved from http://www.mercer.com/content/dam/mercer/attachments/global/Talent/Assess-BrochurePerfMgmt.pdf
Meyer, H. H. (1980). Self-appraisal of job performance. Personnel Psychology, 33, 291295.
Meyer, H. H., Kay, E., & French, J. (1965). Split roles in performance appraisal. Harvard Business Review, 43, 123129.
Milkovich, G. T., & Wigdor, A. K. (1991). Pay for performance. Washington, DC: National Academy Press.
Murphy, K. R. (1982). Difficulties in the statistical control of halo. Journal of Applied Psychology, 67, 161164.
Murphy, K. R. (2008). Explaining the weak relationship between job performance and ratings of job performance. Industrial and Organizational Psychology: Perspectives on Science and Practice, 1, 148160.
Murphy, K. R., & Anhalt, R. L. (1992). Is halo error a property of the rater, rates, or the specific behaviors observed? Journal of Applied Psychology, 77, 494500.
Murphy, K. R., & Balzer, W. K. (1989). Rater errors and rating accuracy. Journal of Applied Psychology, 74, 619624.
Murphy, K. R., & Cleveland, J. N. (1991). Performance appraisal. An organizational perspective. Needham Heights, MA: Allyn & Bacon.
Murphy, K. R., & Cleveland, J. N. (1995). Understanding performance appraisal: Social, organizational, and goal-oriented perspectives. Newbury Park, CA: Sage.
Murphy, K. R., Cleveland, J. N., & Mohler, C. (2001). Reliability, validity, and meaningfulness of multisource ratings. In Bracken, D., Timmreck, C., & Church, A. (Eds.), Handbook of multisource feeback (pp. 130148). San Francisco, CA: Jossey-Bass.
Murphy, K. R., Cleveland, J. N., Skattebo, A. L., & Kinney, T. B. (2004). Raters who pursue different goals give different ratings. Journal of Applied Psychology, 89, 158164.
Murphy, K. R., & DeShon, R. (2000). Interrater correlations do not estimate the reliability of job performance ratings. Personnel Psychology, 53, 873900.
Murphy, K. R., Jako, R. A., & Anhalt, R. L. (1993). Nature and consequences of halo error: A critical analysis. Journal of Applied Psychology, 78, 218225.
Murphy, K. R., Martin, C., & Garcia, M. (1982). Do behavioral observation scales measure observation? Journal of Applied Psychology, 67, 562567.
Nathan, B. R., & Tippins, N. (1989). The consequences of halo “error” in performance ratings: A field study of the moderating effect of halo on test validation results. Journal of Applied Psychology, 74, 290296.
Ones, D. S., Viswesvaran, C., & Schmidt, F. L. (2008). No new terrain: Reliability and construct validity of job performance ratings. Industrial and Organizational Psychology: Perspectives on Science and Practice, 1, 174179.
Pfeffer, J. (2007). A modest proposal: How we might change the process and product of managerial research. Academy of Management Journal, 50, 13341345.
Pichler, S. (2012). The social context of performance appraisal and appraisal reactions: A meta-analysis. Human Resource Management, 51 (5), 709732.
Posthuma, R. A., & Campion, M. A. (2008). Twenty best practices for just employee performance reviews. Compensation & Benefits Review, 40 (1), 4755.
Posthuma, R. A., Campion, M. C., & Campion, M. A. (2015). A taxonomic foundation for evidence-based management research on employee performance management. Manuscript submitted for publication.
Pulakos, E. D. (1984). A comparison of rater training programs: Error training and accuracy training. Journal of Applied Psychology, 69, 581588.
Pulakos, E. D., Mueller-Hanson, R. A., Arad, S., & Moye, N. (2015). Performance management can be fixed: An on-the-job experiential learning approach for complex behavior change. Industrial and Organizational Psychology: Perspectives on Science and Practice, 8 (1), 5176.
Pulakos, E. D., & O'Leary, R. S. (2011). Why is performance management so broken? Industrial and Organizational Psychology: Perspectives on Science and Practice, 4 (2), 146164.
Pulakos, E. D., Schmitt, N., & Ostroff, C. (1986). A warning about the use of a standard deviation across dimensions within ratees to measure halo. Journal of Applied Psychology, 71, 2932.
Reilly, R. R., & McGourty, J. (1998). Performance appraisal in team settings. In Smither, J. W. (Ed.), Performance appraisal: State of the art in practice (pp. 244275). San Francisco, CA: Jossey-Bass.
Rock, D. (2008). SCARF: A brain-based model for collaborating with and influencing others. NeuroLeadership Journal, 1, 19.
Rock, D., Davis, J., & Jones, B. (2014, August). Kill your performance ratings. Strategy + Business. Retrieved from httpv://www.strategy-business.com/article/00275
Ross, L. (1977). The intuitive psychologist and his shortcomings: Distortions in the attribution process. In Berkowitz, L. (Ed.), Advances in experimental social psychology (Vol. 10, pp. 173220). New York, NY: Academic Press.
Rothstein, H. R. (1990). Interrater reliability of job performance ratings: Growth to asymptote level with increasing opportunity to observe. Journal of Applied Psychology, 75, 322327.
Schleicher, D. J., Bull, R. A., & Green, S. G. (2008). Rater reactions to forced distribution rating systems. Journal of Management, 35, 899927.
Schmidt, F. L., & Hunter, J. E. (1998). The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings. Psychological Bulletin, 124, 262274.
Scott, W. R. (1995). Institutions and organizations. Thousand Oaks, CA: Sage.
Scullen, S. E., Bergey, P. K., & Aiman-Smith, L. (2005). Forced distribution rating systems and the improvement of workforce potential: A baseline simulation. Personnel Psychology, 58, 132.
Scullen, S. E., Mount, M. K., & Judge, T. A. (2003). Understanding the latent structure of job performance ratings. Journal of Applied Psychology, 85, 956970.
Silverman, S. B., & Wexley, K. N. (1984). Reaction of employees to performance appraisal interviews as a function of their participation in rating scale development. Personnel Psychology, 37, 703710.
Smith, P. C., & Kendall, L. M. (1963). Retranslation of expectations: An approach to the construction of unambiguous anchors for rating scales. Journal of Applied Psychology, 47, 149155.
Smither, J. W., London, M., & Reilly, R. R. (2005). Does performance improve following multisource feedback? A theoretical model, meta-analysis, and review of empirical findings. Personnel Psychology, 58, 3366.
Society for Industrial and Organizational Psychology. (2003). Principles for the validation and use of personnel selection procedures. Bowling Green, OH: Author.
Stallings, W. M., & Gillmore, G. M. (1972). Estimating the interjudge reliability of the Ali-Frazier fight. Journal of Applied Psychology, 56, 435436.
Sulsky, L. M., & Balzer, W. K. (1988). Meaning and measurement of performance rating accuracy: Some methodological and theoretical concerns. Journal of Applied Psychology, 73, 497506.
Thompson, D. E., & Thompson, T. A. (1985). Task-based performance appraisal for blue-collar jobs: Evaluation of race and sex effects. Journal of Applied Psychology, 70 (4), 747753.
Trank, C. Q., Rynes, S. L., & Bretz, R. D. Jr. (2002). Attracting applicants in the war for talent: Differences in work preferences among high achievers. Journal of Business and Psychology, 16, 331345.
Trevor, C. O., Gerhart, B., & Boudreau, J. W. (1997). Voluntary turnover and job performance: Curvilinearity and the moderating influences of salary growth. Journal of Applied Psychology, 82, 4461.
Tziner, A., & Kopelman, R. E. (2002). Is there a preferred performance rating format? A non-psychometric perspective. Applied Psychology: An International Review, 51 (3), 479503.
Tziner, A., & Murphy, K. (1999). Additional evidence of attitudinal influences in performance appraisal. Journal of Business and Psychology, 13, 407419.
Tziner, A., Prince, B., & Murphy, K. (1997). PCPAQ—The questionnaire for measuring the perceived political considerations in performance appraisal: Some new evidence regarding its psychological properties. Journal of Social Behavior and Personality, 12, 189200.
Vance, R. J., Winne, P. S., & Wright, S. E. (1983). A longitudinal examination of rater and ratee effects in performance ratings. Personnel Psychology, 36, 609620.
Viswesvaran, C., Ones, D. S., & Schmidt, F. L. (1996). Comparative analysis of the reliability of job performance ratings. Journal of Applied Psychology, 81, 557574.
Werner, J. M., & Bolino, M. C. (1997). Explaining U.S. courts of appeals decisions involving performance appraisal: Accuracy, fairness, and validation. Personnel Psychology, 50, 124.
Wherry, R. J., & Bartlett, C. J. (1982). The control of bias in ratings: A theory of rating. Personnel Psychology, 35, 521555.
Williams, C. R., & Livingstone, L. P. (1994). Another look at the relationship between performance and voluntary turnover. Academy of Management Journal, 37, 269298.
Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

Industrial and Organizational Psychology
  • ISSN: 1754-9426
  • EISSN: 1754-9434
  • URL: /core/journals/industrial-and-organizational-psychology
Please enter your name
Please enter a valid email address
Who would you like to send this to? *
×

Metrics

Altmetric attention score

Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed