Skip to main content
×
×
Home

Validity in a Jiffy: How Synthetic Validation Contributes to Personnel Selection

  • Frederick L. Oswald (a1) and Leaetta M. Hough (a2)
Extract

Conclusions about the effectiveness of selection systems require gathering, evaluating, weighting, and interpreting validity data, but these conclusions are obviously challenged to the extent that this process is suspect. Local validity information within the organization may be desirable but not available, and conducting a local validity study may be practically infeasible because of limited time, resources, and small sample sizes. Specific validity studies outside the organization may also be problematic if they are based on jobs or settings of questionable relevance, small sample sizes, range-restricted incumbent samples, and unreliable or content-deficient predictor and criterion measures. It is usually an understatement to say that sifting through a pile of such studies to make educated guesses about the validity of selection measures within of a specific organizational setting could be an idiosyncratic, time-consuming, and frustrating process, resulting in little confidence in any summary conclusions.

Copyright
Corresponding author
E-mail: foswald@rice.edu, Address: Department of Psychology, Rice University, 6100 Main Street MS25, Houston, TX 77005
References
Hide All
Beaty, J. C., Cleveland, J. N., & Murphy, K. R. (2001). The relation between personality and contextual performance in “strong” versus “weak” situations. Human Performance, 14, 125148.
Converse, P. D., & Oswald, F. L. (2004). The effects of data type on job classification and its purposes. Psychology Science, 46, 99127.
De Corte, W., Lievens, F., & Sackett, P. R. (2007). Combining predictors to achieve optimal trade-offs between selection quality and adverse impact. Journal of Applied Psychology, 92, 13801393.
Editorial. (1953). The Validity Information Exchange: Announcing a new Personnel Psychology feature. Personnel Psychology, 6, 265270.
Hoffman, C. C., Holden, L. M., & Gale, K. (2000). So many jobs, so little “N”: Applying expanded validation models to support generalization of cognitive test validity. Personnel Psychology, 53, 955990.
Hoffman, C. C., & McPhail, S. M. (1998). Exploring options for supporting test use in situations precluding local validation. Personnel Psychology, 51, 9871003.
Hoffman, C. C., Rashovsky, B., & D’Egidio, E. (2006). Job component validity: Background, current research, and applications. In McPhail, S. M. (Ed.), Alternative validation strategies: Developing new and leveraging existing validity evidence (pp. 82121). San Francisco: Jossey-Bass.
Hough, L. M., & Oswald, F. L. (2005). They’re right, well…mostly right: Research evidence and an agenda to rescue personality testing from 1960s' insights. Human Performance, 18, 373387.
James, L. R., Demaree, R. G., Mulaik, S. A., & Ladd, R. T. (1992). Validity generalization in the context of situational models. Journal of Applied Psychology, 77, 314.
Jeanneret, P. R. (1992). Applications of job component/synthetic validity to construct validity. Human Performance, 5, 8196.
Johnson, J. W., Carter, G. W., Davison, H. K., & Oliver, D. (2001). A synthetic validity approach to testing differential prediction hypotheses. Journal of Applied Psychology, 86, 774780.
Johnson, J. W., Steel, P., Scherbaum, C. A., Hoffman, C. C., Jeanneret, P. R., & Foster, J. (2010). Validation is like motor oil: Synthetic is better. Industrial and Organizational Psychology: Perspectives on Science and Practice, 3, 305328.
Johnson, J. W., & Carter, G. W. (in press). Validating synthetic validation: Comparing traditional and synthetic validity coefficients. Personnel Psychology, 34, 791804.
LaPolice, C. C., Carter, G. W., & Johnson, J. W. (2008). Linking O*NET descriptors to occupational literacy requirements using job component validation. Personnel Psychology, 61, 405441.
McCloy, R. A. (1994). Predicting job performance scores without performance data. In Green, B. F., & Mavor, A. S. (Eds.), Modeling cost and performance for military enlistment: Report of a workshop (pp. 61100).
McDaniel, M. A., Rothstein, H. R., & Whetzel, D. L. (2006). Publication bias: A case study of four test vendors. Personnel Psychology, 59, 927953.
Oswald, F. L., & Hough, L. M. (2010). Personality and its assessment in organizations: Theoretical and empirical developments. In Zedeck, S. (Ed.), APA handbook of industrial and organizational psychology: Vol. 2. Selecting and developing members for the organization (pp. 153184). Washington, DC: American Psychological Association.
Pearlman, K. (1980). Job families: A review and discussion of their implications for personnel selection. Psychological Bulletin, 87, 128.
Robinson, W. S. (1950). Ecological correlations and the behavior of individuals. American Sociological Review, 15, 351357.
Sackett, P. R., Cornelius, E. T. III, & Carron, T. J. (1981). A comparison of global judgment vs. task oriented approaches to job classification. Personnel Psychology, 34, 791804.
Sackett, P. R., & Arvey, R. D. (1993). Selection in small N settings. In Schmitt, N., & Borman, W. (Eds.), Personnel selection in organizations (pp. 418447). San Francisco: Jossey-Bass.
Scherbaum, C. A. (2005). Synthetic validity: Past, present, and future. Personnel Psychology, 58, 481515.
Steel, P. D. G., Huffcutt, A. I., & Kammeyer-Mueller, J. (2006). From the work one knows the worker: A systematic review of the challenges, solutions and steps to creating synthetic validity. International Journal of Selection and Assessment, 14, 135.
Trattner, M. H. (1982). Synthetic validity and its application to the Uniform Guidelines validation requirements. Personnel Psychology, 35, 383397.
Trattner, M. H., & O’Leary, B. S. (1984). Sample sizes for specified statistical power in testing for differential validity. Journal of Applied Psychology, 65, 127134.
Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

Industrial and Organizational Psychology
  • ISSN: 1754-9426
  • EISSN: 1754-9434
  • URL: /core/journals/industrial-and-organizational-psychology
Please enter your name
Please enter a valid email address
Who would you like to send this to? *
×

Metrics

Full text views

Total number of HTML views: 0
Total number of PDF views: 47 *
Loading metrics...

Abstract views

Total abstract views: 92 *
Loading metrics...

* Views captured on Cambridge Core between September 2016 - 12th June 2018. This data will be updated every 24 hours.