Hostname: page-component-76fb5796d-r6qrq Total loading time: 0 Render date: 2024-04-26T14:25:39.671Z Has data issue: false hasContentIssue false
  • English
  • Français

Individual Psychological Assessment: A Practice and Science in Search of Common Ground

Published online by Cambridge University Press:  07 January 2015

Rob Silzer  and
Richard Jeanneret
Rob Silzer*
Affiliation:
HR Assessment & Development, Inc. and Baruch College, City University of New York
*
E-mail: robsilzer@prodigy.net, Address: HR Assessment and Development Inc., 14 West 11th St., New York, NY 10011
Get access Rights & Permissions [Opens in a new window]

Abstract

During the past 30 years, individual psychological assessment (IPA) has gained in use and in value to organizations in the management of human resources. However, even though IPA is considered a core competency for industrial–organizational (I–O) psychology, its practice is not without critics. This article is written not only to address several criticisms of IPA but also to discuss a variety of issues that must be taken into consideration if IPA is to advance as a major component of the I–O scientist–practitioner model. We rely upon a working definition of IPA in general but, when possible, focus on executive assessment in particular, given its high level of complexity and growing popularity. We discuss the effectiveness of assessment practice, including the ongoing statistical versus clinical prediction argument and the difficulties with establishing validity. Although we are confident that IPA has many strong research and practice underpinnings, we also propose some important research questions, training guidelines, and opportunities for assessing psychologists to improve their practices.

Type
Focal Article
Information
Industrial and Organizational Psychology , Volume 4 , Issue 3 , September 2011 , pp. 270 - 296
Copyright
Copyright © Society for Industrial and Organizational Psychology 2011 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

We would like to recognize the outstanding literature search contribution of Mr. Chad Parson.

References

Ægisdóttir, S., White, M., Spengler, P., Maugherman, A., Anderson, L., Cook, R., …Rush, J. (2006). The meta-analysis of clinical judgment project: Fifty-six years of accumulated research on clinical versus statistical prediction. The Counseling Psychologist, 34, 341–382.Google Scholar
Allport, F. H. (1937). Teleonomic description in the study of personality. Character and Personality, 5, 202–214. Google Scholar
Allport, G. W. (1937). Personality: A psychological interpretation. New York, NY: Holt. Google Scholar
Allport, G. W. (1961). Pattern and growth in personality. New York, NY: Holt, Rinehart and Winston. Google Scholar
Ambady, N., & Rosenthal, R. (1993). Half a minute: Predicting teacher evaluations from thin slices of nonverbal behavior and physical attractiveness. Journal of Personality and Social Psychology, 64, 431–441. Google Scholar
American Psychological Association. (2002). Criteria for evaluating treatment guidelines. American Psychologist, 57, 1052–1059. Google Scholar
Arkes, H. R. (1981). Impediments to accurate clinical judgment and possible ways to minimize their impact. Journal of Consulting and Clinical Psychology, 49, 323–330. Google Scholar
Arkes, H. R. (1991). Costs and benefits of judgment errors: Implications for debiasing. Psychological Bulletin, 110, 486–498. Google Scholar
Arthur, W., Day, E. A., & Woehr, D. J. (2008). Mend it, don't end it: An alternative view of assessment center construct validity evidence. Industrial and Organizational Psychology: Perspectives on Science and Practice, 1, 105–111. Google Scholar
Arthur, W. Jr, Woehr, D. J., & Maldegen, R. (2000). Convergent and discriminant validity of assessment center dimensions: An empirical re-examination of the assessment center construct-related validity paradox. Journal of Management, 26, 813–835. Google Scholar
Borman, W. C., & Motowidlo, S. J. (1993). Expanding the criterion domain to include elements of contextual performance. In Schmitt, N. & Borman, W. C. (Eds.), Personnel selection in organizations (pp. 71–98). San Francisco, CA: Jossey Bass. Google Scholar
Borman, W. C., & Motowidlo, S. J. (1997). Task performance and contextual performance: The meaning for personnel selection research. Human Performance, 10, 99–109. Google Scholar
Brodsky, S. L. (1998). Forensic evaluation and testimony. In Koocher, G. P., Norcross, J. C., & Hill, S. S. (Eds.), Psychologists' desk reference. New York, NY: Oxford University Press. Google Scholar
Campbell, J., Levy, P., Murphy, K., Schmitt, N., & Weiss, H. (2009, April). Letter to the SIOP Executive Committee. The Industrial—Organizational Psychologist, 46, 11–12. Google Scholar
Casas, J. M., Brady, S., & Ponterotto, J. G. (1983). Sexual preference biases in counseling: An information processing approach. Journal of Counseling Psychology, 30, 139–145. Google Scholar
Cattell, R. B. (1937). Measurement versus intuition in applied psychology. Character and Personality, 6, 114–131. Google Scholar
Cooper-Thomas, H., & Trayes, J. (2008). Preoccupied with predictive validity: An alternative perspective. Consulting Psychology Journal, 60, 286–292. Google Scholar
Crits-Christoph, P., Baranackie, K., Kurcias, J. S., Beck, A. T., Carroll, K., Pery, K., Zitrin, C. (1991). Meta-analysis of therapist effects in psychotherapy outcome studies. Psychotherapy Research, 2, 81–91. Google Scholar
Cummings, A. L., Hallberg, E. T., Martin, J., Slemon, A., & Hiebert, B. (1990). Implications of counselor conceptualizations for counselor education. Counselor Education and Supervision, 30, 120–134. Google Scholar
Dalal, R. S., Bonaccio, S., Highhouse, S., Ilgen, D. R., Mohammed, S., & Slaughter, J. E. (2010). What if industrial–organizational psychology decided to take workplace decisions seriously? Industrial and Organizational Psychology: Perspectives on Science and Practice, 3, 385–405.Google Scholar
Davis, S. L. (1998). Assessment as organizational strategy. In Jeanneret, P. R. & Silzer, R. F., (Eds.), Individual psychological assessment: Predicting behavior in organizational setting (pp. 363–390). San Francisco, CA: Jossey-Bass. Google Scholar
Dawes, R. (1979). The robust beauty of improper linear models in decision making. American Psychologist, 34, 571–582. Google Scholar
Dawes, R. M. (1994). House of cards: Psychology and psychotherapy built on myth. New York, NY: Free Press. Google Scholar
Dawes, R., Faust, D., & Meehl, P. (1989). Clinical versus actuarial judgment. Science, 243, 1668–1674. Google Scholar
Day, D. (2009). Executive selection is a process not a decision. Industrial and Organizational Psychology: Perspectives on Science and Practice, 2, 159–162.Google Scholar
Dougherty, T. W., Ebert, R. J., & Callender, J. C. (1986). Policy capturing in the employment interview. Journal of Applied Psychology, 71, 9–15. Google Scholar
Dreher, G. F., Ash, R. A., & Hancock, P. (1988). The role of traditional research designs in underestimating the validity of the employment interview. Personnel Psychology, 41, 315–327. Google Scholar
Dunnette, M. (1998). Emerging trends and vexing issues in industrial and organizational psychology. Applied Psychology: An International Review, 47, 129–153. Google Scholar
Einhorn, H. (1986). Accepting error to make less error. Journal of Personality Assessment, 50, 387–395. Google Scholar
Einhorn, H. J., & Hogarth, R. M. (1978). Confidence in judgment: Persistence of the illusion of validity. Psychological Review, 85, 395–416. Google Scholar
Einhorn, H. J., & Hogarth, R. M. (1981). Behavioral decision theory: Processes of judgment and choice. Annual Review of Psychology, 32, 53–88. Google Scholar
Ericsson, K. A., & Lehmann, A. C. (1996). Expert and exceptional performance: Evidence of maximal adaptation to task constraints. Annual Review of Psychology, 47, 273–305. Google Scholar
Falvey, J. E., & Hebert, D. J. (1992). Psychometric study of clinical treatment planning simulation (CTPS) for assessing clinical judgment. Journal of Mental Health Counseling, 14, 490–507. Google Scholar
Faust, D. (1986). Research on human judgment and its application to clinical practice. Professional Psychology, Research, and Practice, 17, 420–430. Google Scholar
Faust, D. (1991). What if we had really listened? Present reflections on altered pasts. In Cicchetti, D. & Grove, W. M. (Eds.), Thinking clearly about psychology: Vol. I. Matters of public interest (pp. 185–217). Minneapolis, MN: University of Minnesota Press. Google Scholar
Faust, D., Guilmette, T. J., Hart, K., Arkes, H. R., Fishburne, F. J., & Davey, L. (1988). Neuropsychologists' training, experience, and judgment accuracy. Archives of Clinical Neuropsychology, 3, 145–163. Google Scholar
Fulkerson, J. R. (1998). Assessment across cultures. In Jeanneret, R. & Silzer, R. (Eds.) Individual psychological assessment: Predicting behavior in organizational settings (pp. 330–362). San Francisco, CA: Jossey-Bass. Google Scholar
Gambrill, E. (2005). Critical thinking in clinical practice: Improving the accuracy of judgments and decisions about clients (2nd ed.). New York, NY: John Wiley. Google Scholar
Ganzach, Y., Kluger, A., & Klayman, N. (2000). Making decisions from an interview: Expert measurement and mechanical combination. Personnel Psychology, 53, 1–20. Google Scholar
Garb, H. N. (1989). Clinical judgment, clinical training, and professional experience. Psychological Bulletin, 105, 387–396. Google Scholar
Garb, H. N. (1994). Toward a second generation of statistical prediction rules in psychodiagnosis and personality assessment. Computers in Human Behavior, 11, 313–324. Google Scholar
Garb, H. N. (1996). The representativeness and past-behavior heuristics in clinical judgment. Professional Psychological Research Practice, 27, 272–277. Google Scholar
Garb, H. N. (1998). Studying the clinician: Judgment research and psychological assessment. Washington, DC: American Psychological Association. Google Scholar
Garb, H. N. (2005). Clinical judgment and decision making. Annual Review of Clinical Psychology, 1, 67–89. Google Scholar
Garb, H. N., & Grove, W. M. (2005). On the merits of clinical judgment. American Psychologist, 60, 658–659. Google Scholar
Garman, A. N. (2002). Assessing candidates for leadership positions. In Lowman, R. (Ed.), Handbook of consulting psychology. New York, NY: Wiley. Google Scholar
Garner, A. M., & Smith, G. M. (1976). An experimental videotape technique for evaluating trainee approaches to clinical judging. Journal of Consulting and Clinical Psychology, 44, 945–950. Google Scholar
Gaugler, B., Rosenthal, G., Thornton, G., & Bentson, C. (1987). Meta-analysis of assessment center validity. Journal of Applied Psychology, 72, 493–511. Google Scholar
Ghiselli, E. E. (1956). Dimensional problems of criteria. Journal of Applied Psychology, 40, 1–4. Google Scholar
Goodstein, L. D., & Prien, E. P. (2006). Using individual assessments in the workplace. San Francisco, CA: Pfeiffer. Google Scholar
Graves, L. M. (1993). Sources of individual differences in interviewer effectiveness: A model and implications for future research. Journal of Organizational Behavior, 14, 349–370. Google Scholar
Graves, L. M., & Karren, R. J. (1992). Interviewer decision processes and effectiveness: A model and implications for future research. Personnel Psychology, 45, 313–340. Google Scholar
Grove, W., & Meehl, P. (1996). Comparative efficiency of informal (subjective, impressionistic) and formal (mechanical, algorithmic) prediction procedures: The clinical-statistical controversy. Psychology, Public Policy, and Law, 2, 293–323. Google Scholar
Grove, W., Zald, D., Lebow, B., Snitz, B., & Nelson, C. (2000). Clinical versus mechanical prediction: A meta-analysis. Psychological Assessment, 12, 19–30. Google Scholar
Guion, R. M. (1998). Assessment, measurement, and prediction for personnel decisions. Mahwah, NJ: Erlbaum. Google Scholar
Hanson, C. P., & Conrad, K. A. (1991). A handbook of psychological assessment in business. New York, NY: Quorum Books. Google Scholar
Hastie, R., & Dawes, R. M. (2001). Rational choice in an uncertain world (2nd ed.). Thousand Oaks, CA: Sage. Google Scholar
Highhouse, S. (2002). Assessing the candidate as a whole: A historical and critical analysis of individual psychological assessment for personnel decision making. Personnel Psychology, 55, 363–396. Google Scholar
Highhouse, S. (2008). Stubborn reliance on intuition and subjectivity in employee selection. Industrial and Organizational Psychology: Perspectives on Science and Practice, 1, 333–342. Google Scholar
Hollenbeck, G. P. (1994). CEO selection: A streetsmart review. Greensboro, NC: Center for Creative Leadership. Google Scholar
Hollenbeck, G. (2009). Executive selection: What's right… and what's wrong. Industrial and Organizational Psychology: Perspectives on Science and Practice, 2, 130–143. Google Scholar
Hollenbeck, G., McCall, M., & Silzer, R. (2006). Do competency models help or hinder leadership development: A debate. Leadership Quarterly, 17, 398–413. Google Scholar
Holloway, E. L., & Wolleat, P. L. (1980). Relationship of counselor conceptual level to clinical hypothesis formation. Journal of Counseling Psychology, 27, 539–545. Google Scholar
Holt, R. R. (1958). Clinical and statistical prediction: A reformulation and some new data. Journal of Abnormal and Social Psychology, 56, 1–12. Google Scholar
Holt, R. R. (1970). Yet another look at clinical and statistical prediction: Or, is clinical psychology worthwhile? American Psychologist, 25, 337–349. Google Scholar
Holt, R. R. (1975). Clinical and statistical measurement and prediction: How not to survey its literature. JSAS Catalog of Selected Documents in Psychology, 5(178), No. 837.Google Scholar
Holtzman, W. H. (1960). Can the computer supplant the clinician. Journal of Clinical Psychology, 16, 119–122. Google Scholar
Howard, A. (1990). The multiple facets of industrial-organizational psychology: Membership survey results. Bowling Green, OH: SIOP. Google Scholar
Hunt, W. A. (1959). An actuarial approach to clinical judgment. In Bass, B. M. & Berg, I. A. (Eds.), Objective approaches to personality study (pp 169–190). Princeton, NJ: D. Van Nostrand. Google Scholar
International Organization for Standardization. (2010). Assessment service delivery– Procedures and methods to assess people in work and organizational settings, Part 1: Requirements for service providers. ISO/TC 230 N 116, Geneva, Switzerland.Google Scholar
Jeanneret, P. R. (1998). Ethical, legal, and professional issues for individual assessment. In Jeanneret, R. & Silzer, R. (Eds.), Individual psychological assessment: Predicting behavior in organizational settings (pp. 88–131). San Francisco, CA: Jossey-Bass. Google Scholar
Jeanneret, P. R. (2009, July). Letter to the Editor. The Industrial—Organizational Psychologist, 47, 44–45. Google Scholar
Jeanneret, P. R., & Silzer, R. F. (Eds.) (1998a). Individual psychological assessment: Predicting behavior in organizational settings. San Francisco, CA: Jossey-Bass. Google Scholar
Jeanneret, P. R., & Silzer, R. F. (1998b). An overview of individual psychological assessment. In Jeanneret, P. R. & Silzer, R. F. (Eds.), Individual psychological assessment: Predicting behavior in organizational setting (pp. 3–26). San Francisco, CA: Jossey-Bass. Google Scholar
Kahneman, D. (2003). A perspective on judgment and choice: Mapping bounded rationality. American Psychologist, 58, 697–720. Google Scholar
Kahneman, D., Slovic, P., & Tversky, A. (1982). Judgment under uncertainty: Heuristics and biases. Cambridge, UK: Cambridge University Press. Google Scholar
Kaplan, M. F. (1975). Information integration in social judgment: Interaction of judge and information components. In Kaplan, M. F. & Schwartz, S. (Eds.), Human judgment and decision processes. New York, NY: Academic Press. Google Scholar
Karelaia, N., & Hogarth, R. (2008). Determinants of linear judgment: A meta-analysis of lens model studies. Psychological Bulletin, 134, 404–426. Google Scholar
Katsikopoulos, K., Machery, E., Pachur, T., & Wallin, A. (2004). The search for models of clinical judgment: Fast, frugal, and friendly in Paul Meehl's spirit. Unpublished manuscript Retrieved October 15, 2004, from http://jeannicod.ccsd.cnrs.fr/documents/disk0/00/00/05/33/ijn_00000533_00/ijn_00000533_00.pdf.Google Scholar
Kaufmann, E., & Athanasou, J. (2009). A meta-analysis of judgment achievement as defined by the lens model equation. Swiss Journal of Psychology, 68, 99–112. Google Scholar
Kivlighan, D. M. Jr., & Quigley, S. T. (1991). Dimensions used by experienced and novice group therapists to conceptualize group processes. Journal of Counseling Psychology, 38, 415–423. Google Scholar
Klimoski, R. J., & Zukin, L. B. (2003). Psychological assessment in industrial/organizational settings. In Graham, J. R. & Naglierie, J. A. (Eds.), Assessment psychology (pp. 317–343). Hoboken, NJ: Wiley. Google Scholar
Korman, A. K. (1968). The prediction of managerial performance: A review. Personnel Psychology, 21, 295–322. Google Scholar
Kristof-Brown, A. L., Zimmerman, R. D., & Johnson, E. C. (2005). Consequences of individuals' fit at work: A meta-analysis of person–job, person–organization, person–group, and person–supervisor fit. Personnel Psychology, 58, 281–342. Google Scholar
Kuncel, N. R., Klieger, D. M., Connelly, B. S., & Ones, D. S. (2008, April). Mechanical versus clinical data combination in selection and admissions decisions: A meta-analysis. In I. L. Kwaske (Chair). Individual assessment: Does the research support the practice? Symposium presented at the 23rd Annual Conference of the Society for Industrial-Organizational Psychology, San Francisco, CA.Google Scholar
Kwaske, I. L., & Morris, S. B. (2008a). Validating individual assessments: A multilevel, multistage validation of individual assessments. Unpublished paper.Google Scholar
Kwaske, I. L., & Morris, S. B. (2008b, April). Validating individual assessments: A multilevel, multistage validation of individual assessments. In I. L. Kwaske (Chair), Individual assessment: Does the research support the practice? Symposium presented at the 23rd Annual Conference of the Society for Industrial-Organizational Psychology, San Francisco, CA.Google Scholar
Lance, C. E. (2008). Why assessment centers do not work the way they are supposed to. Industrial and Organizational Psychology: Perspectives on Science and Practice, 1, 84–97. Google Scholar
Landon, T. E., & Arvey, R. D. (2007). Practical construct validation for personnel selection. In McPhail, S. M. (Ed.), Alternative validation strategies: Developing new and leveraging existing validation evidence (pp. 317–345). San Francisco, CA: Jossey-Bass. Google Scholar
Levant, R. F. (2005, July 1). Report of the 2005 presidential task force on evidence-based practice. Retrieved September 15, 2005, from www.apa.org/about/president/initiatives.html.Google Scholar
Levenberg, S. B. (1975). Professional training, psychodiagnostic skill, and kinetic family drawings. Journal of Personality Assessment, 39, 389–393. Google Scholar
Levinson, H. (1998). A clinical approach to executive selection. In Jeanneret, R. & Silzer, R. (Eds.), Individual Psychological Assessment: Predicting Behavior in Organizational Settings (pp. 228–242). San Francisco, CA: Jossey-Bass. Google Scholar
Lichtenberg, J. W. (1997). Expertise in counseling psychology: A concept in search of support. Educational Psychology Review, 9, 221–238. Google Scholar
Locke, E. A. (2009, October). Why licensing of I–O psychologists is a very bad idea. The Industrial—Organizational Psychologist, 47, 53–55. Google Scholar
Marchese, M. C. (1992). Clinical versus actuarial prediction: A review of the literature. Perceptual and Motor Skills, 75, 583–594. Google Scholar
Martin, J., Slemon, A. G., Hiebert, B., Hallberg, E. T., & Cummings, A. L. (1989). Conceptualizations of novice and experienced counselors. Journal of Counseling Psychology, 36, 395–400. Google Scholar
Mayfield, W. A., Kardash, C. M., & Kivlighan, D. M. (1999). Differences in experienced and novice counselors' knowledge structures about clients: Implications for case conceptualization. Journal of Counseling Psychology, 46, 504–514. Google Scholar
McPhail, S. M., & Jeanneret, P. R. (in press). Individual psychological assessment. In Schmitt, N. (Ed.), The Oxford handbook of personnel selection and assessment selection. New York, NY: Oxford University Press.Google Scholar
Meehl, P. E. (1954). Clinical versus statistical prediction: A theoretical analysis and a review of the evidence. Minneapolis, MN: University of Minnesota Press. Google Scholar
Meehl, P. E. (1959). Some ruminations on the validation of clinical procedures. Canadian Journal of Psychology, 13, 102–128. Google Scholar
Meier, S. T. (1999). Training the practitioner-scientist: Bridging case conceptualization, assessment, and intervention. The Counseling Psychologist, 27, 846–869. Google Scholar
Meyer, P. (1998). Communicating results with impact. In Jeanneret, P. R. & Silzer, R. F. (Eds.), Individual psychological assessment: Predicting behavior in organizational settings (pp. 243–282). San Francisco, CA: Jossey-Bass. Google Scholar
Muchinsky, P. M. (2004). When the psychometrics of test development meets organizational realities: A conceptual framework for organizational change, examples, and recommendations. Personnel Psychology, 57, 175–209. Google Scholar
Nystedt, L., & Magnusson, D. (1972). Predictive efficiency as a function of amount of information. Multivariate Behavioral Research, 7, 441–450. Google Scholar
O’Byrne, K. R., & Goodyear, R. K. (1997). Client assessment by novice and expert psychologists: A comparison of strategies. Educational Psychology Review, 9, 267–278. Google Scholar
Ones, D., & Dilchert, S. (2009). How special are executives? How special should executive selection be? Observations and recommendations. Industrial and Organizational Psychology, 2, 163–170.Google Scholar
Pfeiffer, A. M., Whelan, J. P., & Martin, J. M. (2000). Decision-making bias in psychotherapy: Effects of hypothesis source and accountability. Journal of Counseling Psychology, 47, 429–436. Google Scholar
Prien, E. P., Schippmann, J. S., & Prien, K. O. (2003). Individual assessment: As practiced in industry and consulting. Mahwah, NJ: Erlbaum. Google Scholar
Pritchard, D. A. (1980). Apologia for clinical configural decision making. American Psychologist, 35, 676–678. Google Scholar
Ridley, C. R., Li, L. C., & Hill, C. L. (1998). Multicultural assessment: Reexamination, reconceptualization, and practical application. The Counseling Psychologist, 26, 827–910. Google Scholar
Roller, R. L., & Morris, S. B. (2008a, April). Individual assessment: Meta-analysis. In I. L. Kwaske (Chair) Individual assessment: Does the research support the practice? Symposium presented at the 23rd Annual Conference of the Society for Industrial-Organizational Psychology, San Francisco, CA.Google Scholar
Roller, R. L., & Morris, S. B. (2008b). Meta-analysis of the relationship between individual assessments and job performance. Unpublished paper.Google Scholar
Rupp, D. E., Thornton, G. C. III, & Gibbons, A. M. (2008). The construct validity of the assessment center method and usefulness of dimensions as focal constructs. Industrial and Organizational Psychology: Perspectives on Science and Practice, 1, 116–120.Google Scholar
Russell, C. (2001). A longitudinal study of top-level executive performance. Journal of Applied Psychology, 86, 560–573. Google Scholar
Ryan, A. M., & Sackett, P. R. (1987). A survey of individual assessment practices by I/O psychologists. Personnel Psychology, 40, 455–488. Google Scholar
Ryan, A. M., & Sackett, P. R. (1989). Exploratory study of individual assessment practices: Interrater reliability and judgments of assessor effectiveness. Journal of Applied Psychology, 74, 568–579. Google Scholar
Ryan, A. M., & Sackett, P. R. (1992). Relationships between graduate training, professional affiliation, and individual psychological assessment practices for personnel decisions. Personnel Psychology, 45, 363–387. Google Scholar
Ryan, A. M., & Sackett, P. R. (1998). Individual assessment: The research base. In Jeanneret, R. & Silzer, R. (Eds.), Individual psychological assessment: Predicting behavior in organizational settings (pp. 54–87). San Francisco, CA: Jossey-Bass. Google Scholar
Sackett, P. R., & Arvey, R. D. (1993). Selection in small N settings. In Schmitt, N. & Borman, W. C. (Eds.), Personnel selection in organizations (pp. 418–447). San Francisco, CA: Jossey Bass. Google Scholar
Sarbin, T. R. (1944). The logic of prediction in psychology. Psychological Review, 51, 210–228. Google Scholar
Sawyer, J. (1966). Measurement and prediction, clinical and statistical. Psychological Bulletin, 66, 178–200.Google Scholar
Schmitt, N. (1978). Comparisons of subjective and objective weighting strategies in changing task situations. Occupational Behavior and Human Performance, 21, 171–188. Google Scholar
Scott, J. C., & Reynolds, D. H. (2010). Handbook of workplace assessment: Evidence-based practices for selecting and developing organizational talent. San Francisco, CA: Jossey Bass. Google Scholar
Shanteau, J. (1988). Psychological characteristics and strategies of expert decision makers. Acta Psychologica, 68, 203–215. Google Scholar
Shanteau, J. & Stewart, T. R. (1992). Why study expert decision making? Some historical perspectives and comments. Organizational Behavior and Human Decision Processes, 53, 95–106. Google Scholar
Silzer, R. F. (1984). Clinical and statistical prediction in a management assessment center. Unpublished doctoral dissertation. University of Minnesota.Google Scholar
Silzer, R. F. (1998). Shaping organizational leadership: The ripple effect of assessment. In Jeanneret, R. & Silzer, R. (Eds.), Individual psychological assessment: Predicting behavior in organizational setting (pp. 391–444). San Francisco, CA: Jossey-Bass. Google Scholar
Silzer, R. F. (Ed.). (2002a). The 21st century executive: Innovative practices for building leadership at the top. San Francisco, CA: Jossey-Bass. Google Scholar
Silzer, R. F. (2002b). Selecting leaders at the top: Exploring the complexity of executive fit. In Silzer, R. (Ed.), The 21st century executive: Innovative practices for building leadership at the top (pp. 77–113). San Francisco, CA: Jossey-Bass. Google Scholar
Silzer, R. F. (2005). Playing three dimensional chess: The complexity of executive success. Presentation at the SIOP Leading Edge Consortium: Leadership at the Top: The Selection, Globalization and Ethics of Executive Talent. St. Louis, Missouri.Google Scholar
Silzer, R. F. (2010, April). Individual psychological assessment: A paradigm shift new approaches to meet organizational and professional needs. In J. Blanton (Chair), Individual assessment: Where we are; where should we be? Symposium conducted at the 25th Annual Conference of the Society of Industrial and Organizational Psychology, Atlanta, GA.Google Scholar
Silzer, R. F., & Adler, S. (2003). Selecting managers and executives: The challenge of measuring success. In Edwards, J., Scott, J., & Raju, N. (Eds.), The human resources program evaluation handbook (pp. 130–152). Thousand Oaks, CA: Sage. Google Scholar
Silzer, R. F., & Church, A. H. (2009). The pearls and perils of identifying potential. Industrial and Organizational Psychology: Perspectives on Science and Practice, 2, 377–412. Google Scholar
Silzer, R. F., Cober, R. T., Erickson, A. R., & Robinson, G. (2008). Practitioner needs survey: Final survey report. Bowling Green, OH: Society for Industrial-Organizational Psychology. Google Scholar
Silzer, R. F., & Davis, S. (2010). Assessing the potential of individuals: The prediction of future behavior. In Scott, J. C. & Reynolds, D. H. (Eds.), Handbook of workplace assessment (pp. 495–532). San Francisco, CA: Jossey-Bass. Google Scholar
Silzer, R. F., & Dowell, B. E. (Eds.). (2010). Strategy-driven talent management: A leadership imperative. San Francisco, CA: Jossey-Bass. Google Scholar
Silzer, R. F., Erickson, A. R., & Cober, R. T. (2009). Licensing and industrial–organizational psychologists. The Industrial—Organizational Psychologist, 46, 89–99. Google Scholar
Silzer, R. F., Fulkerson, J. R., & Hollenbeck, G. (2002, April). Innovative practices for building 21st century executives. Workshop presented at the Annual Conference of the Society for Industrial and Organizational Psychology, Toronto, Ontario, Canada.Google Scholar
Silzer, R. F., & Hollenbeck, G. P. (1992, April). Executive assessment. Workshop presented at the 17th Annual Conference of the Society for Industrial Organizational Psychology, Montreal, Canada.Google Scholar
Silzer, R. F., & Jeanneret, P. R. (1998). Anticipating the future: Assessment strategies for tomorrow. In Jeanneret, R. & Silzer, R. (Eds.), Individual psychological assessment: Predicting behavior in organizational setting (pp. 445–478). San Francisco, CA: Jossey-Bass. Google Scholar
Sines, J. O. (1971). Actuarial versus clinical prediction in psychopathology. British Journal of Psychiatry, 116, 129–144. Google Scholar
Skovholt, T. M., Rønnestad, M. H., & Jennings, L. (1997). Searching for expertise in counseling, psychotherapy, and professional psychology. Educational Psychology Review, 9, 361–369. Google Scholar
Smith, K., Shanteau, J., & Johnson, P. (2004). Psychological investigations of competence in decision making. Cambridge, UK: Cambridge University Press. Google Scholar
Society for Industrial and Organizational Psychology. (1999). Guidelines for education and training at the doctoral level in industrial/organizational psychology. Bowling Green, OH: Author. Google Scholar
Spengler, P. M. (1998). Multicultural assessment and a scientist-practitioner model of psychological assessment. The Counseling Psychologist, 26, 930–938. Google Scholar
Spengler, P. M., & Strohmer, D. C. (2001, August). Empirical analyses of a scientist-practitioner model of assessment. Paper presented at the annual meeting of the American Psychological Association, San Francisco.Google Scholar
Spengler, P. M., Strohmer, D. C., Dixon, D. N., & Shivy, V. A. (1995). A scientist-practitioner model of psychological assessment: Implications for training, practice, and research. The Counseling Psychologist, 23, 506–534. Google Scholar
Spengler, P., White, M., Ægisdóttir, S., Maugherman, A., Anderson, L., Cook, R., …Rush, J. (2009). The meta-analysis of clinical judgment project: Effects of experience on judgment accuracy. The Counseling Psychologist, 37, 350–398. Google Scholar
Stratton, S. A. (1991). Judgment theory applied to data combination in individual psychological assessment. Unpublished doctoral dissertation, University of Houston.Google Scholar
Strohmer, D. C., Shivy, V. A., & Chiodo, A. L. (1990). Information processing strategies in counselor hypothesis testing: The role of selective memory and expectancy. Journal of Counseling Psychology, 37, 465–472.Google Scholar
Strohmer, D. C., & Spengler, P. M. (1993). Studying mental health counselor clinical judgment: A response to Falvey and colleagues. Journal of Mental Health Counseling, 15, 465–474. Google Scholar
Taft, R. (1955). The ability to judge people. Psychological Bulletin, 52, 1–23. Google Scholar
Thorndike, E. L. (1918). Fundamental theorems in judging men. Journal of Applied Psychology, 2, 67–76. Google Scholar
Veneziano, J. (2010, April). Accurate? Useful? Relevant? Individual assessment research with client partners. In J. Blanton (Chair), Individual assessment: Where we are; where should we be? Symposium conducted at the 25th Annual Conference of the Society for Industrial and Organizational Psychology, Atlanta, GA.Google Scholar
Wampold, B. E., Casas, J. M., & Atkinson, D. R. (1981). Ethic bias in counseling: An information processing approach. Journal of Counseling Psychology, 28, 498–503. Google Scholar
Wedding, D., & Faust, D. (1989). Clinical judgment and decision making in neuropsychology. Archives of Clinical Neuropsychology, 4, 233–265. Google Scholar
Weiss, D. J., & Shanteau, J. (2004). The vice of consensus and the virtue of consistency. In Smith, K., Shanteau, J., & Johnson, P. (Eds.), Psychological investigations of competence in decision making. Cambridge, UK: Cambridge University Press. Google Scholar
Westen, D., & Weinberger, J. (2004). When clinical description becomes statistical prediction. American Psychologist, 59, 595–613. Google Scholar
Westen, D., & Weinberger, J. (2005). Clinical judgment in science. American Psychologist, 60, 659–661. Google Scholar
Whitecotton, S., Sanders, D., & Norris, K. (1998). Improving accuracy with a combination of human intuition and mechanical decision aids. Organizational Behavior and Human Decision Processes, 76, 325–348. Google Scholar
Wiggins, J. S. (1973). Personality and prediction: Principles of personality assessment. Reading, MA: Addison-Wesley. Google Scholar
Wiggins, J. S. (1981). Clinical and statistical prediction: Where are we and where do we go from here? Clinical Psychology Review, 1, 3–18. Google Scholar
Wisch, A. F., & Mahalik, J. R. (1999). Male therapists' clinical bias: Influence of client gender roles and therapist gender role conflict. Journal of Counseling Psychology, 46, 51–60. Google Scholar
Wunder, R. S., Thomas, L. L., & Luo, Z. (2010). Administering assessments and decision-making. In Farr, J. L. & Tippins, N. T. (Eds.), Handbook of employee selection (pp. 377–398). New York, NY: Taylor & Francis Group. Google Scholar
Zedlow, P. (2009). In defense of clinical judgment, credentialed clinicians, and reflective practice. Psychotherapy Theory, Research, Practice, Training, 46, 1–10. Google Scholar
Ziskin, J. (1995). Coping with psychiatric and psychological testimony (5th ed., Vols. 1–3). Los Angeles, CA: Law and Psychology Press. Google Scholar