Designing Training for Professionals Based on Subject Matter Experts and Cognitive Task Analysis

doi:10.1017/CBO9780511609817.009

7 - Designing Training for Professionals Based on Subject Matter Experts and Cognitive Task Analysis

Published online by Cambridge University Press: 04 August 2010

Jan Maarten Schraagen

Edited by

K. Anders Ericsson

Show author details

K. Anders Ericsson: Affiliation:
Florida State University

Book contents

Get access

Summary

Instructional design (ID) is a field of both applied research and development activities that aims at formulating, executing, and testing theoretically sound solutions for instructional problems in real-life situations. ID focuses on the analysis and design phases that usually occur before the actual development/production and implementation of training systems. As such, ID is part of the more encompassing instructional systems development or design process (ISD). In a traditional ISD approach, every ID will incorporate a task or content analysis. The purpose of the task and content analysis is to organize the content to be taught by analyzing a job to be performed (task analysis) or the content domain that represents the information to be learned (content analysis) (Tennyson & Elmore, 1997). According to Jonassen, Tessmer, and Hannum (1999, p. 3), “task analysis is probably the most important part of the ISD process, and it has been thought so for some time.”

Notwithstanding its alleged importance, Jonassen, Tessmer, and Hannum also state that task analysis is the most often misconstrued, misinterpreted, poorly executed, or simply ignored component of the ID process. This complaint has been voiced not only in the development of training systems, but also in the design of computer systems to support human work (Diaper & Stanton, 2004a, 2004b). The reasons are manifold: Task analysis requires a lot of time, effort, and expertise; it is more of an art than a science; and its usefulness is frequently doubted, which has resulted in a gulf between the outcomes of task analysis and systems design (Schraagen, 2006; Schraagen, Chipman, & Shalin, 2000).

Information

Type: Chapter
Information: Development of Professional Expertise
Toward Measurement of Expert Performance and Design of Optimal Learning Environments
, pp. 157 - 179

DOI: https://doi.org/10.1017/CBO9780511609817.009 [Opens in a new window]

Publisher: Cambridge University Press

Print publication year: 2009

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Book purchase

Temporarily unavailable

References

Acchione-Noel, S. C., Saia, F. E., Willams, L. A., & Sarli, G. G. (1990). Maintenance and Computer HAWK Intelligent Institutional Instructor Training Development Study. Final Report. Department of the Army, December 1990.

Amirault, R. J., & Branson, R. K. (2006). Educators and expertise: A brief history of theories and models. In Anders Ericsson, K., Charness, N., Feltovich, P. J., & Hoffman, R. R. (Eds.), The Cambridge handbook of expertise and expert performance (pp. 69–86). New York: Cambridge University Press.CrossRef Google Scholar

Annett, J. (2000). Theoretical and pragmatic influences on task analysis methods. In Schraagen, J. M., Chipman, S. F., & Shalin, V. L. (Eds.), Cognitive task analysis (pp. 25–37). Mahwah, NJ: Lawrence Erlbaum Associates.Google Scholar

Annett, J., & Duncan, K D. (1967). Task analysis and training design. Occupational Psychology, 41, 211–221.

Ball, L. J., Evans, J., Saint, B. T., Dennis, I., & Ormerod, T. C. (1997). Problem-solving strategies and expertise in engineering design. Thinking and Reasoning, 3, 247–270.CrossRef

Card, S. K., Moran, T. P., & Newell, A. (1983). The psychology of human-computer interaction. Hillsdale, NJ: Lawrence Erlbaum Associates.Google Scholar

Chipman, S. F., Schraagen, J. M., & Shalin, V. L. (2000). Introduction to cognitive task analysis. In Schraagen, J. M., Chipman, S. F., & Shalin, V. L. (Eds.), Cognitive task analysis (pp. 3–23). Mahwah, NJ: Lawrence Erlbaum Associates.Google Scholar

Cooke, N. J. (1994). Varieties of knowledge elicitation techniques. International Journal of Human-Computer Studies, 41, 801–849.CrossRef

Diaper, D. (2001). Task analysis for knowledge descriptions (TAKD): A requiem for a method. Behavior and Information Technology, 20, 199–212.CrossRef

Diaper, D., & Stanton, N. (Eds.). (2004a). The handbook of task analysis for human-computer interaction. Mahwah, NJ: Lawrence Erlbaum Associates.

Diaper, D., & Stanton, N. (Eds.). (2004b). Wishing on a sTAr: The future of task analysis. In Diaper, D. & Stanton, N. (Eds.), The handbook of task analysis for human-computer interaction (pp. 603–619). Mahwah, NJ: Lawrence Erlbaum Associates.

Ericsson, K. A., & Simon, H. A. (1984). Protocol analysis: Verbal reports as data. Cambridge, MA: MIT Press.Google Scholar

Feltovich, P. J., Prietula, M. J., & Ericsson, K. A. (2006). Studies of expertise from psychological perspectives. In Ericsson, K. A., Charness, N., Feltovich, P. J., & Hoffman, R. R. (Eds.), The Cambridge handbook of expertise and expert performance (pp. 41–67). New York: Cambridge University Press.CrossRef Google Scholar

Flanagan, J. C. (1954). The critical incident technique. Psychological Bulletin, 51, 327–358.CrossRef

Gardner, H. (1985). The mind's new science: A history of the cognitive revolution. New York: Basic Books.Google Scholar

Hayes-Roth, F., Waterman, D. A., & Lenat, D. B. (Eds.). (1983). Building expert systems. Reading, MA: Addison-Wesley.

Hoffman, R. R. (1987). The problem of extracting the knowledge of experts from the perspective of experimental psychology. AI Magazine, 8, 53–67.

Hoffman, R. R. (2002, September). An empirical comparison of methods for eliciting and modeling expert knowledge. In Proceedings of the 46th Meeting of the Human Factors and Ergonomics Society (pp. 482–486). Santa Monica, CA: Human Factors and Ergonomics Society.

Hoffman, R. R., Crandall, B. W., & Shadbolt, N. R. (1998). A case study in cognitive task analysis methodology: The critical decision method for elicitation of expert knowledge. Human Factors, 40, 254–276.CrossRef

Hoffman, R. R., & Deffenbacher, K. (1992). A brief history of applied cognitive psychology. Applied Cognitive Psychology, 6, 1–48.CrossRef

Hoffman, R. R., & Lintern, G. (2006). Eliciting and representing the knowledge of experts. In Ericsson, K. A., Charness, N., Feltovich, P. J., & Hoffman, R. R. (Eds.), The Cambridge handbook of expertise and expert performance (pp. 203–222). New York: Cambridge University Press.CrossRef Google Scholar

Hoffman, R. R., & Woods, D. D. (2000). Studying cognitive systems in context: Preface to the special section. Human Factors, 42, 1–7 (Special section on cognitive task analysis).CrossRef

Hollnagel, E. (2003). Prolegomenon to cognitive task design. In Hollnagel, E. (Ed.), Handbook of cognitive task design (pp. 3–15). Mahwah, NJ: Lawrence Erlbaum Associates.CrossRef Google Scholar

Jonassen, D. H., Tessmer, M., & Hannum, W. H. (1999). Task analysis methods for instructional design. Mahwah, NJ: Lawrence Erlbaum Associates.Google Scholar

Kieras, D. (2004). GOMS models for task analysis. In Diaper, D. & Stanton, N. A. (Eds.), The handbook of task analysis for human-computer interaction (pp. 83–116). Mahwah, NJ: Lawrence Erlbaum Associates.Google Scholar

Klein, G. A., Calderwood, R., & Macgregor, D. (1989). Critical decision method for eliciting knowledge. IEEE Transactions on Systems, Man, and Cybernetics, 19, 462–472.CrossRef

Kurland, L. C., & Tenney, Y. J. (1988). Issues in developing an intelligent tutor for a real-world domain: Training in radar mechanics. In Psotka, J., Massey, L., & Mutter, S. A. (Eds.), Intelligent tutoring systems: Lessons learned (pp. 119–180). Hillsdale, NJ: Lawrence Erlbaum Associates.Google Scholar

Massey, L. Dan, Bruin, J., & Roberts, B. (1988). A training system for system maintenance. In Psotka, J., Massey, L., & Mutter, S. A. (Eds.), Intelligent tutoring systems: Lessons learned (pp. 369–402). Hillsdale, NJ: Lawrence Erlbaum Associates.Google Scholar

Mettes, C. T. C. W., Pilot, A., & Roossink, H. J. (1981). Linking factual and procedural knowledge in solving science problems: A case study in a thermodynamics course. Instructional Science, 10, 333–361.CrossRef

Morris, N. M., & Rouse, W. B. (1985). Review and evaluation of empirical research in troubleshooting. Human Factors, 27, 503–530.CrossRef

Newell, A., & Simon, H. A. (1972). Human problem solving. Englewood Cliffs, NJ: Prentice-Hall.Google Scholar

Perez, C. (2002). Technological revolutions and financial capital: The dynamics of bubbles and golden ages. Cheltenham: Edward Elgar.CrossRef Google Scholar

Ross, K. G., Shafer, J. L., & Klein, G. (2006). Professional judgments and “naturalistic decision making.” In Ericsson, K. A., Charness, N., Feltovich, P. J., & Hoffman, R. R. (Eds.), The Cambridge handbook of expertise and expert performance (pp. 403–419). New York: Cambridge University Press.CrossRef Google Scholar

Rouse, W. B. (1988). Adaptive aiding for human/computer control. Human Factors, 30, 431–443.CrossRef

Schaafstal, A. M. (1991). Diagnostic skill in process operation: A comparison between experts and novices. Unpublished doctoral dissertation, Groningen University, Netherlands.

Schaafstal, A. M., & Schraagen, J. M. C. (1991). Diagnosis in technical environments: A theoretical framework and a review of the literature (Tech. Rep. 1991 A–37). Soesterberg: TNO Institute for Perception.

Schaafstal, A., Schraagen, J. M., & Berlo, M. (2000). Cognitive task analysis and innovation of training: The case of structured troubleshooting. Human Factors, 42, 75–86.CrossRef

Schraagen, J. M. (1993). How experts solve a novel problem in experimental design. Cognitive Science, 17, 285–309.CrossRef

Schraagen, J. M. C. (2006). Task analysis. In Ericsson, K. A., Charness, N., Feltovich, P. J., & Hoffman, R. R. (Eds.), The Cambridge handbook of expertise and expert performance (pp. 185–201). New York: Cambridge University Press.CrossRef Google Scholar

Schraagen, J. M. C., Chipman, S. F., & Shalin, V. L. (Eds.). (2000). Cognitive task analysis. Mahwah, NJ: Lawrence Erlbaum Associates.

Schraagen, J. M. C., & Schaafstal, A. M. (1996). Training of systematic diagnosis: A case study in electronics troubleshooting. Le Travail Humain, 59, 5–21.

Seamster, T. L., Redding, R. E., & Kaempf, G. L. (1997). Applied cognitive task analysis in aviation. London: Ashgate.Google Scholar

Tenney, Y. J., & Kurland, L. C. (1988). The development of troubleshooting expertise in radar mechanics. In Psotka, J., Massey, L., & Mutter, S. A. (Eds.), Intelligent tutoring systems: Lessons learned (pp. 59–83). Hillsdale, NJ: Lawrence Erlbaum Associates.Google Scholar

Tennyson, R. D., & Elmore, R. L. (1997). Learning theory foundations for instructional design. In Tennyson, R. D., Schott, F., Seel, N. M., & Dijkstra, S. (Eds.), Instructional design: International perspectives (Vol. 1: Theory, research, and models) (pp. 55–78). Mahwah, NJ: Lawrence Erlbaum Associates.Google Scholar

Viteles, M. S. (1932). Industrial psychology. New York: W.W. Norton & Company.Google Scholar

Accessibility standard: Unknown

Accessibility compliance for the PDF of this book is currently unknown and may be updated in the future.