Skip to main content Accessibility help

We use cookies to distinguish you from other users and to provide you with a better experience on our websites. Close this message to accept cookies or find out how to manage your cookie settings.

Close cookie message
×
Hostname: page-component-848d4c4894-mwx4w Total loading time: 0 Render date: 2024-06-14T00:06:05.346Z Has data issue: false hasContentIssue false

11 - Eliciting and Representing the Knowledge of Experts

from Part III - Methods for Studying the Structure of Expertise

Published online by Cambridge University Press:  10 May 2018

By
Gavan Lintern ,
Brian Moon ,
Gary Klein  and
Robert R. Hoffman
Edited by
K. Anders Ericsson ,
Robert R. Hoffman ,
Aaron Kozbelt  and
A. Mark Williams
K. Anders Ericsson
Affiliation:
Florida State University
Robert R. Hoffman
Affiliation:
Florida Institute for Human and Machine Cognition
Aaron Kozbelt
Affiliation:
Brooklyn College, City University of New York
A. Mark Williams
Affiliation:
University of Utah
Get access

Summary

A summary is not available for this content so a preview has been provided. Please use the Get access link above for information on how to access this content.
Image of the first page of this content. For PDF version, please use the ‘Save PDF’ preceeding this image.'
Type
Chapter
Information
The Cambridge Handbook of Expertise and Expert Performance , pp. 165 - 191
Publisher: Cambridge University Press
Print publication year: 2018

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Beach, L. R., & Lipshitz, R. (1993). Why classical decision theory is an inappropriate standard for evaluating and aiding most human decision making. In Klein, G., Orasanu, J., Calderwood, R., & Zsambok, C. E. (eds.), Decision making in action: Models and methods (pp. 21–35). Norwood, NJ: Ablex.Google Scholar
Bennett, K. B., & Flach, J. M. (2011). Display and interface design: Subtle science, exact art. Boca Raton, FL: CRC Press.CrossRefGoogle Scholar
Bennett, K. B., & Hoffman, R. R. (2015). Principles for interaction design, Part 3: Spanning the creativity gap. IEEE Intelligent Systems, 30, 82–91.Google Scholar
Bradshaw, J. M., Hoffman, R. R., Johnson, M., & Woods, D. D. (2013). The seven deadly myths of “autonomous systems.” IEEE Intelligent Systems, 28, 54–61.Google Scholar
Cañas, A. J., Coffey, J. W., Carnot, M. J., Feltovich, P., Hoffman, R. R., Feltovich, J., & Novak, J. D. (2003). A summary of literature pertaining to the use of concept mapping techniques and technologies for education and performance support. Report to the Chief of Naval Education and Training, prepared by the Institute for Human and Machine Cognition, Pensacola, FL.Google Scholar
Challenger, R., Clegg, C. W., & Shepherd, C. (2013). Function allocation in complex systems: Reframing an old problem. Ergonomics, 56, 1051–1069.Google Scholar
Cook, R. I., Woods, D. D., Walters, M., & Christoffersen, K. (1996). The cognitive systems engineering of automated medical evacuation scheduling. In Proceedings of the Third Annual Symposium on Human Interaction with Complex Systems (pp. 202–207). Los Alamitos, CA: IEEE Computer Society Press.CrossRefGoogle Scholar
Cooke, N. J., & Durso, F. (2007). Stories of modern technology failures and cognitive engineering successes. Boca Raton, FL: CRC Press.Google Scholar
Crandall, B., & Getchell-Reiter, K. (1993). Critical decision method: A technique for eliciting concrete assessment indicators from the intuition of NICU nurses. Advances in Nursing Science, 16, 42–51.Google Scholar
Crandall, B., Klein, G., & Hoffman, R. R. (2006). Working minds: A practitioner’s guide to cognitive task analysis. Cambridge, MA: MIT Press.CrossRefGoogle Scholar
Cyterra (2015). Handheld Standoff Mine Detection System. www.cyterra.com/products/anpss14.htm.Google Scholar
Defense Science Board (2016). Summer study on autonomy final report. Washington, DC: Office of the Under Secretary for Defense, Department of Defense.Google Scholar
Dominguez, C., Strouse, R., Papautsky, L., & Moon, B. (2015). Cognitive design of an application enabling remote bases to receive unmanned helicopter resupply. Journal of Human–Robot Interaction, 4, 50–60.Google Scholar
Duncker, K. (1945). On problem solving. Psychological Monographs, 58, 1–113.Google Scholar
Ericsson, K. A., Whyte, J., & Ward, P. (2007). Expert performance in nursing: Reviewing research on expertise in nursing within the framework of the expert performance approach. Advances in Nursing Science, 30, E58–E71.CrossRefGoogle ScholarPubMed
Hambrick, D. Z., Ferreira, F., & Henderson, J. M. (2014). The 10,000 hour rule is wrong and perpetuates a cruel myth. www.slate.com/articles/health_and_science/science/192014/09/malcolm_gladwell_s_10_000_hour_rule_for_deliberate_practice_is_wrong_genes.htmlslate.com.Google Scholar
Hintze, N. R. (2008). First responder problem solving and decision making in today’s asymmetrical environment. Master’s thesis, Naval Postgraduate School Monterey, CA.Google Scholar
Hoffman, R. R., Crandall, B., & Shadbolt, N. (1998). Use of the critical decision method to elicit expert knowledge: A case study in the methodology of cognitive task analysis. Human Factors, 40, 254–276.CrossRefGoogle Scholar
Hoffman, R. R., Cullen, T. M., & Hawley, J. K. (2016). Rhetoric and reality of autonomous weapons: Getting a grip on the myths and costs of automation. Bulletin of the Atomic Scientists, 72, 247–255.CrossRefGoogle Scholar
Hoffman, R. R., Henderson, S., Moon, B., Moore, D. T., & Litman, J. A. (2011a). Reasoning difficulty in analytical activity. Theoretical Issues in Ergonomic Science, 12, 225–240.Google Scholar
Hoffman, R. R., LaDue, D. S., Mogil, H. M., Roebber, P. J., & Trafton, J. G. (2017). Minding the weather: How expert forecasters think. Cambridge, MA: MIT Press.Google Scholar
Hoffman, R. R., & Lintern, G. (2006). Eliciting and representing the knowledge of experts. In Ericsson, K. A., Charness, N., Hoffman, R. R., & Feltovich, P. J. (eds.), The Cambridge handbook of expertise and expert performance (pp. 203–222). Cambridge University Press.Google Scholar
Hoffman, R. R., & Militello, L. G. (2008). Perspectives on cognitive task analysis: Historical origins and modern communities of practice. Boca Raton, FL: CRC Press/Taylor & Francis.Google Scholar
Hoffman, R. R., Norman, D., & Vagners, J. (2009). Complex sociotechnical joint cognitive work systems IEEE Intelligent Systems, 24, 82–83.Google Scholar
Hoffman, R. R., Schraagen, J. M., van de Ven, J., & Moon, B. M. (2011b). Influencing the business model and innovations of a research organization through concept mapping. In Moon, B. M., Hoffman, R. R., Novak, J. D., and Cañas, A. J. (eds.), Applied concept mapping: Capturing, analyzing, and organizing knowledge (pp. 169–192). Boca Raton, FL: CRC Press/Taylor & Francis.Google Scholar
Hoffman, R. R., Ward, P., DiBello, L., Feltovich, P. J., Fiore, S. M., & Andrews, D. (2014). Accelerated expertise: Training for high proficiency in a complex world. Boca Raton, FL: CRC Press/Taylor & Francis.Google Scholar
Hoffman, R. R., & Yates, J. (2005). Decision (?) making (?). IEEE Intelligent Systems, 20, 22–29.Google Scholar
Hoffman, R. R., Ziebell, D., Feltovich, P., Moon, B., & Fiore, S. (2011c). Franchise experts. IEEE Intelligent Systems, 26, 72–77.Google Scholar
Hutchins, E. (1995). Cognition in the wild. Cambridge, MA: MIT Press.Google Scholar
Hutchins, S. (2007). What makes intelligence analysis difficult? A cognitive task analysis. Monterey, CA: Dudley Knox Library, Naval Postgraduate School.Google Scholar
Hutton, R. J. B., & Militello, L. G. (1996). Applied cognitive task analysis (ACTA): A practitioner’s window into skilled decision making. In Harris, D. (ed.), Engineering psychology and cognitive ergonomics: Job design and product design (Vol. 2, pp. 17–23). Aldershot: Ashgate.Google Scholar
Johnston, R. (2005). Analytic culture in the US intelligence community: An ethnographic study. Washington, DC: Center for the Study of Intelligence.Google Scholar
Jordan, B. (1989). Cosmopolitical obstetrics: Some insights from the training of traditional midwives. Social Science Medicine, 28, 925–944.Google Scholar
Kahneman, D. (2011). Thinking, fast and slow. New York: Farrar, Straus & Giroux.Google Scholar
Kahneman, D., & Klein, G. (2009). Conditions for intuitive expertise: A failure to disagree. American Psychologist, 64, 515–526.Google Scholar
Klein, G. A. (1989). Recognition-primed decisions. In Rouse, W. B. (ed.), Advances in man–machine systems research (Vol. 5, pp. 47–92). Greenwich, CT: JAI Press.Google Scholar
Klein, G. (1998). Sources of power: How people make decisions. Cambridge, MA: MIT Press.Google Scholar
Klein, G., & Borders, J. (2016). The ShadowBox approach to cognitive skills training: An empirical evaluation. Journal of Cognitive Engineering and Decision Making, 10, 268–280.Google Scholar
Klein, G. A., & Calderwood, R. (1991). Decision models: Some lessons from the field. IEEE Transactions on Systems, Man, and Cybernetics, 21, 1018–1026.Google Scholar
Klein, G. A., Calderwood, R., & MacGregor, D. (1989). Critical decision method for eliciting knowledge. IEEE Transactions on Systems, Man, and Cybernetics, 19, 462–472.CrossRefGoogle Scholar
Klein, G., Hintze, N., & Saab, D. (2013). Thinking inside the box: The ShadowBox method for cognitive skill development. In Proceedings of the 11th International Conference on Naturalistic Decision Making (NDM-11), Marseille, France. Paris: Arpege Science Publishing.Google Scholar
Klein, G., & Hoffman, R. R. (2008). Macrocognition, mental models, and cognitive task analysis methodology. In Schraagen, J. M., Militello, L. G., Ormerod, T., & Lipshitz, R. (eds.), Naturalistic decision making and macrocognition (pp. 57–80). Aldershot: Ashgate.Google Scholar
Klein, G., Militello, L. G., Dominguez, C. O., & Lintern, G. (in press). A one-day workshop for teaching cognitive systems engineering skills. In Hoffman, R. R. & Smith, P. (eds.), Cognitive systems engineering: The future for a changing world. Boca Raton, FL: Taylor & Francis.Google Scholar
Klein, G., Moon, B., & Hoffman, R. R. (2006). Making sense of sensemaking 2: A macrocognitive model. IEEE Intelligent Systems, 21, 88–92.Google Scholar
Klinger, D. W., & Klein, G. (1999). Emergency response organizations: An accident waiting to happen. Ergonomics in Design, 7, 20–25.Google Scholar
Kruger, C., & Cross, N. (2006). Solution driven versus problem driven design: Strategies and outcomes. Design Studies, 27, 527–548.Google Scholar
Kuipers, B., & Kassirer, J. P. (1987). Knowledge acquisition by analysis of verbatim protocols. In Kidd, A. L. (ed.), Knowledge acquisition for expert systems: A practical handbook (pp. 45–71). New York: Plenum Press.Google Scholar
Lave, J. (1988). Cognition in practice. Cambridge University Press.Google Scholar
Lave, J., & Wenger, E. (1991). Situated learning: Legitimate peripheral participation. Cambridge University Press.Google Scholar
Lintern, G. (2010). A comparison of the decision ladder and the recognition-primed decision model. Journal of Cognitive Engineering and Decision Making, 4, 304–327.Google Scholar
Lintern, G. (2013). Joker one: A tutorial in cognitive work analysis. Melbourne: Cognitive Systems Design. www.cognitivesystemsdesign.net.Google Scholar
Militello, L. G., Dominguez, C. O., Lintern, G., & Klein, G. (2010). The role of cognitive systems engineering in the systems engineering design process. Systems Engineering, 13, 261–273.Google Scholar
Miller, A., Moon, B., Anders, S., Walden, R., & Montella, D. (2015). Integrating computerized clinical decision support systems into electronic health records: A metasynthesis. International Journal of Medical Informatics, 84, 1009–1018.Google Scholar
Moon, B. M., & Hoffman, R. R. (2005). How might “transformational” technologies and concepts be barriers to sensemaking in intelligence analysis. In Schraagen, J. M. C. (ed.), Proceedings of the Seventh International Naturalistic Decision Making Conference (pp. 1–11). Amsterdam.Google Scholar
Moon, B. M., Hoffman, R. R., Eskridge, T., & Coffey, J. (2011b). Skills in concept mapping. In Moon, B. M., Hoffman, R. R., Novak, J. D., & Cañas, A. J. (eds.), Applied concept mapping: Capturing, analyzing, and organizing knowledge (pp. 23–46). Boca Raton, FL: CRC Press/Taylor & Francis.Google Scholar
Moon, B. M., Hoffman, R. R., Lacroix, M., Fry, E., & Miller, A. (2014). Exploring macrocognitive healthcare work: Discovering seeds for design guidelines for clinical decision support. Presentation at the 5th International Conference on Applied Human Factors and Ergonomics. Krakow, Poland.Google Scholar
Moon, B. M., Hoffman, R. R., Novak, J. D., & Cañas, A. J. (eds.) (2011a). Applied concept mapping: Capturing, analyzing, and organizing knowledge. Boca Raton, FL: CRC Press/Taylor & Francis.Google Scholar
Moon, B., Way, A., Fry, E., Miller, A., & Montella, D. (2015). Tracing a user-centered design process to validate guidelines for clinical decision support. Poster presentation at the International Symposium on Human Factors and Ergonomics in Health Care. Santa Monica, CA: Human Factors and Ergonomics Society.Google Scholar
Newell, A. (1985). Duncker on thinking: An inquiry into progress on cognition. In Koch, S. & Leary, D. E. (eds.), A century of psychology as a science (pp. 392–419). Oxford University Press.Google Scholar
Novak, J. D. (1998). Learning, creating, and using knowledge. Mahwah, NJ: Erlbaum.Google Scholar
Papautsky, E. L., Dominguez, C., Strouse, R., & Moon, B. (2015). Integration of cognitive task analysis and design thinking for autonomous helicopter displays. Journal of Cognitive Engineering and Decision Making, 9.CrossRefGoogle Scholar
Pliske, R. M., Crandall, B., & Klein, G. (2004). Competence in weather forecasting. In Smith, K., Shanteau, J., & Johnson, P. (eds.), Psychological investigations of competence in decision making (pp. 40–68). Cambridge University Press.Google Scholar
Rasmussen, J. (1986). Information processing and human–machine interaction: An approach to cognitive engineering. New York: Science Publishing.Google Scholar
Rasmussen, J., Petjersen, A. M., & Goodstein, L. P. (1994). Cognitive systems engineering. New York: John Wiley.Google Scholar
Read, G. J. M., Salmon, P. M., Lenné, M. G., & Jenkins, D. P. (2015). Designing a ticket to ride with the Cognitive Work Analysis Design Toolkit. Ergonomics, 58, 1266–1286.Google Scholar
Regan, M. A., Lintern, G., Hutchinson, R., & Turetschek, C. (2014). Use of cognitive work analysis for exploration of safety management in the operation of motorcycles and scooters. Accident Analysis and Prevention, 74, 279–289.Google Scholar
Schnittker, R., Marshall, S. D., Horberry, T., Young, K., & Lintern, G. (2016). Examination of anesthetic practitioners’ decisions for the design of a cognitive tool for airway management. In Proceedings of the 60th Human Factors and Ergonomics Society Annual Meeting (pp. 1765–1769). Santa Monica, CA: Human Factors and Ergonomics Society.Google Scholar
Staszewski, J. (2004). Models of expertise as blueprints for cognitive engineering: Applications to landmine detection. In Proceedings of the 48th Annual Meeting of the Human Factors and Ergonomics Society (pp. 458–462). Santa Monica, CA: Human Factors and Ergonomics Society.Google Scholar
Vicente, K. H. (1999). Cognitive work analysis: Towards safe, productive, and healthy computer-based work. Mahwah, NJ: Erlbaum.Google Scholar
Woods, D. D., & Roth, E. M. (1986). Models of cognitive behavior in nuclear power plant personnel. Washington, DC: U.S. Nuclear Regulatory Commission.Google Scholar
Zakay, D., & Wooler, S. (1984). Time pressure, training, and decision effectiveness. Ergonomics, 27, 273–284.Google Scholar

Save book to Kindle

To save this book to your Kindle, first ensure coreplatform@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Available formats
×

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

Available formats
×

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

Available formats
×