Skip to main content Accessibility help

A systematic review of protocol studies on conceptual design cognition: Design as search and exploration

  • Laura Hay (a1), Alex H. B. Duffy (a1), Chris McTeague (a1), Laura M. Pidgeon (a2), Tijana Vuletic (a1) and Madeleine Grealy (a2)...


This paper reports findings from the first systematic review of protocol studies focusing specifically on conceptual design cognition, aiming to answer the following research question: What is our current understanding of the cognitive processes involved in conceptual design tasks carried out by individual designers? We reviewed 47 studies on architectural design, engineering design and product design engineering. This paper reports 24 cognitive processes investigated in a subset of 33 studies aligning with two viewpoints on the nature of designing: (V1) design as search (10 processes, 41.7%); and (V2) design as exploration (14 processes, 58.3%). Studies on search focused on solution search and problem structuring, involving: long-term memory retrieval; working memory; operators and reasoning processes. Studies on exploration investigated: co-evolutionary design; visual reasoning; cognitive actions; and unexpected discovery and situated requirements invention. Overall, considerable conceptual and terminological differences were observed among the studies. Nonetheless, a common focus on memory, semantic, associative, visual perceptual and mental imagery processes was observed to an extent. We suggest three challenges for future research to advance the field: (i) developing general models/theories; (ii) testing protocol study findings using objective methods conducive to larger samples and (iii) developing a shared ontology of cognitive processes in design.

  • View HTML
    • Send article to Kindle

      To send this article to your Kindle, first ensure is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about sending to your Kindle. Find out more about sending to your Kindle.

      Note you can select to send to either the or variations. ‘’ emails are free but can only be sent to your device when it is connected to wi-fi. ‘’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

      Find out more about the Kindle Personal Document Service.

      A systematic review of protocol studies on conceptual design cognition: Design as search and exploration
      Available formats

      Send article to Dropbox

      To send this article to your Dropbox account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Dropbox.

      A systematic review of protocol studies on conceptual design cognition: Design as search and exploration
      Available formats

      Send article to Google Drive

      To send this article to your Google Drive account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Google Drive.

      A systematic review of protocol studies on conceptual design cognition: Design as search and exploration
      Available formats


Distributed as Open Access under a CC-BY 4.0 license (

Corresponding author

Email address for correspondence:


Hide All
Abraham, A. & Bubic, A. 2015 Semantic memory as the root of imagination. Frontiers in Psychology 6, 15. doi:10.3389/fpsyg.2015.00325.
*Akin, Ö. 1979 An exploration of the design process. Design Methods and Theories: Journal of the DMG 13 (3/4), 115119.
*Akin, O. & Akin, C. 1996 Frames of reference in architectural design:analysing the hyperacclamation (a-h-a-!). Design Studies 17 (4), 341361.
*Athavankar, U. A. 1997 Mental imagery as a design tool. Cybernetics and Systems 28 (1), 2542. doi:10.1080/019697297126236.
*Athavankar, U., Bokil, P. & Guruprasad, K. 2008 Reaching out in the mind’s space. In Design Computing and Cognition ’08, pp. 321340. Springer.
*Ball, L. J., Ormerod, T. C. & Morley, N. J. 2004 Spontaneous analogising in engineering design: a comparative analysis of experts and novices. Design Studies 25 (5), 495508. doi:10.1016/j.destud.2004.05.004.
Beaty, R. E., Silvia, P. J., Nusbaum, E. C., Jauk, E. & Benedek, M. 2014 The roles of associative and executive processes in creative cognition. Memory and Cognition 42 (7), 11861197. doi:10.3758/s13421-014-0428-8.
Benedek, M., Jauk, E., Fink, A., Koschutnig, K., Reishofer, G., Ebner, F. & Neubauer, A. C. 2013 To create or to recall? Neural mechanisms underlying the generation of creative new ideas. NeuroImage 88, 125133. doi:10.1016/j.neuroimage.2013.11.021.
*Bilda, Z. & Demirkan, H. 2003 An insight on designers’ sketching activities in traditional versus digital media. Design Studies 24 (1), 2750. doi:10.1016/S0142-694X(02)00032-7.
*Bilda, Z. & Gero, J. S. 2007 The impact of working memory limitations on the design process during conceptualization. Design Studies 28 (4), 343367. doi:10.1016/j.destud.2007.02.005.
*Bilda, Z., Gero, J. S. & Purcell, T. 2006 To sketch or not to sketch? That is the question. Design Studies 27 (5), 587613. doi:10.1016/j.destud.2006.02.002.
Blizzard, J. L. & Klotz, L. E. 2012 A framework for sustainable whole systems design. Design Studies 33 (5), 456479. doi:10.1016/j.destud.2012.03.001.
Bruce, V., Green, P. R. & Georgeson, M. A. 2003 Visual Perception: Physiology, Psychology and Ecology. Psychology Press.
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J. & Munafò, M. R. 2013 Power failure: why small sample size undermines the reliability of neuroscience. Nature Reviews: Neuroscience 14 (5), 365376. doi:10.1038/nrn3475.
*Chan, C.-S. 1990 Cognitive processes in architectural problem solving. Design Studies 11 (2), 6080. doi:10.1016/0142-694X(90)90021-4.
Chan, R. C. K., Shum, D., Toulopoulou, T. & Chen, E. Y. H. 2008 Assessment of executive functions: review of instruments and identification of critical issues. Archives of Clinical Neuropsychology: The Official Journal of the National Academy of Neuropsychologists 23 (2), 201216. doi:10.1016/j.acn.2007.08.010.
*Chandrasekera, T., Vo, N. & D’Souza, N. 2013 The effect of subliminal suggestions on Sudden Moments of Inspiration (SMI) in the design process. Design Studies 34, 193215. doi:10.1016/j.destud.2012.09.002.
*Chen, X. & Zhao, J. 2006 Research on the model and application of knowledge-based industrial design. In International Technology and Innovation Conference 2006, vol. 1, pp. 258263. Institution of Engineering and Technology.
Chiu, M. L. 2003 Design moves in situated design with case-based reasoning. Design Studies 24 (1), 125. doi:10.1016/S0142-694X(02)00007-8.
Coley, F., Houseman, O. & Roy, R. 2007 An introduction to capturing and understanding the cognitive behaviour of design engineers. Journal of Engineering Design 18 (4), 311325. doi:10.1080/09544820600963412.
Cross, N. 2001 Design Cognition: Results From Protocol And Other Empirical Studies Of Design Activity (ed. Eastman, C. M., McCracken, W. M. & Newstetter, W. C.), Design Knowing and Learning: Cognition in Design Education, pp. 79103. Elsevier Science Ltd.
Danielescu, A., Dinar, M., MacLellan, C., Shah, J. J. & Langley, P. 2012 The structure of creative design: what problem maps can tell us about problem formulation and creative designers. In Volume 7: 9th International Conference on Design Education; 24th International Conference on Design Theory and Methodology, pp. 437446. ASME.
Dinar, M., Shah, J. J., Cagan, J., Leifer, L., Linsey, J., Smith, S. M. & Hernandez, N. V. 2015 Empirical studies of designer thinking: past, present, and future. Journal of Mechanical Design 137 (2), 113. doi:10.1115/1.4029025.
*Dorst, K. & Cross, N. 2001 Creativity in the design process: co-evolution of problem–solution. Design Studies 22 (2), 425437. doi:10.1016/S0142-694X(01)00009-6.
Dorst, K. & Dijkhuis, J. 1995 Comparing paradigms for describing design activity. Design Studies 16 (2), 261274. doi:10.1016/0142-694X(94)00012-3.
*Eckersley, M. 1988 The form of design processes: a protocol analysis study. Design Studies 9 (2), 8694. doi:10.1016/0142-694X(88)90034-8.
Ericsson, A. K. & Simon, H. A. 1984 Protocol analysis – Verbal reports as data. MIT.
Erkarslan, O. 2013 A systematic review of the relations between industrial design education and industry in Turkey through SWOT analysis. The Design Journal 16 (1), 74102. doi:10.2752/175630613X13512595146952.
Finke, R. A., Ward, T. B. & Smith, S. M. 1992 Creative Cognition: Theory, Research, and Applications. MIT Press.
Gero, J. S. 1990 Design prototypes: a knowledge representation schema for design. AI Magazine 11 (4), 2636. doi:10.1609/aimag.v11i4.854.
Gero, J. S. & Kannengiesser, U. 2007 A function–behavior–structure ontology of processes. AI EDAM 21 (4), 379391. doi:10.1017/S0890060407000340.
Gero, J. S. & Kannengiesser, U. 2004 The situated function–behaviour–structure framework. Design Studies 25 (4), 373391. doi:10.1016/j.destud.2003.10.010.
Gero, J. S. & Tang, H.-H. 2001 The differences between retrospective and concurrent protocols in revealing the process-oriented aspects of the design process. Design Studies 22 (3), 283295. doi:10.1016/S0142-694X(00)00030-2.
*Goel, V. 1995 Cognitive processes involved in design problem solving. In Sketches of Thought (ed. Goel, V.), pp. 95126. MIT Press.
Goel, V. 2014 Creative brains: designing in the real world. Frontiers in Human Neuroscience 8, 114. doi:10.3389/fnhum.2014.00241.
*Goldschmidt, G. 1991 The dialectics of sketching. Creativity Research Journal 4 (2), 123143. doi:10.1080/10400419109534381.
Hubka, V. 1982 Principles of Engineering Design. Butterworth & Co (Publishers) Ltd.
Jiang, H. & Yen, C.-C. 2009 Protocol analysis in design research: a review. In Rigor and Relevance in Design: IASDR 2009, Seoul, Korea October 18–22, Seoul, pp. 147156. International Association of Societies of Design Research.
Jin, Y. & Benami, O. 2010 Creative patterns and stimulation in conceptual design. AI EDAM 24 (2), 191209. doi:10.1017/S0890060410000053.
Jin, Y. & Chusilp, P. 2006 Study of mental iteration in different design situations. Design Studies 27 (1), 2555. doi:10.1016/j.destud.2005.06.003.
*Kavakli, M. & Gero, J. S. 2001 Sketching as mental imagery processing. Design Studies 22 (4), 347364. doi:10.1016/S0142-694X(01)00002-3.
*Kavakli, M. & Gero, J. S. 2002 The structure of concurrent cognitive actions: a case study on novice and expert designers. Design Studies 23 (1), 2540. doi:10.1016/S0142-694X(01)00021-7.
Khorshidi, M., Shah, J. J. & Woodward, J. 2014 Applied tests of design skills—part III: abstract reasoning. Journal of Mechanical Design 136, 101101-1–101101-11. doi:10.1115/1.4027986.
Kim, J. & Ryu, H. 2014 A design thinking rationality framework: framing and solving design problems in early concept generation. Human–Computer Interaction 29 (5–6), 516553. doi:10.1080/07370024.2014.896706.
Kim, J. E., Bouchard, C., Omhover, J. F. & Aoussat, A. 2010 Towards a model of how designers mentally categorise design information. CIRP Journal of Manufacturing Science and Technology 3 (3), 218226. doi:10.1016/j.cirpj.2010.11.004.
*Kim, M. H., Kim, Y. S., Lee, H. S. & Park, J. A. 2007 An underlying cognitive aspect of design creativity: limited commitment mode control strategy. Design Studies 28 (6), 585604. doi:10.1016/j.destud.2007.04.006.
*Lee, J., Gu, N. & Williams, A. 2014 Parametric design strategies for the generation of creative designs. International Journal of Architectural Computing 12 (3), 263282.
*Liikkanen, L. A. & Perttula, M. 2009 Exploring problem decomposition in conceptual design among novice designers. Design Studies 30 (1), 3859. doi:10.1016/j.destud.2008.07.003.
Lloyd, P., Lawson, B. & Scott, P. 1995 Can concurrent verbalization reveal design cognition? Design Studies 16 (2), 237259. doi:10.1016/0142-694X(94)00011-2.
*Lloyd, P. & Scott, P. 1994 Discovering the design problem. Design Studies 15 (2), 125140. doi:10.1016/0142-694X(94)90020-5.
Logan, B. & Smithers, T. 1993 Creativity and design as exploration. In Modeling Creativity and Knowledge-Based Creative Design (ed. Gero, J. S. & Maher, M. L.), pp. 130. Lawrence Erlbaum.
*Maher, M. L. & Kim, M. 2006 The effects of tangible user interfaces on designers’ cognitive actions. In The International Workshop on Spatial Cognition 2006, pp. 119124. Springer.
Maher, M., Poon, J. & Boulanger, S. 1996 Formalising design exploration as co-evolution: A combined gene approach. In Advances in Formal Design Methods for CAD (ed. Gero, J. S. & Sudweeks, F.), pp. 330. Chapman Hall.
*Maher, M. & Tang, H.-H. 2003 Co-evolution as a computational and cognitive model of design. Research in Engineering Design 14 (1), 4764. doi:10.1007/s00163-002-0016-y.
McNeill, T., Gero, J. S. & Warren, J. 1998 Understanding conceptual electronic design using protocol analysis. Research in Engineering Design 10 (3), 129140. doi:10.1007/BF01607155.
Mednick, S. 1962 The associative basis of the creative process. Psychological Review 69 (3), 220232.
Moher, D., Liberati, A., Tetzlaff, J. & Altman, D. G. 2009 Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Medicine 6 (7), 16. doi:10.1371/journal.pmed.1000097.
Mumford, M. D., Medeiros, K. E. & Partlow, P. J. 2012 Creative thinking: processes, strategies, and knowledge. Journal of Creative Behaviour 46 (1), 3047. doi:10.1002/jocb.003.
Newell, A. & Simon, H. A. 1972 Human Problem Solving. Prentice-Hall.
*Park, J. & Kim, Y. 2007 Visual reasoning and design processes. In International Conference on Engineering Design, ICED07, pp. 112. The Design Society.
Poldrack, R.2015 Cognitive Atlas [online]. (accessed 10.29.15).
Poldrack, R. A., Kittur, A., Kalar, D., Miller, E., Seppa, C., Gil, Y., Parker, D. S., Sabb, F. W. & Bilder, R. M. 2011 The cognitive atlas: toward a knowledge foundation for cognitive neuroscience. Frontiers in Neuroinformatics 5, 111. doi:10.3389/fninf.2011.00017.
Reber, M.2011 A theory of value in design. PhD thesis, Department of Design, Manufacture and Engineering Management, University of Strathclyde.
Roozenburg, N. F. M. & Eekels, J. 1994 Product Design: Fundamentals and Methods. Wiley.
Runco, M. A. & Chand, I. 1995 Cognition and creativity. Educational Psychology Review 7 (3), 243267. doi:10.1007/BF02213373.
Sarkar, P. & Chakrabarti, A. 2014 Ideas generated in conceptual design and their effects on creativity. Research in Engineering Design 25 (3), 185201. doi:10.1007/s00163-014-0173-9.
Schön, D. A. 1983 The Reflective Practitioner: How Professionals Think in Action. Basic Books.
Schon, D. A. & Wiggins, G. 1992 Kinds of seeing and their functions in designing. Design Studies 13 (2), 135156. doi:10.1016/0142-694X(92)90268-F.
Shah, J. J., Millsap, R. E., Woodward, J. & Smith, S. M. 2012 Applied tests of design skills - part 1: divergent thinking. Journal of Mechanical Design 134, 021005-1–021005-10. doi:10.1115/1.4005594.
Shah, J. J., Millsap, R. E., Woodward, J. & Smith, S. M. 2013 Applied tests of design skills—part II: visual thinking. Journal of Mechanical Design 134, 071004-1–071004-11. doi:10.1115/1.4005594.
Shah, J. J., Smith, S. M. & Vargas-Hernandez, N. 2003 Metrics for measuring ideation effectiveness. Design Studies 24 (2), 111134. doi:10.1016/S0142-694X(02)00034-0.
Sim, S. K. & Duffy, A. H. B. 2003 Towards an ontology of generic engineering design activities. Research in Engineering Design 14 (4), 200223. doi:10.1007/s00163-003-0037-1.
Simon, H. A. 1996 The Sciences of the Artificial. MIT Press.
*Stauffer, L. A. & Ullman, D. G. 1991 Fundamental processes of mechanical designers based on empirical data. Journal of Engineering Design 2 (2), 113125. doi:10.1080/09544829108901675.
*Sun, G., Yao, S. & Carretero, J. A. 2013 Evaluating cognitive efficiency by measuring information contained in designers’ cognitive processes. In Proceedings of the ASME 2013 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, Portland, Oregon, pp. 110. The American Society of Mechanical Engineers.
*Suwa, M. 2003 Constructive perception: Coordinating perception and conception toward acts of problem-finding in a creative experience. Japanese Psychological Research 45 (4), 221234. doi:10.1111/1468-5884.00227.
*Suwa, M., Gero, J. & Purcell, T. 2000 Unexpected discoveries and S-invention of design requirements: important vehicles for a design process. Design Studies 21 (6), 539567.
Suwa, M., Gero, J. S. & Purcell, T. A 1998b The roles of sketches in early conceptual design processes. In Proceedings of the Twentieth Annual Meeting of the Cognitive Science Society, pp. 10431048. Lawrence Erlbaum.
*Suwa, M., Purcell, T. & Gero, J. 1998a Macroscopic analysis of design processes based on a scheme for coding designers’ cognitive actions. Design Studies 19 (4), 455483. doi:10.1016/S0142-694X(98)00016-7.
Suwa, M. & Tversky, B. 1996 What architects see in their sketches: implications for design tools. In Conference on Human Factors in Computing Systems, CHI 96 – Common Ground, pp. 191192. ACM.
*Suwa, M. & Tversky, B. 1997 What do architects and students perceive in their design sketches? A protocol analysis. Design Studies 18 (4), 385403. doi:10.1016/S0142-694X(97)00008-2.
Suwa, M., Tversky, B., Gero, J. & Purcell, T. 2001 Seeing into sketches: regrouping parts encourages new interpretations. In Visual and Spatial Reasoning in Design II. Key Centre of Design Computing and Cognition. University of Sydney.
Tversky, B. 2014 Some ways of thinking. In Model-Based Reasoning in Science and Technology, Studies in Applied Philosophy, Epistemology and Rational Ethics (ed. Magnani, L.), pp. 38. Springer.
van Someren, M. W., Barnard, Y. F. & Sandberg, J. A. C. 1994 The Think Aloud Method: a Practical Guide to Modelling Cognitive Processes. Academic.
Visser, W. 2004 Dynamic Aspects of Design Cognition: Elements for a Cognitive Model of Design. Institut National de Recherche en Informatique et en Automatique.
Visser, W. 2006 The Cognitive Artifacts of Designing. Lawrence Erlbaum Associates, Inc.
*Won, P. H. 2001 The comparison between visual thinking using computer and conventional media in the concept generation stages of design. Automation in Construction 10 (3), 319325. doi:10.1016/S0926-5805(00)00048-0.
Yu, R. & Gero, J. S. 2015 An empirical foundation for design patterns in parametric design. In Proceedings of the 20th International Conference of the Association for Computer-Aided Architectural Design Research in Asia CAADRIA 2015 (ed. Ikeda, Y., Herr, C. M., Holzer, D., Kaijima, S., Kim, M. J. & Schnabel, A.), pp. 19. The Association for Computer-Aided Architectural Design Research In Asia (CAADRIA).
*Yu, R., Gu, N. & Lee, J. H. 2013 Comparing designers’ behavior in responding to unexpected discoveries in parametric design environments and geometry modeling environments. International Journal of Architectural Computing 11 (4), 393414.
*Yu, R., Gu, N., Ostwald, M. & Gero, J. S. 2014 Empirical support for problem–solution coevolution in a parametric design environment. AI EDAM 29 (1), 3344. doi:10.1017/S0890060414000316.


Type Description Title
Supplementary materials

Hay supplementary material
Hay supplementary material 1

 Unknown (40 KB)
40 KB

A systematic review of protocol studies on conceptual design cognition: Design as search and exploration

  • Laura Hay (a1), Alex H. B. Duffy (a1), Chris McTeague (a1), Laura M. Pidgeon (a2), Tijana Vuletic (a1) and Madeleine Grealy (a2)...


Altmetric attention score

Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed