Skip to main content
    • Aa
    • Aa

A systematic review of protocol studies on conceptual design cognition: Design as search and exploration

  • Laura Hay (a1), Alex H. B. Duffy (a1), Chris McTeague (a1), Laura M. Pidgeon (a2), Tijana Vuletic (a1) and Madeleine Grealy (a2)...

This paper reports findings from the first systematic review of protocol studies focusing specifically on conceptual design cognition, aiming to answer the following research question: What is our current understanding of the cognitive processes involved in conceptual design tasks carried out by individual designers? We reviewed 47 studies on architectural design, engineering design and product design engineering. This paper reports 24 cognitive processes investigated in a subset of 33 studies aligning with two viewpoints on the nature of designing: (V1) design as search (10 processes, 41.7%); and (V2) design as exploration (14 processes, 58.3%). Studies on search focused on solution search and problem structuring, involving: long-term memory retrieval; working memory; operators and reasoning processes. Studies on exploration investigated: co-evolutionary design; visual reasoning; cognitive actions; and unexpected discovery and situated requirements invention. Overall, considerable conceptual and terminological differences were observed among the studies. Nonetheless, a common focus on memory, semantic, associative, visual perceptual and mental imagery processes was observed to an extent. We suggest three challenges for future research to advance the field: (i) developing general models/theories; (ii) testing protocol study findings using objective methods conducive to larger samples and (iii) developing a shared ontology of cognitive processes in design.

  • View HTML
    • Send article to Kindle

      To send this article to your Kindle, first ensure is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about sending to your Kindle.

      Note you can select to send to either the or variations. ‘’ emails are free but can only be sent to your device when it is connected to wi-fi. ‘’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

      Find out more about the Kindle Personal Document Service.

      A systematic review of protocol studies on conceptual design cognition: Design as search and exploration
      Available formats
      Send article to Dropbox

      To send this article to your Dropbox account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your Dropbox account. Find out more about sending content to Dropbox.

      A systematic review of protocol studies on conceptual design cognition: Design as search and exploration
      Available formats
      Send article to Google Drive

      To send this article to your Google Drive account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your Google Drive account. Find out more about sending content to Google Drive.

      A systematic review of protocol studies on conceptual design cognition: Design as search and exploration
      Available formats
Distributed as Open Access under a CC-BY 4.0 license (
Corresponding author
Email address for correspondence:
Linked references
Hide All

This list contains references from the content that can be linked to their source. For a full set of references and notes please see the PDF or HTML where available.

A. Abraham  & A. Bubic 2015 Semantic memory as the root of imagination. Frontiers in Psychology 6, 15. doi:10.3389/fpsyg.2015.00325.

U. A. *Athavankar 1997 Mental imagery as a design tool. Cybernetics and Systems 28 (1), 2542. doi:10.1080/019697297126236.

U. *Athavankar , P. Bokil  & K. Guruprasad 2008 Reaching out in the mind’s space. In Design Computing and Cognition ’08, pp. 321340. Springer.

R. E. Beaty , P. J. Silvia , E. C. Nusbaum , E. Jauk  & M. Benedek 2014 The roles of associative and executive processes in creative cognition. Memory and Cognition 42 (7), 11861197. doi:10.3758/s13421-014-0428-8.

M. Benedek , E. Jauk , A. Fink , K. Koschutnig , G. Reishofer , F. Ebner  & A. C. Neubauer 2013 To create or to recall? Neural mechanisms underlying the generation of creative new ideas. NeuroImage 88, 125133. doi:10.1016/j.neuroimage.2013.11.021.

J. L. Blizzard  & L. E. Klotz 2012 A framework for sustainable whole systems design. Design Studies 33 (5), 456479. doi:10.1016/j.destud.2012.03.001.

K. S. Button , J. P. A. Ioannidis , C. Mokrysz , B. A. Nosek , J. Flint , E. S. J. Robinson  & M. R. Munafò 2013 Power failure: why small sample size undermines the reliability of neuroscience. Nature Reviews: Neuroscience 14 (5), 365376. doi:10.1038/nrn3475.

R. C. K. Chan , D. Shum , T. Toulopoulou  & E. Y. H. Chen 2008 Assessment of executive functions: review of instruments and identification of critical issues. Archives of Clinical Neuropsychology: The Official Journal of the National Academy of Neuropsychologists 23 (2), 201216. doi:10.1016/j.acn.2007.08.010.

T. *Chandrasekera , N. Vo  & N. D’Souza 2013 The effect of subliminal suggestions on Sudden Moments of Inspiration (SMI) in the design process. Design Studies 34, 193215. doi:10.1016/j.destud.2012.09.002.

M. L. Chiu 2003 Design moves in situated design with case-based reasoning. Design Studies 24 (1), 125. doi:10.1016/S0142-694X(02)00007-8.

F. Coley , O. Houseman  & R. Roy 2007 An introduction to capturing and understanding the cognitive behaviour of design engineers. Journal of Engineering Design 18 (4), 311325. doi:10.1080/09544820600963412.

M. Dinar , J. J. Shah , J. Cagan , L. Leifer , J. Linsey , S. M. Smith  & N. V. Hernandez 2015 Empirical studies of designer thinking: past, present, and future. Journal of Mechanical Design 137 (2), 113. doi:10.1115/1.4029025.

K. *Dorst  & N. Cross 2001 Creativity in the design process: co-evolution of problem–solution. Design Studies 22 (2), 425437. doi:10.1016/S0142-694X(01)00009-6.

K. Dorst  & J. Dijkhuis 1995 Comparing paradigms for describing design activity. Design Studies 16 (2), 261274. doi:10.1016/0142-694X(94)00012-3.

M. *Eckersley 1988 The form of design processes: a protocol analysis study. Design Studies 9 (2), 8694. doi:10.1016/0142-694X(88)90034-8.

O. Erkarslan 2013 A systematic review of the relations between industrial design education and industry in Turkey through SWOT analysis. The Design Journal 16 (1), 74102. doi:10.2752/175630613X13512595146952.

J. S. Gero  & U. Kannengiesser 2004 The situated function–behaviour–structure framework. Design Studies 25 (4), 373391. doi:10.1016/j.destud.2003.10.010.

J. S. Gero  & H.-H. Tang 2001 The differences between retrospective and concurrent protocols in revealing the process-oriented aspects of the design process. Design Studies 22 (3), 283295. doi:10.1016/S0142-694X(00)00030-2.

V. Goel 2014 Creative brains: designing in the real world. Frontiers in Human Neuroscience 8, 114. doi:10.3389/fnhum.2014.00241.

G. *Goldschmidt 1991 The dialectics of sketching. Creativity Research Journal 4 (2), 123143. doi:10.1080/10400419109534381.

V. Hubka 1982 Principles of Engineering Design. Butterworth & Co (Publishers) Ltd.

Y. Jin  & P. Chusilp 2006 Study of mental iteration in different design situations. Design Studies 27 (1), 2555. doi:10.1016/j.destud.2005.06.003.

M. *Kavakli  & J. S. Gero 2001 Sketching as mental imagery processing. Design Studies 22 (4), 347364. doi:10.1016/S0142-694X(01)00002-3.

M. *Kavakli  & J. S. Gero 2002 The structure of concurrent cognitive actions: a case study on novice and expert designers. Design Studies 23 (1), 2540. doi:10.1016/S0142-694X(01)00021-7.

M. Khorshidi , J. J. Shah  & J. Woodward 2014 Applied tests of design skills—part III: abstract reasoning. Journal of Mechanical Design 136, 101101-1–101101-11. doi:10.1115/1.4027986.

J. Kim  & H. Ryu 2014 A design thinking rationality framework: framing and solving design problems in early concept generation. Human–Computer Interaction 29 (5–6), 516553. doi:10.1080/07370024.2014.896706.

J. E. Kim , C. Bouchard , J. F. Omhover  & A. Aoussat 2010 Towards a model of how designers mentally categorise design information. CIRP Journal of Manufacturing Science and Technology 3 (3), 218226. doi:10.1016/j.cirpj.2010.11.004.

L. A. *Liikkanen  & M. Perttula 2009 Exploring problem decomposition in conceptual design among novice designers. Design Studies 30 (1), 3859. doi:10.1016/j.destud.2008.07.003.

P. Lloyd , B. Lawson  & P. Scott 1995 Can concurrent verbalization reveal design cognition? Design Studies 16 (2), 237259. doi:10.1016/0142-694X(94)00011-2.

M. Maher , J. Poon  & S. Boulanger 1996 Formalising design exploration as co-evolution: A combined gene approach. In Advances in Formal Design Methods for CAD (ed. J. S. Gero  & F. Sudweeks ), pp. 330. Chapman Hall.

S. Mednick 1962 The associative basis of the creative process. Psychological Review 69 (3), 220232.

D. Moher , A. Liberati , J. Tetzlaff  & D. G. Altman 2009 Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Medicine 6 (7), 16. doi:10.1371/journal.pmed.1000097.

M. D. Mumford , K. E. Medeiros  & P. J. Partlow 2012 Creative thinking: processes, strategies, and knowledge. Journal of Creative Behaviour 46 (1), 3047. doi:10.1002/jocb.003.

R. A. Poldrack , A. Kittur , D. Kalar , E. Miller , C. Seppa , Y. Gil , D. S. Parker , F. W. Sabb  & R. M. Bilder 2011 The cognitive atlas: toward a knowledge foundation for cognitive neuroscience. Frontiers in Neuroinformatics 5, 111. doi:10.3389/fninf.2011.00017.

M. A. Runco  & I. Chand 1995 Cognition and creativity. Educational Psychology Review 7 (3), 243267. doi:10.1007/BF02213373.

P. Sarkar  & A. Chakrabarti 2014 Ideas generated in conceptual design and their effects on creativity. Research in Engineering Design 25 (3), 185201. doi:10.1007/s00163-014-0173-9.

D. A. Schon  & G. Wiggins 1992 Kinds of seeing and their functions in designing. Design Studies 13 (2), 135156. doi:10.1016/0142-694X(92)90268-F.

J. J. Shah , R. E. Millsap , J. Woodward  & S. M. Smith 2012 Applied tests of design skills - part 1: divergent thinking. Journal of Mechanical Design 134, 021005-1–021005-10. doi:10.1115/1.4005594.

J. J. Shah , S. M. Smith  & N. Vargas-Hernandez 2003 Metrics for measuring ideation effectiveness. Design Studies 24 (2), 111134. doi:10.1016/S0142-694X(02)00034-0.

S. K. Sim  & A. H. B. Duffy 2003 Towards an ontology of generic engineering design activities. Research in Engineering Design 14 (4), 200223. doi:10.1007/s00163-003-0037-1.

H. A. Simon 1996 The Sciences of the Artificial. MIT Press.

L. A. *Stauffer  & D. G. Ullman 1991 Fundamental processes of mechanical designers based on empirical data. Journal of Engineering Design 2 (2), 113125. doi:10.1080/09544829108901675.

M. Suwa  & B. Tversky 1996 What architects see in their sketches: implications for design tools. In Conference on Human Factors in Computing Systems, CHI 96 – Common Ground, pp. 191192. ACM.

B. Tversky 2014 Some ways of thinking. In Model-Based Reasoning in Science and Technology, Studies in Applied Philosophy, Epistemology and Rational Ethics (ed. L. Magnani ), pp. 38. Springer.

Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

Design Science
  • ISSN: -
  • EISSN: 2053-4701
  • URL: /core/journals/design-science
Please enter your name
Please enter a valid email address
Who would you like to send this to? *


Type Description Title
Supplementary Materials

Hay supplementary material
Hay supplementary material 1

 Unknown (40 KB)
40 KB


Full text views

Total number of HTML views: 10
Total number of PDF views: 121 *
Loading metrics...

Abstract views

Total abstract views: 162 *
Loading metrics...

* Views captured on Cambridge Core between 20th July 2017 - 22nd September 2017. This data will be updated every 24 hours.