Skip to main content Accessibility help

Evidence of problem exploration in creative designs

  • Jaryn A. Studer (a1), Shanna R. Daly (a2), Seda McKilligan (a3) and Colleen M. Seifert (a4)


Design problems are often presented as structured briefs with detailed constraints and requirements, suggesting a fixed definition. However, past studies have identified the importance of exploring design problems for creative design outcomes. Previous protocol studies of designers has shown that problems can “co-evolve” with the development of solutions during the design process. But to date, little evidence has been provided about how designers systematically explore presented problems to create better solutions. In this study, we conducted a qualitative analysis of 252 design problems collected from publically available sources, including award-winning product designs and open-source design competitions. This database offers an independent sample of presented problems, designers’ alternative problem descriptions, and innovative solutions. We report the results of this large-scale qualitative analysis aimed at characterizing changes to problems during the design process. Inductive coding was used to identify content patterns in “discovered” problem descriptions, with qualitative codes reliably scored by two independent coders. A total of 32 distinct patterns of problem exploration were identified across designers and presented problems. Each pattern is described in the form of a generalized strategy to guide designers as they explore problem spaces. The exploration patterns identified in this study are the first empirical evidence of problem exploration in independent design problems. Further, the presence of exploration patterns in discovered problems is associated with the selection of the corresponding solution as a challenge finalist. These empirically identified strategies for problem exploration may be useful for computational tools supporting designers.

  • View HTML
    • Send article to Kindle

      To send this article to your Kindle, first ensure is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about sending to your Kindle. Find out more about sending to your Kindle.

      Note you can select to send to either the or variations. ‘’ emails are free but can only be sent to your device when it is connected to wi-fi. ‘’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

      Find out more about the Kindle Personal Document Service.

      Evidence of problem exploration in creative designs
      Available formats

      Send article to Dropbox

      To send this article to your Dropbox account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Dropbox.

      Evidence of problem exploration in creative designs
      Available formats

      Send article to Google Drive

      To send this article to your Google Drive account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Google Drive.

      Evidence of problem exploration in creative designs
      Available formats


This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (, which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.

Corresponding author

Author for correspondence: Colleen Seifert, E-mail:


Hide All
Adams, R, Daly, S, Mann, L and Dall'Alba, G (2011) Being a professional: three lenses on design thinking, acting, and being. Design Studies 32, 588607.
Ahmed, S, Wallace, K and Blessing, L (2003) Understanding the differences between how novice and experienced designers approach design tasks. Research in Engineering Design 14, 111.
Altshuller, G (1984) Creativity as an Exact Science. New York: Gordon & Breach.
Altshuller, G (1997) 40 Principles: TRIZ Keys to Technical Innovation. Worcester, MA: Technical Innovation Center.
Archer, LB (1968) The structure of design processes. Thesis (Ph.D.) Royal College of Art, London, 1968. Shelfmark: Document Supply DRT 484530. Available on Ethos:
Asimow, M (1962) Introduction to Design: Fundamentals of Engineering Design. New Jersey: Prentice-Hall.
Atman, CJ, Chimka, JR and Bursic, KM (1999) A comparison of freshman and senior engineering design processes. Design Studies 20, 131152.
Ball, L and Ormerod, T (2000) Applying ethnography in the analysis and support of expertise in engineering design. Design Studies 21, 403421.
Beckman, S and Barry, M (2015) Framing and re-framing: core skills for a problem-filled world. Rotman Magazine (Winter), 67–71.
Borrego, M, Douglas, E and Amelink, C (2009) Quantitative, qualitative, and mixed research methods in engineering education. Journal of Engineering Education 98, 5366.
Brophy, DR (2001) Comparing the attributes, activities, and performance of divergent, convergent, and combination thinkers. Creativity Research Journal 13, 439455.
Bulsuk, KG (2011) An introduction to 5-why. Retrieved from html#axzz1WBoqfIV6. May 1, 2017.
Carroll, JM, Thomas, JC and Malhotra, A (1979) Clinical-experimental analysis of design problem solving. Design Studies 1, 8492.
Casakin, HP (2007) Metaphors in design problem solving: implications for creativity. International Journal of Design 1, 2133.
Chi, MT (1997) Quantifying qualitative analyses of verbal data: a practical guide. The Journal of the Learning Sciences 6, 271315.
Christiaans, HHCM (1992 a) Creativity in Design: The Role of Domain Knowledge in Designing. Delft, Netherlands: Technical University of Delft.
Christiaans, HHCM (1992 b) Cognitive models in industrial design engineering: a protocol study. In Taylor, DL and Stauffer, DA (eds), Design Theory and Methodology. New York: American Society of Mechanical Engineers, pp. 131140.
Clemen, R and Reilly, T (2014) Making Hard Decisions with Decision Tools: An Introduction to Decision Analysis. Stamford, CT: Cengage.
Coffey, A and Atkinson, P (1996) Making Sense of Qualitative Data: Complementary Research Strategies. Thousand Oaks: Sage.
Cohen, J (1960) A coefficient for agreement for nominal scales. Education and Psychological Measurement 20, 3746.
Crabtree, BF and Miller, WL (eds) (1999) Doing Qualitative Research. New York: Sage Publications.
Creswell, JW and Clark, VLP (2007) Designing and Conducting Mixed Methods Research. California: Sage Publications.
Cross, N (1997) Descriptive models of creative design: application to an example. Design Studies 18, 427440.
Cross, N (2004) Expertise in design: an overview. Design Studies 25, 427441.
Cross, N (2006) Designerly ways of knowing (pp. 113). London: Springer.
Cross, N and Cross, AC (1998) Expertise in engineering design. Research in Engineering Design 10, 141149.
Csikszentmihalyi, M and Getzels, JW (1971) Discovery-oriented behavior and the originality of creative products: a study with artists. Journal of Personality and Social Psychology 19, 4752.
Csikszentmihalyi, M and Getzels, JW (1988) Creativity and problem finding. In Farley, FH and Neperud, RW (eds), The Foundations of Aesthetics, Art, and Art Education. New York: Praeger, pp. 91106.
Daly, S, Christian, JL, Yilmaz, S, Seifert, CM and Gonzalez, (2012 a) Assessing design heuristics for idea generation in an introductory engineering course. International Journal of Engineering Education 28, 111.
Daly, SR, Adams, RS and Bodner, GM (2012 b) ‘What does it mean to design? A qualitative investigation of design professionals’ experiences. Journal of Engineering Education 101, 187219.
Daly, SR, McKilligan, S, Studer, JA, Murray, JA and Seifert, CM (2018) Innovative solutions through innovated problems. International Journal of Engineering Education 34, 695707.
Daly, SR, Mosyjowski, EA and Seifert, CM (2014) Teaching creativity in engineering courses. Journal of Engineering Education 103, 417449.
Daly, SR, Yilmaz, S, Christian, JL, Seifert, CM and Gonzalez, R (2012 c) Design heuristics in engineering concept generation. Journal of Engineering Education 101, 601629.
Daly, SR, Yilmaz, S, Seifert, C and Gonzalez, R (2010) Cognitive Heuristic use in Engineering Design Ideation. Proceedings of the American Society for Engineering Education (AC 2010-1032). Washington, DC: American Society for Engineering Education.
Dewey, J (1910) How We Think. Boston: D.C. Heath and Co.
Dillon, JT (1982) Problem finding and solving. The Journal of Creative Behavior 16, 97111.
Dorst, K (2010) The nature of design thinking. DTRS8 Interpreting Design Thinking: Design Thinking Research Symposium Proceedings (DTRS8), 131–139.
Dorst, K (2011) The core of “design thinking” and its application. Design Studies 32, 521532.
Dorst, K and Cross, N (2001) Creativity in the design process: co-evolution of problem–solution. Design Studies 22, 425437.
Drews, C (2009) Unleashing the full potential of design thinking as a business method. Design Management Review 20, 3944.
Duncker, K (1945) On problem solving. Psychological Monographs 58, 270.
Dzbor, M and Zdrahal, Z (2002) Modelling design interpretation as interaction of problem framing and problem solving. Proceedings of DETC'02: ASME 2002 Design Engineering Technical Conferences and Computers and Information in Engineering Conference. Montreal, Canada.
Ecker, DW (1963) The artistic process as qualitative problem solving. Journal of Aesthetics and Art Criticism 31, 283290.
Fogler, SH and LeBlanc, SE (2008) Strategies for Creative Problem Solving. Massachusetts, USA: Pearson Education, Inc.
Fricke, G (1999) Successful approaches in dealing with differently precise design problems. Design Studies 20, 417429.
Fu, KK, Yang, MC and Wood, KL (2015) Design principles: The foundation of design. In ASME 2015 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference (pp. V007T06A034-V007T06A034). American Society of Mechanical Engineers.
Gero, JS (2004) The situated function-behaviour-structure framework. Design Studies 25, 373391.
Getzels, JW (1975) Problem-finding and the inventiveness of solutions. The Journal of Creative Behavior 9, 1218.
Getzels, JW and Csikszentmihalyi, M (1976) The Creative Vision: A Longitudinal Study of Problem Finding in Art. New York: Wiley.
Getzels, JW and Smilansky, J (1983) Individual differences in pupil perceptions of school problems. British Journal of Educational Psychology 531, 307316.
Glaser, BG (1965) The constant comparative method of qualitative analysis. Social Problems 12, 436445.
Goel, AK and Bhatta, SR (2004) Use of design patterns in analogy-based design. Advanced Engineering Informatics 18, 8594.
Granger, CH (1964) The hierarchy of objectives. Harvard Business Review, 42, 6374.
Gray, CM, Seifert, CM, Yilmaz, S, Daly, SR and Gonzalez, R (2016) What is the content of “design thinking”? Design heuristics as conceptual repertoire. International Journal of Engineering Education 32.
Hall, AD III (1962) A Methodology for Systems Engineering. Princeton, NJ: Van Nostrand.
Haller, L and Cullen, CD (2006) Design Secrets: Products 2: Fifty Real-Life Design Projects Uncovered (V. 2). (Edited by the Industrial Designers Society of America.) Glaucester, MA: Rockport.
Harfield, S (2007) On design ‘problematization:’ theorising differences in designed outcomes. Design Studies 28, 159173.
Hargadon, AB and Bechy, BA (2006) When collections of creatives become creative collectives: a field study of problem solving at work. Organization Science 17, 484500.
Higgins, JS, Maitland, GC, Perkins, JD and Richardson, SM (1989) Identifying and solving problems in engineering design. Studies in Higher Education 14, 169181.
Howard, TJ, Culley, SJ and Dekoninck, E (2008) Describing the creative design process by the integration of engineering design and cognitive psychology literature. Design Studies 29, 160180.
Industrial Designers of Society of America (2001) Design Secrets: Products: Fifty Real-Life Projects Uncovered. Glaucester, MA: Rockport.
Kahn, AJ (1969) Theory and Practice of Social Planning. New York: Russell Sage Foundation.
Kepner, CH and Tregoe, BB (1981) The New Rational Manager. Princeton, NJ: Princeton Research Press.
Krippendorf, K (1980) Content Analysis: An Introduction to its Methodology. Beverly Hills, CA: Sage.
Kruger, C and Cross, N (2006) Solution driven versus problem driven design: strategies and outcomes. Design Studies 27, 527548.
Leydens, J, Moskal, B and Pavelich, M (2004) Qualitative methods used in the assessment of engineering education. Journal of Engineering Education 94, 1325.
Liu, YC, Bligh, T and Chakrabarti, A (2003) Towards an “ideal” approach for concept generation. Design Studies 24, 341355.
Luma Institute (2012) Innovating for People: Handbook of Human-Centered Design Methods. Pittsburgh, PA: LUMA Institute.
MacCrimmon, KR and Taylor, RN (1976) Decision making and problem solving. In Dunnette, MD (ed.), Handbook of Industrial and Organizational Psychology. Chicago: Rand McNally College Publishing Co, pp. 13971493.
MacLellan, CJ, Langley, P, Shah, J and Dinar, M (2013) A computational aid for problem formulation in early conceptual design. Journal of Computing and Information Science in Engineering 13, 031005–10.
Maher, ML and Poon, J (1996) Modeling design exploration as co-evolution. Computer-Aided Civil Infrastructure 11, 195209.
Maher, ML, Poon, J and Boulanger, S (1996) Formalising design exploration as co-evolution: a combined gene approach. Advances in Formal Design Methods for CAD: Proceedings of the IFIP WG5.2 Workshop on Formal Design Methods for Computer-Aided Design, 3–30.
Maier, RF (1970) Problem Solving and Creativity in Individuals and Groups. Belmont, California: Brooks/Cole Publishing Co.
Mingers, J and Rosenhead, J (2004) Problem structuring methods in action. European Journal of Operational Research 152, 530664.
Moreno, DP, Hernandez, AA, Yang, MC, Otto, KN, Holtta-Otto, K, Linsey, JS and Wood, KL (2014) Fundamental studies in design-by-analogy: a focus on domain-knowledge experts and applications to transactional design problems. Design Studies 35, 232272.
Mumford, MD, Reiter-Palmon, R and Redmond, MR (1994) Problem construction and cognition: applying problem representations in ill-defined domains. In Runco, M (ed.), Problem Finding, Problem Solving, and Creativity. Norwood, NJ: Ablex, pp. 339.
Nadler, G (1967) Work Systems Design: The IDEALS Concept. Homewood, Illinois: Richard D. Irwin, Inc.
Newell, A and Simon, HA (1972) Human Problem Solving. Englewood, NJ: Prentice-Hall.
Okuda, SM, Runco, MA and Berger, DE (1991) Creativity and the finding and solving of real-world problems. Journal of Psychoeducational Assessment 9, 4553.
Ottosson, S (2004) Dynamic product development - DPD. Technovation 24, 207217.
Parnes, SJ (1967) Creative Behavior Guidebook. New York: Scribner.
Paton, B and Dorst, K (2011) Briefing and reframing: a situated practice. Design Studies 32, 573587.
Patton, MQ (2005) Qualitative Research. London: John Wiley & Sons, Ltd.
Paul, R and Elder, L (2006) Critical thinking: The nature of critical and creative thought. Journal of Developmental Education 30, 34.
Reed, SK and Abramson, A (1976) Effect of the problem space on subgoal facilitation. Journal of Educational Psychology 68, 243246.
Restrepo, J and Christiaans, H (2004) Problem structuring and information access in design. Journal of Design Research 4, 218236.
Rickards, T (1975) Problem Solving Through Creative Analysis. Essex: Gower Press.
Seevinck, J and Lenigas, T (2013) Rock, paper, scissors: reflective practice for design process in the novice landscape architect. Proceedings of the 2nd International Conference for Design Education Researchers, 21452159.
Schön, D (1983) The Reflective Practitioner: How Practitioners Think in Action. London: Temple Smith.
Shneiderman, B (2000) Creating creativity: user interfaces for supporting innovation. ACM Transactions on Computer-Human Interaction 7, 114138.
Shull, FA, Delbecq, AL and Cummings, LL (1970) Organizational Decision Making. New York: McGraw-Hill Book Co.
Simon, HA (1969) The Sciences of the Artificial. Cambridge, MA: MIT Press.
Simon, HA (1979) Models of Thought. New Haven: Yale University Press.
Simon, HA (1972) Theories of bounded rationality. Decision and organization 1, 161176.
Singh, V, Skiles, SM, Krager, JE, Wood, KL, Jensen, D and Sierakowski, R (2009) Innovations in design through transformation: a fundamental study of transformation principles. ASME Journal of Mechanical Design 131, 081010.
Singh, V, Walter, B, Krager, J, Putnam, N, Koraishy, B, Wood, K and Jensen, D (2007) Design for Transformation: Theory, Method and Application. Proceedings of the IDETC/CIE 2007, ASME 2007 International Design Engineering Technical Conferences & Computers and Information in Engineering Conference, September, Las Vegas, NV.
Spradlin, D (2012) Are you solving the right problem? Harvard Business Review 90.
Stokes, PD (2009) Using constraints to create novelty: a case study. Psychology of Aesthetics, Creativity, and the Arts 3, 174180.
Stokes, PD and Fisher, D (2005) Selection, constraints, and creativity case studies: Max Beckmann and Philip Guston. Creativity Research Journal 17, 283291.
Studer, JA, Yilmaz, S, Daly, SR and Seifert, CM (2016) Cognitive heuristics in defining engineering design problems. In 29th International Conference on Design Theory and Methodology, Volume 7. ASME.
Stumpf, S and McDonnell, J (1999, April). Relating argument to design problem framing. In Proceedings of the 4th Design Thinking Research Symposium (pp. 245-253). Chicago, Il.
Tversky, A and Kahneman, D (1986) Rational choice and the framing of decisions. Journal of Business 59, S251S278.
Uebersax, JS (1987) Diversity of decision making models and the measurement of interrater agreement. Psychological Bulletin 101, 140146.
Unbranded Designs (2015). Ret. from (Oct. 28, 2015).
Valkenburg, R and Dorst, K (1998) The reflective practice of design teams. Design Studies 19, 249271.
Vasconcelos, LA, Crilly, N, Chen, CC, Campos, F and Kelner, J (2016) What's the benefit of problem exploration? Proceedings of the DESIGN 2016 14th International Design Conference (pp. 89-98). Cavtat, Dubrovnik, Croatia: The Design Society.
Weaver, J, Wood, K, Crawford, R and Jensen, D (2010) Transformation design theory: a meta-analogical framework. Journal of Computing and Information Science in Engineering 10, 031012–1.
Weaver, J, Wood, K and Jensen, D (2008) Transformation Facilitators: A Quantitative Analysis of Reconfigurable Products and their Characteristics, Proceedings of the ASME 2008 International Design Engineering Conferences & Computers and Information in Engineering Conference, IDETC/CIE 2008, Brooklyn, New York.
Yilmaz, S., Daly, S. R., Seifert, C. M. and Gonzalez, R. (2016a). Evidence-based design heuristics for idea generation. Design Studies 46, 95124.
Yilmaz, S and Seifert, CM (2011) Creativity through design heuristics: A case study of expert product design. Design Studies 32, 384415.
Yilmaz, S, Seifert, CM, Daly, SR and Gonzalez, R (2016b). Design heuristics in innovative products. Journal of Mechanical Design, 138, 112.


Evidence of problem exploration in creative designs

  • Jaryn A. Studer (a1), Shanna R. Daly (a2), Seda McKilligan (a3) and Colleen M. Seifert (a4)


Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed