Skip to main content

Characterizing innovative processes in design spaces through measuring the information entropy of empirical data from protocol studies

  • Jeff W.T. Kan (a1) and John S. Gero (a2)

This paper reports on a study characterizing design processes and the potential of design spaces through measuring the information entropy of empirical data derived from protocol studies. The sequential segments in a protocol analysis can be related to each other by examining their semantic content producing a design session's linkograph, which defines the design space for a design session. From a linkograph, it is possible to compute the probabilities of the connectivity of each segment for its forelinks and its backlinks, together with the probabilities of distance among links. A linkograph's entropy is a measure of the information in the design session. It is claimed that the entropy of the linkograph measures the potential of the design space being generated as the design proceeds chronologically. We present an approach to the automated construction of linkographs by connecting segments using the lexical database WordNet and measure its entropy. A case study of two design sessions with different characteristics was conducted, one considered more productive and creative, the other more pragmatic. Those segments with high entropy and those associated with high rates of change of entropy are analyzed. The creative session has a higher linkograph entropy. This result indicates the potential of using entropy to characterize a design process.

Corresponding author
Reprint requests to: Jeff W.T. Kan, Independent Scholar, Flat F, 34/F, Block One, Grand View Garden, Diamond Hill, Kowloon, Hong Kong. E-mail:
Hide All
Bilda, Z. (2006). The role of externalizations in design: designing in imagery versus sketching . Unpublished doctoral dissertation, University of Sydney.
Cross, N., Christiaans, H., & Dorst, K. (Eds.). (1996). Analysing Design Activity. New York: Wiley.
Dale, R., Moisl, H., & Somers, H. (2000). Handbook of Natural Language Processing. Boca Raton, FL: CRC Press.
Dorst, C. (2015). Frame Innovation: Create New Thinking by Design. Cambridge, MA: MIT Press.
Eastman, C.M. (1968). Explorations of the Cognitive Processes in Design, Technical Report. Carnegie Mellon University.
El-Haik, B., & Yang, K. (1999). The components of complexity in engineering design. IIE Transactions 31 (10), 925934.
Fellbaum, C. (1998). WordNet: An Electronic Lexical Database. Cambridge, MA: MIT Press.
Gero, J.S. (2011). Fixation and commitment while designing and its measurement. Journal of Creative Behavior 45 (2), 108115.
Goldschmidt, G. (1992). Criteria for design evaluation: a process-oriented paradigm. In Evaluating and Predicting Design Performance (Kaley, Y.E., Ed.), pp. 6779. New York: Wiley.
Goldschmidt, G. (1995). The designer as a team of one. Design Studies 16 (2), 189209.
Goldschmidt, G. (2014). Linkography: Unfolding the Design Process. Cambridge, MA: MIT Press.
Goldschmidt, G., & Tatsa, D. (2005). How good are good ideas? Correlates of design creativity. Design Studies 26 (6), 593611.
Kan, J.W.T. (2008). Quantitative methods for studying design protocols . Unpublished doctoral dissertation, University of Sydney.
Kan, W.T., & Gero, J.S. (2005). Can entropy indicate the richness of idea generation in team designing? Proc. CAADRIA'05 (Bhatt, A., Ed.), Vol. 1, pp. 451–457, New Delhi, India.
Kan, J.W.T., & Gero, J.S. (2008). Acquiring information from linkography in protocol studies of designing. Design Studies 29 (4), 315337.
Kan, J.W.T., & Gero, J.S. (2009). Using the FBS ontology to capture semantic design information in design protocol studies. In About Designing: Analysing Design Meetings (McDonnell, J., & Lloyd, P., Eds.), pp. 213229. New York: Taylor & Francis.
Kan, J.W.T., Gero, J.S., & Tang, H.-H. (2010). Measuring cognitive design activity changes during an industry team brainstorming session. Proc. Design Computing and Cognition '10 (Gero, J.S., Ed.), pp. 621640. Berlin: Springer.
Khan, W.A., & Angeles, J. (2011). The role of entropy in design theory and methodology. Proc. CDEN/C2E2 2007 Conf., Winnipeg, Canada, July 22–24.
Krus, P. (2013). Information entropy in the design process. Proc. ICoRD'13 (Chakrabati, A., & Prakash, R.V., Eds.), pp. 101112. New Delhi: Springer India.
Maher, M.L., Bilda, Z., & Gül, L.F. (2006). Impact of collaborative virtual environments on design behaviour. Proc. Design Computing and Cognition '06 (Gero, J.S., Ed.), pp. 305321. Dordrecht: Springer.
McDonnell, J., & Lloyd, P. (Eds.) (2009). About Designing: Analysing Design Meetings. Boca Raton, FL: CRC Press.
Popescu, I.-I., Lupea, M., Tatar, D., & Altmann, G. (2015). Quantitative Analysis of Poetic Texts. New York: de Gruyter.
Schön, D.A. (1983). The Reflective Practitioner: How Professionals Think in Action. London: Temple Smith.
Shannon, C.E. (1948). A mathematical theory of communication. Bell System Technical Journal 27, 379423.
Simon, H.A. (1969). The Sciences of the Artificial. Cambridge, MA: MIT Press.
Summers, J.D., & Shah, J.J. (2003). Developing measures of complexity for engineering design. Proc. ASME 2003 Int. Design Engineering Technical Conf./Computers and Information in Engineering Conf., pp. 381392. New York: American Society of Mechanical Engineers.
Torres, D.F. (2002). Entropy Text Analyzer. Accessed at
Tribelsky, E., & Sacks, R. (2010). Measuring information flow in the detailed design of construction projects. Research in Engineering Design 21 (3), 189206.
van der Lugt, R. (2003). Relating the quality of the idea generation process to the quality of the resulting design ideas. DS 31: Proc. ICED 03, the 14th Int. Conf. Engineering Design. Stockholm: Design Society.
Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

  • ISSN: 0890-0604
  • EISSN: 1469-1760
  • URL: /core/journals/ai-edam
Please enter your name
Please enter a valid email address
Who would you like to send this to? *



Full text views

Total number of HTML views: 9
Total number of PDF views: 63 *
Loading metrics...

Abstract views

Total abstract views: 411 *
Loading metrics...

* Views captured on Cambridge Core between 30th January 2017 - 23rd March 2018. This data will be updated every 24 hours.