Skip to main content
×
×
Home

The characterisation of engineering activity through email communication and content dynamics, for support of engineering project management

  • C. Snider (a1), S. Škec (a2), J. A. Gopsill (a3) and B. J. Hicks (a1)
Abstract

Significant challenge exists in the effective monitoring and management of engineering design and development projects. Due to traits such as contextual variation and scale, detailed understanding of engineering projects and activity are difficult to form, with monitoring hence reliant on interpretation of managerial personnel and adherence to defined performance indicators. This paper presents a novel approach to the quantitative monitoring and analysis of engineering activity through computational topic identification and analysis of low-level communication data. Through three metrics of communication activity, this approach enables detailed detection and tracking of activity associated with specific project work areas. By application to 11,832 emails within two industry email corpora, this work identifies four distinct patterns in activity, and derives seven characteristics of communication activity within engineering design and development. Patterns identified are associated with background discussion, focused working, and the appearance of issues, supporting detailed managerial understanding. Characteristics identified relate to through-process norms against which a manager may compare and assess. Such project-specific information extends the ability of managers to understand the activity within their specific project scenario. Through detailed description of activity and its characteristics, in tandem with existing toolsets, a manager may be supported in their interpretation and decision-making processes.

  • View HTML
    • Send article to Kindle

      To send this article to your Kindle, first ensure no-reply@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about sending to your Kindle. Find out more about sending to your Kindle.

      Note you can select to send to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be sent to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

      Find out more about the Kindle Personal Document Service.

      The characterisation of engineering activity through email communication and content dynamics, for support of engineering project management
      Available formats
      ×
      Send article to Dropbox

      To send this article to your Dropbox account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Dropbox.

      The characterisation of engineering activity through email communication and content dynamics, for support of engineering project management
      Available formats
      ×
      Send article to Google Drive

      To send this article to your Google Drive account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Google Drive.

      The characterisation of engineering activity through email communication and content dynamics, for support of engineering project management
      Available formats
      ×
Copyright
Distributed as Open Access under a CC-BY 4.0 license (http://creativecommons.org/licenses/by/4.0/)
Corresponding author
Email address for correspondence: chris.snider@bristol.ac.uk
References
Hide All
Ahmed, S., Wallace, K. M. & Blessing, L. T. 2003 Understanding the differences between how novice and experienced designers approach design tasks. Research in Engineering Design 14 (1), 111.
Allan, J. 2002 Topic Detection and Tracking. Springer Science+Business Media.
AlSumait, L., Barbará, D. & Domeniconi, C. 2008 On-line LDA: adaptive topic models for mining text streams with applications to topic detection and tracking. In Proceedings – IEEE International Conference on Data Mining, ICDM, pp. 312. IEEE Computer Society.
Aral, S., Brynjolfsson, E. & Van Alstyne, M.2007 Productivity Effects of Information Diffusion in Networks. 4683–08. doi:10.2139/ssrn.987499.
Atkinson, R. 1999 Project management: cost, time and quality, two best guesses and a phenomenon, its time to accept other success criteria. International Journal of Project Management 17 (6), 337342. Available at: http://www.sciencedirect.com/science/article/pii/S0263786398000696.
Banker, R. D., Bardhan, I. & Asdemir, O. 2006 Understanding the impact of collaboration software on product design and development. Information Systems Research 17 (4), 352373.
Brants, T., Chen, F. & Tsochantaridis, I. 2002 Topic-based document segmentation with probabilistic latent semantic analysis. In Proceedings of the Eleventh International Conference on Information and Knowledge Management CIKM 02, p. 211. Available at: http://portal.acm.org/citation.cfm?doid=584792.584829.
Byron, K. 2008 Carrying too heavy a load? The communication and miscommunication of emotion by email. The Academy of Management Review 33 (2), 309327.
Cantamessa, M., Montagna, F. & Neirotti, P. 2010 Understanding the organizational impact of PLM systems. International Journal of Operations & Production Management 32 (2), 191215.
Carley, K. M. 2003 Dynamic network analysis. In Dynamic Social Network Modeling and Analysis Workshop Summary and Papers, pp. 133145. Available at: http://www.chronicdisease.org/files/public/2009Institute_NA_Track_Carley_2003_dynamicnetwork.pdf.
Cataldi, M., Caro, L. D. & Schifanella, C. 2010 Emerging topic detection on twitter based on temporal and social terms evaluation. In The 10th International Workshop on Multimedia Data Mining. Available at: http://dl.acm.org/citation.cfm?id=1814245.1814249.
Cha, M., Mislove, A. & Gummadi, K. P. 2009 A measurement-driven analysis of information propagation in the Flickr social network. In Proceedings of the 18th International Conference on World Wide Web, pp. 721730. Available at:http://doi.acm.org/10.1145/1526709.1526806.
Chapman, C. & Ward, S. 1996 Project Risk Management: Processes, Techniques and Insights. John Wiley & Sons, Ltd.
Chen, H., Chiang, R. H. L. & Storey, V. C. 2012 Business intelligence and analytics: from big data to big impact. MIS Quarterly Quarterly 36 (4), 11651188. Available at: http://web.a.ebscohost.com/ehost/pdfviewer/pdfviewer?sid=c72752a6-fd0c-4184-ad0b-39ae0c9c16d8@sessionmgr4003&vid=1&hid=4209.
Collins, A. & Baccarini, D. 2004 Project success – a survey. Journal of Construction Research 5 (2), 211231. Available at: http://search.ebscohost.com/login.aspx?direct=true&db=buh&AN=14874051&site=ehost-live.
Cooke-Davies, T. 2002 The ‘real’ success factors on projects. International Journal of Project Management 20 (3), 185190. Available at: http://www.sciencedirect.com/science/article/pii/S0263786301000679.
Coursey, K. & Mihalcea, R. 2009 Topic identification using Wikipedia graph centrality. In Proceedings of NAACL HLT 2009, Boulder, Colorado, pp. 117120. Available at:http://portal.acm.org/citation.cfm?doid=1620853.1620887.
Cross, N. & Cross, A. C. 1998 Expertise in engineering design. Research in Engineering Design 10 (3), 141149.
Dewar, R. D. & Dutton, J. E. 1986 The adoption of radical and incremental innovations: an empirical analysis. Management Science 32 (11), 14221433. Available at:http://www.jstor.org/stable/2631501.
Dorst, K. & Cross, N. 2001 Creativity in the design process: co-evolution of problem-solution. Design Studies 22 (5), 425437. Available at: http://www.sciencedirect.com/science/article/B6V2K-43BXNJY-3/2/ec88c05634af799b89a41081220036b2.
Dumais, S. T. 2004 Latent semantic analysis. Annual Review of Information Science and Technology 38 (1). Available at: http://www.scholarpedia.org/article/Latent_semantic_analysis.
Dumais, S., Furnas, G., Landauer, T., Deerwester, S. & Harshman, R. 1988 Using latent semantic analysis to improve access to textual information. In ACM Conference on Human Factors in Computing Systems, CHI ’88, pp. 281285. ACM Press.
Eagle, N. & Pentland, A. 2006 Reality mining: sensing complex social systems. Personal and Ubiquitous Computing 10 (4), 255268.
Earl, C., Eckert, C. & Clarkson, J. 2005 Design change and complexity. In 2nd Workshop on Complexity in Design and Engineering (ed. Johnson, C.). GIST, University of Glasgow.
Engwall, M. 2002 No project is an island: linking projects to history and context. Research Policy 32 (2003), 789808.
Fernandez, D. J. & Fernandez, J. D. 2008 Agile project management – agilism versus traditional approaches. Journal of Computer Information Systems 49 (2), 1017. Available at: http://www.tandfonline.com/doi/abs/10.1080/08874417.2009.11646044.
Floricel, S. & Miller, R. 2001 Strategizing for anticipated risks and turbulence in large-scale engineering projects. International Journal of Project Management 19 (8), 445455.
Gero, J. S. & Tang, H. H. 2001 The differences between retrospective and concurrent protocols in revealing the process-oriented aspects of the design process. Design Studies 22 (3), 283295.
Gruhl, D., Liben-Nowell, D., Guha, R. & Tomkins, A. 2004 Information diffusion through blogspace. ACM SIGKDD Explorations Newsletter 6, 4352.
Guille, A. & Hacid, H. 2012 A predictive model for the temporal dynamics of information diffusion in online social networks. In Proceedings of the 21st International Conference … Available at: http://dl.acm.org/citation.cfm?id=2188254.
Gupta, A., Mattarelli, E., Seshasai, S. & Broschak, J. 2009 Use of collaborative technologies and knowledge sharing in co-located and distributed teams: towards the 24-h knowledge factory. Journal of Strategic Information Systems 18 (3), 147161.
Hales, C. 1987 Analysis of the Engineering Design Process in an Industrial Context. University of Cambridge.
Highsmith, J. & Cockburn, A. 2001 Agile software development: the business of innovation. Computer 34 (9), 120122.
von Hippel, E. 1998 Economics of product development by users: the impact of ‘sticky’ local information. Management Science 44 (5), 629644.
Holme, P. & Saramaki, J. 2012 Temporal networks. Physics Reports 519 (3), 97125.
Iribarren, J. L. & Moro, E. 2009 Impact of human activity patterns on the dynamics of information diffusion. Physical Review Letters 103 (July), 811.
Johansen, L. et al. 2007 Email communities of interest. Ceas. Available at: http://www.cse.psu.edu/∼butler/pubs/ceas07.pdf.
Jones, S., Cotterill, N., Dewdney, N., Muir, K. & Joinson, A. 2014 Finding zelig in text: a measure for normalizing linguistic accommodation. In COLING 2014: 25th International Conference on Computational Linguistics, Association for Computational Linguistics.
Jones, S., Payne, S., Hicks, B., Gopsill, J., Snider, C. & Shi, L. 2015 Subject lines as sensors: co-word analysis of email to support the management of collaborative engineering work. In ICED’15: International Conference on Engineering Design. The Design Society.
Kuhn, A., Ducasse, S. & Girba, T. 2007 Semantic clustering: identifying topics in source code. Information and Software Technology 49 (3), 230243.
Labrinidis, A. & Jagadish, H. V. 2012 Challenges and opportunities with big data. Proceedings of the VLDB Endowment 5 (12), 20322033. Available at:http://dl.acm.org/citation.cfm?id=2367572%5Cnhttp://dl.acm.org/citation.cfm?doid=2367502.2367572.
Landaeta, R. E. 2008 Evaluating benefits and challenges of knowledge transfer across projects. Engineering Management Journal 20 (1), 2938. Available at: http://0-search.ebscohost.com.library.vu.edu.au/login.aspx?direct=true&db=bth&AN=32526091&site=bsi-live.
Lavagnon, A. I. 2009 Project success as a topic in project management journals. Project Management Journal 40 (4), 619.
Matsubara, Y., Sakurai, Y., Prakash, B. A., Li, L. & Faloutsos, C. 2012 Rise and fall patterns of information diffusion: model and implications. In The 18th ACM SIGKDD International Conference, pp. 614. Available at: http://dl.acm.org/citation.cfm?doid=2339530.2339537.
May, R. M. & Lloyd, A. L. 2001 Infection dynamics on scale-free networks. Physical Review E 64, 6611266114. Available at: http://link.aps.org/abstract/PRE/v64/e066112.
McAlpine, H., Hicks, B. J. & Culley, S. J. 2009 Comparing the information content of formal and informal design documents: lessons for more complete design records. In ICED09: International Conference on Engineering Design. The Design Society.
Munson, S. A., Kervin, K. & Robert, L. P. 2014 Monitoring email to indicate project team performance and mutual attraction. In Proceedings of the 17th ACM Conference on Computer Supported Cooperative Work & Social Computing – CSCW ’14, pp. 542549. Available at: http://dl.acm.org/citation.cfm?id=2531602.2531628.
Myers, S. A., Zhu, C. & Leskovec, J. 2012 Information diffusion and external influence in networks. In KDD 2012, Beijing, China, p. 33. Available at: http://dl.acm.org/citation.cfm?doid=2339530.2339540%5Cnhttp://www.scopus.com/inward/record.url?eid=2-s2.0-84866021278&partnerID=tZOtx3y1.
O’Kane, P., Palmer, M. & Hargie, O. 2007 Workplace interactions and the polymorphic role of e-mail. Leadership & Organization Development Journal 28 (4), 308324.
Pahl, G. & Beitz, W. 1984 Engineering Design: A Systematic Approach. Springer.
Pang, B. & Lee, L. 2008 Opinion mining and sentiment analysis. Foundations and Trends® in Information Retrieval 2 (1–2), 1135. Available at: http://www.nowpublishers.com/article/Details/INR-001.
Parraguez, P., Eppinger, S. D. & Maier, A. M. 2015 Information flow through stages of complex engineering design projects: a dynamic network analysis approach. IEEE Transactions on Engineering Management 62 (4), 604617.
Pastor-Satorras, R. & Vespignani, A. 2001 Epidemic spreading in scale-free networks. Physical Review Letters 86 (14), 32003203.
Patrashkova-Volzdoska, R. R. et al. 2003 Examining a curvilinear relationship between communication frequency and team performance in cross-functional project teams. IEEE Transactions on Engineering Management 50 (3), 262269.
Pinto, J. K. & Slevin, D. P. 1987 Critical factors in successful project implementation. IEEE Transactions on Engineering Management EM‐34 (1), 2227.
Pugh, S. 1990 Total Design: Integrated Methods for Successful Product Engineering. Prentice Hall.
Robertson, S. 2004 Understanding inverse document frequency: on theoretical arguments for IDF. Journal of Documentation 60 (5), 503520.
Robinson, M. A. 2010 An empirical analysis of engineers’ information behaviours. Journal of the American Society for Information Science and Technology 61 (4), 640658.
Robinson, M. A. 2012 How design engineers spend their time: job content and task satisfaction. Design Studies 33 (4), 391425. Available at: doi:10.1016/j.destud.2012.03.002.
Rodan, S. & Galunic, C. 2004 More than network structure: how knowledge heterogeneity influences managerial performance and innovativeness. Strategic Management Journal 25 (6), 541562.
Romero, D. M., Meeder, B. & Kleinberg, J. 2011 Differences in the mechanics of information diffusion across topics: idioms, political hashtags, and complex contagion on twitter. In Proceedings of the 20th International Conference on World Wide Web, pp. 695704. Available at: http://dl.acm.org/citation.cfm?id=1963503.
Schmidt, R., Lyytinen, K., Keil, M. & Cule, P. 2001 Identifying software project risks: an international Delphi study. Journal of Management Information Systems 17 (4), 536.
Škec, S., Cash, P. & Štorga, M. 2017 A dynamic approach to real-time performance measurement in design projects. Journal of Engineering Design 4828 (March), 132. Available at: https://www.tandfonline.com/doi/full/10.1080/09544828.2017.1303665.
Snider, C., Škec, S., Gopsill, J. & Hicks, B. 2016 Determining work focus, common language, and issues in engineering projects through topic persistence. In DESIGN 2016: International Conference on Engineering Design. The Design Society.
Snider, C., Gopsill, J., Jones, S., Shi, L. & Hicks, B. 2015 Understanding engineering projects: an integrated vehicle health management approach to engineering project monitoring. In ICED15: International Conference on Engineering Design. The Design Society.
Snider, C., McAlpine, H., Gopsill, J., Jones, S., Shi, L. & Hicks, B. 2015 It’s not personal: can logbooks provide insights into engineering projects? In ICED’15: International Conference on Engineering Design. The Design Society.
Spärck Jones, K. 1972 A statistical interpretation of term specificity and its retrieval. Journal of Documentation 28 (1), 1121. Available at: http://www.emeraldinsight.com/doi/abs/10.1108/eb026526.
Tang, J., Musolesi, M., Mascolo, C., Latora, V. & Nicosia, V. 2010 Analysing information flows and key mediators through temporal centrality metrics categories and subject descriptors. In Proceedings of the 3rd Workshop on Social Network Systems, ACM New York.
Thelwall, M., Buckley, K., Paltoglou, G. & Cai, D. 2010 Sentiment strength detection in short informal text. The American Society for Informational Science and Technology 61 (12), 25442558. Available at: http://www.scit.wlv.ac.uk/∼cm1993/papers/SentiStrengthPreprint.pdf.
Toor, S.-R. & Ogunlana, S. O. 2010 Beyond the ‘iron triangle’: Stakeholder perception of key performance indicators (KPIs) for large-scale public sector development projects. International Journal of Project Management 28 (3), 228236.
Uflacker, M. & Zeier, A. 2011 A semantic network approach to analyzing virtual team interactions in the early stages of conceptual design. Future Generation Computer Systems 27 (1), 8899. Available at: doi:10.1016/j.future.2010.05.006.
Wallace, K. M. & Ahmed, S. 2003 How engineering designers obtain information. In Human Behaviour in Design. Individuals, Teams, Tools (ed. Lindemann, U.), pp. 184194. Springer.
Wang, T., Rao, J. & Hu, Q. 2014 Supervised word sense disambiguation using semantic diffusion kernel. Engineering Applications of Artificial Intelligence 27, 167174.
Wasiak, J., Hicks, B. J., Newnes, L., Dong, A. & Burrow, L. 2010 Understanding engineering email: the development of a taxonomy for identifying and classifying engineering work. Research in Engineering Design 21 (1), 4364.
Wasiak, J., Hicks, B., Newnes, L., Loftus, C., Dong, A. & Burrow, L. 2011 Managing by e-mail: what e-mail can do for engineering project management. IEEE Transactions on Engineering Management 58 (3), 445456.
Watson, J.2012 Joseph Black Lecture, Design Exhibition, available at https://wiki.bath.ac.uk/display/MechEngDesignExhibition/Home. University of Bath.
Wu, F. et al. 2004 Information flow in social groups. Physica A (1), 327335. Available at: http://www.hpl.hp.com/research/idl/papers/flow/flow.pdf.
Xia, W. & Lee, G. 2004 Grasping the complexity of IS development projects. Communications of the ACM 47, 6874.
Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

Design Science
  • ISSN: -
  • EISSN: 2053-4701
  • URL: /core/journals/design-science
Please enter your name
Please enter a valid email address
Who would you like to send this to? *
×

Keywords

Metrics

Full text views

Total number of HTML views: 23
Total number of PDF views: 148 *
Loading metrics...

Abstract views

Total abstract views: 302 *
Loading metrics...

* Views captured on Cambridge Core between 9th November 2017 - 17th July 2018. This data will be updated every 24 hours.