Hostname: page-component-848d4c4894-2pzkn Total loading time: 0 Render date: 2024-06-13T09:35:23.784Z Has data issue: false hasContentIssue false
  • English
  • Français

A proposed framework for data-driven human factors evaluation

Published online by Cambridge University Press:  16 May 2024

Isabelle Ormerod ,
Henrikke Dybvik ,
Mike Fraser  and
Chris Snider
Isabelle Ormerod*
Affiliation:
University of Bristol, United Kingdom
Henrikke Dybvik
Affiliation:
University of Bristol, United Kingdom
Mike Fraser
Affiliation:
University of Bristol, United Kingdom
Chris Snider
Affiliation:
University of Bristol, United Kingdom
*
isabelle.ormerod@bristol.ac.uk

Abstract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the ‘Save PDF’ action button.

Human-centred approaches within the design cycle are crucial to enhance usability and inclusivity of products. However, the qualitative nature of traditional human factors evaluation can create bottle necks, prompting the need for more data driven methods. A framework for data-driven human factors is presented, looking to integrate mixed-method approaches. Case studies illustrate its usage in real-world scenarios and challenges are summarised, calling for robust data collection methods, balancing of mixed methods, a need for explainable systems, and interdisciplinary expertise.

Keywords

human-centred designinclusive designdata-driven design
Type
Design Theory and Research Methods
Information
Proceedings of the Design Society , Volume 4: DESIGN 2024 , May 2024 , pp. 85 - 94
Creative Commons
Creative Common License - CCCreative Common License - BYCreative Common License - NCCreative Common License - ND
This is an Open Access article, distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivatives licence (http://creativecommons.org/licenses/by-nc-nd/4.0/), which permits non-commercial re-use, distribution, and reproduction in any medium, provided the original work is unaltered and is properly cited. The written permission of Cambridge University Press must be obtained for commercial re-use or in order to create a derivative work.
Copyright
The Author(s), 2024.

References

Abowitz, D., Toole, T., 2010. Mixed Method Research: Fundamental Issues of Design, Validity, and Reliability in Construction Research. Journal of Construction Engineering and Management 136. https://doi.org/10.1061/(ASCE)CO.1943-7862.0000026CrossRefGoogle Scholar
Blanchonette, P., 2010. Jack Human Modelling Tool: A Review.Google Scholar
Caggiano, V., Wang, H., Durandau, G., Sartori, M., Kumar, V., 2022. MyoSuite – A contact-rich simulation suite for musculoskeletal motor control. https://doi.org/10.48550/arXiv.2205.13600CrossRefGoogle Scholar
Caine, M., Blair, K., Vasquez, M., 2012. Materials and technology in sport. Nature Mater 11, 655–658. https://doi.org/10.1038/nmat3382CrossRefGoogle ScholarPubMed
Chen, V., Liao, Q.V., Wortman Vaughan, J., Bansal, G., 2023. Understanding the Role of Human Intuition on Reliance in Human-AI Decision-Making with Explanations. Proc. ACM Hum.-Comput. Interact. 7, 1–32. https://doi.org/10.1145/3610219Google Scholar
Conati, C., Carenini, G., Toker, D., Lallé, S., 2015. Towards user-adaptive information visualization, in: Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence, AAAI’15. AAAI Press, Austin, Texas, pp. 4100–4106.CrossRefGoogle Scholar
Cox, C., Hicks, B., Gopsill, J., 2022. Improving Mixed-Reality Prototyping through a Classification and Characterisation of Fidelity. Proc. Des. Soc. 2, 353–362. https://doi.org/10.1017/pds.2022.37CrossRefGoogle Scholar
Demirel, H.O., Goldstein, M.H., Li, X., Sha, Z., 2023. Human-Centered Generative Design Framework: An Early Design Framework to Support Concept Creation and Evaluation. International Journal of Human–Computer Interaction 1–12. https://doi.org/10.1080/10447318.2023.2171489CrossRefGoogle Scholar
Dybvik, H., Erichsen, C., Steinert, M., 2021. Demonstrating the feasibility of multimodal neuroimaging data capture with wearable Electroencephalography + Functional Near-Infrared Spectroscopy (EEG+FNIRS) in situ. Proceedings of the Design Society 1, 901–910. https://doi.org/10.1017/pds.2021.90CrossRefGoogle Scholar
Eikevåg, S.W., Grondahl, H., Sletten, H., Silseth, H., Steinert, M., 2022. Analysis of Kinetic and kinematic data from instrumented outrigger-skis of an elite Paralympic alpine skier: a pilot study, The Engineering of Sport. Perdue University. https://doi.org/10.5703/1288284317541CrossRefGoogle Scholar
Fletcher, H., 2023. The principles of inclusive design: they include you.Google Scholar
Giacomin, J., 2015. What Is Human Centred Design? The Design Journal. https://doi.org/10.2752/175630614X14056185480186CrossRefGoogle Scholar
HSE, 2023. Workstation assessments - Display screen equipment.Google Scholar
HSE, 2013. Workplace health, safety and welfare, L 24.Google Scholar
HSE, 2007. Reducing error and influencing behaviour, HSG. HSE Books, Sudbury.Google Scholar
Imam, W., 2023. How to consider human factors in medical device design [WWW Document]. URL https://advisera.com/13485academy/blog/2017/09/28/considering-human-factors-in-medical-device-design/ (accessed 11.3.23).Google Scholar
Jarecki, J.B., Tan, J.H., Jenny, M.A., 2020. A framework for building cognitive process models. Psychon Bull Rev 27, 1218–1229. https://doi.org/10.3758/s13423-020-01747-2CrossRefGoogle ScholarPubMed
Joshi, M., Deshpande, V., 2019. A systematic review of comparative studies on ergonomic assessment techniques. International Journal of Industrial Ergonomics 74, 102865. https://doi.org/10.1016/j.ergon.2019.102865CrossRefGoogle Scholar
Kanis, H., 1998. Usage centred research for everyday product design. Applied Ergonomics 29, 75–82. https://doi.org/10.1016/S0003-6870(97)00028-8CrossRefGoogle ScholarPubMed
Kent, L., Snider, C., Gopsill, J., Hicks, B., 2021. Mixed reality in design prototyping: A systematic review. Design Studies 77, 101046. https://doi.org/10.1016/j.destud.2021.101046CrossRefGoogle Scholar
Knott, D., 2001. The Place of TRIZ in a Holistic Design Methodology. Creativity and Innovation Management 10, 126–133. https://doi.org/10.1111/1467-8691.00213CrossRefGoogle Scholar
Lee, M.-H., Fazli, S., Mehnert, J., Lee, S.-W., 2015. Subject-dependent classification for robust idle state detection using multi-modal neuroimaging and data-fusion techniques in BCI. Pattern Recognition 48, 2725–2737. https://doi.org/10.1016/j.patcog.2015.03.010CrossRefGoogle Scholar
Maher, M.L., Poon, J., 1996. Modelling Design Exploration as Co-Evolution. https://doi.org/10.1111/j.1467-8667.1996.tb00323.xCrossRefGoogle Scholar
Mcintosh, J., 2016. Exploring the practicality of wearable gesture recognition. University of Bristol.Google Scholar
Mimosa, , 2023. Mimosa OSA-CBM [WWW Document]. URL https://www.mimosa.org/mimosa-osa-cbm/ (accessed 10.27.23).Google Scholar
Reason, J., 1990. Human Error. Cambridge University Press. https://doi.org/10.1017/CBO9781139062367CrossRefGoogle Scholar
Scherer, C., Rose, C., 2023. 6 Indispensable Tools To Drive Effective User-Centered Design [WWW Document]. Med Device Online. URL https://www.meddeviceonline.com/doc/indispensable-tools-to-drive-effective-user-centered-design-0001 (accessed 11.17.23).Google Scholar
Silseth, H., Sletten, H.S., Grøndahl, H., Eikevåg, S.W., Steinert, M., 2021. Design of Experiment for Sports Equipment - Experimentally mapping the design space for Paralympic Alpine Outriggers. https://doi.org/10.1017/pds.2021.107CrossRefGoogle Scholar
Sims, S.D., Conati, C., 2020. A Neural Architecture for Detecting User Confusion in Eye-tracking Data, in: Proceedings of the 2020 International Conference on Multimodal Interaction. Presented at the ICMI 20 : International Conference on Multimodal Interaction, ACM, Virtual Event Netherlands, pp. 15–23. https://doi.org/10.1145/3382507.3418828CrossRefGoogle Scholar
Sletten, H.S., Eikevag, S.W., Silseth, H., Grondahl, H., Steinert, M., 2021. Force Orientation Measurement: Evaluating Ski Sport Dynamics. IEEE Sensors Journal. https://doi.org/10.1109/JSEN.2021.3124021CrossRefGoogle Scholar
Steen, M., 2011. Tensions in human-centred design. CoDesign 7, 45–60. https://doi.org/10.1080/15710882.2011.563314CrossRefGoogle Scholar
Steichen, B., Carenini, G., Conati, C., 2013. User-adaptive information visualization: using eye gaze data to infer visualization tasks and user cognitive abilities, in: Proceedings of the 2013 International Conference on Intelligent User Interfaces. ACM, pp. 317–328. https://doi.org/10.1145/2449396.2449439CrossRefGoogle Scholar
Steinert, M., Jablokow, K., 2013. Triangulating front end engineering design activities with physiology data and psychological preferences: 19th International Conference on Engineering Design, ICED 2013. Proceedings of the 19th International Conference on Engineering Design 7 DS75-07, 109–118.Google Scholar
Thales Group, 2023. Human factors design [WWW Document]. Thales Group. URL https://www.thalesgroup.com/en/human-factors-design (accessed 11.16.23).Google Scholar
University of Cambridge, 2023. Inclusive Design Toolkit [WWW Document]. URL https://www.inclusivedesigntoolkit.com/usercapabilities/usercap.html (accessed 11.9.23).Google Scholar
Valdez, S., Seepersad, C., Kambampati, S., 2021. A Framework for Interactive Structural Design Exploration. Presented at the ASME 2021 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, American Society of Mechanical Engineers Digital Collection. https://doi.org/10.1115/DETC2021-71775CrossRefGoogle Scholar
Whitefield, A., Wilson, F., Dowell, J., 1991. A framework for human factors evaluation. Behaviour & Information Technology 10, 65–79. https://doi.org/10.1080/01449299108924272CrossRefGoogle Scholar
Wickens, C.D., Gordon, S.E., Liu, Y., 2002. An introduction to human factors engineering: Christopher D. Wickens; Sallie E. Gordon; Yili Liu, Nachdr. ed. Addison Wesley Longman, New York.Google Scholar
Wolf, A., Miehling, J., Wartzack, S., 2020. Challenges in interaction modelling with digital human models – A systematic literature review of interaction modelling approaches. Ergonomics 63. https://doi.org/10.1080/00140139.2020.1786606CrossRefGoogle ScholarPubMed