Skip to main content

Designing for social experiences with and within autonomous vehicles – exploring methodological directions

  • Helena Strömberg (a1), Ingrid Pettersson (a1) (a2), Jonas Andersson (a3), Annie Rydström (a2), Debargha Dey (a4), Maria Klingegård (a3) and Jodi Forlizzi (a5)...

The introduction of autonomous vehicles (autonomous vehicles) will reshape the many social interactions that are part of traffic today. In order for autonomous vehicles to become successfully integrated, the social interactions surrounding them need to be purposefully designed. To ensure success and save development efforts, design methods that explore social aspects in early design phases are needed to provide conceptual directions before committing to concrete solutions. This paper contributes an exploration of methods for addressing the social aspects of autonomous vehicles in three key areas: the vehicle as a social entity in traffic, co-experience within the vehicle and the user–vehicle relationship. The methods explored include Wizard of Oz, small-scale scenarios, design metaphors, enactment and peer-to-peer interviews. These were applied in a workshop setting with 18 participants from academia and industry. The methods provided interesting design seeds, however with differing effectiveness. The most promising methods enabled flexible idea exploration, but in a contextualized and concrete manner through tangible objects and enactment to stage future use situations. Further, combinations of methods that enable a shift between social perspectives were preferred. Wizard of Oz and small-scale scenarios were found fruitful as collaboration basis for multidisciplinary teams, by establishing a united understanding of the problem at hand.

  • View HTML
    • Send article to Kindle

      To send this article to your Kindle, first ensure is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about sending to your Kindle. Find out more about sending to your Kindle.

      Note you can select to send to either the or variations. ‘’ emails are free but can only be sent to your device when it is connected to wi-fi. ‘’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

      Find out more about the Kindle Personal Document Service.

      Designing for social experiences with and within autonomous vehicles – exploring methodological directions
      Available formats
      Send article to Dropbox

      To send this article to your Dropbox account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Dropbox.

      Designing for social experiences with and within autonomous vehicles – exploring methodological directions
      Available formats
      Send article to Google Drive

      To send this article to your Google Drive account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Google Drive.

      Designing for social experiences with and within autonomous vehicles – exploring methodological directions
      Available formats
Distributed as Open Access under a CC-BY-NC-ND 4.0 license (
Corresponding author
Email address for correspondence:
Hide All
Arvola, M. & Artman, H. 2007 Enactments in interaction design: how designers make sketches behave. Artifact 1 (2), 106119.
Baltodano, S., Sibi, S., Martelaro, N., Gowda, N. & Ju, W. 2015 The RRADS platform: a real road autonomous driving simulator. In Automotive UI15: Proceedings of the 7th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. ACM. doi:10.1145/2799250.2799288.
Banks, V. A. & Stanton, N. A. 2016 Keep the driver in control: Automating automobiles of the future. Applied Ergonomics 53 (Part B), 389395.
Battarbee, K. & Koskinen, I. 2005 Co-experience: user experience as interaction. CoDesign 1 (1), 518.
Beggiato, M., Witzlack, C. & Krems, J. F. 2017 Gap Acceptance and Time-To-Arrival Estimates as Basis for Informal Communication between Pedestrians and Vehicles. In Automotive UI17 Proceedings of the 9th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, pp. 5057. ACM. doi:10.1145/3122986.3122995.
Beller, J., Heesen, M. & Vollrath, M. 2013 Improving the driver – automation interaction: An approach using automation uncertainty. Human factors: The Journal of the Human Factors and Ergonomics Society 55 (6), 11301141.
Brandt, E. & Grunnet, C. 2000 Evoking the future: Drama and props in user centered design. In PDC 2000 Proceedings of Participatory Design Conference, New York, NY, USA. CPSR.
Broberg, O., Andersen, V. & Seim, R. 2011 Participatory ergonomics in design processes: the role of boundary objects. Applied Ergonomics 42 (3), 464472.
Brown, B. & Laurier, E. 2017 The trouble with autopilots: assisted and autonomous driving on the social road. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, pp. 416429. ACM. doi:10.1145/3025453.3025462.
Bruemmer, D. J., Gertman, D. I. & Nielsen, C. W. 2007 Metaphors to drive by: exploring new ways to guide human-robot interaction. Open Cybernetics and Systemics Journal 1, 512.
Buchenau, M. & Fulton-Suri, J. 2000 Experience prototyping. In Proceedings of the 3rd Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques, pp. 424433. ACM.
Burns, C., Dishman, E., Verplank, W. & Lassiter, B. 1994 Actors, hairdos and videotape informance design. In Conference Companion on Human Factors in Computing Systems, pp. 119120. ACM.
Charisi, V., Habibovic, A., Andersson, J., Li, J. & Evers, V. 2017 Children’s views on identification and intention communication of self-driving vehicles. In Proceedings of the 2017 Conference on Interaction Design and Children, pp. 399404. ACM.
Cila, N.2013 Metaphors we design by: The use of metaphors in product design. Doctoral Thesis, Delft University of Technology.
Davidoff, S., Lee, M. K., Dey, A. K. & Zimmerman, J. 2007 Rapidly exploring application design through speed dating. In International Conference on Ubiquitous Computing, pp. 429446. Springer.
Davidsson, S. & Alm, H. 2009 Applying the team player approach on car design. In Proceedings of Engineering Psychology and Cognitive Ergonomics: 8th International Conference, EPCE 2009, San Diego, CA, USA, July 19–24, 2009, pp. 349357. Springer.
Davila, A. & Nombela, M. 2012 Platooning – safe and eco-friendly mobility. In SAE 2012 World Congress and Exibition. Detroit, Michigan: SAE International.
Dorst, K. 2011 The core of design thinking and its application. Design studies 32 (6), 521532.
Dubberly, H., Evenson, S. & Robinson, R. 2008 The analysis-synthesis bridge model. Interactions 15 (2), 5761.
Eden, G., Nanchen, B., Ramseyer, R. & Evquoz, F. 2017 On the road with an autonomous passenger shuttle. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems – CHI EA17, pp. 15691576. ACM. doi:10.1145/3027063.3053126.
Fagnant, D. J. & Kockelman, K. M. 2014 The travel and environmental implications of shared autonomous vehicles, using agent-based model scenarios. Transportation Research Part C: Emerging Technologies 40, 113.
Fallman, D. 2008 The interaction design research triangle of design practice, design studies, and design exploration. Design Issues 24 (3), 418.
Flemisch, F., Adams, C., Conway, S., Goodrich, K., Palmer, M. & Schutte, P.2003 The H-metaphor as a guideline for vehicle automation and interaction. NASA Technical Report.
Flemisch, F., Heesen, M., Hesse, T., Kelsch, J., Schieben, A. & Beller, J. 2012 Towards a dynamic balance between humans and automation: authority, ability, responsibility and control in shared and cooperative control situations. Cognition, Technology Work 14 (1), 318.
Flemisch, F., Kelsch, J., Löper, C., Schieben, A., Schindler, J. & Heesen, M. 2008 Cooperative Control and Active Interfaces for Vehicle Assistance and Automation. FISITA World Automotive Congress, Munich.
Habibovic, A., Andersson, J., Nilsson, M., Malmsten Lundgren, V. & Nilsson, J. 2016 Evaluating interactions with non-existing automated vehicles: three wizard of Oz approaches. In Workshop on Human Factors in Intelligent Vehicles (HFIV16), Workshop in Conjunction with Intelligent Vehicles Symposium (IV16), IEEE.
Haeuslschmid, R., Pfleging, B. & Alt, F. 2016 A design space to support the development of windshield applications for the car. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, 50765091. ACM. doi:10.1145/2858036.2858336.
Halse, J., Brandt, E., Clark, B. & Binder, T. 2010 Rehearsing the Future. Kbenhavn. The Danish Design School Press.
Hey, J., Linsey, J., Agogino, A. M. & Wood, K. L. 2008 Analogies and metaphors in creative design. International Journal of Engineering Education 24 (2), 283294.
Ive, H. P., Sirkin, D., Miller, D., Li, J. & Ju, W. 2015 Don’t make me turn this seat around! driver and passenger activities and positions in autonomous cars. In Adjunct Proceedings of the 7th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, ACM.
Jorlöv, S., Bohman, K. & Larsson, A. 2017 Seating positions and activities in highly automated cars. A qualitative study of future automated driving scenarios. In International Research Conference on the Biomechanics of Impact, IRCOBI.
Kun, A. L., Boll, S. & Schmidt, A. 2016 Shifting gears: user interfaces in the age of autonomous driving. IEEE Pervasive Computing 15 (1), 3238.
Lakoff, G. & Johnson, M. 2003 Metaphors We Live by New Afterword Edition. The University of Chicago Press, Chicago and London.
Landauer, T. K. 1987 Psychology as a mother of invention. In Proc. ACM CHI+GI87, pp. 333335.
Lim, K. H., Ward, L. M. & Benbasat, I. 1997 An empirical study of computer system learning: comparison of co-discovery and self-discovery methods. Information Systems Research 8 (3), 254272.
Liu, S., Li, L., Tang, J., Wu, S. & Gaudiot, J.-L. 2017 Creating autonomous vehicle systems. Synthesis Lectures on Computer Science 6 (1), doi:10.2200/S00787ED1V01Y201707CSL009.
Lee, J. D. & See, K. A. 2004 Trust in automation: designing for appropriate reliance. Human Factors 46 (1), 5080.
Lucero, A., Dalsgaard, P., Halskov, K. & Buur, J. 2016 Designing with cards. In Collaboration in Creative Design: Methods and Tools (ed. Markopoulos, P., Martens, J. B., Malins, J., Coninx, K. & Liapis, A.), pp. 7595. Springer.
Lundgren, V. M., Lagström, T., Habibovic, A., Andersson, J., Nilsson, M., Sirkka, A., Fagerlönn, J., Edgren, C., Fredriksson, R., Krupenia, S., Saluäär, D. & Larsson, P. 2016 Will there be a new communication need when introducing automated vehicles to the urban context? In Proceedings of the 4th International Conference on Human Factors in Transportation (AHFE2016), Springer.
Macaulay, C., Jacucci, G., O’Neill, S., Kankaineen, T. & Simpson, M. 2006 Editorial: The emerging roles of performance within HCI and interaction design. Interact. Comput. 18 (5), 942955.
Marshall, P., Antle, A., Van Den Hoven, E. & Rogers, Y. 2013 Introduction to the special issue on the theory and practice of embodied interaction in HCI and interaction design. ACM Trans. Comput.-Hum. Interact. 20 (1), doi:10.1145/2442106.2442107.
Mok, B., Sirkin, D., Sibi, S., Miller, D. B. & Ju, W. 2015 Understanding driver – automated vehicle interactions through wizard of oz design improvisation. In Proceedings of the Fourth Int. Driv. Symp. Hum. Factors Driv. Assessment, Training, Veh. Des. Public Policy Center, University of Iowa.
Nelson, H. G. & Stolterman, E. 2012 The design way: Intentional change in an unpredictable world: Foundations and fundamentals of design competence. In Educational Technology, 2nd edn .
Nyholm Andersen, S. & Broberg, O. 2015 Participatory ergonomics simulation of hospital work systems: the influence of simulation media on simulation outcome. Applied Ergonomics 51, 331342.
Odom, W., Zimmerman, J., Davidoff, S., Forlizzi, J., Dey, A. K. & Lee, M. K. 2012 A fieldwork of the future with user enactment. In Procedings of the Designing Interactive Systems Conference, Newcastle Upon Tyne, United Kingdom, ACM.
Österman, C., Berlin, C. & Bligård, L. 2016 Involving users in a ship bridge re-design process using scenarios and mock-up models. International Journal of Industrial Ergonomics 53, 236244.
Pettersson, I. & Ju, W. 2017 Design techniques for exploring automotive interaction in the drive towards automation. In Proceedings of the 2017 Conference on Designing Interactive Systems, pp. 147160. ACM.
Pettersson, I. & Karlsson, M. 2015 Setting the stage for self-driving cars: exploration of future autonomous driving experiences. IET Intelligent Transport Systems Journal 9 (7), 694701.
Pettersson, I., Rydström, A., Strömberg, H., Hylving, L., Andersson, J., Klingegård, M. & Karlsson, M. 2016 Living room on the move: autonomous vehicles and social experiences. In Proceedings of the 9th Nordic Conference on Human-Computer Interaction, Gothenburg, Sweden, ACM.
Rakotonirainy, A., Schroeter, R. & Soro, A. 2014 Three social car visions to improve driver behaviour. Pervasive and Mobile Computing 14, 147160.
Risto, M., Emmenegger, C., Vinkhuyzen, E., Cefkin, M. & Hollan, J. 2017 Human-vehicle interfaces: the power of vehicle movement gestures in human road user coordination. In Driving Assessment: The Ninth International Driving Symposium on Human Factors in Driver Assessment, Training and Vehicle Design. Manchester Village, Vermont, Public Policy Center, University of Iowa.
Rogers, E. 1995 Diffusion of Innovation, 4th edn The Free Press.
Rothenbücher, D., Li, J., Sirkin, D., Mok, B. & Ju, W. 2016 Ghost driver: A field study investigating the interaction between pedestrians and driverless vehicles. In 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), pp. 795802. IEEE.
Rupp, J. D. & King, A. G. 2010 Autonomous driving. A practical roadmap. SAE Technical Paper Series 2010-01-2335. SAE International.
Ruohomäki, V. 2003 Simulation gaming for organizational development. Simulation & Gaming 34 (4), 531549.
Rödel, C., Stadler, S., Meschtscherjakov, A. & Tscheligi, M. 2014 Towards autonomous cars: the effect of autonomy levels on acceptance and user experience. In Proceedings of the 6th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, Seattle, WA, USA, ACM.
Sanders, E., Brandt, E. & Binder, T. 2010 A framework for organizing the tools and techniques of participatory design. In Proceedings of the 11th Biennial Participatory Design Conference, ACM.
Sibi, S., Ayaz, H., Kuhns, D. P., Sirkin, D. M. & Ju, W. 2016 Monitoring driver cognitive load using functional near infrared spectroscopy in partially autonomous cars. In Intelligent Vehicles Symposium (IV), 2016, pp. 419425. IEEE.
Steinfeld, E. 2004 Modeling spatial interaction through full-scale modeling. International Journal of Industrial Ergonomics 33 (3), 265278.
Sucha, M. 2014 Road users strategies and communication: driver-pedestrian interaction. In Transport Research Arena 2014 Proceedings, Elsevier Transportation Research Procedia.
Verberne, F. M. F., Ham, J. & Midden, C. J. H. 2012 Trust in smart systems: sharing driving goals and giving information to increase trustworthiness and acceptability of smart systems in cars. Human Factors 54 (5), 799810.
Verganti, R. 2008 Design, meanings, and radical innovation: a metamodel and a research agenda. Journal of Product Innovation Management 25 (5), 436456.
Vinkhuyzen, E. & Cefkin, M. 2016 Developing socially acceptable autonomous vehicles. Ethnographic Praxis in Industry Conference Proceedings 2016 (1), 522534.
Watkins, N., Myers, D. & Villasante, R. 2008 Mock-ups as interactive laboratories: mixed methods research using inpatient unit room mock-ups. HERD: Health Environments Research and Design Journal 2 (1), 6681.
Wilde, D., Vallgårda, A. & Tomico, O. 2017 Embodied design ideation methods: analysing the power of estrangement. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, pp. 51585170. ACM.
Wilson, J. & Rosenberg, D. 1988 Rapid prototyping for user interface design. In Handbook of Human-Computer Interaction (ed. Helander, M.), pp. 859875. North-Holland, New York.
Wixon, D. 2003 Evaluating usability methods: why the current literature fails the practitioner. Interactions 10 (4), 2834.
Woods, D. D. & Christoffersen, K. 2002 Balancing practice-centered research and design. In Cognitive Systems Engineering in Military Aviation Domains, pp. 121136. Human Systems Information Analysis Center, Wright-Patterson AFB, OH.
Zimmerman, J. & Forlizzi, J. 2014 The rise of research through design in HCI. In Ways of Knowing in HCI (ed. Kellogg, W. & Olsen, J.), pp. 167189. Springer.
Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

Design Science
  • ISSN: -
  • EISSN: 2053-4701
  • URL: /core/journals/design-science
Please enter your name
Please enter a valid email address
Who would you like to send this to? *



Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed