Skip to main content

Digital Musical Interactions: Performer–system relationships and their perception by spectators

  • Michael Gurevich (a1) and A. Cavan Fyans (a1)

This article adopts an ecological view of digital musical interactions, considering first the relationship between performers and digital systems, and then spectators’ perception of these interactions. We provide evidence that the relationships between performers and digital music systems are not necessarily instrumental in the same was as they are with acoustic systems, and nor should they always strive to be. Furthermore, we report results of a study indicating that spectators may not perceive such interactions in the same way as performances with acoustic musical instruments. We present implications for the design of digital musical interactions, suggesting that designers should embrace the reality that digital systems are malleable and dynamic, and may engage performers and spectators in different modalities, sometimes simultaneously.

Corresponding author
E-mail: *;
Hide All
Bellotti, V., Back, M., Edwards, W.K., Grinter, R.E., Henderson, A., Lopes, C. 2002. Making Sense of Sensing Systems: Five Questions for Designers and Researchers. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. New York: ACM Press, 415422.
Blackwell, A., Collins, N. 2005. The Programming Language as a Musical Instrument. In P. Romero, J. Good, E. Acosta Chaparro and S. Bryant (eds.) Proceedings of the 17th Workshop of tohe Psychology of Programming Interest Group, Sussex University: 120–30.
Broughton, M., Stevens, C. 2009. Music, Movement and Marimba: An Investigation of the Role of Movement and Gesture in Communicating Musical Expression to an Audience. Psychology of Music 37(2): 137153.
Cadoz, C. 1994. Le geste canal de communication homme/machine: La communication ‘instrumentale’. Technique et Science Informatiques 13(1): 3161.
Cadoz, C. 2009. Supra-Instrumental Interactions and Gestures. Journal of New Music Research 38(3): 215230.
Cadoz, C., Wanderley, M.M. 2000. Gesture-Music. In M.M. Wanderley and M. Battier (eds.) Trends in Gestural Control of Music. Paris: IRCAM – Centre Pompidou.
Cascone, K. 2002. Laptop Music – Counterfeiting Aura in the Age of Infinite Reproduction. Parachute 107: 5260.
Cascone, K. 2003. Grain, Sequence, System: Three Levels of Reception in the Performance of Laptop Music. Contemporary Music Review 22(4): 101104.
Chambers, I. 1994. The Aural Walk. In C. Cox and D. Warner (eds.) Audio Culture: Readings on Modern Music. New York: Continuum, 2004.
Clarke, E.F. 1989. The Perception of Expressive Timing in Music. Psychological Research 51(1): 29.
Clarke, E.F. 2005. Ways of Listening: An Ecological Approach to the Perception of Musical Meaning. Oxford: Oxford University Press.
Cohen, A.J. 2005. Music Cognition: Defining Constraints on Musical Communication. In D. Miell, R.A.R. MacDonald and D.J. Hargreaves (eds.) Musical Communication. Oxford: Oxford University Press.
Collins, N. 2003. Generative Music and Laptop Performance. Contemporary Music Review 22(4): 6779.
Collins, N., McLean, A., Rohrhuber, J., Ward, A. 2003. Live Coding in Laptop Performance. Organised Sound 8(3): 321330.
Cross, I. 2005. Music and Meaning, Ambiguity and Evolution. In D. Miell, R.A.R. MacDonald and D.J. Hargreaves (eds.) Musical Communication. Oxford: Oxford University Press.
Dahl, S., Friberg, A. 2007. Visual Perception of Expressiveness in Musicians’ Body Movements. Music Perception 24(5): 433454.
Davidson, J.W. 1993. Visual Perception of Performance Manner in the Movements of Solo Musicians. Psychology of Music 21(2): 103113.
DeNora, T. 2000. Music in Everyday Life. Cambridge: Cambridge University Press.
Djajadiningrat, T., Matthews, B., Stienstra, M. 2007. Easy Doesn't Do It: Skill and Expression in Tangible Aesthetics. Personal and Ubiquitous Computing 11(8): 657676.
Dobrian, C., Koppelman, D. 2006. The ‘E’ in NIME: Musical Expression with New Computer Interfaces. Proceedings of the 2006 Conference on New Interfaces for Musical Expression. Paris: IRCAM – Centre Pompidou, 277282.
Fiebrink, R., Wang, G., Cook, P.R. 2007. Don't Forget the Laptop: Using Native Input Capabilities for Expressive Musical Control. Proceedings of the 2007 Conference on New Interfaces for Musical Expression. New York: ACM Press, 164167.
Fyans, A.C., Gurevich, M., Stapleton, P. 2010. Examining the Spectator Experience. Proceedings of the 2010 Conference on New Interfaces for Musical Expression. Sydney, Australia: 451–4.
Gabrielsson, A. 1988. Timing in Music Performance and its Relations to Music Experience. In J.A. Sloboda (ed.) Generative Processes in Music. Oxford: Clarendon Press.
Gabrielsson, A., Juslin, P.N. 1996. Emotional Expression in Music Performance: Between the Performer's Intention and the Listener's Experience. Psychology of Music 24(1): 6891.
Glaser, B.G., Strauss, A.L. 1967. The Discovery of Grounded Theory: Strategies for Qualitative Research. London: Weidenfeld & Nicolson.
Godøy, R.I., Leman, M. (eds.) 2010. Musical Gestures: Sound, Movement, and Meaning. New York: Routledge.
Gritten, A., King, E. 2006. Music and Gesture. Aldershot: Ashgate.
Gurevich, M., Treviño, J. 2007. Expression and its Discontents: Toward an Ecology of Musical Creation. Proceedings of the 7th International Conference on New Interfaces for Musical Expression. New York: ACM Press, 106111.
Hatten, R.S. 2004. Interpreting Musical Gestures, Topics, and Tropes: Mozart, Beethoven, Schubert. Bloomington and Indianapolis: Indiana University Press.
Hornof, A., Sato, L. 2004. EyeMusic: Making Music with the Eyes. Proceedings of the 2004 Conference on New Interfaces for Musical Expression, Hamamatsu, Japan: 3–5.
Hunt, A., Kirk, R. 2000. Mapping Strategies for Musical Performance. In M.M. Wanderley and M. Battier (eds.) Trends in Gestural Control of Music. Paris: IRCAM – Centre Pompidou.
Ingold, T. 2000. The Perception of the Environment: Essays on Livelihood, Dwelling and Skill. London: Routledge.
Jensen, M.V., Buur, J., Djajadiningrat, T. 2005. Designing the User Actions in Tangible Interaction. Proceedings of the 4th Decennial Conference on Critical Computing: Between Sense and Sensibility. New York: ACM Press, 918.
Johansson, G. 1973. Visual Perception of Biological Motion and a Model for its Analysis. Perception & Psychophysics 14(2): 201211.
Johnston, A., Candy, L., Edmonds, E. 2008. Designing and Evaluating Virtual Musical Instruments: Facilitating Conversational User Interaction. Design Studies 29(6): 556571.
Juslin, P.N. 1997. Emotional Communication in Music Performance: A Functionalist Perspective and Some Data. Music Perception 14(4): 383418.
Knapp, R.B., Lusted, H.S. 1990. A Bioelectric Controller for Computer Music Applications. Computer Music Journal 14(1): 4247.
Leach, E.R. 1976. Culture and Communication: The Logic by Which Symbols are Connected. Cambridge: Cambridge University Press.
Lewis, G.E. 2000. Too Many Notes: Computers, Complexity and Culture in Voyager. Leonardo Music Journal 10: 3339.
Miller, P.D. 2004. Rhythm Science. Cambridge, MA: The MIT Press.
Miranda, E.R., Brouse, A. 2005. Interfacing the Brain Directly with Musical Systems: On Developing Systems for Making Music with Brain Signals. Leonardo 38(4): 331336.
Miranda, E.R., Wanderley, M.M. 2006. New Digital Musical Instruments: Control and Interaction Beyond the Keyboard. Middleton, WI: A-R Editions.
Nakamura, T. 1987. The Communication of Dynamics Between Musicians and Listeners Through Musical Performance. Perception & Psychophysics 41(6): 525533.
Norman, D.A. 1993. Things That Make Us Smart: Defending Human Attributes in the Age of the Machine. Cambridge, MA: Perseus Books.
Norman, D.A. 1998. The Invisible Computer: Why Good Products Can Fail, the Personal Computer is so Complex, and Information Appliances are the Solution. Cambridge, MA: The MIT Press.
Nusseck, M., Wanderley, M.M. 2009. Music and Motion-How Music-Related Ancillary Body Movements Contribute to the Experience of Music. Music Perception 26(4): 335353.
Pachet, F. 2003. The Continuator: Musical Interaction with Style. Journal of New Music Research 32(3): 333341.
Poepel, C. 2005. On Interface Expressivity: A Player-Based Study. Proceedings of the 2005 Conference on New Interfaces for Musical Expression, Vancouver, Canada: 228–31.
Pressing, J. 1990. Cybernetic Issues in Interactive Performance Systems. Computer Music Journal 14(1): 1225.
Reason, J. 1990. Human Error. Cambridge: Cambridge University Press.
Rodger, M. 2010. Musicians’ Body Movements in Musical Skill Acquisition. PhD thesis, Queen's University Belfast.
Rosenbaum, D.A., Carlson, R.A., Gilmore, R.O. 2001. Acquisition of Intellectual and Perceptual-Motor Skills. Annual Review of Psychology 52(1): 453470.
Schloss, W.A. 2003. Using Contemporary Technology in Live Performance: The Dilemma of the Performer. Journal of New Music Research 32(3): 239242.
Stuart, C. 2003. The Object of Performance: Aural Performativity in Contemporary Laptop Music. Contemporary Music Review 22(4): 5965.
Toop, D. 1995. Ocean of Sound: Aether Talk, Ambient Sound and Imaginary Worlds. London: Serpent's Tail.
Truax, B. 1994. The Inner and Outer Complexity of Music. Perspectives of New Music 32(1): 176193.
Ueno, K., Kato, K., Kawai, K. 2010. Effect of Room Acoustics on Musicians’ Performance. Part I: Experimental Investigation with a Conceptual Model. Acta Acustica united with Acustica 96(3): 505515.
Vines, B.W., Krumhansl, C.L., Wanderley, M.M., Levitin, D.J. 2006. Cross-Modal Interactions in the Perception of Musical Performance. Cognition 101(1): 80113.
Wanderley, M.M., Depalle, P. 2004. Gestural Control of Sound Synthesis. Proceedings of the IEEE 92(4): 632644.
Wanderley, M.M., Vines, B.W., Middleton, N., McKay, C., Hatch, W. 2005. The Musical Significance of Clarinetists … Ancillary Gestures: An Exploration of the Field. Journal of New Music Research 34(1): 97113.
Wang, G., Cook, P.R. 2004. On-The-Fly Programming: Using Code as an Expressive Musical Instrument. Proceedings of the 2004 Conference on New Interfaces for Musical Expression, Hamamatsu, Japan, 138–43.
Wang, G., Essl, G., Penttinen, H. 2008. Do Mobile Phones Dream of Electric Orchestras? Proceedings of the 2008 International Computer Music Conference. Belfast/San Francisco: ICMA.
Weinberg, G., Driscoll, S. 2006. Toward Robotic Musicianship. Computer Music Journal 30(4): 2845.
Wessel, D., Wright, M. 2002. Problems and Prospects for Intimate Musical Control of Computers. Computer Music Journal 26(3): 1122.
Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

Organised Sound
  • ISSN: 1355-7718
  • EISSN: 1469-8153
  • URL: /core/journals/organised-sound
Please enter your name
Please enter a valid email address
Who would you like to send this to? *


Full text views

Total number of HTML views: 10
Total number of PDF views: 126 *
Loading metrics...

Abstract views

Total abstract views: 358 *
Loading metrics...

* Views captured on Cambridge Core between September 2016 - 17th March 2018. This data will be updated every 24 hours.