Skip to main content

An Action–Sound Approach to Teaching Interactive Music

  • Alexander Refsum Jensenius (a1)

The conceptual starting point for an ‘action–sound approach’ to teaching music technology is the acknowledgment of the couplings that exist in acoustic instruments between sounding objects, sound-producing actions and the resultant sounds themselves. Digital music technologies, on the other hand, are not limited to such natural couplings, but allow for arbitrary new relationships to be created between objects, actions and sounds. The endless possibilities of such virtual action–sound relationships can be exciting and creatively inspiring, but they can also lead to frustration among performers and confusion for audiences. This paper presents the theoretical foundations for an action–sound approach to electronic instrument design and discusses the ways in which this approach has shaped the undergraduate course titled ‘Interactive Music’ at the University of Oslo. In this course, students start out by exploring various types of acoustic action–sound couplings before moving on to designing, building, performing and evaluating both analogue and digital electronic instruments from an action–sound perspective.

Hide All
Berthoz, A. 1997. Le sens du mouvement. Paris: Odile Jacob.
Cadoz, C. 1988. Instrumental Gesture and Musical Composition. In Proceedings of the International Computer Music Conference. The Hague: ICMC, pp. 6073.
Carello, C., Wagman, J.B., Turvey, M.T. 2005. Acoustic Specification of Object Properties. In J. Anderson and B. Anderson (eds.) Moving Image Theory: Ecological Considerations. Carbondale: Southern Illinois University Press, pp. 79104.
Collins, N. 2006. Handmade Electronic Music: The Art of Hardware Hacking. New York: Routledge.
Fiebrink, R., Wang, G., Cook, P.R. 2007. Don't Forget the Laptop: Using Native Input Capabilities for Expressive Musical Control. In Proceedings of the International Conference on New Interfaces for Musical Expression. New York: NIME, pp. 164167.
Gaver, W.W. 1993a. How Do We Hear in the World? An Ecological Approach to Auditory Event Perception. Ecological Psychology 5(4): 285313.
Gaver, W.W. 1993b. What in the World Do We Hear? An Ecological Approach to Auditory Event Perception. Ecological Psychology 5(1): 129.
Gibson, J.J. 1977. The Theory of Affordances. In R. Shaw and J. Bransford (eds.) Perceiving, Acting, and Knowing: Toward an Ecological Psychology. Hillsdale, NJ: Erlbaum, pp. 6782.
Gibson, J.J. 1979. The Ecological Approach to Visual Perception. New York: Houghton-Mifflin.
Giordano, B.L. 2005. Sound Source Perception in Impact Sounds. PhD dissertation, University of Padova.
Godøy, R.I. 2006. Gestural-Sonorous Objects: Embodied Extensions of Schaeffer's Conceptual Apparatus. Organised Sound 11(2): 149157.
Godøy, R.I., Jensenius, A.R., Nymoen, K. 2010. Chunking in Music by Coarticulation. Acta Acoustica united with Acoustica 96(4): 690700.
Hunt, A., Wanderley, M.M., Paradis, M. 2003. The Importance of Parameter Mapping in Electronic Instrument Design. Journal of New Music Research 32(4): 429440.
Husserl, E. 1991. On the Phenomenology of the Consciousness of Internal Time (1893–1917), Trans. John Barnett Brough. Dordrecht: Kluwer.
Jensenius, A.R. 2012. Motion-Sound Interaction using Sonification Based on Motiongrams. In Proceedings of the Fifth International Conference on Advances in Computer-Human Interactions, Valencia, pp. 170–5.
Jensenius, A.R., Wanderley, M.M., Godøy, R.I., Leman, M. 2010. Musical Gestures: Concepts and Methods in Research. In R.I. Godøy and M. Leman (eds.) Musical Gestures: Sound, Movement, and Meaning. New York: Routledge, pp. 1235.
Lakoff, G., Johnson, M. 1999. Philosophy in the Flesh: The Embodied Mind and its Challenge to Western Thought. New York: Basic Books.
Leman, M. 2008. Embodied Music Cognition and Mediation Technology. Cambridge, MA: The MIT Press.
McGurk, H., MacDonald, J. 1976. Hearing Lips and Seeing Voices. Nature 264: 746748.
Norman, D.A. 1990. The Design of Everyday Things. New York: Doubleday.
Rocchesso, D., Fontana, F. 2003. The Sounding Object. Florence: Edizioni di Mondo Estremo.
Schaeffer, P. 1966. Traité des objets musicaux. Paris: Éditions du Seuil.
Thelen, E. 1995. Time-Scale Dynamics in the Development of an Embodied Cognition. In R. Port and T. van Gelder (eds.) Mind as Motion: Explorations in the Dynamics of Cognition. Cambridge, MA: The MIT Press, pp. 69100.
Thelle, N.J.W. 2010. Making Sensors Make Sense: Challenges in the Development of Digital Musical Instruments. MA thesis, University of Oslo.
Thompson, W.F., Russo, F.A. 2006. Preattentive Integration of Visual and Auditory Dimensions of Music. In Proceedings of the Second International Conference on Music and Gesture, Manchester, pp. 217–21.
Trueman, D. 2007. Why a Laptop Orchestra? Organised Sound 12(2): 171179.
Vines, B., Krumhansl, C., Wanderley, M., Levitin, D. 2005. Cross-Modal Interactions in the Perception of Musical Performance. Cognition 101: 80113.
Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

Organised Sound
  • ISSN: 1355-7718
  • EISSN: 1469-8153
  • URL: /core/journals/organised-sound
Please enter your name
Please enter a valid email address
Who would you like to send this to? *


Full text views

Total number of HTML views: 6
Total number of PDF views: 56 *
Loading metrics...

Abstract views

Total abstract views: 331 *
Loading metrics...

* Views captured on Cambridge Core between September 2016 - 23rd March 2018. This data will be updated every 24 hours.