Skip to main content
×
Home
    • Aa
    • Aa

Can Micro-Gestural Inflections Be Used to Improve the Soniculatory Effectiveness of Parameter Mapping Sonifications?

  • David Worrall (a1)
Abstract

Parameter mapping sonification is the most widely used technique for representing multi-dimensional data in sound. However, it is known to be unreliable when used for detecting information in some types of data. This is generally thought to be the result of the co-dependency of the psychoacoustic dimensions used in the mapping.

Positing its perceptual basis in a theory of embodied cognition, the most common approach to overcoming this limitation involves techniques that afford the interactive exploration of the data using gross body gestures. In some circumstances, such exploration is not possible and, even when it is, it may be neither necessary nor sufficient.

This article explores some other possible reasons for the unreliability of parameter mapping sonification and, drawing from the experience of expressive musical performance, suggests that the problem lies not in the parametric approach per se, nor in the lack of interactivity, but in the extent to which the parameters employed contribute to coherent gestalts. A method for how this might be achieved that relies on the use of micro-gestural information is proposed. While this is speculative, the use of such gestural inflections is well known in music performance, is supported by findings in neuroscience and lends itself to empirical testing.

Copyright
Corresponding author
E-mail: david.worrall@iis.fraunhofer.de
Linked references
Hide All

This list contains references from the content that can be linked to their source. For a full set of references and notes please see the PDF or HTML where available.

P Doornbusch . 2002. Composers’ Views on Mapping in Algorithmic Composition. Organised Sound 7(2): 145156.

J.H. Flowers , D.C. Buhman , K.D Turnage . 1997. Cross-Modal Equivalence of Visual and Auditory Scatterplots for Exploring Bivariate Data Samples. Human Factors 39: 341351.

J Fyk . 1997. Intonational Protention in the Performance of Melodic Octaves on the Violin. In M. Leman (ed.) Music, Gestalt, and Computing: Studies in Cognitive and Systematic Musicology. Berlin: Springer.

L Goehr . 1994. The Imaginary Museum of Musical Works. Oxford: Oxford University Press.

A Hunt , M.M Wanderley . 2002. Mapping Performer Parameters to Synthesis Engines. Organised Sound 7(2): 97108.

P. Loui , D.L. Wessel , C.L Hudson Kam . 2010. Humans Rapidly Learn Grammatical Structures in a New Scale. Music Perception 27(5) (June): 377388.

G.A Miller . 1956. The Magical Number Seven, Plus or Minus Two: Some Limits on Our Capacity for Processing Information. Psychological Review 63: 8197.

C Nichols . 2002. The vBow: A Virtual Violin Bow Controller for Mapping Gesture to Synthesis with Haptic Feedback. Organised Sound 7(2): 215220.

G Paine . 2009. Towards Unified Design Guidelines for New Interfaces for Musical Expression. Organised Sound 14(2): 143156.

D Smalley . 1997. Spectromorphology: Explaining Sound-Shapes. Organised Sound 2(2): 107126.

D Smalley . 2007. Space-Form and the Acousmatic Image. Organised Sound 12(1): 107126.

K. Tuuri , T Eerola . 2012. Formulating a Revised Taxonomy for Modes of Listening. Journal of New Music Research 41(2): 137152.

D Smalley . 1986. Spectro-Morphology and Structuring Processes. In S. Emmerson (ed.) The Language of Electroacoustic Music. London: Macmillan.

Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

Organised Sound
  • ISSN: 1355-7718
  • EISSN: 1469-8153
  • URL: /core/journals/organised-sound
Please enter your name
Please enter a valid email address
Who would you like to send this to? *
×