Skip to main content
×
Home
    • Aa
    • Aa

Can Micro-Gestural Inflections Be Used to Improve the Soniculatory Effectiveness of Parameter Mapping Sonifications?

  • David Worrall (a1)
Abstract

Parameter mapping sonification is the most widely used technique for representing multi-dimensional data in sound. However, it is known to be unreliable when used for detecting information in some types of data. This is generally thought to be the result of the co-dependency of the psychoacoustic dimensions used in the mapping.

Positing its perceptual basis in a theory of embodied cognition, the most common approach to overcoming this limitation involves techniques that afford the interactive exploration of the data using gross body gestures. In some circumstances, such exploration is not possible and, even when it is, it may be neither necessary nor sufficient.

This article explores some other possible reasons for the unreliability of parameter mapping sonification and, drawing from the experience of expressive musical performance, suggests that the problem lies not in the parametric approach per se, nor in the lack of interactivity, but in the extent to which the parameters employed contribute to coherent gestalts. A method for how this might be achieved that relies on the use of micro-gestural information is proposed. While this is speculative, the use of such gestural inflections is well known in music performance, is supported by findings in neuroscience and lends itself to empirical testing.

Copyright
Corresponding author
E-mail: david.worrall@iis.fraunhofer.de
References
Hide All
P Doornbusch . 2002. Composers’ Views on Mapping in Algorithmic Composition. Organised Sound 7(2): 145156.

J.H. Flowers , D.C. Buhman , K.D Turnage . 1997. Cross-Modal Equivalence of Visual and Auditory Scatterplots for Exploring Bivariate Data Samples. Human Factors 39: 341351.

J Fyk . 1997. Intonational Protention in the Performance of Melodic Octaves on the Violin. In M. Leman (ed.) Music, Gestalt, and Computing: Studies in Cognitive and Systematic Musicology. Berlin: Springer.

L Goehr . 1994. The Imaginary Museum of Musical Works. Oxford: Oxford University Press.

R.I Godøy . 2006. Gestural-Sonorous Objects: Embodied Extensions of Schaeffer's Conceptual Apparatus. Organised Sound 11(2): 149157.

R.I Godøy . 2010. Images of Sonic Objects. Organised Sound 15(1): 5462.

A Hunt , M.M Wanderley . 2002. Mapping Performer Parameters to Synthesis Engines. Organised Sound 7(2): 97108.

B Kane . 2007. L'Objet Sonore Maintenant: Pierre Schaeffer, Sound Objects and the Phenomenological Reduction. Organised Sound 12(1): 1524.

P. Loui , D.L. Wessel , C.L Hudson Kam . 2010. Humans Rapidly Learn Grammatical Structures in a New Scale. Music Perception 27(5) (June): 377388.

G.A Miller . 1956. The Magical Number Seven, Plus or Minus Two: Some Limits on Our Capacity for Processing Information. Psychological Review 63: 8197.

C Nichols . 2002. The vBow: A Virtual Violin Bow Controller for Mapping Gesture to Synthesis with Haptic Feedback. Organised Sound 7(2): 215220.

G Paine . 2009. Towards Unified Design Guidelines for New Interfaces for Musical Expression. Organised Sound 14(2): 143156.

D Smalley . 1992. The Listening Imagination: Listening in the Electroacoustic Era. In J. Payner, T. Howell, R. Orton and P. Seymour (eds.) Companion to Contemporary Musical Thought. London and New York: Routledge.

D Smalley . 2007. Space-Form and the Acousmatic Image. Organised Sound 12(1): 107126.

D Smalley . 2007. Space-Form and the Acousmatic Image. Organised Sound 12(1): 107126.

P.M Todd , G Loy . (eds.) 1991. Music and Connectionism. Cambridge, MA: The MIT Press.

K. Tuuri , M. Mustonen , A. Pirhonen 2007. Same Sound – Different Meanings: A Novel Scheme for Modes of Listening. In Proceedings of Audio Mostly, Ilmenau, Germany: Fraunhofer Institute for Digital Media Technology IDMT, 13–18.

Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

Organised Sound
  • ISSN: 1355-7718
  • EISSN: 1469-8153
  • URL: /core/journals/organised-sound
Please enter your name
Please enter a valid email address
Who would you like to send this to? *
×

Metrics

Full text views

Total number of HTML views: 1
Total number of PDF views: 32 *
Loading metrics...

Abstract views

Total abstract views: 82 *
Loading metrics...

* Views captured on Cambridge Core between September 2016 - 17th October 2017. This data will be updated every 24 hours.