Hostname: page-component-76fb5796d-25wd4 Total loading time: 0 Render date: 2024-04-26T00:38:04.665Z Has data issue: false hasContentIssue false
  • English
  • Français

instance: Soma-based multi-user interaction design for the telematic sonic arts

Published online by Cambridge University Press:  22 December 2021

Lucy Strauss ,
Kivanç Tatar  and
Sumalgy Nuro
Lucy Strauss*
Affiliation:
1University of British Columbia,Vancouver, Canada.
Kivanç Tatar*
Affiliation:
2Chalmers University of Technology, Gothenburg, Sweden.
Sumalgy Nuro*
Affiliation:
3University of Cape Town, Cape Town, South Africa.
*
Email: lucystrauss@protonmail.com
Email: tatar@chalmers.se
Email: sumalgyjafar@gmail.com
Get access Rights & Permissions [Opens in a new window]

Abstract

The telematic work instance is a performance for viola and dance that digitally connects performers in Vancouver and Cape Town. The network interface enables a violist and a dancer to simultaneously play multi-user digital music-dance instruments over the internet with music and dance. The composition, design and performance interaction of instance draw from acoustic multi-user instrument paradigms and music-dance interactions in the African performing arts to explore the idiosyncrasies of the telematic performance space. The iterative design process implements soma-based research methods to inspire sonic compositional material with the body and to explore the performers’ embodied experience of sonic aesthetics during their interaction.

Type
Article
Information
Organised Sound , Volume 26 , Issue 3: Collective and Networked Sound Practices , December 2021 , pp. 390 - 402
Check for updates
Copyright
© The Author(s), 2021. Published by Cambridge University Press

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

References

Agawu, K. 2014. Representing African Music: Postcolonial Notes, Queries, Positions. Abingdon: Routledge.CrossRefGoogle Scholar
Araújo, M. V. and Hein, C. F. 2019. A Survey to Investigate Advanced Musicians’ Flow Disposition in Individual Music Practice. International Journal of Music Education. 37(1): 107–17.CrossRefGoogle Scholar
Balaam, M., Comber, R., Clarke, R. E., Windlin, C., Ståhl, A., Höök, K. and Fitzpatrick, G. 2019. Emotion Work in Experience-Centered Design. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, Glasgow, Scotland, 1–12. https://doi.org/10.1145/3290605.3300832 CrossRefGoogle Scholar
Berliner, Paul F. 2020. The Interlocking Aesthetic. The Art of Mbira. University of Chicago Press, 81–8.Google Scholar
Bigoni, F. and Erkut, C. 2020. DogDog: Soma-Based Interface Design for an Improvising Musician. Proceedings of the 7th International Conference on Movement and Computing, Jersey City, NJ, 1–4. https://doi.org/10.1145/3401956.3404242 CrossRefGoogle Scholar
Bischoff, J., Gold, R. and Horton, J. 1978. Music for an Interactive Network of Microcomputers. Computer Music Journal 2(3): 24. https://doi.org/10.2307/3679453 CrossRefGoogle Scholar
Buchanan, H. J. 2014. Body Mapping: Enhancing Voice Performance Through Somatic Pedagogy. In Harrison, S. D. and O’Bryan, J. (eds.) Teaching Singing in the 21st Century. Dordrecht, Netherlands: Springer, 143–74. https://doi.org/10.1007/978-94-017-8851-910 CrossRefGoogle Scholar
Burnidge, A. 2012. Somatics in the Dance Studio: Embodying Feminist/Democratic Pedagogy. Journal of Dance Education 12(2): 37–47. https://doi.org/10.1080/15290824.2012.634283 CrossRefGoogle Scholar
Cage, J. 1960. Imaginary Landscape, No. 4 (March No. 2). CF Peters. www.edition-peters.com/product/imaginary-landscape-no-4-march-no-2/ep6718a (accessed 11 November 2021).Google Scholar
Chafe, C. 2009. Tapping into the Internet as an Acoustical/Musical Medium. Contemporary Music Review 28(4–5): 413–20. https://doi.org/10.1080/07494460903422362 CrossRefGoogle Scholar
Chafe, C., Cáceres, J. P. and Gurevich, M. 2010. Effect of Temporal Separation on Synchronization in Rhythmic Performance. Perception 39(7): 982–92. https://doi.org/10.1068/p6465 CrossRefGoogle ScholarPubMed
de Cheveigné, A. and Kawahara, H. 2002. YIN, a Fundamental Frequency Estimator for Speech and Music. The Journal of the Acoustical Society of America 111(4), 1917. https://doi.org/10.1121/1.1458024 CrossRefGoogle ScholarPubMed
Diaz, X. A., Boddie, P., Erdem, C., Aandahl, E., Andersen, E. S., Dahl, E., Lesteberg, M. and Jensenius, A. R. 2019. Sensing Place and Presence in an INTIMAL Long-Distance Improvisation. Journal of Network Music and Arts 1(1): 24.Google Scholar
Erdem, C., Schia, K. H. and Jensenius, A. R. 2019. Vrengt: A Shared Body-Machine Instrument for Music-Dance Performance. Proceedings of the International Conference on New Interfaces for Musical Expression, Porto Alegre, Brazil, 186–91. https://doi.org/10.5281/zenodo.3672918 CrossRefGoogle Scholar
Eriksson, S., Unander-Scharin, A., Trichon, V., Unander-Scharin, C., Kjellström, H. and Höök, K. 2019. Dancing with Drones: Crafting Novel Artistic Expressions Through Intercorporeality. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, Glasgow, Scotland, 1–12. https://doi.org/10.1145/3290605.3300847 CrossRefGoogle Scholar
Höök, K., Caramiaux, B., Erkut, C., Forlizzi, J., Hajinejad, N., Haller, M. et al. 2018. Embracing First-Person Perspectives in Soma-Based Design. Informatics 5(1): 8. https://doi.org/10.3390/informatics5010008 CrossRefGoogle Scholar
Jensenius, A. R. and Lyons, M. J. (eds.) 2017. A NIME Reader: Fifteen Years of New Interfaces for Musical Expression. Cham, Switzerland: Springer International.CrossRefGoogle Scholar
Jordà, S. 2005. Multi-user Instruments: Models, Examples and Promises. Proceedings of the International Conference on New Interfaces for Musical Expression, Vancouver, BC, Canada, 23–6. https://doi.org/10.5281/zenodo.1176760 CrossRefGoogle Scholar
Klooster, S. and Overbeeke, C. J. 2005. Designing Products as an Integral Part of Choreography of Interaction: The Product’s Form as an Integral Part of Movement. Design and Semantics of Form and Movement, Proceedings of the 1st European Workshop on Design and Semantics of Form and Movement, Newcastle, UK, 23–35.Google Scholar
Kubik, G. 1969. Composition Techniques in Kiganda Xylophone Music: With an Introduction into some Kiganda Musical Concepts. African Music: Journal of the African Music Society 4(3): 22–72. https://doi.org/10.21504/amj.v4i3.1437 CrossRefGoogle Scholar
Lemmon, E. C. 2019. Telematic Music vs. Networked Music: Distinguishing Between Cybernetic Aspirations and Technological Music-Making. Journal of Network Music and Arts 1(1): 30. https://commons.library.stonybrook.edu/jonma/vol1/iss1/2 Google Scholar
Locke, D. 2009. Simultaneous Multidimensionality in African Music: Musical Cubism. African Music: Journal of the International Library of African Music 8(3): 8–37. https://doi.org/10.21504/amj.v8i3.1826.CrossRefGoogle Scholar
Mainsbridge, M. 2020. Soma-based Non-Physical Instrument Design in Electronic Music Performance. Leonardo, 1–8. https://doi.org/10.1162/leona01883 CrossRefGoogle Scholar
Morris, J. M. 2015. Weblogmusic: A Performance Platform for Ensembles of Individually Time-Shifted Improvisers. Proceedings of the 21st International Symposium on Electronic Art.Google Scholar
Muller, P., Burger, B., Giovanni, J. D. and Ziegler, M. 2019. Understanding the Telematic Apparatus. Journal of Network Music and Arts 1(1): 27.Google Scholar
Nannyonga-Tamusuza, S. 2015. Music as Dance and Dance as Music: Interdependence and Dialogue in Baganda Baakisimba Performance. Yearbook for Traditional Music 47: 82. https://doi.org/10.5921/yeartradmusi.47.2015.0082 CrossRefGoogle Scholar
Noulis, C. 2014. Somatic Education and Piano Performance. Doctoral diss., Birmingham City University, UK. www.open-access.bcu.ac.uk/4860/ (accessed 29 November 2020).Google Scholar
Palacio, P. and Bisig, D. 2017. Piano&Dancer: Interaction Between a Dancer and an Acoustic Instrument. Proceedings of the 4th International Conference on Movement Computing - MOCO ’17, Goldsmiths, University of London, UK, 1–8. https://doi.org/10.1145/3077981.3078052 CrossRefGoogle Scholar
Pardue, L. S., Buys, K., Edinger, M., Overholt, D. and McPherson, A. P. 2019. Separating Sound from Source: Sonic Transformation of the Violin Through Electrodynamic Pickups and Acoustic Actuation. Proceedings of the International Conference on New Interfaces for Musical Expression, Porto Alegre, Brazil, 6.Google Scholar
Peng, Y. F. and Tanaka, A. 2019. Body and Embodiment in Dance Performance. Proceedings of the 6th International Conference on Movement and Computing, Tempe, AZ, USA, 1–6. https://doi.org/10.1145/3347122.3359596 CrossRefGoogle Scholar
Rovelli, C. 2019. The Order of Time. New York: Riverhead Books.Google Scholar
Schnell, N., Röbel, A., Schwarz, D., Peeters, G. and Borghesi, R. 2009. MuBu and Friends – Assembling Tools for Content Based Real-Time Interactive Audio Processing in Max/MSP. Proceedings of International Computer Music Conference (ICMC), Montreal, Quebec, Canada.Google Scholar
Schnell, N., Schwarz, D., Larralde, J. and Borghesi, R. 2017. PiPo, a Plugin Interface for Afferent Data Stream Processing Modules. Proceedings of International Symposium on Music Information Retrieval (ISMIR 2017), Suzhou, China, 8. https://hal.archives-ouvertes.fr/hal-01575288/file/SchnellEtAl%20-ismir2017-%20pipo.pdf Google Scholar
Schoenberg, A. 1952. My Evolution. The Musical Quarterly 38(4): 517–27.CrossRefGoogle Scholar
Shusterman, R. 2008. Body Consciousness: A Philosophy of Mindfulness and Somaesthetics. Cambridge: Cambridge University Press.CrossRefGoogle Scholar
Stachó, L. 2018. Mental Virtuosity: A New Theory of Performers’ Attentional Processes and Strategies. Musicae Scientiae 22(4): 539–57.CrossRefGoogle Scholar
Tatar, K. 2021. Ktatar/String-Feature-Extraction. https://github.com/ktatar/string-feature-extraction (accessed 16 January 2021).Google Scholar
Tatar, K. and Pasquier, P. 2019. Musical Agents: A Typology and State of the Art Towards Musical Metacreation. Journal of New Music Research 48(1): 56–105. https://doi.org/10.1080/09298215.2018.1511736 CrossRefGoogle Scholar
Tragtenberg, J., Calegario, F., Cabral, G. and Ramalho, G. 2019. Towards the Concept of ‘Digital Dance and Music Instrument’. Proceedings of the International Conference on New Interfaces for Musical Expression, Porto Alegre, Brazil, 6.Google Scholar
Turmo Vidal, L. and Márquez Segura, E. 2018. Documenting the Elusive and Ephemeral in Embodied Design Ideation Activities. Multimodal Technologies and Interaction 2(3): 35. https://doi.org/10.3390/mti2030035 CrossRefGoogle Scholar
Umair, M., Alfaras, M., Gamboa, H. and Sas, C. 2019. Experiencing Discomfort: Designing for Affect from First-Person Perspective. Adjunct Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable Computers, London, UK, 1093–6. https://doi.org/10.1145/3341162.3354061 CrossRefGoogle Scholar
Yogo, Y. 2021. Yuichkun/n4m-posenet. https://github.com/yuichkun/n4m-posenet (accessed 14 January 2021).Google Scholar
Zimmerman, J., Forlizzi, J. and Evenson, S. 2007. Research Through Design as a Method for Interaction Design Research in HCI. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems – CHI ’07, San Jose, CA, USA, 493–502. https://doi.org/10.1145/1240624.1240704 CrossRefGoogle Scholar

Videography

Gimenez, L. 2018. Episode Five: How to Play Zimbabwean Mbiras by Edgar Bera. YouTube. (accessed 15 January 2021).Google Scholar
instance. 2020. https://lucystraussmusic.com/instance (accessed 15 January).Google Scholar

Strauss et al. supplementary material

Strauss et al. supplementary material 1

Download Strauss et al. supplementary material(Audio)
Audio 540.3 KB

Strauss et al. supplementary material

Strauss et al. supplementary material 2

Download Strauss et al. supplementary material(Audio)
Audio 638.3 KB

Strauss et al. supplementary material

Strauss et al. supplementary material 3

Download Strauss et al. supplementary material(Video)
Video 61.2 MB

Strauss et al. supplementary material

Strauss et al. supplementary material 4

Download Strauss et al. supplementary material(Video)
Video 50.8 MB