Hostname: page-component-8448b6f56d-jr42d Total loading time: 0 Render date: 2024-04-23T17:02:44.066Z Has data issue: false hasContentIssue false
  • English
  • Français

Interactivity for Mobile Music-Making

Published online by Cambridge University Press:  29 June 2009

Georg Essl  and
Michael Rohs
Georg Essl*
Affiliation:
Deutsche Telekom Laboratories & TU-Berlin, Ernst Reuter Platz 7, D-10587 Berlin, Germany
Michael Rohs*
Affiliation:
Deutsche Telekom Laboratories & TU-Berlin, Ernst Reuter Platz 7, D-10587 Berlin, Germany
*
E-mail: *georg.essl@telekom.de
†michael.rohs@telekom.de
Get access Rights & Permissions [Opens in a new window]

Abstract

Mobile phones offer an attractive platform for interactive music performance. We provide a theoretical analysis of the sensor capabilities via a design space and show concrete examples of how different sensors can facilitate interactive performance on these devices. These sensors include cameras, microphones, accelerometers, magnetometers and multitouch screens. The interactivity through sensors in turn informs aspects of live performance as well as composition though persistence, scoring, and mapping to musical notes or abstract sounds.

Type
Articles
Information
Organised Sound , Volume 14 , Issue 2 , August 2009 , pp. 197 - 207
Copyright
Copyright © Cambridge University Press 2009

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Arfib, D., Couturier, J. M., Filatriau, J. J. Kessous, L. 2006. What Sounds Can I Do with a Joystick and a Tablet? Proceedings of the 2nd International Symposium on Gesture Interfaces for Multimedia Systems (GIMS2006), Leeds UK.Google Scholar
Ballagas, R., Rohs, M., Sheridan, J. G. Borchers, J. 2006. The Smart Phone: A Ubiquitous Input Device. Ieee Pervasive Computing 5(1): 70–77.CrossRefGoogle Scholar
Behrendt, F. 2005. Handymusik. Klangkunst und ‘mobile devices’. Epos. Available online at: www.epos.uos.de/music/templates/buch.php?id=57.Google Scholar
Cook, P. Scavone, G. 1999. The Synthesis ToolKit (STK). Proceedings of the International ComputerMusic Conference, Beijing.Google Scholar
Essl, G. O’Modhrain, S. 2005. Scrubber: An Interface for Friction-induced Sounds. Proceedings of the Conference for New Interfaces for Musical Expression, Vancouver, Canada, 70–5.Google Scholar
Essl, G. Rohs, M. 2006. Mobile STK for Symbian OS. Proceedings of the International Computer Music Conference, New Orleans, 278–81.Google Scholar
Essl, G. Rohs, M. 2007. ShaMus – A Sensor-Based Integrated Mobile Phone Instrument. Proceedings of the International Computer Music Conference (ICMC), Copenhagen.Google Scholar
Essl, G., Wang, G. Rohs, M. 2008. Developments and Challenges turning Mobile Phones into Generic Music Performance Platforms. Proceedings of the Mobile Music Workshop, Vienna.Google Scholar
Gaye, L., Holmquist, L. E., Behrendt, F. Tanaka, A. 2006. Mobile Music Technology: Report on an Emerging Community. NIME ’06: Proceedings of the 2006 Conference on New Interfaces for Musical Expression, 22–5.Google Scholar
Geiger, G. 2003. Pda: Real Time Signal Processing and Sound Generation on Handheld Devices. Proceedings of the International Computer Music Conference, Singapore.Google Scholar
Geiger, G. 2006. Using the Touch Screen as a Controller for Portable Computer Music Instruments. Proceedings of the International Conference on New Interfaces for Musical Expression (NIME’06). Paris, France.Google Scholar
Hachet, M., Pouderoux, J., Guitton, P. Gonzato, J.-C. 2005. TangiMap: A tangible Interface for Visualization of Large Documents on Handheld Computers. GI ‘05: Proceedings of the 2005 Conference on Graphics Interface, Waterloo, Canada, 9–15.Google Scholar
Hansen, T. R., Eriksson, E. Lykke-Olesen, A. 2005. Mixed Interaction Space: Designing for Camera Based Interaction with Mobile Devices. Proceedings of CHI ’05: Extended Abstracts on Human Factors in Computing Systems, 1933–6.Google Scholar
MacKenzie, I. S. Tanaka-Ishii, K. (eds.) 2007. Text Entry Systems: Mobility, Accessibility, Universality. San Francisco: Morgan Kaufmann Publishers.Google Scholar
Miranda, E. R. Wanderley, M. M. 2006. New Digital Musical Instruments: Control and Interaction Beyond the Keyboard. Middleton, WI: AR Editions.Google Scholar
Misra, A., Essl, G. Rohs, M. 2008. Microphone as Sensor in Mobile Phone Performance. Proceedings of the International Conference for New Interfaces for Musical Expression (NIME–08), Genova, Italy.Google Scholar
Murray-Smith, R., Williamson, J., Hughes, S. Quaade, T. 2008. Stane: Synthesized Surfaces for Tactile Input. Proceedings of the Twenty-Sixth Annual SIGCHI Conference on Human Factors in Computing Systems, Florence, Italy, ACM, New York, 1299–1302.Google Scholar
O’Modhrain, S. Essl, G. 2004. CrumbleBag: Tactile Interfaces for Granular Synthesis. Proceedings of the International Conference for New Interfaces for Musical Expression (NIME), Hamamatsu, Japan.Google Scholar
Rohs, M. 2005. Real-World Interaction with Camera Phones. In H. Murakami, H. Nakashima, H. Tokuda and M. Yasumura (eds.) Second International Symposium on Ubiquitous Computing Systems (UCS 2004), Revised Selected Papers, LNCS 3598, Tokyo, Japan, 74–89.Google Scholar
Rohs, M. Essl, G. 2007. Camus2 – Collaborative Music Performance with Mobile Camera Phones. Proceedings of the International Conference on Advances in Computer Entertainment Technology (ACE), Salzburg, Austria, 13–15.Google Scholar
Rohs, M. Zweifel, P. 2005. A Conceptual Framework for Camera Phone-Based Interaction Techniques. In H. W. Gellersen, R. Want and A. Schmidt (eds.) Pervasive Computing: Third International Conference, PERVASIVE 2005, LNCS 3468, Munich, Germany, 171–89.Google Scholar
Rohs, M., Essl, G. Roth, M. 2006. CaMus: Live Music Performance using Camera Phones and Visual Grid Tracking. Proceedings of the 6th International Conference on New Instruments for Musical Expression (NIME), 31–6.Google Scholar
Schiemer, G. Havryliv, M. 2006. Pocket Gamelan: Tuneable Trajectories for Flying Sources in Mandala 3 and Mandala 4. NIME ’06: Proceedings of the 2006 Conference on New Interfaces for Musical Expression, 37–42.Google Scholar
Strachan, S., Eslambolchilar, P., Murray-Smith, R., Hughes, S. O’Modhrain, S. 2005. GpsTunes: Controlling Navigation via Audio Feedback. Proceedings of the 7th International Conference on Human Computer Interaction with Mobile Devices & Services, Salzburg, Austria.CrossRefGoogle Scholar
Tanaka, A. 2004. Mobile Music Making. NIME ‘04: Proceedings of the 2004 conference on New Interfaces for Musical Expression, 154–6.Google Scholar
Tanaka, A., Valadon, G. Berger, C. 2007. Social Mobile Music Navigation using the Compass. Proceedings of the International Mobile Music Workshop, Amsterdam.9Google Scholar
Wang, G., Essl, G. Penttinen, H. 2008. MoPhO: Do Mobile Phones Dream Of Electric Orchestras? Proceedings of the International Computer Music Conference (ICMC–08), Belfast, Northern Ireland.Google Scholar
Wang, J., Zhai, S. Canny, J. 2006. Camera Phone Based Motion Sensing: Interaction Techniques, Applications and Performance Study. UIST ’06: Proceedings of the 19th Annual ACM Symposium on User Interface Software and Technology, New York, 101–10.Google Scholar