Skip to main content Accessibility help
×
Home

Interactivity for Mobile Music-Making

  • Georg Essl (a1) and Michael Rohs (a1)

Abstract

Mobile phones offer an attractive platform for interactive music performance. We provide a theoretical analysis of the sensor capabilities via a design space and show concrete examples of how different sensors can facilitate interactive performance on these devices. These sensors include cameras, microphones, accelerometers, magnetometers and multitouch screens. The interactivity through sensors in turn informs aspects of live performance as well as composition though persistence, scoring, and mapping to musical notes or abstract sounds.

Copyright

Corresponding author

References

Hide All
Arfib, D., Couturier, J. M., Filatriau, J. J. Kessous, L. 2006. What Sounds Can I Do with a Joystick and a Tablet? Proceedings of the 2nd International Symposium on Gesture Interfaces for Multimedia Systems (GIMS2006), Leeds UK.
Ballagas, R., Rohs, M., Sheridan, J. G. Borchers, J. 2006. The Smart Phone: A Ubiquitous Input Device. Ieee Pervasive Computing 5(1): 7077.
Behrendt, F. 2005. Handymusik. Klangkunst und ‘mobile devices’. Epos. Available online at: www.epos.uos.de/music/templates/buch.php?id=57.
Cook, P. Scavone, G. 1999. The Synthesis ToolKit (STK). Proceedings of the International ComputerMusic Conference, Beijing.
Essl, G. O’Modhrain, S. 2005. Scrubber: An Interface for Friction-induced Sounds. Proceedings of the Conference for New Interfaces for Musical Expression, Vancouver, Canada, 70–5.
Essl, G. Rohs, M. 2006. Mobile STK for Symbian OS. Proceedings of the International Computer Music Conference, New Orleans, 278–81.
Essl, G. Rohs, M. 2007. ShaMus – A Sensor-Based Integrated Mobile Phone Instrument. Proceedings of the International Computer Music Conference (ICMC), Copenhagen.
Essl, G., Wang, G. Rohs, M. 2008. Developments and Challenges turning Mobile Phones into Generic Music Performance Platforms. Proceedings of the Mobile Music Workshop, Vienna.
Gaye, L., Holmquist, L. E., Behrendt, F. Tanaka, A. 2006. Mobile Music Technology: Report on an Emerging Community. NIME ’06: Proceedings of the 2006 Conference on New Interfaces for Musical Expression, 22–5.
Geiger, G. 2003. Pda: Real Time Signal Processing and Sound Generation on Handheld Devices. Proceedings of the International Computer Music Conference, Singapore.
Geiger, G. 2006. Using the Touch Screen as a Controller for Portable Computer Music Instruments. Proceedings of the International Conference on New Interfaces for Musical Expression (NIME’06). Paris, France.
Hachet, M., Pouderoux, J., Guitton, P. Gonzato, J.-C. 2005. TangiMap: A tangible Interface for Visualization of Large Documents on Handheld Computers. GI ‘05: Proceedings of the 2005 Conference on Graphics Interface, Waterloo, Canada, 9–15.
Hansen, T. R., Eriksson, E. Lykke-Olesen, A. 2005. Mixed Interaction Space: Designing for Camera Based Interaction with Mobile Devices. Proceedings of CHI ’05: Extended Abstracts on Human Factors in Computing Systems, 1933–6.
MacKenzie, I. S. Tanaka-Ishii, K. (eds.) 2007. Text Entry Systems: Mobility, Accessibility, Universality. San Francisco: Morgan Kaufmann Publishers.
Miranda, E. R. Wanderley, M. M. 2006. New Digital Musical Instruments: Control and Interaction Beyond the Keyboard. Middleton, WI: AR Editions.
Misra, A., Essl, G. Rohs, M. 2008. Microphone as Sensor in Mobile Phone Performance. Proceedings of the International Conference for New Interfaces for Musical Expression (NIME–08), Genova, Italy.
Murray-Smith, R., Williamson, J., Hughes, S. Quaade, T. 2008. Stane: Synthesized Surfaces for Tactile Input. Proceedings of the Twenty-Sixth Annual SIGCHI Conference on Human Factors in Computing Systems, Florence, Italy, ACM, New York, 1299–1302.
O’Modhrain, S. Essl, G. 2004. CrumbleBag: Tactile Interfaces for Granular Synthesis. Proceedings of the International Conference for New Interfaces for Musical Expression (NIME), Hamamatsu, Japan.
Rohs, M. 2005. Real-World Interaction with Camera Phones. In H. Murakami, H. Nakashima, H. Tokuda and M. Yasumura (eds.) Second International Symposium on Ubiquitous Computing Systems (UCS 2004), Revised Selected Papers, LNCS 3598, Tokyo, Japan, 74–89.
Rohs, M. Essl, G. 2007. Camus2 – Collaborative Music Performance with Mobile Camera Phones. Proceedings of the International Conference on Advances in Computer Entertainment Technology (ACE), Salzburg, Austria, 13–15.
Rohs, M. Zweifel, P. 2005. A Conceptual Framework for Camera Phone-Based Interaction Techniques. In H. W. Gellersen, R. Want and A. Schmidt (eds.) Pervasive Computing: Third International Conference, PERVASIVE 2005, LNCS 3468, Munich, Germany, 171–89.
Rohs, M., Essl, G. Roth, M. 2006. CaMus: Live Music Performance using Camera Phones and Visual Grid Tracking. Proceedings of the 6th International Conference on New Instruments for Musical Expression (NIME), 31–6.
Schiemer, G. Havryliv, M. 2006. Pocket Gamelan: Tuneable Trajectories for Flying Sources in Mandala 3 and Mandala 4. NIME ’06: Proceedings of the 2006 Conference on New Interfaces for Musical Expression, 37–42.
Strachan, S., Eslambolchilar, P., Murray-Smith, R., Hughes, S. O’Modhrain, S. 2005. GpsTunes: Controlling Navigation via Audio Feedback. Proceedings of the 7th International Conference on Human Computer Interaction with Mobile Devices & Services, Salzburg, Austria.
Tanaka, A. 2004. Mobile Music Making. NIME ‘04: Proceedings of the 2004 conference on New Interfaces for Musical Expression, 154–6.
Tanaka, A., Valadon, G. Berger, C. 2007. Social Mobile Music Navigation using the Compass. Proceedings of the International Mobile Music Workshop, Amsterdam.9
Wang, G., Essl, G. Penttinen, H. 2008. MoPhO: Do Mobile Phones Dream Of Electric Orchestras? Proceedings of the International Computer Music Conference (ICMC–08), Belfast, Northern Ireland.
Wang, J., Zhai, S. Canny, J. 2006. Camera Phone Based Motion Sensing: Interaction Techniques, Applications and Performance Study. UIST ’06: Proceedings of the 19th Annual ACM Symposium on User Interface Software and Technology, New York, 101–10.

Related content

Powered by UNSILO

Interactivity for Mobile Music-Making

  • Georg Essl (a1) and Michael Rohs (a1)

Metrics

Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed.