Hostname: page-component-8448b6f56d-jr42d Total loading time: 0 Render date: 2024-04-23T17:22:31.343Z Has data issue: false hasContentIssue false
  • English
  • Français

Theatrical virtual acoustic rendering with head movement interaction

Published online by Cambridge University Press:  03 May 2019

Jaume Segura-Garcia Open the ORCID record for Jaume Segura-Garcia [Opens in a new window] ,
Mario Montagud-Climent ,
Sebastià Mirasol-Menacho  and
Joan Oleza-Simó
Jaume Segura-Garcia*
Affiliation:
Computer Science Department, Universitat de València, Valencia, Spain
Mario Montagud-Climent
Affiliation:
i2Cat, Barcelona & Universitat de València, Valencia, Spain
Sebastià Mirasol-Menacho
Affiliation:
Computer Science Department, Universitat de València, Valencia, Spain
Joan Oleza-Simó
Affiliation:
Philology Department, Universitat de València, Valencia, Spain
*
Author for correspondence: Jaume Segura-Garcia, E-mail: jaume.segura@uv.es
Get access Rights & Permissions [Opens in a new window]

Abstract

Nowadays, the use of virtual reality/virtual acoustics (VR/VA) in archaeology for rendering lost buildings is an important topic in the cultural heritage field. Moreover, the addition of additional senses apart from the sight increases the feeling of immersion in virtual environments. The aim of this paper is to show the interaction work developed in a VA system, based on Unity and FMOD, the graphical and acoustical reconstruction of an ancient building and the development of a VR goggles with headphones to render 3D audio and video interactively. This system has been implemented to render auralizations in a binaural system and has been applied to the renderization of an old and lost theatre in València (Spain). The first building of theatre was built in the 16th century, and was rebuilt several times until the 18th century. The auralization of several theatrical excerpts of different Spanish authors of that time is also presented. The integrated system has been subjectively evaluated, obtaining very satisfactory results.

Keywords

3D audioauralizationhuman–computer interactionvirtual acousticsvirtual reality
Type
Research Article
Information
AI EDAM , Volume 33 , Issue 3 , August 2019 , pp. 359 - 368
Copyright
Copyright © Cambridge University Press 2019 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Algazi, VR, Duda, RO, Thompson, DM and Avendano, C (2001) The CIPIC HRTF Database. Proceedings 2001 IEEE Workshop on Applications of Signal Processing to Audio and Electroacoustics, pp. 99–102, Mohonk Mountain House, New Paltz, NY, Oct. 21–24.Google Scholar
Alonso, A, Sendra, JJ, Suárez, R and Zamarreño, T (2014) Acoustic evaluation of the Cathedral of Seville as a concert hall and proposals for improving the acoustic quality perceived by listeners. Journal of Building Performance Simulation 7, 360–378.Google Scholar
ATMega328p (2018) https://www.sparkfun.com/datasheets/Components/SMD/ATMega328.pdf (Visited on 20/11/2018)Google Scholar
Avanzini, F, Canazza, S, De Poli, G, Fantozzi, C, Pretto, N, Rodà, A, Angelini, I, Bettineschi, C, Deotto, G, Faresin, E, Menegazzi, A, Molin, G, Salemi, G and Zanovello, P (2015) Archeology and Virtual Acoustics. A Pan Flute from Ancient Egypt. Proceedings of the 12th Int. Conference on Sound and Music Computing (SMC-15), Maynooth, Ireland, July 30, 31 & August 1, 2015.Google Scholar
Azevedo, M, Markham, B and Wall, JN (2013) Acoustical Archaeology – Recreating the Soundscape of John Donne's 1622 Gunpowder Plot Sermon at Paul's Cross. In Paper presented at proceedings of ICA 2013. Montreal, Canada. June 2–7, 19: 015133–015133. doi: 10.1121/1.4799054.Google Scholar
Berardi, U, Iannace, G and Maffei, L (2016) “Virtual reconstruction of the historical acoustics of the odeon of pompeii. Journal of Cultural Heritage 19, 555–566, Elsevier Masson SAS. doi: 10.1016/j.culher.2015.12.004.Google Scholar
Christensen, CL and Koutsouris, G (2015) ODEON room Acoustic Software, Version 13, Full User's Manual. Kongens Lyngby: Odeon A/S, Schion DTU.Google Scholar
Collecchia, RE, Kolar, MA and Abel, JS (2012) A Computational Acoustic Model of the Coupled Interior Architecture of Ancient Chavín. Audio Engineering Society 133rd Convention, edited by Audio Engineering Society. San Francisco: Audio Engineering Society. http://www.aes.org/e-lib/browse.cfm?elib=16439.Google Scholar
Fazenda, B and Drumm, I (2011) Recreating the Sound of Stonehenge. Paper presented at the proceedings of the acoustics of ancient theaters conference. September 18–21. Patras.Google Scholar
FMOD Studio 3D Events (2018) https://www.fmod.org/docs/content/generated/overview/3dstudio.html. (Visited on 16 Feb 2018).Google Scholar
Gonizzi, B, Caruso, SG, Micoli, LL, Covarrubias Rodriguez, M and Guidi, G (2015) 3D Visualization of Cultural Heritage Artefacts with Virtual Reality devices. Proceedings of 25th International CIPA Symposium 2015, 31 August–4 September, Taipei, Taiwan.Google Scholar
Juliá, E (1950) Nuevos datos sobre la Casa de la Olivera de Valencia. Boletín de la Real Academia Española, XXX, pp. 47–85, document in 70–81.Google Scholar
Lanham, M (2017) Game Audio Development with Unity 5.X. Packt Publishing. https://www.safaribooksonline.com/library/view/game-audio-development/9781787286450/ (Visited on 10 Mar 2018).Google Scholar
Lubman, D (2008) Convolution-Scattering Model for Staircase Echoes at the Temple of Kukulkan. Paper presented at the Acoustics'08 ASA–EEA–SFA joint congress, 4161–4166. doi: 10.1121/1.2934779.Google Scholar
Micallef, P and Sammut, MA (2002) Statistical Comparison of Islamic and Byzantine Chants in the worship spaces. Paper presented at the workshop on CAHRISMA Project, YTU– Istanbul, December.Google Scholar
Mouyen, J (1981) El corral de la Olivera de Valencia en 1678 y 1682: tentativa de definición sociológica de su público. IIè. Colloque sur les Pays de la Couronne d'Aragon. Pau, Université de Pau.Google Scholar
Mouyen, J (1991 a) Comedias y comediantes. Estudios sobre el teatro clásico español. Valencia: Universitat de València (Dpto. Filología Española).Google Scholar
Mouyen, J (1991 b) Las casas de comedias de Valencia. En: Díez Borque, J.M.: Teatros del Siglo de Oro: Corrales y Coliseos en la Península Ibérica, pp. 91–122. Cuadernos de Teatro Clásico, Madrid.Google Scholar
MPU-9250A (2018) https://www.invensense.com/wp-content/uploads/2015/02/PS-MPU-9250A-01-v1.1.pdf (Visited on 20/11/2018).Google Scholar
Oleza, J (2017) La casa de comedias de La Olivera. Reconstrucción virtual de un teatro distinto. XVIII Congreso Internacional de la AITENSO. El personaje dramático en su discurso. Universidad Iberoamericana & El Colegio de México, México, 23–27 de octubre.Google Scholar
PSoC (2018) http://www.cypress.com/file/127111/download (Visited on 20/11/2018)Google Scholar
Rindel, JH (2011) The ERATO project and its contribution to our understanding of the Acoustics of Ancient Theatres. Proceedings of The Acoustics of Ancient Theatres Conference, Patras, Greece.Google Scholar
Ros Andreu, JL (1981) L'efímer en la formació del Barroc valencià, 1599–1632 (Tesis doctoral). Universitat Politècnica de València.Google Scholar
Sender, M, Planells, A, Perelló, R, Segura, J and Giménez, A (2018) Virtual acoustic reconstruction of a lost church: application to an Order of Saint Jerome monastery in Alzira, Spain. Journal of Building Performance Simulation 11, 369–390.Google Scholar
Sirera, JL (1980) El teatro en Valencia durante los siglos XVI y XVII: la producción dramática valenciana en los orígenes de la comedia barroca (Tesis doctoral). Universidad de Valencia.Google Scholar
Tal, D (2009) Google SketchUp for Site Design: A Guide to Modeling Site Plans, Terrain and Architecture. Series CourseSmart, Wiley.Google Scholar
Vorländer, M (2008) Auralization: Fundamentals of Acoustics, Modelling, Simulation, Algorithms and Acoustic Virtual Reality. Berlin: Springer.Google Scholar