“Wrapping” X3DOM around Web Audio API

Authors

DOI:

https://doi.org/10.9781/ijimai.2015.355

Keywords:

Web3D, X3D, 3D Technologies, Audio, API

Abstract

Spatial sound has a conceptual role in the Web3D environments, due to highly realism scenes that can provide. Lately the efforts are concentrated on the extension of the X3D/ X3DOM through spatial sound attributes. This paper presents a novel method for the introduction of spatial sound components in the X3DOM framework, based on X3D specification and Web Audio API. The proposed method incorporates the introduction of enhanced sound nodes for X3DOM which are derived by the implementation of the X3D standard components, enriched with accessional features of Web Audio API. Moreover, several examples-scenarios developed for the evaluation of our approach. The implemented examples established the achievability of new registered nodes in X3DOM, for spatial sound characteristics in Web3D virtual worlds.

Downloads

Download data is not yet available.

References

[1] Raggett, D. (1995). Extending WWW to support platform independent virtual reality. Techical Report.

[2] KHRONOS GROUP. Retrieved from https://www.khronos.org/news/press/khronos-releases-final-webgl-1.0-specification [accessed May 2015].

[3] Eicke, T. N., Jung, Y., & Kuijper, A. (2015). Stable dynamic webshadows in the X3DOM framework. Expert Systems with Applications. Retrieved from http://dx.doi.org/10.1016/j.eswa.2014.11.059

[4] Daly, L., & Brutzman, D. (2007). X3D: Extensible 3D Graphics Standard. 24, pp. 130 - 135. IEEE. doi: 10.1109/MSP.2007.905889.

[5] McIntosh, P., Hamilton, M., & Schyndel, R. v. (2005). X3D-UML: Enabling Advanced UML Visualisation Through X3D. Association for Computing Machinery, Inc.

[6] Behr, J., Jung, Y., Keil, J., Drevensek, T., Zoellner, M., Eschler, P., & Fellner, D. (2010). A Scalable Architecture for the HTML5/ X3D Integration Model X3DOM. Web3D ‘10 Proceedings of the 15th International Conference on Web 3D Technology. doi: 10.1145/1836049.1836077.

[7] Garbe, K., & Herbst, I. (2008). Extending X3D with Perceptual Auditory Properties. Virtual Reality Conference, 2008. VR ‘08. IEEE. doi: 10.1109/VR.2008.4480787.

[8] Ding, H., Schwarz, D., Jacquemin, C., & Cahen, R. (2011). Spatial audio: graphic modeling for X3D. Web3D ‘11 Proceedings of the 16th International Conference on 3D Web Technology. doi: 10.1145/2010425.2010427.

[9] W3C. (2013). Web Audio API. Retrieved from http://www.w3.org/TR/webaudio/ [accessed May 2015].

[10] Wyse, L. (2014). Interactive Audio Web Development Workflow. ACM. doi: 10.1145/2647868.2655064.

[11] Wyse, L., & Subramanian, S. (2013). The viability of the web browser as a computer music platform (Vol. 37). (C. M. Journal, Ed.).

[12] Dibra, D., Otero, N., & Pettersson, O. (2014). Real-Time Interactive Visualization Aiding Pronunciation of English as a Second Language. IEEE. doi: 10.1109/ICALT.2014.131.

[13] Extensible 3D (X3D) ISO/IEC 19775-1:2008. Retrieved from http://www.web3d.org/documents/specifications/19775-1/V3.2/Part01/Architecture.html [accessed May 2015].

[14] Ding, H., Schwarz, D., Jacquemin, C., Cahen, R. (2011). Spatial audio: graphic modeling for X3D. Web3D ‘11 Proceedings of the 16th International Conference on 3D Web Technology.

[15] Parisi, T. (2014). Programming 3D Applications with HTML5 and WebGL. O’Reilly Media, Inc.

[16] Spala, P., Malamos, A. G., Doulamis , A., & Mamakis, G. (2011). Extending MPEG-7 for efficient annotation of complex web 3D scenes (Vol. 59). Multimedia Tools and Applications, Springer US. doi: 10.1007/s11042-011-0790-5.

[17] Stewart, J. A., Dumoulin, S. J., & Noël, S. (2006). X3D Conformance Testing Factors in Creating Aviable Test Suite. Electrical and Computer Engineering, 2006. CCECE ‘06. doi: 10.1109/CCECE.2006.277506.

[18] Bouras , C., Panagopoulos , A., & Tsiatsos, T. (2005). Advances in X3D multi-user virtual environments. Multimedia, Seventh IEEE International Symposium. doi: 10.1109/ISM.2005.28.

[19] Behr, J., Eschler, P., Jung, Y., & Zollner, M. (2009). X3DOM: a DOMbased HTML5/X3D integration model. Web3D ‘09 Proceedings of the 14th International Conference on 3D Web Technology. doi: 10.1145/1559764.1559784

[20] X3DOM. Retrieved from http://www.x3dom.org/ [accessed May 2015].

[21] Baglivo, A., Ponti, F. D., Luca, D. D., & Fanini, B. (2013). X3D/X3DOM, Blender Game Engine and OSG4WEB: open source visualisation for cultural heritage environments. Digital Heritage International Congress (DigitalHeritage).

[22] Stamoulias, A., Malamos, A. G., Zampoglou, M., & Brutzman, D. (2014). Enhancing X3DOM declarative 3D with rigid body physics support. Proceedings of the Nineteenth International ACM Conference on 3D Web Technologies. ACM.

[23] Mora-Lumbreras , M. A., Flores-Pulido, L., González-Contreras, B. M., & Portilla , A. (2012). Incorporating 3D Sound in Different Virtual Worlds. Web Congress (LA-WEB). doi: 10.1109/LA-WEB.2012.17.

[24] Kapetanakis, K., Panagiotakis, S., Malamos, A. G., & Zampoglou, M. (2014). Adaptive Video Streaming on top of Web3D A bridging technology between X3DOM and MPEG-DASH. Telecommunications and Multimedia (TEMU), 2014 International Conference, IEEE. doi: 10.1109/TEMU.2014.6917765.

[25] Wu, J.-R., Duh, C.-D., Ouhyoung, M., & Wu, J.-T. (1997). Head Motion and Latency Compensation on. Lausanne Switzerland: ACM VRST ‘97.

[26] Lee, H. C., Kim, H. B., Lee , M. J., Kim , P. M., Suh, S. W., & Kim, K. H. (1998). Development of 3D sound generation system for multimedia application. Computer Human Interaction. IEEE.

[27] Cowan, B., & Kapralos, B. (2013). Spatial sound rendering for dynamic virtual environments. Digital Signal Processing (DSP). IEEE.

[28] Laitinen, M. V., Pihlajamäki, T., Erkut, C., & Pulkki, V. (2012). Parametric time-frequency representation of spatial sound in virtual worlds. ACM Transactions on Applied Perception (TAP). doi: 10.1145/2207216.2207219.

[29] Smus, B. (2013). Web Audio API. O’Reilly Media, Inc.

[30] Spuy, R. v. (2015). Sound with the Web Audio API. In Advanced Game Design with HTML5 and JavaScript. IEEE.

[31] Smus, B. Retrieved from Developing Game Audio with the Web Audio API: http://www.html5rocks.com/en/tutorials/webaudio/games/ [accessed May 2015].

[32] Roberts, C., Wakefield, G., & Wright, M. (2013). The Web Browser As Synthesizer And Interface. NIME.

[33] Walker, W., & Belet, B. (2015). Birds of a Feather (Les Oiseaux de Même Plumage): Dynamic Soundscapes using Real-time Manipulation of Locally Relevant Birdsongs.

[34] openAL. Retrieved from http://openal.org/ [accessed May 2015]

[35] Seo, B., Htoon, M. M., Zimmermann, R., & Wang, C.-D. (2010). Spatializer: A Web-based Positional Audio Toolkit. ACE. ACM.

[36] Dirksen, J., Learning Three.js – the JavaScript 3D Library for WebGL, (2015).

[37] Three.js Retrieved from http://threejs.org [accessed May 2015]

[38] GidHub, webaudiox, Retrieved from

[39] https://github.com/jeromeetienne/webaudiox [accessed May 2015].

[40] GidHub, howler.js. Retrieved from https://github.com/goldfire/howler.js [accessed May 2015].

[41] GidHub, pedalboard.js. Retrieved from

[42] http://dashersw.github.io/pedalboard.js/ [accessed May 2015].

[43] GidHub, wad, Retrieved from https://github.com/rserota/wad [accessed May 2015].

[44] GidHub, fifer, Retrieved from https://github.com/f5io/fifer-js [accessed May 2015].

[45] DevBattles. Learn Web Audio API. Retrieved from http://www.devbattles.com/sand/post-69-Learn-Web-Audio-API [accessed May 2015].

[46] Toyosak, A., Flahive, L., & Diaz, J. (2015). Music Story 2: a MotionGraphic-based Music Video Creator.

[47] Mahadevan, A., Freeman, J., & Magerko, B. (2015). EarSketch: Teaching computational music remixing in an online Web Audio based learning environment. Web Audio Conference.

[48] Paradis, M., Clarke, R. G., & Melchior, F. (2015). VenueExplorer, ObjectBased Interactive Audio for Live Events. WAC. Paris.

[49] Wyse, L. (2015). Spatially Distributed Sound Computing and Rendering Using the Web Audio Platform. 1st Web Audio Conference. Paris.

[50] Pendharkar, C., Bäck, P., & Lonce, W. (2015). Adventures in scheduling, buffers and parameters: Porting a dynamic audio engine to Web Audio.

[51] Schnell, N., Saiz, V., Barkati, K., & Goldszmidt, S. (2015). Of Time Engines and Masters An API for Scheduling and Synchronizing the Generation and Playback of Event Sequences and Media Streams for the Web Audio API. WAC. Paris.

[52] Clark, C., & Tindale, A. (2014). Flocking: A Framework for Declarative Music-Making on the Web. ICMC|SMC. Athens.

[53] Zampoglou, M., Spala, P., Kontakis, K., Malamos, A. G., & Ware, J. A. (2013). Direct Mapping of X3D Scenes to MPEG-7 Descriptions. Web3D‘13, ACM. doi: 10.1145/2466533.2466540.

[54] Pohja, M. (2003). X3D and VRML Sound Components.

[55] Extensible 3D (X3D) Sound component. Retrieved from http://www.web3d.org/documents/specifications/19775-1/V3.3/Part01/components/sound.html [accessed May 2015].

[56] Ahmad, L., Boukerche, A., Hamidi, A., Shadid, A., Pazzi, R. (2008). Webbased e-learning in 3D large scale distributed interactive simulations using HLA/RTI. Parallel and Distributed Processing, IEEE.

[57] Repplinger, M., Loffler, A., Schug, B., Slusallek, P. (2009). Proceedings of the 14th International Conference on 3D Web Technology, ACM.

[58] Browsers support Web Audio API. Retrieved from http://caniuse.com/#feat=audio-api [accessed May 2015].

Downloads

Published

2015-12-01
Metrics
Views/Downloads
  • Abstract
    34
  • PDF
    23

How to Cite

Stamoulias, A., Lakka, E., and G. Malamos, A. (2015). “Wrapping” X3DOM around Web Audio API. International Journal of Interactive Multimedia and Artificial Intelligence, 3(5), 36–46. https://doi.org/10.9781/ijimai.2015.355

Issue

Vol. 3 No. 5 (2015): IJIMAI 2015 - Regular Issue.

Section

Regular Articles