Mosaicode and the visual programming of web application for music and multimedia
DOI:
https://doi.org/10.5216/mh.v18i1.53577Keywords:
Webaudio, Mosaicode, Visual programming, Language, Specific domain (programming) languages, Graphical Programming environmentAbstract
The development of audio application demands a high knowledge about this application domain, traditional program- ming logic and programming languages. It is possible to use a Visual Programming Language to ease the application development, including experimentations and creative exploration of the language. In this paper we present a Visual Programming Environment to create Web Audio applications, called Mosaicode. Different from other audio creation platforms that use a visual approach, our environment is a source code generator based on code snippets to create complete applications.
Downloads
References
CAMURRI, A.; HASHIMOTO, S.; RICCHETTI, M.; RICCI, A.; SUZUKI, K.; TROCCA, R.; VOL- PE, G. Eyesweb: Toward gesture and affect recognition in interactive dance and music systems. Computer Music Journal, 24(1), 57-69, 2000.
CLARK, C. B.; TINDALE, A. Flocking: a framework for declarative music-making on the Web. In SMC Conference and Summer School, 1550-1557, 2014.
DANKS, M. Real-time Image and Video Processing in GEM. In International Computer Music Conference, Thessaloniki, 1997.
GAMMA, E. Design patterns: elements of reusable object-oriented software. Pearson Education India, 1995.
GARTON, B.; TOPPER, D. RTcmix-Using CMIX in Real Time. In International Computer Music Conference, Thessaloniki. 1997.
GOMES, A.; HENRIQUES, J.; MENDES, A. Uma proposta para ajudar alunos com dificuldades na aprendizagem inicial de programação de computadores. Educação, Formação & Tecnologias, 1(1), 93-103, 2008. (ISSN 1646-933X)
GRONBACK, R. C. Eclipse modeling project: a domain-specific language (DSL) toolkit. Pearson Education, 2009.
HAEBERLI, P. E. ConMan: a visual programming language for interactive graphics. In ACM Si- gGraph Computer Graphics, 22 (4), 103-111, 1988.
HILS, D. D. Visual languages and computing survey: Data flow visual programming languages. Journal of Visual Languages & Computing, 3(1), 69-101, 1992.
LANSKY, P. Cmix release notes and manuals. Department of Music, Princeton University. Prin- ceton, New Jersey: Princeton University, 1990.
LAZZARINI, V.; COSTELLO, E.; YI, S. Csound on the Web. Csound conference. University of Bath, 2014.
LETZ, S.; DENOUX, S.; ORLAREY, Y.; FOBER, D. Faust audio DSP language in the Web. In Pro- ceedings of the Linux Audio Conference (LAC-15), Mainz, Germany, 2015.
MAHADEVAN, A.; FREEMAN, J.; MAGERKO, B. An interactive, graphical coding environment for EarSketch online using Blockly and Web Audio API. Web Audio Conference WAC-2016, April 4–6. Atlanta, GA: Georgia Institute of Technology, 2016.
MATHEWS, M. V. The digital computer as a musical instrument. Science, 142(3592), 553-557, 1963. MCCARTNEY, J. Rethinking the computer music language: SuperCollider. Computer Music
Journal, 26(4), 61-68, 2002.
MERNIK, M.; HEERING, J.; SLOANE, A. M. When and how to develop domain-specific langua-
ges. ACM computing surveys (CSUR), 37(4), 316-344, 2005.
MOORE, F. R. Elements of computer music. New Jersey: Prentice-Hall, 1990.
ORLAREY, Y.; FOBER, D.; LETZ, S. FAUST: an efficient functional approach to DSP program- ming. New Computational Paradigms for Computer Music, 1-33, 2009.
POPE, S. T. Machine tongues XV: Three packages for software sound synthesis. Computer Mu- sic Journal, 17(2), 23-54, 1993.
PUCKETTE, M. Pure Data: another integrated computer music environment. Proceedings of the second intercollege computer music concerts, 37-41, 1996.
PUCKETTE, M.; ZICARELLI, D. MAX-An interactive graphic programming environment. Op- code Systems, Menlo Park, CA. 1990.
REAS, C.; FRY, B. Processing: programming for the media arts. AI & SOCIETY, 20(4), 526-538, 2006.
RESIG, J.; FRY, B., REAS, C. Processing.js [Visual programming language], 2008. http://proces- singjs.org/
ROBERTS, C.; WAKEFIELD, G.; WRIGHT, M. The Web Browser As Synthesizer And Interface. In International Conference on New Interfaces for Musical Expression, 313-318, 2013.
ROBERTS, C.; WAKEFIELD, G.; WRIGHT, M.; KUCHERA-MORIN, J. Designing musical instru- ments for the browser. Computer Music Journal, 39(1), 27-40, 2015.
ROBERTS, C.; WRIGHT, M.; KUCHERA-MORIN, J.; HÖLLERER, T. Gibber: Abstractions for creative multimedia programming. In Proceedings of the 22nd ACM international conference on Multimedia (pp. 67-76). New York: ACM, 2014.
SCHIAVONI, F. L.; GONCALVES, L. L. From Virtual Reality to Digital Arts with Mosaicode. In Proceedings of the 19th Symposium on Virtual and Augmented Reality (SVR 2017) (pp. 200-206), 2017.
SCHIAVONI, F. L.; GONCALVES, L. L. Teste de usabilidade do sistema Mosaicode. In: Anais do IV Workshop de Iniciação Científica em Sistemas de Informação (WICSI). Lavras, MG: Universi- dade Federal de Lavras, p. 5–8, 2017.
TAYLOR, B.; ALLISON, J. BRAID: A web audio instrument builder with embedded code blocks. In Proceedings of the 1st international Web Audio Conference, 2015.
TROWER, J.; GRAY, J. Blockly language creation and applications: Visual programming for me- dia computation and bluetooth robotics control. In Proceedings of the 46th ACM Technical Sym- posium on Computer Science Education, 5-5, New York: ACM, 2015.
VERCOE, B. CSound manual. Cambridge, MA: Media Lab, 1986.
WILSON, C., KALLIOKOSKI, J. Web MIDI API. on W3C Working Draft 17 March 2015, Available
on: https://www.w3.org/TR/webmidi/. Accessed: 2017-09-30.
WYSE, L.; SUBRAMANIAN, S. The viability of the web browser as a computer music platform.
Computer Music Journal, 37(4), 10-23, 2013.
Downloads
Published
How to Cite
Issue
Section
