Towards an interactive tool for music and dance: gestures, laban movement analysis and spectromorphology

Leandro Souza; Sergio Freire Garcia

doi:10.5216/mh.v18i1.53576

Authors

Leandro Souza Universidade Federal de Minas Gerais, Belo Horizonte, Brasil http://orcid.org/0000-0001-7304-3907
Sergio Freire Garcia Universidade Federal de Minas Gerais, Belo Horizonte, Brasil) http://orcid.org/0000-0002-5072-3114

DOI:

https://doi.org/10.5216/mh.v18i1.53576

Keywords:

Gesture, Interactive musical systems, Interactive dance, Laban

Abstract

The paper presents a real-time tool for the segmentation and analysis of body gestures, part of a larger se- tup for exploring music and dance in the contexts of electroacoustic composition, live-electronics and other interac- tive performances. The idea of gesture is the foundation of the proposed interactive strategies, and is discussed from different points of view. The current implementation uses the Max/Msp programming language and Kinect sensors. The segmentation of dance gestures is based on the inspection of the zero-crossings of the acceleration curve of ea- ch body joint. Concepts from Laban Movement Analysis are used to qualify the extracted gestures. Dance improvi- sations on Petrushka excerpts are the basis of a case study, where the relations between the music (tempo, pulses,instrumentation, character) and Laban Basic Actions are stressed.

Downloads

Download data is not yet available.

Author Biographies

Leandro Souza, Universidade Federal de Minas Gerais, Belo Horizonte, Brasil

Leandro Souza (Universidade Federal de Minas Gerais, Belo Horizonte, Brasil) lleandro_ssouza@hotmail.com

Sergio Freire Garcia, Universidade Federal de Minas Gerais, Belo Horizonte, Brasil)

Sergio Freire (Universidade Federal de Minas Gerais, Belo Horizonte, Brasil) sfreire@musica.ufmg.br

References

BINDIGANAVALE, Ramamani. Building parameterized action representations from observa- tion. Doctoral dissertation University of Pennsylvania Philadelphia, 2000, Pennsylvania: Uni- versity of Pennsylvania, 2000.124p.

BACHRATÁ, Petra.InteraçãoGestualnamúsicaparainstrumentos e sons eletroacústicos.349f. Doctoral dissertation.Department of Communication and Art – Aveiro University.Aveiro: PT, 2010. p.349.

CARAMIAUX, Baptiste et al. Movement qualities as interaction modality. In: Designing Interac- tive Systems Conference, 12, 2012, New Castle: Proceedings of the Designing Interactive Sys- tems Conference, 2012. p. 761–769

CAMURRI, A., De Poli G., Leman M., “MEGASE - A Multisensory Expressive Gesture Applica- tions System Environment for Artistic Performances”. Proc. Intl Conf CAST01, GMD, St Augus- tin-Bonn, 2001. p.59-62.

CAMURRI, A., Mazzarino, B., Ricchetti, M., Timmers, R., & Volpe, G. Multimodal analysis of expressive gesture in music and dance performances. In Gesture-based communication in hu- man-computer interaction, volume 2915 of Lecture Notes in Computer Science Berlin/Heidel- berg: Springer Verlag. 2004. p. 357–358

CHION, Michel. Guide to Sound Objects. Pierre Schaeffer and Musical Research.English transla- tion of the version from 1983 by John Dack and Christine North. In: ElectroAcoustic Resource, 1995. Disponível em: <http://www.ears.dmu.ac.uk> .

EKMAN, P. and Friesen, W. V. The repertoire of nonverbal behavior: categories, origins, usage, and coding. Semiotics.1969. p. 49-98.

FERNANDES, Ciane. Esculturaslíquidas: a pré-expressividade e a forma fluidanadançaeducati- va (pós) moderna. In: Cadernos Cedes, v. 53. n. 21, p. 7- 29, 2001

FERNANDES, Ciane. O CorpoemMovimento: o sistema Laban/Bartenieffnaformação e pesqui- saemartescênicas. 2a edition. São Paulo: Annablume, 2006. p. 408.

HASHIM, W., Noor, N., and Adnan, W.The Design of Aesthetic Interaction: Towards a Graceful Interaction Framework.Human Development, 2009,p. 24-26.

HATTEN, Robert S. Interpreting Musical Gestures, Topics, and Tropes: Mozart, Beethoven, and Schubert. Bloomington: Indiana University Press, 2004. P.358.

JENSENIUS, Alexander R., Wanderley, M., Godø y, R. I., Leman, M. Musical gestures: Concepts and Methods in Research. In R. I. Godøy& M. Leman (Eds.), Musical Gestures: Sound, Move- ment, and Meaning. New York: Routledge.2010.

LABAN, Rudolf. Domínio do Movimento. Lisa Ullmann (org.). São Paulo: Summus, 1978.p.268. LABAN, Rudolf. Choreutics. Annotated and edited by Lisa Ullman.London: MacDonald and

Evans, 1966, p. 48

LEMAN, Marc. “Embodied music cognition and mediation technology.” Massachusetts: The MIT Press.2008

NAVEDA, Luis e Santana, Ivani. “Topos” toolkit for Pure Data: exploring the spatial features of dance gestures for interactive musical applications. In: The Joint Conference ICMC-SMC, 2014, Athens, Proceedings of the Joint Conference ICMC-SMC Athens: ICMC-SMC, 2014, p. 470–478,

NAVEDA, Luis “ Gesture in Samba: Across-modal analysis of dance and music from the Afro- Brazilian culture.” Doctoral dissertation. Ghent University. Belgíca. 2011, p.342.

SCHACHER, C. Jan. Motion To Gesture To Sound: Mapping For Interactive Dance. in: The Con- ference on New Interfaces for Musical Expression,2010, Sidney, Proceedings of the 2010 Confe- rence on New Interfaces for Musical Expression Sidney: NIME, 2010, p. 250–254.

SCHACHER, J.C., The Body in Electronic Music Performance. In: Proceedings of the 2012. Sound And Music Computing Conference (SMC 2012), Copenhagen, Denmark.

SCHAEFFER, Pierre. Traité des ObjetsMusicaux (nouvelle édition 1977). Paris: Éditions du Seu- il. 1966.

SMALLEY, Denis. Spectromorphology: explaining sound-shapes. Organized Sound 2(2):p. 107- 26. 1997.

SMITH, w. Steven.The scientis and engineer’s guide ti digital signal processing. San Diego: Cali- fornia Technical Publishing, 1997.

STRAVINSKY, Igor. Petrushka, for orchestra.Dover, 1988 (1912 version).

STRAVINSKY, Igor. Petrushka, for orchestra. Cleveland Orchestra, conducted by G. Szell.

Sony Classics, 1992.

RAN, Bernstein et al. Multitask Learning for Laban Movement Analysis. In: The 2nd Interna- tional Workshop on Movement and Computing, 2015, Proceedings of the 2nd International Workshop on Movement and Computing Vancouver: Simon Fraser University, 2015.p.37

WISHART, Trevor. On Sonic Art (new revised edition, Emmerson, Simon, ed.). New York: Rou- tledge, 1996.p.357.

ZHAO, Liwei. Synthesis and acquisition of laban movement analysis qualitative parameters for communicative gestures Doctoral dissertation University of Pennsylvania Philadelphia, Pennsylvania: University of Pennsylvania, 2012.160p.