Web Applications and Projects { Sound Music Movement } Interaction

CoMo.te

CoMo.te is a smartphone applications (iOS and Android) that allows for streaming motion data (accelerometer, gyroscope) from the smartphone to desktop applications using either the OSC protocol or Websockets. The network's setup is facilitated by the use of a QR code generated by the targeted remote application receiving the motion sensor data.

CoMo.te is especially designed for the CoMo applications family that enables real-time interaction between gestures/movements and sounds. Nevertheless, the CoMo.te application can be used with any software that makes use of the OSC protocol.

Among the CoMo applications that make use of CoMo.te are CoMo-Vox to learn and train conducting gestures, and CoMo-Elements to interact collectively thought body movements with recorded sounds.

CoMo.te and the CoMo applications are software designed and developed by IRCAM in the Sound-Music-Movement-Interaction team (UMR STMS).

Demo

Technical details

The CoMo.te application is open-source and available on Github: https://github.com/ircam-ismm/comote.

One of the main goal of the application is to provide unified axis and units across the different platforms. For this reason, we choose to follow the devicemotion W3C specification.

To integrate the CoMo.te application within your own application, we provide 2 different related packages for Node.js and Max/MSP. You can find more information on our dedicated github repository https://github.com/ircam-ismm/comote-helpers.

The Max/MSP package can be directly downloaded at the following url https://github.com/ircam-ismm/comote-helpers/releases/latest/download/CoMo.te.zip

If you want to adapat existing application using R-IoTs to CoMo.te, you can follow the conversion guildelines described here

Screenshots

Home
Configuration
Play mode

Credits

CoMo.te is developed by Ircam and the Music and Sound Science and Technology Joint Research Unit (STMS), supported by Ircam, CNRS, the French Ministry of Culture and Sorbonne University.

Produced with the support of the French Ministry of Education, Youth and Sports (Edu-up system), the National Research Agency (ELEMENT project), and in partnership with Radio France.