Skip to content

Partner project

MotionComposer: Music Through Movement

A therapy device that turns physical movement directly into music and sound – contactless and in real time.

Video (60 seconds; the sound can be switched on in the control bar): a person's movement is detected and turned into sound.

Starting point

People with very different abilities, including people with disabilities, should experience movement as something that has an immediate effect.

Approach

  • Movements are detected contactlessly, without sensors worn on the body
  • From large gestures to very fine actions such as the blink of an eye
  • The detection is turned into music and sound in real time

What is in place

  • Integrated real-time system of sensors, motion analysis and interactive media
  • Experience in developing usable complete solutions, not just individual methods

Partner

We have been developing the MotionComposer together with our partner MotionComposer GmbH since 2018.

The MotionComposer gives patients, in particular also people with disabilities, an aid on their way to more joy in movement and self-efficacy. Because no sensors are worn on the body, freedom of movement is preserved and the barrier to entry is low. Prepared sound worlds offer different forms of expression for all age groups and abilities.

Two women sit facing each other on chairs, laughing and moving their arms; in the foreground, a device stands on a tripod
MotionComposer in use.

Further topics

AI Technologies

Vision AI

Image-based and video-based AI, grown out of many years of experience in industrial machine vision.

AI Technologies

Sensor Fusion & Physical AI

Combining information from different physical measurement sources – camera, radar, LiDAR, and other sensors – as the basis for systems that act in the real world.

Solutions

Person Detection

Detecting, tracking, and understanding people in camera images: position, motion, posture, gestures, and face – with high detection performance and a low false alarm rate.

Would you like to make AI usable in your company?

Whether a first AI adoption or a complex development task – we discuss the requirements and suitable next steps with you.

Discuss your AI project