OSMoSIS: interactive sound generation system for children with autism

This paper reports on the design and pilot evaluation of a system that uses movement, music and sounds to support playful interactions for children with Autism Spectrum Conditions (ASC). OSMoSIS (Observation of Social Motor Synchrony with an Interactive System) is a musical motion-based game. The design was inspired by previous research that suggests that music and movement can be helpful in fostering communication and expression skills, and the first author's experiences as a music therapist. OSMoSIS converts movements into sounds, using a Microsoft Kinect-based system which provides full body tracking. A recently conducted evaluation with a group of 11 children with autism aged 5-- 11 years old showed positive engagement with the system, and some instances of imaginative play. In our discussion, we highlight implications for the design of future music and movement systems to support learning in children with autism.