The progressively adaptive generative "smart" instrument for personalized
human motion-based musical compositions and
sonification of the present invention is an
algorithm / apparatus / device for
neurorehabilitation, therapy, and performance using
human motion to generate music or data
sonification by integrating
computer vision (CV) with adaptive musical
instrumentation. The present invention provides a real-time
generative music engine and framework that integrates digital symbolic representations of music, audio inputs or files, text or voice-prompts, audio inputs or files, and / or musical artifacts. Further, the present invention includes access to a
database that stores and catalogs the elements which can be used to guide or generate a personalized
musical composition or sonified output, integrating CV and the generative framework, developing a modular "development" style framework, developing progressively adaptive mappings for personalized / customized user interactions with motion-based
musical composition and sonified motion, and correlating music and motion data in a digital analytics platform.