Free-Space Music Controller Using Infrared Shadow Sensing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing music systems lack transparency and symmetry in rhythmic transfer functions, making it difficult for non-musicians and casual players to achieve coherent and aesthetically pleasing performances, as physical contact interfaces introduce perceivable delays and constraints in rhythmic synchronization.

Innovation Solution

A free-space interactive music system employing opto-mechanical design with radial sensors and infrared shadows to detect player movements, providing real-time, non-contact body sensing and feedback, allowing for seamless integration of kinesthetic inputs into audio and visual responses, and enabling precise synchronization with pre-recorded music.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If physical contact interfaces are used for music input, then tactile feedback and control precision are improved, but rhythmic synchronization delays and player constraints increase

Engineering Contradiction:
Improvecontrol precisionVSAvoidrhythmic synchronization delays
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent replaces physical contact interfaces with an optical sensing system using infrared sensors and shadow detection. Players interact through body movements in free space without physical contact, eliminating mechanical interface delays while maintaining precise control through optical detection of position and motion.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces infrared light and shadow patterns as intermediaries between player movement and system detection. The optical field serves as a mediator that captures player position and motion without physical contact, enabling real-time rhythmic synchronization while preserving tactile expressiveness through visual feedback.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If physical contact interfaces are used for music input, then control precision is improved, but ease of operation for non-musicians deteriorates

Engineering Contradiction:
Improvecontrol precisionVSAvoidease of operation
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent replaces complex physical interfaces with intuitive body movement in free space. Non-musicians can naturally express themselves through movement without learning specialized techniques, while the optical system maintains precise control detection through shadow and position sensing.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

Instead of requiring players to adapt to fixed interface constraints, the patent inverts the approach by having the interface adapt to natural body movement. The system detects and responds to organic motion patterns, making music creation accessible to non-musicians while maintaining precision through optical measurement.

Inventive Principle:
Principle #13The other way round (Inversion)

3Stability of the object's composition

If transparent rhythmic processing is implemented, then aesthetic integration is improved, but system complexity increases

Engineering Contradiction:
Improveaesthetic integrationVSAvoidsystem complexity
Core Design Contradiction:
Stability of the object's compositionVSDevice complexity

Solution Approach 1:

The patent uses optical sensing and computational processing to achieve transparent rhythmic alignment. The system automatically quantizes and synchronizes player movements to the musical tempo through software algorithms, creating seamless aesthetic integration without visible mechanical processing components.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent implements real-time visual feedback through light pipes and displays that show player position and rhythmic alignment. This feedback loop enables automatic tempo synchronization and rhythmic quantization, achieving aesthetic integration through continuous monitoring and adjustment without increasing apparent system complexity.

Inventive Principle:
Principle #23Feedback

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables effortless and precise musical expression for both beginners and experts, maintaining aesthetic integration and rhythmic sync across all musical parameters, with transparent and invisible rhythmic processing that enhances creative freedom and synchronizes player actions with media responses.

Implementation Method 1

An overhead optical source fixture assembly provides an invisible infrared (IR) flood to generate the player IR shadows which affect Type I sensor shadow transitions

Methodology Applied
Scientific EffectInfrared radiation: Infrared Radiation

Implementation Method 2

Narrow-field optical, passive, through-beam (line-of-sight), shadow-transition detecting Type I sensors are employed

Methodology Applied
Scientific EffectShadow detection: Shadow

Implementation Method 3

Wide-field, active (reflective), proximity (height) detecting Type II Sensors are also employed

Methodology Applied
Scientific EffectReflective ranging: Reflection

Data Source

PatentUS7402743B2Free-space human interface for interactive music, full-body musical instrument, and immersive media controller
Publication Date: 2008.07.22 SPACEHARP CORP
  • US7402743B2 patent drawing
  • US7402743B2 patent drawing
  • US7402743B2 patent drawing

AI summary

“Method and apparatus entraining interactive media players into a sustained experience of “Kinesthetic Spatial Sync,” defined as a perceived simultaneity and spatial superposition between a non-tactile, full body (“free-space”) input control process and immersive multisensory feedback. Asynchronous player input actions and (MIDI tempo) clock-synchronous media feedback events exhibit a seamless synesthesia1 or multisensory events fused into an integral event perception, this being between musical sound (hearing), visual responses (sight), and body kinesthetic (radial extension, angular position, height, speed, timing, and precision). This non-tactile interface process and multisensory feedback “look and feel” is embodied as an optimal ergonomic human interface for interactive music and as a six-degrees-of-freedom full-body-interactive immersive media controller. The invention provides for a wide scope of fully reconfigurable transfer functions between kinesthetic input features and media responses (“Creative Zone Behaviors”) managed by means of MIDI protocol and/or display interface commands. Alternative forms of optomechanical embodiments are disclosed, including floor Platform systems and floor-stand-mounted Console systems, all of which exhibit identical free-space input and integrated media response paradigms.”