Audio Feedback Modulation for Motion Deviation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing audio bio-feedback systems, which use sonification to guide kinematic motions, face challenges in being embedded within audio sources without disrupting audibility, and struggle to provide effective feedback during activities like music listening.

Innovation Solution

A system that utilizes processors, sensors, and audio effects modules to analyze motion data and adjust audio signals in real-time, applying effects such as amplitude modulation, frequency modulation, and filtering to provide feedback on kinematic, kinetic, spatial, and temporal motion performance, even when music is being listened to.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If sonification is used to provide audio bio-feedback for guiding kinematic motions, then motion performance improvement is achieved, but the audio source is disrupted and audibility is affected

Engineering Contradiction:
Improvemotion performance improvementVSAvoidaudio source disruption
Core Design Contradiction:
ReliabilityVSObject-generated harmful factors

Solution Approach 1:

The patent combines the bio-feedback audio signal with the music audio source by merging them into a single mixed audio output. The bio-feedback signal is scaled and mixed with the music signal at appropriate volumes, allowing both the music and the motion-guiding audio cues to be heard simultaneously without one disrupting the other.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent introduces an intermediary mixing process that combines the bio-feedback audio signal with the music source. This intermediary step allows the system to integrate multiple audio sources (music and bio-feedback) into a unified output that maintains the integrity of both components while eliminating the disruption problem.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If audio effects are applied to embed bio-feedback within music signal, then audibility is maintained, but the underlying audio source may be degraded

Engineering Contradiction:
Improveaudibility maintenanceVSAvoidaudio source quality
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The patent applies dynamic audio effects processing where the characteristics of the audio signal (such as amplitude, frequency, or other parameters) are continuously adjusted based on the detected motion characteristics. This dynamic adjustment allows the bio-feedback to be embedded within the music signal in a way that adapts to the user's motion state while preserving the overall audio quality.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes parameters of the audio signal (such as amplitude, frequency, or other audio characteristics) based on the detected motion characteristics. By modifying audio parameters dynamically according to motion data, the system embeds bio-feedback within the music signal without severely degrading the underlying audio source.

Inventive Principle:
Principle #35Parameter changes

3Loss of information

If multiple audio sources are played simultaneously for bio-feedback, then motion guidance is provided, but complete disruption of audio sources occurs

Engineering Contradiction:
Improvemotion guidance informationVSAvoidaudio source disruption
Core Design Contradiction:
Loss of informationVSObject-generated harmful factors

Solution Approach 1:

The patent merges multiple audio sources (music and bio-feedback signals) into a single mixed audio output. This combining approach allows motion guidance information to be conveyed while preventing the complete disruption that would occur if multiple sources were played independently and simultaneously.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent applies partial action by selectively mixing only the necessary components of the bio-feedback signal with the music source at appropriate volume levels. This partial integration provides sufficient motion guidance information while avoiding the excessive audio disruption that would result from playing full-strength multiple audio sources simultaneously.

Inventive Principle:
Principle #16Partial or excessive action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This system enhances user performance by providing continuous, real-time audio feedback that optimizes motion characteristics, improving rehabilitation and sports performance by adjusting audio signals based on motion deviations, thus improving focus and accuracy without disrupting the underlying audio source.

Implementation Method 1

amplitude modulation (AM) is an audio Fx with two adjustable parameters: AM depth and AM frequency

Methodology Applied
Scientific EffectAmplitude modulation: Phase Modulation

Implementation Method 2

AM frequency is controllable from 0 Hz up to 16 Hz

Methodology Applied
Scientific EffectFrequency modulation: Phase Modulation

Data Source

PatentUS20240298976A1Method and system for adjusting audio signals based on motion deviation
Publication Date: 2024.09.12 UNIV OF MIAMI
  • US20240298976A1 patent drawing
  • US20240298976A1 patent drawing
  • US20240298976A1 patent drawing

AI summary

A system measures performance activity of a user using a motion capture device, such as one or more knee sleeves each a plurality of inertial-measurement unit. Captured motion characteristic data is classified against previously captured data and then mapped to particular audio effects, which are then altered in different ways depending on the classification and provided the user. The audio feedback works to improve the user's performance of the activity by changing between negative and positive feedback depending on the user's performance. The system regularly measures the motion capture data, altering audio effects provided to the user, until the user reaches an improvement goal.