Multi-Device Audio Control Using User Position And Gestures

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing surround audio systems require manual reconfiguration when mobile devices are moved, and there is no effective method for automatic audio data control based on user position and gesture recognition.

Innovation Solution

Mobile devices form a wireless network using short-distance communication modules like Bluetooth and Wi-Fi, employing sensors and transceivers to detect user position and gestures, and transmit audio data control signals using inaudible high frequencies for synchronization and interference reduction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If manual reconfiguration is used for each device movement, then audio channel assignment is fixed and reliable, but device complexity and ease of operation deteriorate

Engineering Contradiction:
Improveease of operationVSAvoiddevice complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system enables automatic audio channel assignment and device role determination based on detected user position and gesture data. Mobile devices autonomously negotiate their roles (master/slave) and audio channel assignments without requiring manual reconfiguration, making the system self-organizing and eliminating the need for user intervention when devices are moved or added to the network.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system dynamically changes audio channel assignments and device roles based on real-time parameters such as user position coordinates and gesture recognition results. When a user approaches a mobile device or performs specific gestures, the system automatically reassigns audio channels and updates device functions according to the detected parameters, enabling adaptive audio reproduction without manual intervention.

Inventive Principle:
Principle #35Parameter changes

2Ease of operation

If automatic audio control based on user position and gesture is implemented, then ease of operation improves, but measurement precision and reliability requirements increase

Engineering Contradiction:
Improveease of operationVSAvoidmeasurement precision
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The system replaces manual mechanical configuration operations with automated sensor-based detection and control. Instead of manually configuring audio channels when devices are moved, the system uses sensors (cameras, microphones, accelerometers, gyroscopes) to detect user position and gestures, then automatically translates these physical measurements into audio channel assignments and device role determinations, eliminating the need for manual reconfiguration.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system continuously monitors user position and gesture data through sensors and provides real-time feedback by automatically adjusting audio channel assignments and device roles. This closed-loop feedback mechanism ensures that the audio reproduction system continuously adapts to user actions, maintaining high measurement precision requirements while significantly improving ease of operation through automated control.

Inventive Principle:
Principle #23Feedback

3Adaptability or versatility

If multiple mobile devices form a wireless network for audio reproduction, then adaptability improves, but signal interference and energy consumption increase

Engineering Contradiction:
ImproveadaptabilityVSAvoidsignal interference
Core Design Contradiction:
Adaptability or versatilityVSObject-affected harmful factors

Solution Approach 1:

The system segments the multi-device audio reproduction task by assigning specific audio channels to specific mobile devices based on their detected roles and positions. Each mobile device is responsible for reproducing only its assigned audio channel, which reduces signal interference between devices and optimizes energy consumption by preventing redundant transmissions. The segmentation is dynamically determined through sensor-based user position and gesture detection.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS12436732B2Method and apparatus for controlling audio data by recognizing user gesture and position using multiple mobile devices
Publication Date: 2025.10.07 TECHFLUX
  • US12436732B2 patent drawing
  • US12436732B2 patent drawing
  • US12436732B2 patent drawing

AI summary

A method or apparatus for multi-channel audio data control using plural mobile devices comprising steps of detecting user presence through assigned frequency, transmitting audio data to the nearest device from the user based on user presence information, and recognize user gesture to control the audio data. A remote controller held by the user may also have a priority to control audio data.