Dynamic Audio Distribution from Camera-Detected User Positions

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing audio reproduction systems do not adapt to the actual positions of users in a room, leading to suboptimal acoustic experiences, especially when multiple users are present and their positions change.

Innovation Solution

An audio stream management method that uses a camera to detect user positions, calculates an optimal bearing angle, and adjusts the audio distribution based on this angle to enhance the acoustic experience dynamically.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If a fixed theoretical listening position is assumed for audio distribution, then the system configuration is simplified, but the acoustic experience deteriorates when users are not at that position

Engineering Contradiction:
Improvesystem configurationVSAvoidacoustic experience adaptation
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The audio distribution system transitions from a static configuration based on a fixed theoretical listening position to a dynamic system that continuously adapts to actual user positions. The camera captures real-time user positions, and the mixing means adjust audio distribution dynamically based on detected positions, making the system flexible and adaptive to changing conditions.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the distribution parameters of audio channels based on detected user positions. Instead of using fixed parameters, the mixing means adjust the audio distribution parameters dynamically according to the actual positions of users in the room, allowing optimal acoustic experience for different user configurations.

Inventive Principle:
Principle #35Parameter changes

2Adaptability or versatility

If the audio system adapts to multiple user positions, then the acoustic experience improves, but the system complexity increases due to position detection and dynamic adjustment

Engineering Contradiction:
Improveuser position adaptationVSAvoidposition detection and control system
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

A camera is introduced as an intermediary device to detect user positions in the room. The camera captures images, and the processing means extract position information from these images to control the audio distribution. This intermediary simplifies the overall system by using a common device (camera) to bridge the gap between user positions and audio configuration.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system automatically detects user positions and adjusts audio distribution without requiring manual calibration or user intervention. The camera continuously monitors the room, and the processing means automatically calculate optimal audio distribution based on detected positions, making the system self-configuring and eliminating complex manual setup procedures.

Inventive Principle:
Principle #25Self-service

3Productivity

If real-time user position detection is implemented, then the acoustic experience adapts dynamically, but the processing requirements and system complexity increase

Engineering Contradiction:
Improvereal-time adaptation capabilityVSAvoidimage processing and calculation system
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system extracts only the essential position information from camera images, rather than processing complete image data. The processing means identify user positions and extract relevant spatial coordinates to determine optimal audio distribution, reducing processing complexity while maintaining real-time adaptation capability.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentEP4297410B1Method for managing an audio stream using a camera and associated decoder equipment
Publication Date: 2025.10.15 SAGEMCOM BROADBAND SAS
  • EP4297410B1 patent drawingFigure 1
  • EP4297410B1 patent drawingFigure 2~3
  • EP4297410B1 patent drawingFigure 4

AI summary

The invention relates to a method for managing an audio stream played by a group of audio playback devices, said group being arranged in a given location. According to the invention, the method comprises the steps of: - Detecting, on at least one image, the user(s) present in the image and deducing, for each of said users, at least one characteristic piece of information regarding the user's position in said image, - Determining, at least from the various characteristic pieces of information, an optimal bearing angle (βopt), - Providing mixing means distributing the audio stream among the different audio playback devices of the group, a characteristic value of the optimal bearing angle so that the mixing means distribute the audio stream at least according to said value.