3D Visual Audio Processing Configuration via Intermediary Interface

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Configuring sophisticated audio processing systems in sound environments is challenging due to imperceptible processing characteristics, making it difficult to fine-tune and intuitively control noise cancellation and sound sensitivity settings.

Innovation Solution

An audio processing system that uses a user interface with 3D interactable visual objects to represent audio processing characteristics, allowing users to modify spatial variations through augmented or virtual reality platforms, enabling intuitive control of microphone arrays and loudspeakers via hand gestures or touch inputs.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If audio processing systems use sophisticated processing characteristics (e.g., noise cancellation, sound sensitivity control), then the audio processing capability is improved, but the configurability and intuitiveness deteriorate because these characteristics are imperceptible and can only be inferred through close attention to sound behavior data

Engineering Contradiction:
Improveaudio processing capabilityVSAvoidconfigurability
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent introduces an intermediary visualization layer between the audio processing system and the user. This layer converts imperceptible audio processing characteristics (noise cancellation levels, sound sensitivity, beamforming patterns) into perceivable visual representations. Users interact with these visual representations rather than directly with the audio parameters, making sophisticated audio processing configurable and intuitive while maintaining high processing capability.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces traditional mechanical/audio-based interaction (listening to sound behavior data to infer processing characteristics) with visual-based interaction. Instead of requiring users to pay close attention to audio data to understand processing characteristics, the system substitutes audio perception with visual perception, allowing users to directly see and manipulate processing parameters through visual interfaces.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Reliability

If audio processing systems implement spatial variation of processing characteristics (e.g., spatial sensitivity of microphone array), then the audio processing performance is improved, but the user's ability to perceive and control these characteristics deteriorates because spatial variations are imperceptible without visual rendering

Engineering Contradiction:
Improvespatial processing performanceVSAvoidspatial characteristic perceivability
Core Design Contradiction:
ReliabilityVSDifficulty of detecting and measuring

Solution Approach 1:

The patent uses visual rendering to represent spatial variations in audio processing characteristics. Different spatial zones and sensitivity levels are depicted through visual properties (colors, intensities, shapes) that correspond to audio characteristics. This allows users to perceive and understand spatial variations that would otherwise be imperceptible, enabling effective control of spatial processing performance.

Inventive Principle:
Principle #32Color changes

3Ease of operation

If the system provides detailed visualization of audio processing characteristics, then the configurability is improved, but the complexity of the system increases due to the need for rendering platforms and additional processing

Engineering Contradiction:
ImproveconfigurabilityVSAvoidsystem complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent implements a universal visualization framework that can represent multiple types of audio processing characteristics (noise cancellation, beamforming, spatial sensitivity, voice activity) through a common visual language and interaction paradigm. This multi-functional approach allows the system to provide detailed configurability for various audio processing features while using a single, cohesive interface framework, thereby managing complexity through consolidation rather than proliferation of separate systems.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentEP4391592A1Visual platforms for configuring audio processing operations
Publication Date: 2024.06.26 CERENCE OPERATING CO
  • EP4391592A1 patent drawingFigure 1
  • EP4391592A1 patent drawingFigure 2
  • EP4391592A1 patent drawingFigure 3

AI summary

Disclosed are systems, methods, and other implementations, including a method for controlling a configurable audio processor, coupled via a plurality of transducers (such as the microphones 220A-C and/or the loudspeakers 224A-B of FIG. 2) to an acoustic environment, that includes determining a three-dimensional spatial variation in the acoustic environment of a processing characteristic of the audio processor based on configuration values for the audio processor, forming a three-dimensional image of the three-dimensional spatial variation of the processing characteristic, and providing the three-dimensional image for presentation to a user for controlling the configuration values.