Audio Object Information Image Visual Selection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

It is difficult to adjust the volume and other audio characteristics of audio objects in video content encoded with object audio encoding technology, as selecting the desired audio object solely by listening to the output sound is extremely challenging.

Innovation Solution

An audio processing apparatus and method that displays audio object information images based on positional information, allowing users to select and adjust audio objects visually, with features like volume and sound quality adjustment, and rendering processing to position audio objects accurately on a display.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If object audio encoding technology is used to encode multiple audio objects with positional information, then the ability to manipulate individual sound sources is improved, but the difficulty of selecting and adjusting specific audio objects during reproduction worsens

Engineering Contradiction:
Improveability to manipulate individual sound sourcesVSAvoiddifficulty of selecting specific audio object
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent introduces a visual dimension by displaying audio object information images on the display unit. Instead of relying solely on auditory selection, the system projects audio objects into a visual space where users can see and select them. This dimensional transition from audio-only to audio-visual interface resolves the contradiction by making individual audio objects distinguishable and selectable through visual cues.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent introduces an intermediary visual interface (audio object information images) between the encoded audio objects and the user. This intermediary layer translates invisible audio object data into visible representations that users can interact with, facilitating easy selection and manipulation of specific audio objects without directly exposing the complex encoding structure.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If audio object information is encoded with positional metadata, then the precision of audio object positioning is improved, but the complexity of the encoding system worsens

Engineering Contradiction:
Improveprecision of audio object positionVSAvoidcomplexity of encoding system
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts positional information from the encoded audio objects and displays it separately as visual information on the display unit. By separating the positional metadata from the audio signal processing path and presenting it visually, the system maintains high positioning precision while reducing the operational complexity of managing encoded audio objects.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentEP3468233B1Sound processing device, sound processing method, and program
Publication Date: 2021.06.30 SONY GROUP CORP
  • EP3468233B1 patent drawingFigure 1
  • EP3468233B1 patent drawingFigure 2
  • EP3468233B1 patent drawingFigure 3

AI summary

The present technology relates to an audio processing apparatus and method and a program that are configured to adjust audio characteristics more easily. This audio processing apparatus has a display control unit configured, on the basis of object positional information of an audio object, to cause a display unit to display an audio object information image indicative of a position of the audio object and a selection unit configured to select the predetermined audio object from among one or a plurality of the audio objects. The present technology is applicable to video/audio processing apparatuses.