Audio Signal Processing Apparatus Mute State Optimization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The existing object audio technologies require a significant amount of arithmetic operations for rendering and HRTF processes, which consume excessive battery power, especially in devices like smartphones, necessitating a reduction in arithmetic operation without compromising the sense of presence.

Innovation Solution

A signal processing apparatus and method that perform at least one of the decoding or rendering processes based on audio object mute information, omitting processing during mute intervals or outputting predetermined values, thereby reducing the arithmetic operation amount while maintaining high presence.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If rendering process and HRTF process are performed for virtual speakers to achieve high sense of presence, then audio reproduction quality is improved, but arithmetic operation amount increases

Engineering Contradiction:
Improveaudio reproduction qualityVSAvoidarithmetic operation amount
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent applies partial action by performing rendering and HRTF processes only for audio objects that are not in mute state. The decoding apparatus checks the mute state of each audio object and selectively processes only those requiring output, thereby reducing unnecessary arithmetic operations while maintaining audio reproduction quality for active sound sources.

Inventive Principle:
Principle #16Partial or excessive action

2Manufacturing precision

If rendering process and HRTF process are performed continuously to maintain high sense of presence, then audio reproduction quality is improved, but battery consumption increases

Engineering Contradiction:
Improveaudio reproduction qualityVSAvoidbattery consumption
Core Design Contradiction:
Manufacturing precisionVSUse of energy by moving object

Solution Approach 1:

The patent implements periodic action by checking the mute state of audio objects at regular intervals and adjusting processing accordingly. The decoding apparatus periodically evaluates which audio objects are in mute state and skips rendering and HRTF processes for those intervals, creating a rhythm of processing only when necessary. This reduces battery consumption while maintaining audio quality during active playback periods.

Inventive Principle:
Principle #19Periodic action

3Manufacturing precision

If full decoding and rendering processes are performed for all audio objects, then audio reproduction quality is improved, but processing time increases

Engineering Contradiction:
Improveaudio reproduction qualityVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent extracts and identifies mute audio objects from the overall audio stream using mute state information. By separating mute audio objects from active ones, the system excludes mute objects from the rendering and HRTF processing pipeline entirely. This extraction approach significantly reduces processing time while maintaining audio reproduction quality for non-mute objects.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS11743646B2Signal processing apparatus and method, and program to reduce calculation amount based on mute information
Publication Date: 2023.08.29 SONY GROUP CORP
  • US11743646B2 patent drawing
  • US11743646B2 patent drawing
  • US11743646B2 patent drawing

AI summary

The present technology relates to a signal processing apparatus and method, and a program that make it possible to reduce an arithmetic operation amount.The signal processing apparatus performs, on the basis of audio object mute information indicative of whether or not a signal of an audio object is a mute signal, at least either one of a decoding process or a rendering process of an object signal of the audio object. The present technology can be applied to a signal processing apparatus.