Audio Codec Side Information for Packet Loss Concealment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing audio encoding technologies face challenges in maintaining audio quality during packet loss in communication networks, particularly in CELP encoding, due to inconsistencies in adaptive codebooks and increased algorithmic delay, which degrades voice communication quality.

Innovation Solution

An audio coding system that includes an audio encoding device and method for encoding audio signals using side information calculated from a look-ahead signal, which encodes and transmits parameters like pitch lag and gain, and an audio decoding device that decodes and synthesizes audio signals using accumulated side information to recover audio quality without increasing algorithmic delay.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If packet loss concealment is performed by copying decoded audio signal from previously received packets, then implementation complexity is reduced, but audio quality degrades when audio properties change suddenly

Engineering Contradiction:
Improvepacket loss concealment implementation complexityVSAvoidaudio quality during packet loss
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The patent performs preliminary encoding of audio signals at the transmitting end before transmission, creating encoded audio data that can be used for packet loss concealment. This preliminary action allows the receiving end to reconstruct lost packets using the pre-encoded data without requiring complex real-time analysis, thus maintaining audio quality while reducing implementation complexity.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces encoded audio data as an intermediary element between the original audio signal and the packet loss concealment process. This intermediary contains essential audio characteristics that facilitate accurate reconstruction of lost packets, bridging the gap between simple copying methods and high-quality reconstruction without requiring complex algorithms at the receiving end.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If side information is encoded and transmitted for packet loss concealment, then audio quality during packet loss improves, but communication bandwidth consumption increases

Engineering Contradiction:
Improveaudio quality during packet lossVSAvoidcommunication bandwidth consumption
Core Design Contradiction:
ReliabilityVSLoss of energy

Solution Approach 1:

The patent extracts only the essential side information parameters needed for packet loss concealment from the full audio signal, such as key spectral characteristics and temporal features. By taking out only the critical elements rather than transmitting redundant data, the method maintains audio quality during packet loss while minimizing bandwidth consumption.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent transforms audio signal characteristics into compact parameter representations for transmission. By changing the form of the data from raw audio samples to condensed parameters, the system achieves efficient bandwidth utilization while preserving the essential information needed for accurate packet loss concealment and high audio quality.

Inventive Principle:
Principle #35Parameter changes

3Adaptability or versatility

If audio packets are transmitted through communication network, then audio communication functionality is enabled, but packet loss and errors occur due to network congestion

Engineering Contradiction:
Improveaudio communication functionalityVSAvoidaudio packet transmission reliability
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent prepares encoded audio data and side information at the transmitting end before transmission occurs. This beforehand cushioning creates a buffer of preparatory work that can be used to reconstruct lost packets, cushioning against the reliability issues caused by network congestion and packet loss while maintaining audio communication functionality.

Inventive Principle:
Principle #11Beforehand cushioning (Prior cushioning)

Solution Approach 2:

The patent uses copying of encoded audio data and parameters from previously transmitted packets to reconstruct lost packets at the receiving end. This copying mechanism enables recovery from packet loss without requiring retransmission, maintaining audio communication functionality despite network reliability issues.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS9881627B2Audio coding device, audio coding method, audio coding program, audio decoding device, audio decoding method, and audio decoding program
Publication Date: 2018.01.30 NTT DOCOMO INC
  • US9881627B2 patent drawing
  • US9881627B2 patent drawing
  • US9881627B2 patent drawing

AI summary

An audio signal transmission device for encoding an audio signal includes an audio encoding unit that encodes an audio signal and a side information encoding unit that calculates and encodes side information from a look-ahead signal. An audio signal receiving device for decoding an audio code and outputting an audio signal includes: an audio code buffer that detects packet loss based on a received state of an audio packet, an audio parameter decoding unit that decodes an audio code when an audio packet is correctly received, a side information decoding unit that decodes a side information code when an audio packet is correctly received, a side information accumulation unit that accumulates side information obtained by decoding a side information code, an audio parameter missing processing unit that outputs an audio parameter upon detection of audio packet loss, and an audio synthesis unit that synthesizes decoded audio from the audio parameter.