Audio Processing Apparatus for Synchronized Video

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In applications like live television broadcasts and teleconferences, the return delay from satellite links can cause over-talking issues due to unsynchronized audio and video signals, and similar problems arise in live streaming where maintaining audio-video synchronization is challenging.

Innovation Solution

An apparatus that classifies audio signals into two categories based on synchronization needs, processing the first audio signal for time synchronization with a video signal, introducing a longer delay, and the second audio signal with a shorter delay, optimized for minimum delay, to ensure accurate synchronization.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If audio signals are processed with a single fixed delay to synchronize with video, then audio-video synchronization is improved, but conversational speech responsiveness deteriorates

Engineering Contradiction:
Improveaudio-video synchronizationVSAvoidprocessing delay
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent segments audio signals into different types (first audio signals for synchronization and second audio signals for minimal delay) and processes them through separate paths with different delay characteristics. This allows simultaneous optimization for both synchronization accuracy and conversational responsiveness without compromise.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different delay characteristics are applied locally to different audio signal types. First audio signals receive longer delay for synchronization with video events, while second audio signals receive shorter delay for conversational speech. This localized optimization resolves the contradiction by matching processing characteristics to content requirements.

Inventive Principle:
Principle #3Local quality

2Device complexity

If a single audio processing path is used for all audio signals, then device complexity is reduced, but audio processing adaptability deteriorates

Engineering Contradiction:
Improveprocessing path structureVSAvoidaudio signal handling flexibility
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The processing system is segmented into multiple parallel paths (first path for synchronization, second path for minimal delay) that can handle different audio signal types. This segmentation enables adaptability to various audio content while maintaining manageable complexity through structured organization.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system dynamically selects which processing path to use based on audio signal classification. The classifier analyzes audio characteristics and routes signals to appropriate paths, providing adaptive handling without requiring all processing options to be active simultaneously, thus managing complexity.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS20230377600A1Audio processing
Publication Date: 2023.11.23 NOKIA TECHNOLOGIES OY
  • US20230377600A1 patent drawing
  • US20230377600A1 patent drawing
  • US20230377600A1 patent drawing

AI summary

An apparatus comprising means for:classifying an audio signal as at least a first audio signal for time synchronization with a video signal or a second audio signal not for time synchronization with a video signal;processing the first audio signal for time synchronization with the video signal wherein the processing introduces a first delay for time synchronization with the video signal;processing the second audio signal wherein the processing introduces a second delay shorter than the first delay.