Rendering System Audio Event Detection and Channel Switching

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current audiovisual systems that allow simultaneous rendering of multiple channels often mute the secondary audio channel, making it difficult for viewers to detect interesting events, and require manual channel switching, which can be inconvenient, especially during events like football matches.

Innovation Solution

A method and apparatus for processing multiple audiovisual signals in a rendering system that automatically detects events in one audiovisual signal, such as increased audio power levels, specific emotions, or keywords, and switches the audio output to play the audio content of the secondary signal, allowing viewers to listen to the event and optionally switch the video displays manually or automatically.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the secondary audio channel is muted to allow simultaneous rendering of multiple channels, then the main channel audio quality is improved, but the viewer cannot detect interesting events in the secondary channel

Engineering Contradiction:

Improvemain channel audio qualityVSAvoidsecondary channel event detection

Core Design Contradiction:

ReliabilityVSLoss of information

Solution Approach 1:

An audio analysis module acts as an intermediary between the secondary audio channel and the viewer. This module analyzes the muted secondary audio stream for events (keywords, emotions, audio power level changes) and triggers notifications or automatic switching when events are detected, allowing event detection without unmuting the secondary channel

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The system implements feedback by continuously monitoring the secondary audio channel and providing information back to the viewer through event notifications, visual indicators, or automatic channel switching. This feedback loop allows the viewer to be informed about secondary channel events without the secondary audio competing with the main channel audio

Inventive Principle:

Principle #23Feedback

2Ease of operation

If manual channel switching is required to listen to the secondary channel, then audio output control is simplified, but the viewing experience deteriorates during important events

Engineering Contradiction:

Improveaudio output controlVSAvoidresponse time to events

Core Design Contradiction:

Ease of operationVSLoss of time

Solution Approach 1:

The system performs preliminary analysis of the secondary audio channel continuously in the background, preparing event detection before the viewer needs to switch channels. When events are detected, the system can immediately notify the viewer or automatically switch channels, eliminating the delay associated with manual channel switching

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system automatically monitors and manages channel switching based on detected events without requiring manual user intervention. The audio analysis module and controller work together to automatically switch between channels when events occur, allowing the system to serve itself rather than requiring the viewer to manually manage channel switching

Inventive Principle:

Principle #25Self-service

3Adaptability or versatility

If Picture-in-Picture is used to display secondary video, then simultaneous viewing of multiple channels is enabled, but the secondary audio cannot be heard

Engineering Contradiction:

Improvesimultaneous video display capabilityVSAvoidsecondary audio content

Core Design Contradiction:

Adaptability or versatilityVSLoss of information

Solution Approach 1:

An audio analysis module serves as an intermediary that processes the secondary audio stream independently of the video display. This module detects events in the muted secondary audio and triggers notifications or automatic switching, enabling event detection without compromising the PIP video display functionality

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The system segments the audio processing from the video display functionality. The secondary audio is analyzed separately from the PIP video stream, allowing independent event detection and control. This segmentation enables the PIP feature to maintain video display while the audio analysis module separately monitors for events

Inventive Principle:

Principle #1Segmentation

Data Source

PatentUS10922046B2Method for processing a plurality of A/V signals in a rendering system and associated rendering apparatus and system

Publication Date: 2021.02.16 INTERDIGITAL CE PATENT HOLDINGS SAS

AI summary

The disclosure relates to a method for processing at least first and second audiovisual signals in a rendering system. Each of the first and second audiovisual signals include a video content and an audio content. The rendering system having a main display, an auxiliary display and a first audio output. The method includes: displaying the video content of the first audiovisual signal on the main display and the video content of the second audiovisual signal on the auxiliary display and playing the audio content of the first audiovisual signal on the first audio output, detecting an event in the audio content of the second audiovisual signal, and upon detection of the event, playing the audio content of the second audiovisual signal, instead of the audio content of the first audiovisual signal.