Adaptive Audio Modification for Disruptive Event Mitigation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Multimedia systems lack effective methods to detect and mitigate potentially disruptive audio events in video content, which can disturb viewers or others nearby, as they often cannot predict such events and fail to account for individual viewer sensitivities.

Innovation Solution

The system identifies defined audio event types in video content using user input or machine learning models, and modifies these events through active noise cancellation, frequency domain transforms, or replacing them with alternative audio content to minimize disturbance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Object-affected harmful factors

If audio content is left unmodified in video content, then the original audio quality and fidelity are preserved, but potentially disruptive audio events (such as doorbells, gunshots, sirens, crying infants, barking dogs) may disturb viewers or others nearby

Engineering Contradiction:
Improvedisturbance to viewers and othersVSAvoidoriginal audio content integrity
Core Design Contradiction:
Object-affected harmful factorsVSLoss of information

Solution Approach 1:

The system extracts and identifies specific disruptive audio events (doorbells, gunshots, sirens, crying infants, barking dogs) from the audio content using audio event detection, then applies modification operations (noise cancellation, filtering, replacement) to remove or attenuate these harmful audio components while preserving the rest of the audio content

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system changes audio parameters such as amplitude, frequency content, and temporal characteristics of identified disruptive events through noise cancellation algorithms, frequency filtering, and audio replacement techniques to reduce their disruptive effect while maintaining overall audio quality

Inventive Principle:
Principle #35Parameter changes

2Ease of operation

If audio events are modified to reduce disturbance, then viewer comfort is improved, but the original audio experience and sound quality are altered

Engineering Contradiction:
Improveviewer comfort and satisfactionVSAvoidaudio quality fidelity
Core Design Contradiction:
Ease of operationVSManufacturing precision

Solution Approach 1:

The system provides dynamic audio modification where viewers can select from multiple operation types (noise cancellation, filtering, replacement) and adjust settings for different audio event types, allowing the audio processing to adapt to individual viewer preferences and sensitivity levels

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system applies different modification operations to different audio event types based on their specific characteristics and the viewer's selected preferences, treating each disruptive sound type (doorbell, gunshot, siren, crying infant, barking dog) with appropriate localized processing rather than uniform modification

Inventive Principle:
Principle #3Local quality

3Reliability

If the system provides no warning about potentially disruptive audio events, then the audio content remains unchanged, but viewers cannot predict or prepare for disturbing sounds

Engineering Contradiction:
Improvepredictability of audio eventsVSAvoidaudio content modification
Core Design Contradiction:
ReliabilityVSLoss of information

Solution Approach 1:

The system performs preliminary audio event detection and analysis on video content to identify potentially disruptive events (doorbells, gunshots, sirens, crying infants, barking dogs) before playback, then provides advance warning to viewers through the user interface, allowing them to select appropriate modification operations in advance

Inventive Principle:
Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The solution effectively reduces the conspicuity of disruptive audio events, ensuring a more comfortable viewing experience by attenuating or eliminating disturbing sounds based on individual viewer preferences, thereby enhancing user satisfaction and content consumption.

Implementation Method 1

modification of the defined audio events may include performing active noise cancellation procedures in which an audio event is generated having opposing amplitudes to the defined audio event occurrence identified

Methodology Applied
Scientific EffectActive noise cancellation: Interference

Implementation Method 2

modification of the defined audio events may include performing a frequency domain transform of the defined audio event occurrence and filtering frequency content in the transformed audio event occurrence

Methodology Applied
Scientific EffectFrequency domain transform:

Data Source

PatentUS11818426B2Method and system for adaptive audio modification
Publication Date: 2023.11.14 DISH NETWORK LLC
  • US11818426B2 patent drawing
  • US11818426B2 patent drawing
  • US11818426B2 patent drawing

AI summary

Systems and methods for modifying audio events in video content that correspond to one or more defined audio event types. A request is received to modify audio events in video corresponding to an audio event type. Video content to be presented on a display device is obtained that includes visual and audio content. An occurrence of a defined audio event corresponding to a defined audio event type is identified in the audio content. The defined audio event is modified according to a modification operation to generate modified audio content. The modified audio content is associated with a segment of the visual content that corresponds to the occurrence of the defined audio event. The modified audio content is provided in association with the segment of visual content for display on the display device.