Streaming Audio Video Modulation for Transition Effects

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Digital media content streaming systems cannot modulate audio data in real-time to adjust volume levels during playback, leading to unpleasantly high audio output during transitions, such as from one content to another.

Innovation Solution

A method for streaming digital media content that involves encoding audio and video data into intervals, allowing for modulation of audio and video streams to create fade-in, fade-out, and transition effects, enabling personalized effects during content transitions by precomputing or computing these effects in real-time.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If audio data is passed from the content server to the content player without modification, then the audio data can be transmitted simply and quickly, but the volume level cannot be adjusted during playback, leading to unpleasantly high audio output during transitions

Engineering Contradiction:
Improvevolume adjustment capabilityVSAvoidaudio data processing complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system precomputes modulated versions of audio data streams at the content server before transmission. These precomputed modulated streams are stored and can be quickly switched to during playback without requiring real-time processing at the content player, thus achieving volume adjustment capability while minimizing added complexity.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The invention extracts the audio modulation function from the content player and moves it to the content server. By preprocessing the audio data at the server and transmitting multiple modulated versions, the system enables volume adjustment without burdening the content player with complex real-time processing capabilities.

Inventive Principle:
Principle #2Taking out (Extraction)

2Adaptability or versatility

If the content player adjusts volume control based on previous content playback, then the output volume level may be appropriate for previous content, but it becomes unpleasantly high during transitions to new content with different audio levels

Engineering Contradiction:
Improveaudio level adaptationVSAvoidunpleasantly high audio output
Core Design Contradiction:
Adaptability or versatilityVSObject-affected harmful factors

Solution Approach 1:

The system uses playback location information as feedback to determine which precomputed modulated audio stream to switch to. The content player monitors the current playback position and automatically switches between different modulated audio streams to maintain appropriate volume levels during transitions, eliminating the need for manual volume adjustment.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

Multiple audio streams with different modulation levels are precomputed and prepared at the content server before playback. During transitions, the system can immediately switch to the appropriate pre-prepared stream without delay or manual intervention, ensuring continuous appropriate volume levels.

Inventive Principle:
Principle #10Preliminary action

3Ease of operation

If audio data is modulated before being provided to the content player, then volume levels can be adjusted during playback, but the audio data requires preprocessing and multiple versions must be transmitted

Engineering Contradiction:
Improveautomatic volume controlVSAvoidamount of audio data transmitted
Core Design Contradiction:
Ease of operationVSQuantity of substance

Solution Approach 1:

Instead of transmitting completely separate audio streams for every possible volume level, the system applies different modulation levels (local variations) to the same base audio content. This allows volume adjustment while reusing the core audio data, reducing the total quantity of data that must be transmitted and stored.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS9762936B2Audio and video data streaming for media effects
Publication Date: 2017.09.12 NETFLIX INC
  • US9762936B2 patent drawing
  • US9762936B2 patent drawing
  • US9762936B2 patent drawing

AI summary

One embodiment of the present invention sets forth a technique for streaming digital media content with transition effects. Audio data may be modulated and received by the streaming device for an audio fade-in effect. Similarly, video data may be modulated to perform various visual effects. Such a technique allows for fading-in of audio and/or video, fading-out of audio and/or video, and effects that blend audio from different content and video from different content during a transition from one digital media content to a different digital media content or within the same digital media content. The modulated audio and video data to generate the audio or video effect during a transition may be precomputed or computed in real-time and transmitted to the streaming device. The streaming device switches between original unmodulated content streams and effect content streams when transitions are detected.