Media Application Backgrounding Video Audio Stream Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional client devices do not allow for independent control of video and audio streams during media playback, leading to unnecessary resource consumption when a media application is backgrounded, which hinders the use of resources on mobile devices with limited capacity.

Innovation Solution

A mechanism that allows for independent playback control of video and audio portions of a media item, enabling the video portion to be stopped and resumed in synchronization with the audio portion, while releasing resources when in the background state to reduce network and battery consumption.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the media application continues to process both audio and video data in background state, then audio playback can be maintained, but resource consumption increases unnecessarily

Engineering Contradiction:
Improveaudio playback continuityVSAvoidresource consumption
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The patent segments the media data into independent audio and video streams, allowing the audio stream to continue processing while the video stream is suspended in the background state. This segmentation enables selective resource allocation where only the audio processing consumes resources, while video processing is halted, thereby reducing overall resource consumption while maintaining audio playback continuity.

Inventive Principle:
Principle #1Segmentation

2Use of energy by moving object

If the media application releases all resources when backgrounded, then resource consumption is reduced, but audio playback cannot be maintained

Engineering Contradiction:
Improveresource consumptionVSAvoidaudio playback continuity
Core Design Contradiction:
Use of energy by moving objectVSReliability

Solution Approach 1:

The patent applies local quality by differentiating the processing state between audio and video streams. The audio stream maintains its processing quality and continuity in the background state, while the video stream suspends its processing. This localized differentiation of processing quality allows the system to maintain audio playback while releasing video processing resources, achieving both resource reduction and audio continuity.

Inventive Principle:
Principle #3Local quality

3Use of energy by moving object

If video and audio streams are processed independently in background state, then resource consumption is reduced, but synchronization may be affected

Engineering Contradiction:
Improveresource consumptionVSAvoidvideo-audio synchronization
Core Design Contradiction:
Use of energy by moving objectVSStability of the object's composition

Solution Approach 1:

The patent implements preliminary action by pre-synchronizing the audio and video streams before the background state is entered. The system records the synchronization state and timing information in advance, allowing the audio stream to continue from the recorded synchronization point when the user returns to the application. This preliminary synchronization setup ensures that when video processing resumes, it can realign with the ongoing audio playback without desynchronization issues.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentEP3739584B1Media application backgrounding
Publication Date: 2024.08.21 GOOGLE LLC
  • EP3739584B1 patent drawingFigure 1
  • EP3739584B1 patent drawingFigure 2
  • EP3739584B1 patent drawingFigure 3

AI summary

A media application is disclosed. The media application provides a playback of a media item that includes a video portion and an audio portion. The media application stops the playback of the video portion of the media item while continuing to provide the audio portion of the media item. The media application resumes the playback of the video portion of the media item in synchronization with the audio portion being provided.