Synchronized Media Playback via Segmented Stream Processing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Electronic devices with limited resources struggle to concurrently play synchronized audio and visual content streams, often resulting in perceivable disruptions or inability to play both types of content simultaneously.

Innovation Solution

The system determines triggering events to synchronize visual content with ongoing audio content by obtaining audio information, receiving a visual content stream, and processing it to start outputting visual content at a synchronized time point, using different encryption techniques if necessary, and processing audio and visual content streams using foreground and background system processes respectively.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If electronic devices use limited hardware, firmware or software resources to support playback of only audio content, then audio playback is maintained, but the ability to provide concurrent, synchronized playback of both audio content and visual content is lost

Engineering Contradiction:
Improvecapability to play synchronized audio and visual contentVSAvoidhardware, firmware or software resources
Core Design Contradiction:
Adaptability or versatilityVSQuantity of substance

Solution Approach 1:

The system divides the media content into separate audio and visual streams, processing them through different system processes (foreground for visual, background for audio). This segmentation allows the device to handle each content type with dedicated resources, enabling synchronized playback without requiring substantial additional resources.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system determines a triggering event and obtains audio information including current output status before initiating visual content playback. By calculating the starting time point in advance and pre-processing the visual content stream, the system ensures synchronized output without requiring continuous high-resource consumption during playback.

Inventive Principle:
Principle #10Preliminary action

2Adaptability or versatility

If electronic devices attempt to provide concurrent playback of audio content and visual content, then synchronized playback capability is improved, but perceivable disruptions occur due to resource limitations

Engineering Contradiction:
Improveconcurrent playback capabilityVSAvoidsynchronization quality
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The system determines a triggering event and calculates the starting time point for visual content based on audio information obtained in advance. This preliminary calculation ensures that visual and audio content are synchronized from the outset, preventing disruptions that would occur with delayed or reactive synchronization attempts.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system obtains audio information including current output status and uses this feedback to adjust the visual content playback timing. By continuously monitoring audio output status and adjusting visual content accordingly, the system maintains reliable synchronization even under resource constraints.

Inventive Principle:
Principle #23Feedback

3Productivity

If electronic devices process both audio and visual content streams simultaneously, then synchronized output is achieved, but resource consumption increases causing disruptions

Engineering Contradiction:
Improvesynchronized content outputVSAvoidprocessing resources
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

The system segments content processing into foreground and background system processes, with visual content processed in the foreground and audio content in the background. This segmentation allows the device to prioritize visual processing when needed while maintaining audio processing continuously, achieving synchronized output with optimized resource utilization.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system determines the starting time point and prepares visual content for output in advance based on audio information. By performing preliminary processing and buffering where possible, the system reduces the need for continuous high-intensity processing during playback, thereby reducing overall energy consumption while maintaining synchronized productivity.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11831943B2Synchronized playback of media content
Publication Date: 2023.11.28 APPLE INC
  • US11831943B2 patent drawing
  • US11831943B2 patent drawing
  • US11831943B2 patent drawing

AI summary

The subject technology provides for synchronized playback of different media content streams. The disclosed techniques may include determining, while certain audio content is being outputted, whether a triggering event has occurred at a media device. Responsive to a determination that the triggering event has occurred, audio information including identification information and a current output status of the audio content may be obtained, and a visual content stream for visual content corresponding to the audio content may be obtained. At the media device, the visual content stream may be processed based on the audio information to determine a starting time point indicating a time point within the visual content from which to start outputting the visual content. The visual content may be outputted such that the output of the visual content begins at the starting time point and is synchronized in time with the audio content.