Synchronized Stream Packing for Multi-Angle A/V Playback
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current DVD, HD DVD, and Blu-ray technologies restrict audio and sub-picture data to be bit-for-bit identical across A/V streams, limiting the seamless multi-angle feature and leading to redundant data storage and synchronization issues when different angles are selected.
Innovation Solution
A method and apparatus for synchronized stream packing that identifies and packs sub-picture and audio packets with matching timestamps to video packets, ensuring contextual differences between A/V streams while maintaining synchronization and stream continuity during interactive selection.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If audio and sub-picture data are restricted to be bit-for-bit identical across A/V streams, then speaker damage is prevented and stream synchronization is simplified, but the range of applications for seamless multi-angle feature is greatly limited and redundant data storage occurs
Solution Approach 1:
The patent segments audio and sub-picture data into synchronized packets that are independently manageable. Each packet is associated with specific video packets through timestamp matching, allowing different audio/sub-picture content in different angle streams while maintaining synchronization. This segmentation enables versatile multi-angle applications without requiring identical audio/sub-picture data across all streams.
Solution Approach 2:
The patent creates a universal data structure where audio and sub-picture packets can serve multiple functions across different angle streams. By using timestamp-based synchronization rather than identity-based matching, the same packet structure can accommodate diverse audio and sub-picture content, enabling the seamless multi-angle feature to work with varied content types.
2Adaptability or versatility
If different audio and sub-picture content is allowed in parallel A/V streams, then application range is enhanced, but synchronization with video data becomes complex and stream continuity may be disrupted
Solution Approach 1:
The patent implements a feedback mechanism through timestamp matching. Audio and sub-picture packets are synchronized to video packets by matching their timestamps, creating a closed-loop synchronization system. This feedback approach ensures that even with different audio/sub-picture content across streams, all data remains synchronized to the video timeline, maintaining stream continuity and reliability.
Solution Approach 2:
The patent changes the synchronization parameter from data identity (bit-for-bit matching) to temporal alignment (timestamp matching). This parameter change allows different audio and sub-picture content while maintaining synchronization, as the focus shifts from what the data is to when it occurs, enabling content diversity without sacrificing reliability.
3Ease of operation
If timestamp-based synchronization is implemented for audio and sub-picture packets, then seamless switching among different angle streams is enabled, but data organization complexity increases
Solution Approach 1:
The patent applies preliminary action by pre-organizing audio and sub-picture data into timestamp-synchronized packets during the authoring process. This advance organization allows seamless switching during playback without real-time synchronization complexity, as the temporal alignment is already established. The data structure is prepared in advance with clear timestamp associations, simplifying the switching operation.
Data Source
AI summary
There are provided methods and apparatus for synchronized stream packing of packets that differ contextually between A/V streams in a parallel presentation. A method includes the step of identifying sub-picture/subtitle packets and/or audio packets having arrival timestamps and/or presentation timestamps that match an arrival timestamp and/or a presentation timestamp, respectively, of video packets. The method also includes the step of packing a Video Object Unit (VOBU) and/or a Transport Stream (TS) with the identified sub-picture/subtitle and audio packets and the video packets having the matching timestamps.