Gateway Multi-View Video Stream Processing for Second-Screen Overlay
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The limited uptake of second-screen solutions is hindered by the need for users to download multiple applications and synchronization latency issues, particularly in real-time programs, where coordination between first-screen and second-screen content is critical.
Innovation Solution
A multi-view coding (MVC) extension system that multiplexes first-screen and second-screen content into a single stream, allowing an intelligent gateway to de-multiplex and synchronize second-screen content delivery to secondary devices without requiring changes to first-screen or second-screen devices, using metadata to determine content destinations and cache second-screen content for timely display.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If second-screen content is delivered through separate applications and communication networks, then content delivery flexibility is improved, but synchronization latency increases
Solution Approach 1:
The patent merges first-screen content and second-screen content into a single multiplexed stream delivered through one communication network. This eliminates the need for separate applications and networks, reducing synchronization latency while maintaining delivery flexibility through the unified stream structure.
Solution Approach 2:
The gateway acts as an intermediary that receives the multiplexed stream, de-multiplexes it into first-screen and second-screen content, and redistributes them appropriately. This intermediary approach enables synchronized delivery without requiring changes to end devices, resolving the contradiction between flexibility and latency.
2Adaptability or versatility
If multiple applications are required for different content sources, then content source compatibility is improved, but device complexity increases
Solution Approach 1:
The gateway provides universal functionality by handling multiple content sources and delivering both first-screen and second-screen content through a single interface. This multi-functional approach eliminates the need for multiple applications on user devices while maintaining compatibility with different content sources.
Solution Approach 2:
The gateway serves as an intermediary that manages the complexity of multiple content sources internally, presenting a simplified interface to end users. This mediator approach maintains content source compatibility without requiring users to install or manage multiple applications.
3Measurement precision
If second-screen content is cached at the gateway, then synchronization accuracy is improved, but gateway processing complexity increases
Solution Approach 1:
The gateway performs preliminary actions by caching second-screen content in advance before it is needed for synchronization. This advance preparation ensures accurate synchronization with first-screen content while the complexity is managed as a preprocessing step in the content delivery pipeline.
Data Source
AI summary
Particular embodiments use a multi-view coding (MVC) extension to provide second-screen content along with the first-screen content. In one embodiment, a head-end multiplexes the first-screen content with the second-screen content into a single content stream. The second-screen content is added to the video stream according to the MVC extension requirements. At the user end, such as at a gateway, instead of sending the first-screen content and second-screen content to the first-screen device, the gateway de-multiplexes the first-screen content and the second-screen content. The gateway can then send the first-screen content to the first-screen device while caching the second-screen content. When the gateway determines that the second-screen content should be displayed on the second-screen device, the gateway can send the second-screen content to the second-screen device for display on the second-screen of the second-screen device.