Spatial Manifest for Segmenting Video Streams
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current content delivery networks (CDNs) face challenges in efficiently delivering high-resolution, wide-angle video content due to high bandwidth requirements and lack of scalability, leading to potential overload and delay issues, especially when handling spatially segmented content.
Innovation Solution
A content processing device and spatial manifest data structure that allows clients to receive and stitch spatial segment streams from multiple delivery nodes using location information, enabling efficient client-based video manipulation and interaction without requiring changes to conventional CDN infrastructure.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If high-resolution wide-angle video content is delivered to clients, then video quality and information content are improved, but bandwidth requirements and network load increase significantly
Solution Approach 1:
The patent divides high-resolution video content into multiple spatial segments or tiles that can be independently encoded and delivered. Instead of transmitting the entire high-resolution frame, only the requested spatial segments are delivered to the client, significantly reducing bandwidth consumption while maintaining video quality for the displayed region.
Solution Approach 2:
The patent enables different spatial segments of the video to be delivered at different resolutions and qualities based on client requirements. The client can request high-resolution segments for regions of interest while receiving lower-resolution segments for other areas, optimizing the trade-off between video quality and bandwidth usage.
2Productivity
If server-based ROI encoding is implemented, then encoding speed is improved, but scalability and compatibility with existing CDN infrastructure deteriorate
Solution Approach 1:
The patent segments the video content spatially into independent tiles that can be encoded once and then distributed through existing CDN infrastructure. This segmentation allows the content to be delivered in a CDN-compatible manner while maintaining the benefits of efficient encoding.
Solution Approach 2:
The patent creates multiple copies of the spatially segmented video content and distributes them through the CDN network. This allows existing CDN infrastructure to handle the content delivery without requiring modifications, while the segmented structure enables efficient client-side retrieval and assembly.
3Productivity
If spatially segmented content is delivered through CDN, then content delivery efficiency is improved, but system complexity increases due to client-side processing requirements
Solution Approach 1:
The patent performs spatial segmentation and organization of video content in advance during the encoding phase, creating a structured format with metadata that describes the spatial relationships between segments. This preliminary organization simplifies the client-side processing, as the client only needs to retrieve and assemble pre-organized segments rather than perform complex processing.
Solution Approach 2:
The patent introduces a manifest file or metadata structure that acts as an intermediary between the segmented video content and the client. This metadata contains information about the spatial arrangement, resolution, and timing of segments, allowing the client to efficiently retrieve and assemble segments without requiring complex processing logic.
4Adaptability or versatility
If multiple spatial segment streams are received from different delivery nodes, then content delivery flexibility is improved, but synchronization and stitching complexity increases
Solution Approach 1:
The patent incorporates timing metadata and synchronization information in the segment structure that provides feedback to the client about the temporal relationships between segments from different delivery nodes. This enables the client to synchronize segments correctly by using the embedded timing information, reducing the complexity of synchronization logic.
Solution Approach 2:
The patent creates consistent copies of synchronization metadata across all spatial segment streams, ensuring that each segment contains the necessary timing and positioning information. This standardized copying of metadata simplifies the client's stitching and synchronization tasks, as all segments follow the same format and structure.
Data Source
Figure 1
Figure 2A~2B
Figure 2C
AI summary
Methods and systems are described for processing spatially segmented content originating from a content delivery network. One method comprises a client in a media processing device receiving a spatial manifest information comprising one or more spatial representations of a source stream, each spatial representation identifying one or more spatial segment streams, location information for locating one or more delivery nodes in said content delivery network and, optionally, position information for stitching spatial segment frames in said segment streams into a video frame for display; selecting one or more spatial segment streams and on the basis of said spatial manifest information requesting at least one delivery node in said content delivery network to transmit said one or more selected spatial segment streams to said client; and, receiving said one or more selected spatial segment streams from said at least one delivery node.