Multi-View Video Segment Conversion for Heterogeneous Displays
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current methods for streaming multi-view video to heterogeneous multi-view displays face challenges due to the exponential growth in data requirements and lack of interoperability, as different displays have varying characteristics and capabilities, making it inefficient to store all necessary data formats.
Innovation Solution
An adaptive streaming scheme using an edge server that generates segments on-the-fly based on client device-specific multi-view parameters, allowing conventional streaming clients to deliver multi-view video tailored to the display's requirements without needing to store all data formats.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If all necessary data formats for heterogeneous multi-view displays are stored, then display compatibility is improved, but storage requirements grow exponentially
Solution Approach 1:
The patent introduces an edge server as an intermediary component between the content source and the client device. This edge server receives source segments in a first data format, transforms them into a second data format specific to the client's display device, and delivers the transformed segments. This mediator approach allows a single source format to serve multiple display types without requiring the storage of all possible formats simultaneously.
Solution Approach 2:
The patent applies parameter changes by transforming multi-view video segments from one data format to another based on the specific display device characteristics. The edge server modifies parameters such as view angle, resolution, and encoding format to match the capabilities of different display devices, enabling format conversion on-demand rather than storing all formats.
2Adaptability or versatility
If multiple data formats are stored for different display devices, then interoperability is improved, but device complexity increases
Solution Approach 1:
The edge server serves as a specialized intermediary that handles format conversion complexity centrally. By placing the transformation logic in this intermediate layer, the system maintains simplicity at the content source and client ends while managing the complexity of multiple format conversions at the edge server, which can be optimized and updated independently.
Solution Approach 2:
The edge server is designed with multi-functionality to handle various data format transformations for different display device types. This universal component can process multiple formats (e.g., different view angles, resolutions, and encoding schemes) through a single system, reducing the need for device-specific processing logic at each endpoint.
3Quantity of substance
If source segments are transformed on-the-fly, then storage demands are reduced, but processing time increases
Solution Approach 1:
The system performs preliminary actions by pre-processing and transforming source segments into multiple possible data formats in advance, storing these pre-transformed segments at the edge server. When a client requests a segment, the system can quickly retrieve the pre-transformed version rather than performing real-time conversion, significantly reducing latency while maintaining storage efficiency.
Solution Approach 2:
The edge server dynamically adjusts its transformation behavior based on real-time conditions. It can switch between pre-processing segments in advance or performing on-the-fly transformations depending on factors such as network conditions, display device capabilities, and segment characteristics, optimizing the balance between processing time and storage requirements.
Data Source
AI summary
A method of processing multi-view video data by an server is described, wherein the method may comprise receiving one or more first multi-view parameters from a client device, the one or more multi-view parameters being indicative of a first data format associated with a multi-view display device of the client device; receiving a request for a segment sent by the client device based on a manifest file, the segment request comprising a segment resource locator identifying a first source segment comprising first multi-view video data, the segment resource locator comprising one or more second multi-view parameters indicating that the first multi-view video data are of a second data format; generating a segment of the first data format based on the one or more first multi-view parameters, the first multi-view video data and, optionally, further multi-view video data associated with one or more further source segments; and, transmitting the generated segment to the client device.