Immersive Video Pre-Processing for Bandwidth Optimization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current methods for immersive video broadcasting face challenges in bandwidth limitations and latency due to the need for extensive computational resources and high-resolution data transmission, particularly when dealing with multiple cameras and complex processing requirements, which can result in delayed video delivery and inefficient use of network bandwidth.
Innovation Solution
A method is introduced to pre-process immersive video data by assigning relevance factors to different image regions within a scene, allowing for selective bitrate allocation and reduction in data transmission, where more relevant regions are sent at higher quality and less relevant regions are sent at lower quality or omitted, thereby optimizing network usage and reducing latency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If immersive video data from multiple cameras is transmitted at high resolution to maintain video quality, then video quality is improved, but bandwidth consumption increases
Solution Approach 1:
The patent applies local quality by differentiating transmission quality across different image regions. Relevant regions (containing important objects or actions) are transmitted at high resolution, while less relevant regions are transmitted at lower resolution or omitted entirely. This selective quality approach maintains overall video quality perception while reducing total bandwidth consumption.
Solution Approach 2:
The patent extracts and identifies relevant regions within the immersive video data using analysis of camera positions, viewer orientation, and scene importance. Only these extracted relevant regions are transmitted at full quality, while non-essential regions are removed or heavily compressed, directly reducing bandwidth requirements.
2Quantity of substance
If extensive computational processing is performed onsite to reduce data transmission, then bandwidth requirement is reduced, but processing time and latency increase
Solution Approach 1:
The patent performs preliminary identification of relevant regions and calculates relevance factors before video encoding and transmission. This pre-processing step enables the system to prepare optimization strategies in advance, allowing for reduced transmission data without requiring extensive real-time computational processing that would increase latency.
3Reliability
If all camera data is processed and transmitted to ensure complete coverage of all viewpoints, then disocclusion is avoided, but data transmission volume increases
Solution Approach 1:
The patent dynamically changes transmission parameters based on relevance analysis. For each image region, the system adjusts whether to transmit full-resolution data, compressed data, or no data at all, based on calculated relevance factors. This parameter adaptation ensures sufficient viewpoint coverage for immersive experiences while minimizing transmitted data volume.
Data Source
AI summary
A method for preparing immersive video data prior to processing into an immersive video. The method comprises receiving immersive video data containing one or more images of a scene, the scene comprising one or more image regions, and obtaining a relevance factor for at least one of the image regions, the relevance factor being indicative of the relative importance of the image region to a viewer. The immersive video data is separated into one or more sets of region data, wherein each set of region data corresponds to the data of one or more image regions and, based on the relevance factor of an image region, a bitrate is selected at which the set of region data corresponding to the image region is to be sent to an external processing unit.