Multi-plane Video Transmission with Varying Resolution
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Video processing systems face challenges in efficiently transmitting high-definition video streams over low-bandwidth wireless links without compromising video quality, particularly in virtual reality applications where real-time processing and immersive experiences are critical.
Innovation Solution
The system divides video frames into multiple planes with varying resolutions and compression levels, using eye-tracking sensors and software hints to prioritize regions of focus, allowing for efficient transmission by sending lower-resolution planes first and inserting higher-resolution planes only in overlapping areas, thereby optimizing bandwidth usage and maintaining quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of energy
If video compression is applied to reduce bandwidth usage, then transmission efficiency is improved, but video quality deteriorates
Solution Approach 1:
The video frame is divided into multiple planes (first plane, second plane, third plane) with different resolution and compression characteristics. Each plane is transmitted separately, allowing the receiver to reconstruct the full-resolution image by combining planes, thus achieving both bandwidth efficiency and quality preservation.
Solution Approach 2:
Different regions of the video frame are assigned different quality levels. The first plane contains high-resolution data for critical regions (faces, hands, objects), while the second and third planes provide lower-resolution data for less important regions. This local differentiation maintains perceived quality while reducing overall bandwidth consumption.
2Manufacturing precision
If higher resolution is transmitted to maintain video quality, then visual quality is improved, but transmission bandwidth requirement increases
Solution Approach 1:
Instead of transmitting a single high-resolution frame that consumes maximum bandwidth, the system segments the frame into multiple planes with varying resolution levels. The sum of bandwidth across all planes equals the bandwidth of a single low-resolution frame, achieving quality preservation with reduced total bandwidth consumption.
Solution Approach 2:
The system transmits more detail than a single low-resolution frame would provide, but less than a single high-resolution frame would require. By combining multiple partially-resolved planes, the receiver achieves high-quality reconstruction without the full bandwidth cost of transmitting one high-resolution frame.
3Speed
If real-time processing is performed to meet latency requirements, then responsiveness is improved, but processing complexity increases
Solution Approach 1:
The complex real-time processing task is segmented into independent plane processing operations. Each plane can be processed and transmitted concurrently, reducing the computational burden on any single operation and enabling real-time processing without excessive complexity.
Solution Approach 2:
The system dynamically adjusts the number of planes and their resolution levels based on available bandwidth and processing capabilities. This dynamic adaptation allows the system to maintain real-time performance while adjusting processing complexity according to operational conditions.
Data Source
AI summary
Systems, apparatuses, and methods for performing efficient video transmission are disclosed. In a video processing system, a transmitter identifies multiple planes in a scene. The transmitter renders and compresses each of the multiple planes with a combination of a corresponding compression level and a resolution, which is different from a combination of compression level and resolution of any other plane. For each plane, the transmitter inserts, in multi-plane information, data such as identification of the plane, a location in the video frame for the plane, and one or more of a resolution and compression level for the plane. The transmitter conveys the rendered and compressed planes along with the multi-plane information to a receiver. The receiver decodes each of the planes and insets each of the planes on any lower resolution planes of the multiple planes.