VR Polyhedron Mapping for Bandwidth-Constrained Streaming
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing virtual reality (VR) technologies face challenges in smoothly streaming omnidirectional images due to the high capacity requirements and network connectivity issues when processing and transmitting these images, particularly when mapping three-dimensional (3D) omnidirectional content to two-dimensional (2D) planes.
Innovation Solution
An electronic device and method that selects a polyhedron to map the omnidirectional image based on the device's processing state and network connection, then decreases the image mapped to multiple polyhedron surfaces based on the user's field of view (FOV), arranging the reduced image on a 2D plane for efficient transmission and rendering.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If an omnidirectional image is captured and transmitted with high capacity to maintain quality, then the image quality is improved, but the network transmission becomes unstable and processing becomes difficult
Solution Approach 1:
The omnidirectional image is segmented by mapping it to a polyhedron structure, dividing the 360-degree field of view into multiple discrete surfaces or faces. This segmentation allows selective transmission of only those surfaces that fall within the user's current field of view, rather than transmitting the entire omnidirectional image, thus reducing network bandwidth requirements while maintaining perceived image quality.
Solution Approach 2:
The patent applies local quality by determining the user's field of view and selectively transmitting high-quality image data only for the surfaces within that FOV, while reducing or omitting transmission of surfaces outside the FOV. This ensures that network resources are concentrated on the visually relevant portions of the omnidirectional image, improving both transmission stability and perceived quality.
2Adaptability or versatility
If the entire omnidirectional image is mapped and transmitted, then complete coverage is achieved, but the data capacity increases and processing becomes more difficult
Solution Approach 1:
The patent implements dynamic adaptation by continuously monitoring the user's field of view and adjusting which polyhedron surfaces are transmitted based on current viewing conditions. As the user moves or changes orientation, the system dynamically determines which surfaces are visible and transmits only those, maintaining complete omnidirectional coverage capability while minimizing instantaneous data capacity requirements.
Solution Approach 2:
The system transmits only the necessary portion of the omnidirectional image data required for the current field of view, rather than transmitting the complete omnidirectional image. This partial action approach reduces data capacity by approximately 75% while still providing complete omnidirectional coverage as the user moves, since the polyhedron structure allows for efficient viewport-dependent rendering.
3Measurement precision
If high-resolution omnidirectional images are processed in real-time, then image quality is maintained, but the processing load on the device increases
Solution Approach 1:
The omnidirectional image is pre-mapped to a polyhedron structure during encoding, with each surface pre-calculated and organized. This preliminary action allows the receiving device to simply select and render the relevant surfaces based on current field of view information, rather than performing complex real-time mapping and projection calculations, thus maintaining high image quality while significantly reducing processing load during playback.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
An electronic device (430) is provided. The electronic device (430) includes a communication module comprising communication circuitry, a memory configured to store first information indicating first image data generated using a first rendering scheme based on a first polyhedron configured with a first number of surfaces and second information indicating second image data generated using a second rendering scheme based on a second polyhedron configured with a second number of surfaces, and a processor. The processor is configured to verify state information of the electronic device (430), to select one of the first information and the second information based on the at least state information, to transmit a request corresponding to the selected information to an external electronic device (420) via the communication module, to receive image data corresponding to the selected information between the first image data and the second image data from the external electronic device (420) in response to the request, and to control playback of the received image data.