Tile-Based 360-Degree Image Encoding for VR Viewport Rendering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current VR content display technology is limited by poor screen quality due to insufficient resolution and frame rate, restricting user experience compared to fixed view-type content, and experiences delays in view region display due to feedback input from viewpoint changes.
Innovation Solution
A method and apparatus for displaying 360-degree images encoded in tiles based on user viewpoint, allowing for higher resolution rendering by decoding and rendering only the necessary tiles corresponding to the view region, and using a safeguard mechanism to mitigate delays from rapid viewpoint changes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If VR content is displayed using conventional decoding methods, then the system is compatible with existing decoders, but the resolution is limited to 4K and screen quality is poor
Solution Approach 1:
The patent divides the 360-degree image into multiple tiles, allowing the system to process and transmit only the necessary portions of the image. This segmentation enables higher effective resolution without requiring the decoder to handle the entire high-resolution image at once, thus resolving the contradiction between display resolution and decoder complexity
Solution Approach 2:
The patent performs encoding and tile division at the content preparation stage before transmission. By pre-processing the content into manageable tiles with appropriate resolution, the system enables high-resolution display on existing decoders without requiring real-time complex processing, thus resolving the contradiction between manufacturing precision and device complexity
2Productivity
If the entire 360-degree image is decoded and transmitted, then complete view coverage is provided, but transmission bandwidth and processing load increase significantly
Solution Approach 1:
The patent extracts and transmits only the specific tile data corresponding to the user's current view region, rather than transmitting the entire 360-degree image. This extraction principle reduces data transmission volume by approximately 80% while maintaining productivity by delivering only the necessary visual information for the current viewpoint
Solution Approach 2:
The patent implements dynamic tile selection based on the user's viewpoint. As the user moves their head or changes viewpoint, the system dynamically determines which tiles need to be transmitted and decoded next, optimizing both productivity and data efficiency by adapting to real-time viewing conditions
3Manufacturing precision
If high resolution encoding is used for 360-degree images, then display quality improves, but processing complexity and computational load increase
Solution Approach 1:
The patent segments the high-resolution 360-degree image into multiple lower-complexity tiles that can be processed independently. This segmentation reduces processing complexity by breaking down the large computational task into smaller, manageable units while preserving image quality in the displayed region
Solution Approach 2:
The patent applies different processing quality levels to different regions of the 360-degree image. High-quality encoding is applied to tiles that are likely to be viewed, while lower quality or compressed versions are used for peripheral or less likely view regions, thus improving overall image quality perception without proportionally increasing processing complexity
Data Source
AI summary
The present disclosure provides a method for displaying a 360 degree image, capable of performing encoding in tile unit defined as a part of the 360 degree image according to the position occupied within the 360 degree image, the method comprising: an operation for requesting at least one tile corresponding to a view region to be displayed so as to correspond to the viewpoint of a user; an operation for receiving at least one tile corresponding to the view region and decoding the at least one tile received; and an operation for rendering the at least one tile decoded.