Spherical Image Display Apparatus Viewpoint Region Extraction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image display apparatuses face challenges in efficiently rendering and displaying 360-degree images, particularly in reducing data transmission time and processing overhead when converting planar-format images to sphere-format for dynamic viewpoint changes.
Innovation Solution
The image display apparatus determines a copy region of the planar-format 360-degree image based on the current viewpoint, transmitting only this region to the GPU for graphic processing, which generates the sphere-format image and output image, thereby reducing data transmission and processing time.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the entire planar-format 360-degree image is transmitted to the GPU for processing, then complete image data is available for rendering, but data transmission time and processing overhead increase
Solution Approach 1:
The patent divides the planar-format 360-degree image into multiple regions based on the current viewpoint and field of view angle. Only the relevant region (first region) is extracted and transmitted to the GPU for processing, while other regions are discarded. This segmentation approach maintains the quality of the displayed image by focusing on the visible area while significantly reducing data transmission time and processing overhead.
2Manufacturing precision
If the entire planar-format 360-degree image is processed, then accurate sphere-format conversion is achieved, but processing overhead and rendering time increase
Solution Approach 1:
The patent extracts only the necessary portion (first region) of the planar-format image that corresponds to the current viewpoint and field of view. This extracted region is then processed for sphere-format conversion and displayed. By taking out only the relevant data, the patent maintains conversion accuracy for the visible area while dramatically reducing processing overhead and rendering time.
3Adaptability or versatility
If viewpoint changes are handled by reprocessing the entire image, then accurate dynamic viewing is achieved, but buffering and latency occur
Solution Approach 1:
The patent pre-divides the planar-format image into multiple regions before viewpoint changes occur. When the viewpoint changes, the system can quickly switch to displaying a different pre-divided region without needing to reprocess the entire image. This preliminary segmentation enables smooth dynamic viewpoint changes without buffering or latency, as the relevant image portions are already prepared and ready for immediate display.
Data Source
Figure 1
Figure 2A
Figure 2B~2C
AI summary
An image display apparatus and a method of displaying an image are provided. The image display apparatus includes: a display; a graphics processing unit (GPU); and a processor configured to: determine a copy region of a planar-format image based on information regarding a current viewpoint, control the GPU to generate a sphere-format image by mapping an image corresponding to the copy region to a sphere and to generate an output image by rendering the sphere-format image, and control the display to display the output image.