Omnidirectional Image Texture Generation with Guide Image Occlusion Management
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
When the viewpoint for generating an omnidirectional image differs from the viewpoint for reproduction, occlusion regions in the generated image are included in the texture image, leading to degraded picture quality for the viewer.
Innovation Solution
An image processing apparatus and method that utilize a texture image, a depth image, and a guide image to compare pixel values and adjust them accordingly, ensuring high-quality texture image generation at a predetermined viewpoint.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If an omnidirectional image is generated from a fixed viewpoint, then the image can be efficiently encoded and stored, but occlusion regions are included when reproduced from different viewpoints, degrading picture quality
Solution Approach 1:
The image is divided into multiple regions based on depth information: occlusion regions (where picture quality is degraded) and non-occlusion regions. This segmentation allows different processing strategies to be applied to different parts of the image, improving overall picture quality while managing processing complexity.
Solution Approach 2:
The guide image is generated with different quality levels for different regions: high-quality regions correspond to non-occlusion areas, while low-quality regions correspond to occlusion areas. This local quality differentiation ensures that processing resources are focused on improving picture quality where it matters most, without unnecessarily complicating the overall system.
2Adaptability or versatility
If the viewpoint for generation and reproduction are different, then the system is more flexible, but occlusion regions are included in the texture image, degrading picture quality
Solution Approach 1:
The guide image is generated in advance from the original viewpoint, containing depth and occlusion information that will be useful for any reproduction viewpoint. This preliminary preparation enables the system to handle different reproduction viewpoints flexibly while maintaining picture quality through informed processing decisions.
Solution Approach 2:
The guide image provides feedback information about occlusion regions and depth relationships to the image processing algorithm. This feedback enables the system to adapt to different reproduction viewpoints while compensating for occlusion effects, thereby maintaining picture quality across various viewing conditions.
Data Source
AI summary
The present disclosure relates to an image processing apparatus and an image processing method that make it possible to generate a high picture quality texture image of a predetermined viewpoint using an omnidirectional image. A reception section receives a texture image and a depth image as well as a guide image to be referred to upon generation of a display image in which the texture image and the depth image are used. A drawing section compares a pixel value of the display image generated using the texture image and the depth image and a corresponding pixel value of the guide image with each other and executes a process for changing the pixel value in response to a result of the comparison. The present disclosure can be applied, for example, to a home server or the like that generates a display image of a predetermined viewpoint from an omnidirectional image.