Image Processing Apparatus for Natural Light Representation in Pseudo Stereoscopic Images
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods struggle to naturally represent light in pseudo stereoscopic images generated from real-space images, as the positional relationship between the light source and object is unknown, making it difficult to accurately depict light changes with viewpoint shifts.
Innovation Solution
An image processing apparatus that includes a light source change calculation unit to determine changes in the light source region between an input image and a viewpoint-converted image, and a light representation control unit to adjust the light representation based on these changes, ensuring natural light representation according to the viewpoint.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If viewpoint conversion is performed on a real-space image to generate pseudo stereoscopic images, then motion parallax and three-dimensional effect are achieved, but natural light representation becomes difficult because the positional relationship between light source and object is unknown
Solution Approach 1:
The patent introduces an intermediary process between viewpoint conversion and light representation. A light source region estimation unit estimates the light source region in the viewpoint-converted image based on the original image's light source information and the viewpoint conversion parameters. This intermediary estimation enables subsequent light representation processing even though the exact light source position in the converted view is unknown.
Solution Approach 2:
The patent copies light source information from the original image to the viewpoint-converted image. The light source region estimation unit creates a copied representation of the light source by transforming the original light source coordinates according to the viewpoint conversion, allowing light representation without requiring direct measurement of the light source in the new viewpoint.
2Manufacturing precision
If light representation is adjusted based on estimated light source region changes, then natural light representation in viewpoint-converted images is achieved, but processing complexity increases
Solution Approach 1:
The patent performs preliminary action by estimating the light source region in advance before final light representation processing. The light source region estimation unit pre-calculates the light source position and region in the viewpoint-converted image based on original image data and conversion parameters, so that subsequent light representation can proceed efficiently with prepared information.
Solution Approach 2:
The light source region estimation unit serves multiple functions: it estimates light source position, determines light source region boundaries, and provides information for both shading and highlight processing. This multi-functional approach reduces overall system complexity by consolidating multiple processing tasks into a single versatile unit.
Data Source
AI summary
The present technology relates to an image processing apparatus and method and a program that enable natural representation of light in an image in accordance with a viewpoint. The image processing apparatus calculates information indicating a change in a light source region between an input image and a viewpoint-converted image that is obtained by performing viewpoint conversion on the input image on the basis of a specified viewpoint, and causes a change in representation of light in the viewpoint-converted image on the basis of the calculated information indicating a change in the light source region. The present technology can be applied to an image display system that generates a pseudo stereoscopic image with motion parallax from one image.