2D to 3D Image Conversion via Local Sharpness Adjustment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for converting 2D images to 3D images either require time-consuming preprocessing or fail to provide an adequate three-dimensional effect, especially when dealing with images that have a deep-focus or incorrect front-and-back relationships between objects and backgrounds.

Innovation Solution

An image processing apparatus that calculates the sharpness of 2D image regions, adjusts sharpness levels by increasing it in focused areas and reducing it in blurred areas, and generates left and right eye images by shifting the 2D image horizontally based on focus position determination, ensuring a correct front-and-back relationship.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If a 2D image is simply shifted horizontally to generate L-eye and R-eye images, then the conversion process is simple and fast, but the three-dimensional effect is insufficient when the original image has deep-focus or incorrect front-and-back relationships

Engineering Contradiction:
Improveconversion speedVSAvoidthree-dimensional effect quality
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent applies different sharpness processing to different regions of the image based on their focus status. In-focus regions have their sharpness enhanced while out-of-focus regions have their sharpness reduced, creating localized quality differences that generate adequate three-dimensional effects without requiring complex global processing

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent performs sharpness adjustment on the 2D image before generating the L-eye and R-eye images. This preliminary processing ensures that the image has appropriate focus characteristics before the horizontal shifting operation, thereby ensuring correct front-and-back relationships in the final 3D output

Inventive Principle:
Principle #10Preliminary action

2Reliability

If sharpness is increased in in-focus regions to enhance three-dimensional effect, then the three-dimensional effect is improved, but excessive blurring in out-of-focus regions degrades image quality

Engineering Contradiction:
Improvethree-dimensional effectVSAvoidimage quality degradation
Core Design Contradiction:
ReliabilityVSObject-affected harmful factors

Solution Approach 1:

The patent calculates sharpness for each region of the 2D image and applies different processing strengths based on the calculated sharpness values. Regions with sharpness above a first threshold have their sharpness enhanced, while regions with sharpness below a second threshold have their sharpness reduced, creating localized quality adjustments that prevent excessive blurring

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent dynamically adjusts the sharpness parameter differently for different image regions based on their focus characteristics. By changing the sharpness parameter locally rather than applying a uniform transformation, the system enhances three-dimensional effects in appropriate regions while maintaining image quality in others

Inventive Principle:
Principle #35Parameter changes

3Reliability

If the focus position in a 2D image is incorrect or the front-and-back relationship is wrong, then simple horizontal shifting produces incorrect 3D relationships, but complex processing time is required to correct it

Engineering Contradiction:
Improvefront-and-back relationship accuracyVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent performs sharpness adjustment as a preliminary action before the horizontal shifting operation. By ensuring the 2D image has correct focus characteristics and front-and-back relationships before generating the L-eye and R-eye images, the system avoids the need for complex post-processing corrections

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses the calculated sharpness values as feedback to determine which regions require sharpness enhancement and which require reduction. This feedback mechanism ensures that the sharpness adjustment is automatically adapted to the specific characteristics of each image region, correcting focus issues efficiently without requiring manual intervention or complex algorithms

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS8787655B2Image processing apparatus and control method therefor
Publication Date: 2014.07.22 CANON KK
  • US8787655B2 patent drawing
  • US8787655B2 patent drawing
  • US8787655B2 patent drawing

AI summary

An image processing apparatus according to the present invention, comprises a calculation unit that calculates a sharpness of a 2D image for each region thereof; an image processing unit that performs image processing, in a region with a sharpness calculated by the calculation unit being higher than a first predetermined value, to increase that sharpness, and performing image processing, in a region with a sharpness calculated by the calculation unit being lower than a second predetermined value which is equal to or lower than the first predetermined value, to reduce that sharpness; and a generation unit that generates, from the 2D image processed by the image processing unit, an image for a left eye and an image for a right eye by shifting the 2D image in a horizontal direction.