Virtual Light Source Shadow Correction for Multiple Objects

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional image processing techniques struggle to naturally correct shadows for multiple objects in an image using virtual light sources, often resulting in unnatural lighting or difficulty in achieving a desired lighting effect.

Innovation Solution

An image processing apparatus and method that allows users to designate objects for virtual light correction, either uniformly from the same direction or differently, based on user operation, with parameters set accordingly to ensure effective shadow correction across multiple objects.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If a virtual light source is determined according to shadows for each object, then shadow correction for each object is achieved, but the lighting effect becomes unnatural

Engineering Contradiction:
Improveshadow correction accuracyVSAvoidunnatural lighting effect
Core Design Contradiction:
Manufacturing precisionVSObject-generated harmful factors

Solution Approach 1:

The patent segments the shadow correction process into two independent stages: first determining virtual light sources individually for each object based on their shadows, then merging these light sources into a unified lighting effect. This allows each object to receive appropriate shadow correction while maintaining a consistent, natural lighting appearance across all objects.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies local quality by determining virtual light sources specifically for each object based on its shadow characteristics, rather than using a single global light source. Each object receives customized lighting parameters tailored to its specific shadow pattern, enabling precise shadow correction while maintaining overall natural appearance.

Inventive Principle:
Principle #3Local quality

2Object-generated harmful factors

If a virtual light source is determined based on shadows of a specific object, then natural lighting effect is achieved, but it is difficult to appropriately correct each object

Engineering Contradiction:
Improvenatural lighting effectVSAvoidshadow correction accuracy
Core Design Contradiction:
Object-generated harmful factorsVSManufacturing precision

Solution Approach 1:

The patent divides the correction process into object-specific virtual light source determination followed by unified merging. Each object's shadow characteristics are used to determine its own virtual light source parameters, ensuring accurate shadow correction for each object while the merged result provides a natural overall lighting effect.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent creates a universal approach by determining virtual light sources individually for each object and then combining them into a single unified lighting effect that applies to all objects simultaneously. This multi-functional approach enables both precise per-object correction and natural overall appearance.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Manufacturing precision

If multiple objects are corrected with individual virtual light sources, then each object receives appropriate lighting, but the overall lighting effect becomes complex and difficult to control

Engineering Contradiction:
Improveper-object lighting accuracyVSAvoidlighting effect complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent merges multiple object-specific virtual light sources into a single unified lighting effect. By combining the individually determined light sources and their parameters into one consolidated result, the system achieves per-object correction accuracy while simplifying the overall lighting effect to a manageable and controllable single virtual light source representation.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS11523064B2Image processing apparatus, image processing method, and storage medium
Publication Date: 2022.12.06 CANON KK
  • US11523064B2 patent drawing
  • US11523064B2 patent drawing
  • US11523064B2 patent drawing

AI summary

An image processing apparatus comprises a processing unit configured to provide an image containing a first object and a second object, with a lighting effect from a virtual light source, a setting unit configured to set a parameter of the virtual light source; and a designating unit configured to designate the first object and/or the second object, based on a user's operation, wherein, in a case in which the designating unit has designated at least one of the first object and the second object, the first object and the second object are provided with an effect of virtual light from a same direction, and in a case in which the designating means has not designated any object, the first object and the second object are provided with an effect of virtual light from different directions.