Rendering Apparatus Using Dual Normal Information for Intuitive Lighting Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing methods using high-resolution normal information from photometric stereo are not intuitive for users to make precise lighting changes, as slight shifts in designated areas significantly alter lighting effects.

Innovation Solution

An apparatus and method that acquire first normal information and second normal information of lower frequency, using the latter to determine virtual light source conditions for generating rendering images, allowing users to intuitively control lighting effects by smoothing changes when shifting designated areas.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If high-resolution normal information is used for rendering, then measurement precision is improved, but ease of operation deteriorates because lighting changes significantly with slight area shifts

Engineering Contradiction:
Improvenormal information resolutionVSAvoidlighting control intuitiveness
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent segments the normal information into two distinct types: first normal information (high-resolution) for accurate rendering and second normal information (low-resolution) for intuitive lighting control. This segmentation allows each type to serve its specific purpose without the drawbacks of using high-resolution normal information for both rendering and lighting control

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces second normal information as an intermediary between the user's lighting intent and the final rendering. This intermediary smooths out the sensitivity to area shifts by providing stabilized normal values that represent the overall lighting direction rather than local variations

Inventive Principle:
Principle #24Intermediary (Mediator)

2Manufacturing precision

If high-resolution normal information is used, then manufacturing precision is improved, but device complexity increases due to additional processing requirements

Engineering Contradiction:
Improverendering accuracyVSAvoidprocessing complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent divides the processing into two parallel streams: one handling high-resolution normal information for rendering accuracy and another handling low-resolution normal information for lighting control. This segmentation organizes the complexity into manageable, purpose-specific processing paths

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies partial action by using only the necessary resolution level for each processing purpose. High-resolution normal information is used only where precision is critical for rendering, while low-resolution normal information suffices for lighting control, avoiding the excessive processing burden of using high-resolution data everywhere

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS11997396B2Processing apparatus, processing system, image pickup apparatus, processing method, and memory medium
Publication Date: 2024.05.28 CANON KK
  • US11997396B2 patent drawing
  • US11997396B2 patent drawing
  • US11997396B2 patent drawing

AI summary

An apparatus includes at least one processor configured to execute a plurality of tasks including a first normal acquiring task configured to acquire first normal information of an object, a designated area acquiring task configured to acquire a designated portion in the object, the designated area being designated by a user, a second normal acquiring task configured to acquire second normal information of the object, the second normal information being normal information having a lower frequency than a frequency of the first normal information, a virtual light source determining task configured to determine a virtual light source condition based on the second normal information corresponding to the designated portion, and a rendering task configured to generate a rendering image using the first normal information and the virtual light source condition.