Virtual Image Generation with Multi-Camera Color and Luminance Adjustment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional image generation methods fail to properly correct color and luminance differences between images captured by multiple cameras with different positions and attitudes, leading to visual discomfort when generating virtual images from varying viewpoints.

Innovation Solution

An image generation method that performs luminance or color adjustments on images captured by cameras with different configurations, using a second process distinct from the first process applied to images from reference cameras, to ensure consistent color and luminance across regions of the virtual image.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If a single processing process is applied to all images from multiple cameras, then the processing complexity is reduced, but color and luminance differences between regions in the virtual image increase

Engineering Contradiction:
Improveprocessing complexityVSAvoidcolor and luminance differences
Core Design Contradiction:
Device complexityVSObject-affected harmful factors

Solution Approach 1:

The patent applies different processing processes (first process for reference cameras, second process for other cameras) to different images based on their camera origin. This local differentiation ensures that each image region receives appropriate color and luminance adjustment specific to its camera's characteristics, thereby reducing visual discomfort while maintaining manageable processing complexity through structured categorization.

Inventive Principle:
Principle #3Local quality

2Object-affected harmful factors

If different processing processes are applied to images from different cameras, then color and luminance consistency is improved, but the processing complexity increases

Engineering Contradiction:
Improvecolor and luminance differencesVSAvoidprocessing complexity
Core Design Contradiction:
Object-affected harmful factorsVSDevice complexity

Solution Approach 1:

The patent segments the set of cameras into reference cameras and other cameras, applying distinct processing processes to each group. This segmentation allows for targeted color and luminance correction specific to each camera type while organizing the complexity through clear categorization and reference-based processing, making the overall system manageable.

Inventive Principle:
Principle #1Segmentation

3Adaptability or versatility

If images from cameras with different positions and attitudes are used without correction, then the versatility of the system is improved, but visual discomfort increases due to color and luminance inconsistencies

Engineering Contradiction:
Improvesystem versatilityVSAvoidvisual discomfort
Core Design Contradiction:
Adaptability or versatilityVSObject-affected harmful factors

Solution Approach 1:

The patent changes the color and luminance parameters of images from non-reference cameras to match the characteristics of reference camera images. By adjusting these parameters dynamically based on camera identity and capturing conditions, the system maintains versatility in handling multiple camera configurations while eliminating visual discomfort through parameter normalization.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11017587B2Image generation method and image generation device
Publication Date: 2021.05.25 PANASONIC INTELLECTUAL PROPERTY CORP OF AMERICA
  • US11017587B2 patent drawing
  • US11017587B2 patent drawing
  • US11017587B2 patent drawing

AI summary

This image generation method is for generating a virtual image by a processor using at least one of images obtained by cameras disposed in different positions and attitudes capturing the same target space in a three-dimensional (3D) space. The virtual image is a two-dimensional (2D) image of the target space viewed from a virtual viewpoint in the 3D space. When generating the virtual image using one or more second images captured by one or more second cameras, at least one of which is different from one or more first cameras that capture one or more first images serving as a basis among the images, a second process which includes at least one of luminance and color adjustments and is different from a first process performed to generate the virtual image using the one or more first images is performed on the one or more second images.