Image Joining Brightness Conversion Factor Calculation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing devices struggle to efficiently join images with different exposure conditions while maintaining low processing load and high speed, particularly in resource-constrained devices like mobile phones.

Innovation Solution

An image processing device that calculates a brightness conversion factor using motion vectors and brightness values to align and join images, employing a synthetic image generation method that reduces noticeable joint artifacts by using a perpendicular bisector as the joint and adjusting pixel values independently.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If template-matching and brightness correction are performed in the overlapping region to make joints less noticeable, then image joining quality is improved, but processing time and computational load increase

Engineering Contradiction:
Improveimage joining qualityVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent extracts only the necessary brightness information from the overlapping region by using motion vectors to determine the region and calculating brightness conversion factors based on sampled brightness values, rather than performing comprehensive template-matching across the entire overlapping area. This selective extraction approach reduces computational load while maintaining joining quality.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent performs preliminary brightness value calculation and conversion factor determination before the actual image joining process. By pre-calculating the brightness conversion factor based on brightness values from the overlapping region, the system prepares the necessary correction parameters in advance, reducing the computational burden during the main joining operation.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If comprehensive template-matching is performed to align images, then joining accuracy is improved, but processing speed decreases

Engineering Contradiction:
Improvejoining accuracyVSAvoidprocessing speed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

Instead of performing comprehensive template-matching across the entire overlapping region, the patent applies partial action by using motion vectors to directly determine the overlapping region and sampling brightness values at specific locations. This partial approach provides sufficient accuracy for joining while significantly improving processing speed.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The patent replaces the mechanical template-matching process with a motion vector-based approach. Motion vectors, which can be obtained from video processing or image matching algorithms, provide direct positional information without requiring exhaustive template comparison, thus substituting a computationally intensive mechanical search process with a more efficient vector-based method.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Manufacturing precision

If brightness conversion is performed to match exposure conditions, then visual quality of joint is improved, but processing load increases

Engineering Contradiction:
Improvebrightness matching qualityVSAvoidprocessing load
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent changes the parameter approach by calculating a single brightness conversion factor based on the average brightness values in the overlapping region, rather than performing pixel-by-pixel brightness adjustment. This parameter transformation simplifies the processing load while maintaining effective brightness matching across the joint.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS8538192B2Image processing device, image processing method and storage medium
Publication Date: 2013.09.17 MORPHO INC
  • US8538192B2 patent drawing
  • US8538192B2 patent drawing
  • US8538192B2 patent drawing

AI summary

An image processing device that sequentially generates a synthetic image by joining a first image, which is a single image or constituted by a plurality of the images joined together, and a second image that is input, every time when the second image is input, includes: an overlapping region obtainment portion 14 that obtains a motion vector on the basis of the second image and an image input immediately before the second image among the images constituting the first image, and obtains an overlapping region where the image input immediately before and the second image overlap each other on the basis of the obtained motion vector; a brightness-value conversion factor calculation portion 16 that calculates a brightness conversion factor for converting a brightness value of the first image or a brightness value of the second image on the basis of the brightness value of the first image and the brightness value of the second image in the overlapping region so that a change in the brightness values between the first image and the second image becomes small; and a synthetic image generation portion 12 that generates the synthetic image by converting the first image or the second image using the brightness conversion factor and by joining the first image and the second image.