Multi-Mode Image Stitching Brightness Uniformity

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing around view monitoring systems fail to correctly display images in specific view modes due to differences in brightness and exposure, leading to unsuitable image output for drivers, particularly in multi-camera setups where images need conversion and stitching to provide a 360-degree view.

Innovation Solution

An image processing method that adjusts brightness and exposure time based on user input, performs image conversion or stitching, and applies correction values using lookup tables to ensure images are accurately displayed in the desired view mode, including processes like inverse perspective mapping and color interpolation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If images are converted and stitched from multiple cameras to provide 360-degree view, then the coverage area is improved, but the brightness uniformity deteriorates due to different exposure ratios between cameras

Engineering Contradiction:
Improvecoverage areaVSAvoidbrightness uniformity
Core Design Contradiction:
Area of stationary objectVSIllumination intensity

Solution Approach 1:

The patent applies parameter changes by adjusting exposure parameters (exposure time, gain) of individual cameras based on their specific characteristics and the target view mode. The system calculates optimal exposure parameters for each camera to ensure uniform brightness in the stitched image, directly resolving the brightness uniformity issue while maintaining 360-degree coverage.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The system performs preliminary calibration to measure and store the characteristics of each camera (lens parameters, sensor properties, exposure characteristics) before actual operation. This preliminary action enables the system to pre-calculate appropriate exposure parameters for each camera based on the selected view mode, ensuring brightness uniformity is achieved before image stitching occurs.

Inventive Principle:
Principle #10Preliminary action

2Illumination intensity

If exposure parameters are adjusted based on individual camera images, then the brightness saturation is improved, but the image quality for different view modes deteriorates due to mode-specific requirements

Engineering Contradiction:
Improvebrightness saturationVSAvoidview mode adaptability
Core Design Contradiction:
Illumination intensityVSAdaptability or versatility

Solution Approach 1:

The patent implements dynamics by making exposure parameters adaptive to the selected view mode. The system dynamically adjusts exposure parameters based on which view mode is active (e.g., front view, rear view, top view, or 360-degree view), allowing optimal image quality for each specific mode rather than using fixed parameters.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes exposure parameters according to the target view mode. Different view modes have different requirements for brightness and exposure, and the patent adjusts the exposure parameters of individual cameras based on the selected mode to optimize image quality for that specific view while preventing brightness saturation.

Inventive Principle:
Principle #35Parameter changes

3Adaptability or versatility

If image processing is performed for multiple view modes, then the versatility is improved, but the computation time deteriorates

Engineering Contradiction:
Improveview mode supportVSAvoidcomputation time
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The patent performs preliminary calibration to measure and store camera characteristics (lens parameters, sensor properties, distortion coefficients) before actual operation. This pre-computed information is stored and reused for different view modes, avoiding redundant calculations and significantly reducing computation time while supporting multiple view modes.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system segments the image processing into distinct stages: calibration stage (performed once), parameter calculation stage (performed when view mode changes), and real-time stitching stage (performed continuously). This segmentation allows computationally intensive operations to be performed only when necessary, reducing overall computation time while maintaining versatility.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11477372B2Image processing method and device supporting multiple modes and improved brightness uniformity, image conversion or stitching unit, and computer readable recording medium realizing the image processing method
Publication Date: 2022.10.18 LG INNOTEK CO LTD
  • US11477372B2 patent drawing
  • US11477372B2 patent drawing
  • US11477372B2 patent drawing

AI summary

Disclosed is an image processing method including adjusting a light exposure time of an image acquisition unit by using a target image converted to be output in a desired output mode among a plurality of output modes; and displaying target images acquired according to the adjustment.