Rear Image Stitching With Pre-Conversion Gain Matching
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing techniques for synthesizing images from multiple cameras with partially-overlapping fields of view often result in individual images within the synthetic image appearing flawed due to differences in color tone and brightness, leading to seamlessness loss.
Innovation Solution
A synthetic image generation system that includes image conversion units, comparative image extractors, a correction gain calculator, a correction unit, an inverse-conversion unit, and a synthesis unit, which applies specific image conversions and corrections to maintain pixel value ratios close to 1, preventing saturation and ensuring seamless integration.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Stability of the object's composition
If gain correction is applied to images from multiple cameras to correct color tone and brightness differences, then seamlessness between images is improved, but individual images may appear flawed due to saturation and unnatural color tones
Solution Approach 1:
The patent applies preliminary image conversion to both input images before calculating the correction gain. This preliminary action transforms the images into a common color space and adjusts their characteristics in advance, so that when the correction gain is applied, it doesn't cause saturation or unnatural colors in the final synthetic image. The conversion is performed before the correction step to prevent quality degradation.
Solution Approach 2:
The patent changes the parameters of the images by applying a predetermined image conversion that modifies pixel values in a controlled manner. This conversion adjusts the relationship between pixel values of corresponding pixels in different images, ensuring that the correction gain operates on transformed data rather than raw data, thereby preventing saturation while maintaining seamlessness.
2Stability of the object's composition
If correction gain is calculated from raw images to correct brightness differences, then color tone consistency is improved, but pixel values may become saturated leading to unnatural colors
Solution Approach 1:
The patent performs preliminary image conversion on both input images before calculating the correction gain. This preliminary action transforms the images into a common color space and adjusts their characteristics in advance, so that when the correction gain is applied, it doesn't cause saturation or unnatural colors in the final synthetic image.
Solution Approach 2:
The patent introduces an intermediary image conversion process that acts as a mediator between the raw images and the correction gain calculation. This intermediary conversion transforms the images into a state where the correction can be applied safely without causing saturation, thus preventing harmful effects while achieving color tone consistency.
3Stability of the object's composition
If image conversion is applied to maintain pixel value ratios close to 1, then seamless integration is achieved, but the complexity of the processing system increases
Solution Approach 1:
The patent applies a universal image conversion process that serves multiple functions: it converts images to a common color space, adjusts pixel value relationships, and prepares images for correction gain application. This multi-functional conversion reduces the need for separate processing steps, thereby managing system complexity while achieving seamless integration.
Solution Approach 2:
The patent uses parameter changes through image conversion to achieve seamless integration by controlling pixel value relationships. By transforming images into a common color space and adjusting parameters beforehand, the system achieves seamless integration without requiring complex real-time adjustments during synthesis.
Data Source
Figure 1
Figure 2A-1~2A-2
Figure 2B
AI summary
A synthetic image generation system for generating a synthetic image by synthesizing a first image captured by a first camera and a second image captured by a second camera is provided. At least a part of the field of view of the first camera and at least a part of the field of view of the second camera overlap each other. The synthetic image is an image in which at least a part of the first image and at least a part of the second image are joined together. The synthetic image generation system at least includes a first image conversion unit, a second image conversion unit, a comparative image extracting unit, a correction gain calculation unit, a correction unit, a second image inverse-conversion unit, and a synthesis unit.