Semiconductor Device Dynamic Color Balance for Surround View
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing systems for surround view in automobiles struggle to perform dynamic color balance adjustment for objects moving around the vehicle, especially when the distance from the camera's optical axis increases, leading to inadequate color balance processing and reduced visibility for the driver.
Innovation Solution
A semiconductor device that acquires and processes multiple images from overlapping camera regions, detects a target object, estimates its position change, determines a color adjustment gain, and performs color balance adjustment on subsequent image data to ensure suitable color balance across overlapping regions, thereby enhancing image synthesis and visibility.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If color balance processing is performed based on the photographed pixel corresponding to the optical axis of the photographing device, then the color balance can be adjusted for the central region, but the color balance processing becomes inadequate as the distance from the optical axis increases
Solution Approach 1:
The patent applies local quality by performing color balance processing separately for different regions of the image. Specifically, it divides the image into a first region (central area around the optical axis) and a second region (peripheral areas), and applies different color balance processing methods to each region. This allows the color balance to be optimized locally for each region rather than using a single global processing approach, thereby improving both accuracy and adaptability across the entire image.
2Ease of operation
If a fixed color balance processing method is used for all images, then the processing is simple and consistent, but it cannot dynamically adapt to objects moving around the automobile
Solution Approach 1:
The patent implements dynamics by making the color balance processing adaptive and time-varying. It detects target objects in sequential images, tracks their movement, and dynamically adjusts the color balance processing based on the current position and region of the target object. This allows the system to automatically adapt to moving objects without requiring manual intervention, maintaining both operational simplicity and dynamic adaptability.
Solution Approach 2:
The patent uses feedback by continuously detecting target objects in real-time, determining their positions, and using this information to adjust the color balance processing for subsequent images. The system creates a closed-loop control where the output of one processing cycle (detected object position) becomes the input for the next cycle (color balance adjustment), enabling dynamic adaptation to changing scene conditions while maintaining processing simplicity through automated feedback-driven adjustments.
3Measurement precision
If color balance processing is performed on each image independently, then each image can be optimized individually, but the synthesized image from multiple cameras shows color inconsistency in overlapping regions
Solution Approach 1:
The patent applies merging by integrating color balance processing across multiple cameras and images. It identifies overlapping regions between images from different cameras, detects target objects across these regions, and applies unified color balance processing that ensures consistency across the synthesized image. This combining approach maintains individual image optimization while ensuring color consistency in the final synthesized output.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A semiconductor device includes an image data acquisition circuit which acquires a plurality of first captured image data and a plurality of second captured image data at a first time and a second time, an adjustment region determination circuit which detects a target object from the plurality of first captured image data, and determines an adjustment region by estimating a position of the target object at the second time, a color adjustment circuit configured to determine a color adjustment gain based on the adjustment region, and perform color balance adjustment processing on the plurality of second captured image data based on the color adjustment gain, and an image synthesis circuit configured to synthesize the plurality of second captured image data so that overlapping regions included in a plurality of images of the plurality of second captured image data overlap each other.