Vehicle Top-View Image Harmonization Around Detected Objects
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing vehicle camera systems struggle to harmonize images accurately under varying lighting conditions and when objects are present, leading to discrepancies in brightness and color that distort the composite top view.
Innovation Solution
A vehicle camera system that employs a harmonization algorithm adjusting brightness and color based on detected objects, using proximity sensors to modify harmonization weights for overlapping image segments, ensuring accurate reproduction of surroundings.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If image harmonization is performed using standard algorithms, then brightness and color consistency is improved, but discrepancies remain in overlapping regions containing objects
Solution Approach 1:
The patent applies different harmonization strategies to different regions of the image. Specifically, overlapping regions containing detected objects are excluded from harmonization processing, while non-overlapping and non-object overlapping regions undergo standard harmonization. This local differentiation resolves the contradiction by preserving object appearance accuracy in critical overlapping regions while maintaining overall image consistency elsewhere.
Solution Approach 2:
The patent segments the image into distinct regions based on overlap detection and object detection results. By dividing the image into harmonization-applicable regions and object-containing overlapping regions, the system can apply appropriate processing to each segment, thereby achieving both overall consistency and local accuracy.
2Stability of the object's composition
If all overlapping segments are harmonized uniformly, then overall image consistency is improved, but object appearance becomes distorted
Solution Approach 1:
The patent implements local quality control by identifying overlapping regions containing objects through detection algorithms and excluding only those specific regions from harmonization processing. This selective approach preserves object appearance information while maintaining consistency in the rest of the image, resolving the contradiction between uniform consistency and object fidelity.
Solution Approach 2:
The patent extracts or removes object-containing overlapping regions from the harmonization process. By separating these critical regions from the general harmonization workflow, the system prevents distortion of object appearance while still applying harmonization to the remaining image areas, thus maintaining both consistency and information integrity.
3Manufacturing precision
If proximity sensor data is integrated into harmonization weighting, then object region accuracy is improved, but system complexity increases
Solution Approach 1:
The patent introduces proximity sensor data as an intermediary element that mediates the harmonization process. The sensor data provides objective information about object locations, which the system uses to automatically adjust harmonization weights in overlapping regions. This intermediary approach improves object region accuracy while keeping the system relatively simple by using straightforward weight adjustment based on sensor input.
Solution Approach 2:
The system uses proximity sensor data to automatically identify and adjust harmonization parameters for object-containing regions without requiring complex manual intervention or sophisticated algorithms. The sensor data essentially serves the system by providing ready-to-use information that simplifies the decision-making process for weight adjustment, thereby improving accuracy without proportionally increasing complexity.
Data Source
AI summary
A composite top view of an area surrounding a vehicle is generated utilizing image harmonization and proximity sensor data. Images from various vehicle cameras are received, wherein at least two of the cameras can see the same portion of the environment in an overlapping region. The images are segmented into segments. The overlapping regions include some of the segments of one image and some of the segments of another region to define overlapping segments. Sensor data is received from a plurality of proximity sensors, wherein the sensor data indicates a location of an object outside of the vehicle. The color and/or brightness of the images are harmonized based at least in part on the sensor data. In particular embodiments, weights are placed on the color and/or brightness of the overlapping segments associated with the location of the object. Or these overlapping segments can be removed from the harmonization.