Multi-Camera Image Projection via Space Model Coordinate Association
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image creating devices struggle to effectively convert and display input images from multiple cameras in a way that allows drivers or operators to intuitively understand the positional relationships and distances of objects in their surroundings, particularly in complex environments like those around jib cranes or shovels, without causing discomfort or confusion.
Innovation Solution
A processing-target image creating device and method that associates coordinates on input images with a space model and adjusts image slopes to ensure parallel lines or specific features align correctly, allowing for intuitive display of positional relationships and distances through an output image conversion process.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If multiple cameras are used to capture input images, then the field of view and coverage are improved, but the complexity of coordinate association and image alignment increases
Solution Approach 1:
The patent introduces a space model as an intermediary coordinate system that mediates between multiple camera coordinate systems and the final display coordinate system. Each camera's image coordinates are associated with the space model, which then serves as a common reference for aligning and projecting images from multiple cameras onto a unified display plane, thereby simplifying the overall coordinate association process.
Solution Approach 2:
The patent transitions from 2D image plane coordinates to 3D space model coordinates and then back to 2D display coordinates. This dimensional transformation allows images from multiple cameras to be integrated in a three-dimensional space before being projected onto a two-dimensional display, enabling intuitive representation of spatial relationships while managing coordinate complexity.
2Shape
If image projection is performed onto a space model, then the three-dimensional spatial representation is improved, but the distortion and alignment accuracy deteriorate
Solution Approach 1:
The patent adjusts projection parameters such as slope values and rotation angles to optimize the balance between spatial representation and alignment accuracy. By changing these parameters, the system can control the degree of distortion introduced during projection while maintaining acceptable alignment accuracy between images from different cameras.
Solution Approach 2:
The patent employs dynamic adjustment of projection parameters based on the specific characteristics of each camera and its viewing angle. The slope and rotation parameters are not fixed but are determined dynamically for each camera to minimize distortion and improve alignment accuracy while maintaining accurate spatial representation.
3Measurement precision
If the processing-target image is adjusted by determining slopes, then the alignment of features across multiple images is improved, but the computational complexity increases
Solution Approach 1:
The patent performs preliminary determination of slope values and rotation angles before the actual image projection and alignment process. By pre-calculating these parameters based on camera positions and orientations, the system reduces the computational complexity during real-time image processing while maintaining high feature alignment precision.
4Manufacturing precision
If coordinates are associated to ensure parallel lines, then the geometric accuracy is improved, but the flexibility in image processing is reduced
Solution Approach 1:
The patent makes the coordinate association system dynamic by allowing the slope and rotation parameters to be adjusted based on different processing requirements. While the system can enforce parallel line constraints for geometric accuracy, it also allows these constraints to be modified or relaxed depending on the specific application needs, thereby maintaining both geometric accuracy and processing flexibility.
Data Source
AI summary
A processing-target image creating device creates a processing-target image based on a plurality of input images. The processing-target image creating device includes a coordinates-associating part configured to associate coordinates on each input image plane on which each input image is positioned, coordinates on a space model onto which each input image is projected, and coordinates on a processing-target image plane, and an image adjusting part configured to adjust the processing-target image by determining for each input image a re-projection angle of a re-projection line joining the coordinate and the coordinate. The image adjusting part determines for each input image slopes of the re-projection lines such that each coordinate on the processing-target image plane corresponding to an infinity line in each input image corresponds with each other on a dividing line between image parts corresponding to each input image on the processing-target image plane.