Multi-Camera Image Synthesis for Depth Accuracy
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current information processing devices face challenges in enhancing functions using shot images due to limitations in manufacturing costs, image transmission bandwidth, and responsiveness from shooting to output, making it difficult to improve performance and image quality effectively.
Innovation Solution
An information processing device equipped with two cameras that shoot subjects under different conditions, allowing for the integration of image data with varying properties such as angle of view and exposure time, and using correction tables to align luminance distributions for accurate stereo matching and depth image generation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the performance and image quality of the camera are enhanced, then the manufacturing cost increases
Solution Approach 1:
The patent combines images captured by multiple cameras with different specifications (different angle of view, resolution, exposure time) to generate a synthesized output image. This merging approach allows the system to achieve high image quality equivalent to expensive high-performance cameras by intelligently processing images from multiple lower-cost cameras.
Solution Approach 2:
The image synthesis processing unit performs multiple functions: it selects appropriate images based on shooting conditions, corrects luminance distributions, synthesizes final images, and adapts to different camera configurations. This multi-functional processing unit replaces the need for expensive specialized camera hardware.
2Measurement precision
If the image transmission bandwidth is increased, then the data transmission volume increases
Solution Approach 1:
The system extracts only the necessary image data from multiple cameras based on the specific shooting conditions and processing requirements. Instead of transmitting all raw image data from all cameras, the selection unit chooses appropriate images and the synthesis unit processes them locally, reducing the amount of data that needs to be transmitted while maintaining output image quality.
Solution Approach 2:
The system performs preliminary selection and processing of image data before final output. The image synthesis processing unit pre-processes images by selecting appropriate sources and correcting luminance distributions, so that only essential processed data needs to be transmitted or stored, rather than transmitting all original high-volume image data.
3Speed
If the responsiveness from shooting to output is improved, then the processing complexity increases
Solution Approach 1:
The system performs preliminary organization of camera data and pre-computation of luminance correction tables before actual image synthesis is needed. This allows the image synthesis processing unit to quickly generate output images without performing complex real-time calculations, thereby improving responsiveness while managing processing complexity through advance preparation.
Solution Approach 2:
The image synthesis processing unit automatically selects appropriate images from different cameras and performs luminance correction based on stored correction tables, without requiring manual intervention or complex real-time analysis. This self-service approach streamlines the processing workflow and improves responsiveness.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
An imaging device 12 includes a first camera 28 and a second camera 30 and shoots the same object under different shooting conditions. A shot-image data acquirer 118 of an image analyzer 34 acquires data of two images simultaneously shot from the imaging device 12. A correcting section 124 aligns the distributions of the luminance value between the two images by carrying out correction for either one of the two images. A correction table managing section 120 switches and generates a correction table to be used according to the function implemented by the information processing device 14. A correction table storage 122 stores the correction table showing the correspondence relationship between the luminance values before and after correction. A depth image generator 126 performs stereo matching by using the two images and generates a depth image.