Multi-aperture Camera Depth Calculation via Scan Line Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional stereo camera systems require two optical systems with apertures and image sensors, making them difficult to miniaturize, increasing production costs, and prone to calibration errors that affect accurate depth calculation.
Innovation Solution
A multi-aperture camera system using a single optical system with offset apertures and a scan line processing technique to determine depth, where images from different apertures are processed using a scan line-based processor unit to calculate disparity and determine depth at individual pixels.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a conventional stereo camera system uses two optical systems with apertures and image sensors, then depth can be determined using disparity between images, but the system becomes difficult to miniaturize and production cost increases
Solution Approach 1:
The patent merges multiple apertures into a single optical system, where multiple apertures are formed on one lens assembly rather than requiring separate optical systems. This allows the system to capture multiple images through different apertures using a single image sensor, thereby reducing hardware complexity while maintaining depth determination capability through disparity calculation between the captured images
Solution Approach 2:
The single optical system serves multiple functions by accommodating multiple apertures that can capture images from different viewpoints. The image sensor processes images from all apertures, and the processor determines depth using disparity between these images, making the single optical system universal for both capturing and depth calculation without requiring separate optical systems
2Measurement precision
If a conventional stereo camera system uses two optical systems, then depth can be determined, but additional calibration is required which increases production cost and introduces calibration errors
Solution Approach 1:
The patent extracts the calibration requirement from the system by forming multiple apertures on a single optical system with known relative positions. Since the aperture positions are fixed and known during manufacturing, the system eliminates the need for additional calibration steps, thereby reducing production cost and avoiding calibration errors that would otherwise affect depth calculation accuracy
3Measurement precision
If images from multiple apertures are processed in software in a conventional stereo camera system, then depth can be determined, but the processing procedure becomes more complicated
Solution Approach 1:
The patent segments the image processing into structured steps: capturing images through multiple apertures, calculating disparity between corresponding points in the images, and determining depth based on the disparity. This segmentation of the processing procedure into distinct, manageable steps simplifies the overall software implementation while maintaining accurate depth determination
4Measurement precision
If apertures are distributed to two optical systems in a conventional stereo camera system, then depth can be determined using disparity, but the system cannot hardware-integrate the image processing
Solution Approach 1:
The patent combines multiple apertures and image processing capabilities into a single integrated optical system with a single image sensor. This hardware integration allows the system to capture images from multiple apertures and process them together, eliminating the need for separate optical systems and enabling more efficient hardware-based image processing and depth calculation
Data Source
AI summary
The multi-aperture camera system includes a first aperture receiving an RGB optical signal, a second aperture distinguished from the first aperture and receiving an optical signal of which a wavelength is different from that of the RGB optical signal, an image sensor, a plurality of frame buffers, wherein the first and second images are respectively stored in the frame buffers, and a scan line-based processor unit (SPU) processing the first and second images using a scan line processing technique to determine a depth at at least one pixel of the first and second images. The first aperture and the second aperture are formed on a single optical system so as to be offset in a horizontal direction of the image sensor and thus have center positions deviated from each other.