Multipartite Optical Filter for Simultaneous Visible and Infrared Image Capture
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current methods for capturing both depth and regular images require multiple cameras, leading to increased costs, complexity, and calibration challenges due to differences in camera components and intrinsic parameters.
Innovation Solution
A camera system with a multipartite filter that allows or blocks distinct types of light at different positions, enabling a single sensor array to capture both visible and infrared images simultaneously, reducing the need for multiple cameras and simplifying calibration.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If multiple cameras are used to capture both depth and regular images, then both depth image and regular image quality are improved, but device complexity and cost increase
Solution Approach 1:
The patent combines multiple camera functions into a single camera by integrating a regular imaging sensor and a depth imaging sensor within the same device. The sensor array includes both first sensor elements for regular images and second sensor elements for depth images, eliminating the need for separate cameras and reducing system complexity
Solution Approach 2:
The single camera system performs multiple functions simultaneously - capturing both regular visible light images and infrared depth images using the same device. The sensor array is designed to handle both imaging modes, making the camera universal for both photogrammetry and depth sensing applications
2Loss of information
If multiple cameras are used to capture depth and regular images, then comprehensive image data is obtained, but calibration and alignment difficulty increase
Solution Approach 1:
By merging the regular and depth imaging sensors into a single camera system with a shared lens and sensor array, the patent eliminates the calibration and alignment problems associated with multiple separate cameras. Both image types are captured from the same optical center, ensuring automatic geometric consistency
Solution Approach 2:
The patent uses a microlens array where each microlens corresponds to a sensor element and creates multiple light paths. This copying approach allows the same optical path to be used for both regular and depth imaging, ensuring that both images are naturally aligned without requiring complex calibration procedures
3Productivity
If multiple cameras are used for simultaneous image capture, then both depth and regular images are captured, but hardware cost increases
Solution Approach 1:
The patent merges multiple imaging functions into a single camera by combining regular and depth sensors in one device, reducing the quantity of hardware components needed and thereby lowering overall system cost while maintaining simultaneous capture capability
Solution Approach 2:
The sensor array uses a patterned filter structure where certain sensor elements are assigned to capture infrared light for depth imaging while others capture visible light for regular imaging. This selective assignment allows the system to recover and utilize different light spectra through a single sensor array, eliminating the need for multiple dedicated cameras
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach simplifies the process of capturing simultaneous visible and infrared images, reduces hardware costs, and aligns the images effectively, improving the efficiency of computer vision tasks like 3D reconstruction and face recognition.
Implementation Method 1
A camera system with a multipartite filter that allows or blocks distinct types of light at different positions, enabling a single sensor array to capture both visible and infrared images simultaneously
Data Source
AI summary
Described herein are systems and methods that provide effective way for simultaneous capture of infrared and non-infrared images from a single camera. In embodiments, a filter comprises at least two types of filters elements: (1) an infrared filter type that allows infrared light to pass through the filter element; and (2) at least one non-infrared filter type that allows light in a visible spectrum range or ranges to pass through the filter element. In embodiments, the filter elements form a pattern of the infrared filter elements and the non-infrared filter elements and is positioned relative to a camera's array of sensor cells to form a correspondence between sensor cells and filter elements. In embodiments, signals captured at the camera's sensor cells may be divided to form an infrared image and a visible light image that were captured simultaneous, which images may be used to determine depth information.