Single RGB Camera Depth Extraction via Discontinuous IR Projection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The integration of a depth information extracting function and a video call function in TVs is hindered by increased manufacturing costs and device size due to the need for separate IR and RGB cameras.
Innovation Solution
A device and method that utilize a single RGB camera to capture both RGB and IR images by discontinuously projecting IR light, allowing for the extraction of depth information during IR light projection intervals and RGB image information during non-projection intervals, with the control unit adjusting the IR light projection period based on required depth resolution and object distance.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If both IR camera and RGB camera are included in the module, then depth information extraction function and video call function are both performed, but manufacturing cost increases and device size enlarges
Solution Approach 1:
The patent makes the RGB camera perform dual functions: capturing RGB images for video calls and capturing images with projected IR light patterns for depth information extraction. The RGB camera is configured to receive both visible light and IR light, allowing a single camera to replace what would traditionally require two separate cameras (RGB camera and IR camera), thereby reducing device complexity while maintaining functional versatility
Solution Approach 2:
The patent merges the depth sensing function and video call function into a single imaging system. By projecting IR light patterns and having the RGB camera capture both the pattern and RGB image data, the system combines multiple functions into one camera unit, reducing the overall device size and component count
2Adaptability or versatility
If both IR camera and RGB camera are included in the module, then depth information extraction function and video call function are both performed, but manufacturing cost increases
Solution Approach 1:
The patent makes the RGB camera perform dual functions: capturing RGB images for video calls and capturing images with projected IR light patterns for depth information extraction. The RGB camera is configured to receive both visible light and IR light, allowing a single camera to replace what would traditionally require two separate cameras (RGB camera and IR camera), thereby reducing device complexity while maintaining functional versatility
Solution Approach 2:
The patent merges the depth sensing function and video call function into a single imaging system. By projecting IR light patterns and having the RGB camera capture both the pattern and RGB image data, the system combines multiple functions into one camera unit, reducing the overall device size and component count
3Device complexity
If IR light is projected discontinuously, then single camera can capture both depth and RGB information, but requires precise timing control
Solution Approach 1:
The patent employs periodic projection of IR light patterns followed by periodic capture of images by the RGB camera. The projecting unit projects IR light patterns in discrete time intervals, and the camera captures images during specific time windows that correspond to these projection intervals. This periodic timing allows the single camera to distinguish between depth information capture phases and normal video call phases, enabling automatic function switching without complex mechanical components
Solution Approach 2:
The system performs preliminary actions by projecting IR light patterns before capturing images for depth information extraction. The control unit coordinates the projection and capture timing in advance, ensuring that the camera is ready to capture the patterned light at the precise moment it is projected, which enables automatic timing synchronization
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach reduces manufacturing costs and device size by enabling both depth information and video call functions with a single camera, while maintaining effective depth information extraction.
Implementation Method 1
According to the TOF method, depth information may be acquired by measuring flight time, i.e., the time taken for emitted light to be reflected
Implementation Method 2
depth information may be acquired by measuring flight time, i.e., the time taken for emitted light to be reflected
Implementation Method 3
a camera unit that captures images
Data Source
Figure 1~2
Figure 3~4
Figure 5~6
AI summary
A depth information extracting device according to one embodiment of the present invention comprises a projecting unit that discontinuously projects IR (InfraRed) light of a predetermined pattern; a camera unit that captures images; and a signal processing unit that performs depth information extraction and RGB image information extraction by using the images captured by the camera unit, wherein the signal processing unit extracts depth information by using an image received during a first time interval and extracts RGB image information by using an image received during a second time interval.