Single-Camera 2D/3D Imaging With Time-Division Light Synchronization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing camera systems struggle to simultaneously capture both two-dimensional (2D) and three-dimensional (3D) images, especially in low-light environments, due to the need for multiple cameras and interference issues with infrared patterns affecting 2D images.
Innovation Solution
A camera apparatus with integrated heterogeneous video capabilities, utilizing a 2D light source, a 3D light source, and a camera sensor that operates in time or frequency division modes to separate and synchronize the generation of 2D and 3D images, employing optical filters and pixel units to distinguish between different light types.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If two or more cameras are used to simultaneously recognize 2D color image and 3D image, then the capability to capture both 2D and 3D images is improved, but the device complexity and size increase
Solution Approach 1:
The patent merges 2D imaging and 3D imaging capabilities into a single camera apparatus by integrating multiple image sensors (RGB sensor and IR sensor) and multiple light sources (2D light source and 3D light source) into one device. This allows the single camera to perform both 2D color imaging and 3D depth imaging functions that previously required separate cameras.
Solution Approach 2:
The single camera apparatus is designed with multi-functionality to perform both 2D imaging and 3D imaging tasks. The controller manages different operating modes (first operating mode for 2D imaging, second operating mode for 3D imaging) and coordinates multiple sensors and light sources to achieve universal functionality in one device.
2Device complexity
If a single camera is used to capture both 2D and 3D images, then the device complexity is reduced, but it becomes difficult to simultaneously image both 2D and 3D images
Solution Approach 1:
The controller implements periodic switching between different operating modes. In the first operating mode, the RGB sensor captures 2D color images while the 2D light source is active. In the second operating mode, the IR sensor captures 3D depth images while the 3D light source is active. This periodic alternation allows a single camera to achieve both imaging functions.
Solution Approach 2:
The camera apparatus dynamically switches between different imaging modes and configurations. The controller adjusts which light sources are active and which sensors are reading based on the current operating mode, enabling the single camera to adapt between 2D and 3D imaging functions as needed.
3Adaptability or versatility
If an IR light source with special pattern is used for 3D imaging, then 3D image capability is improved, but the 2D IR image quality deteriorates due to pattern interference
Solution Approach 1:
The patent segments the imaging functions by separating 2D IR imaging and 3D IR imaging into different operating modes. The controller activates the 3D light source with special pattern only during the second operating mode for 3D imaging, while during the first operating mode for 2D imaging, only the 2D light source is active. This temporal segmentation prevents pattern interference in 2D images while maintaining 3D capability.
Solution Approach 2:
The controller prevents pattern interference in 2D images by preliminarily controlling which light sources are active in each mode. Before capturing a 2D image, the controller ensures the 3D light source is inactive, thereby preventing the special pattern from appearing in 2D images. This preliminary control avoids the harmful effect of pattern interference.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables simultaneous capture of 2D and 3D images using a single camera, both in bright and dark environments, reducing the need for multiple cameras and minimizing interference, while maintaining high image quality.
Implementation Method 1
a two-dimensional (2D) light source configured to generate first light for 2D imaging and to irradiate the first light to an object
Implementation Method 2
a three-dimensional (3D) light source to configured to generate second light for 3D imaging and to irradiate the object
Implementation Method 3
an image sensor configured to sense the first light or the third light and the second light incident through the optical filter and to generate the first image signal and the second image signal
Implementation Method 4
an optical filter configured to allow the first light or a third light, which is a visible light, and the second light to pass therethrough
Data Source
AI summary
A camera apparatus includes a two-dimensional (2D) light source to generate first light for 2D imaging and to irradiate the first light to an object; a three-dimensional (3D) light source to generate second light for 3D imaging and to irradiate the object; a camera sensor to perform a time division mode operation which is time-divided into a first time and a second time, to image the object on which the first light is irradiated to generate a first image signal at the first time, to image the object on which the second light is irradiated to generate a second image signal at the second time; and a controller to control synchronization of the 2D light source and the camera sensor and to control synchronization of the 3D light source and the camera sensor during the time division mode operation.