RGB-IR Sensor Movement for Compact Depth Imaging
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In mobile computing devices, the limited physical space poses a challenge for incorporating additional depth imaging sensors, as existing solutions like RGB-IR sensors result in reduced IR image resolution and degraded color image quality due to sub-sampling and the need for separate sensors.
Innovation Solution
The method involves physically moving a RGB-IR sensor to multiple positions to capture images, generating composite images that enhance resolution for both color and depth imaging, thereby reducing space requirements and ensuring sufficient image quality without the need for additional sensors.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If a RGB-IR sensor is used to combine color and depth imaging, then physical space is reduced, but IR image resolution is heavily reduced due to sub-sampling
Solution Approach 1:
The patent moves the problem from the spatial domain to the temporal domain by capturing images at multiple positions sequentially. Instead of having all infrared pixels simultaneously capture the same scene (spatial arrangement), the sensor is moved to different positions to allow different infrared pixels to capture different portions of the scene, effectively increasing resolution through temporal sampling.
Solution Approach 2:
The patent introduces dynamic movement of the sensor to resolve the static limitation of having only one-fourth of pixels available for infrared imaging. By moving the sensor between captures, the system dynamically assigns different pixels to different spatial locations, effectively utilizing all infrared pixels across multiple captures to build a high-resolution composite image.
2Device complexity
If a RGB-IR sensor is used to combine color and depth imaging, then device complexity is reduced, but color image quality is degraded due to sub-sampling
Solution Approach 1:
The patent resolves the color quality degradation by moving the sensor to multiple positions and combining images, effectively using all color pixels across the sequence. This temporal approach ensures that every color pixel contributes to the final composite image, maintaining full color resolution despite the mixed pixel arrangement.
Solution Approach 2:
By dynamically moving the sensor between captures, the system ensures that all color pixels are utilized across the image sequence. Different color pixels capture different portions of the scene at different positions, and the composite image aggregates all this information, maintaining full color quality while using a single sensor.
3Measurement precision
If infrared pixels are placed where color pixels were previously located during sensor movement, then composite image resolution is enhanced, but interference from IR emission during color imaging occurs
Solution Approach 1:
The patent employs periodic action by alternating between infrared capture mode and color capture mode in a systematic sequence. The sensor moves to specific positions for infrared captures, then moves to different positions for color captures, repeating this pattern. This periodic alternation ensures that IR emission only occurs during designated infrared capture periods, preventing interference with color imaging.
Solution Approach 2:
The patent segments the imaging process into distinct infrared capture phases and color capture phases. By dividing the overall imaging sequence into separate segments for each modality, the system ensures that infrared emission and color imaging do not occur simultaneously, eliminating interference while still achieving high resolution through the aggregation of multiple segmented captures.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach allows for higher resolution color and depth images while minimizing physical space and cost, by utilizing a single RGB-IR sensor instead of separate sensors, and reduces interference from IR emission during color imaging.
Implementation Method 1
obtaining, by an image sensor that includes infrared pixels and color pixels, a first image of a scene
Implementation Method 2
the emitter can be a dot projector such that depth images can be computed using a technique called structured light
Data Source
AI summary
Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for depth imaging. In one aspect, a method includes obtaining, by an image sensor that includes infrared pixels and color pixels, a first image of a scene while the image sensor is in a first position, moving the image sensor to a second position, wherein, in the second position, a particular infrared pixel is located where a particular color pixel was previously located when the image sensor was in the first position, obtaining, by the image sensor, a second image of the scene while the image sensor is in the second position, generating a composite image based on the first image and the second image, and determining an estimated distance to an object within the scene based on the composite image.