Foveated Laser Projector with Depth Mapping Modulation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing scanning laser projectors face limitations in combining depth mapping with image projection, constrained by resolution, power, and flexibility, leading to a need for improved devices and methods that can dynamically modulate images based on surface depth maps.
Innovation Solution
The implementation of a scanning laser projector that generates both image pixels and depth mapping pulses during the same scan, using a pixel drive generator to dynamically modulate the projected image in response to surface depth maps, allowing for foveated imaging and rapid adaptation to changes in the scanning region.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If depth mapping is combined with laser projection using past methods, then depth mapping capability is achieved, but resolution is limited
Solution Approach 1:
The system dynamically adjusts the scanning pattern based on depth map data, transitioning from static pre-defined patterns to adaptive real-time modulation. The projector modifies scan lines on-the-fly to concentrate resources on regions of interest identified by depth sensing, resolving the contradiction between resolution and flexibility by making the system adaptable to different scenarios.
Solution Approach 2:
The system changes operational parameters (scan pattern, laser power, scanning speed) based on depth map feedback. By dynamically adjusting these parameters according to surface characteristics and regions of interest, the system achieves high resolution where needed while maintaining flexibility to adapt to different objects and conditions.
2Measurement precision
If depth mapping and laser projection are combined with high resolution, then measurement precision is improved, but power consumption increases
Solution Approach 1:
Instead of uniformly applying high resolution depth mapping across the entire field of view, the system applies depth mapping and high-resolution projection selectively to specific regions of interest. By concentrating power and resources on locally important areas rather than uniformly across the whole scene, the system achieves high measurement precision where needed while significantly reducing overall power consumption.
Solution Approach 2:
The system performs depth mapping and high-resolution projection partially, only in regions where it is truly necessary based on depth map analysis. Rather than excessively processing the entire scene at full resolution, the system applies resources selectively to critical regions, achieving the required measurement precision with optimized power consumption.
3Measurement precision
If the scanning pattern is modified to improve depth mapping, then measurement precision is improved, but image projection quality deteriorates
Solution Approach 1:
The scanning pattern is segmented into different regions with different functions: some scan lines are dedicated to depth mapping while others are optimized for image projection. By dividing the scanning resources spatially and temporally, the system can improve depth mapping quality in specific regions without compromising overall image projection quality, as different portions of the scan serve different purposes.
Solution Approach 2:
The system employs periodic alternation between depth mapping scan lines and image projection scan lines. By rhythmically switching between these two functions in a periodic manner, the system ensures that both depth mapping and image projection receive adequate resources, preventing deterioration of image quality while still achieving improved depth mapping through the modified scanning pattern.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables simultaneous image projection and depth mapping with dynamic modulation of projected images, enhancing flexibility and responsiveness to surface changes, while conserving power and resources.
Implementation Method 1
at least one source of laser light configured to generate a laser beam
Implementation Method 2
at least one scanning mirror configured to reflect the laser beam
Data Source
AI summary
Devices and methods are described herein for providing foveated image projection. In general, at least one source of laser light is used to generate a laser beam, and scanning mirror(s) that reflect the laser beam into a pattern of scan lines. The source of light is controlled to selectively generate projected image pixels during a first portion of the pattern of scan lines, and to selectively generate depth mapping pulses during a second portion of the pattern of scan lines. The projected image pixels generate a projected image, while the depth mapping pulses are reflected from the surface, received, and used to generate a 3-dimensional point clouds that describe the measured surface depth at each point. Thus, during each scan of the pattern both a projected image and a surface depth map can be generated, with the surface depth map used to modify some portion of the projected pixels.