3D Imager Using Invisible Light Projection for Real-Time Depth Mapping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current augmented reality systems lack the ability to effectively create and project high-resolution, interactive three-dimensional images and data in real-time, limiting their ability to enhance user interaction with the environment and provide accurate depth information.
Innovation Solution
A device comprising cameras, projectors, and processors that detect and project both visible and invisible light, generating depth data by comparing projected and detected invisible light patterns, and combining this with visible light images to create three-dimensional data, allowing for interactive virtual objects and enhanced user input recognition.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If current augmented reality systems are used, then basic projection and imaging functions are provided, but the ability to create and project high-resolution, interactive three-dimensional images and data in real-time is lacking
Solution Approach 1:
The system segments the imaging process into multiple independent components: invisible light projection for depth mapping, visible light imaging for texture capture, and processor-based integration for 3D reconstruction. This segmentation allows each component to operate independently at high speed, enabling real-time 3D image creation while maintaining high depth information accuracy through specialized processing of each light type's data
Solution Approach 2:
The system merges invisible light depth data with visible light image data into a unified three-dimensional representation. By combining these complementary data types, the system achieves both high-resolution imagery and accurate depth information simultaneously, resolving the contradiction between productivity and measurement precision
2Measurement precision
If invisible light projection is used to generate depth data, then accurate depth information is obtained, but the system complexity increases due to multiple cameras and projectors
Solution Approach 1:
The system employs cameras and projectors that serve multiple functions: the invisible light camera captures both depth information and can detect visible light, while the projectors can switch between invisible light for depth mapping and visible light for image projection. This multi-functionality reduces the total number of devices needed while maintaining high depth data accuracy
Solution Approach 2:
The processor acts as an intermediary that receives data from multiple sensors and synthesizes unified three-dimensional representations. By centralizing the integration function in the processor, the system manages the complexity of multiple cameras and projectors through a single coordination point, maintaining depth accuracy while organizing system complexity
3Adaptability or versatility
If high-resolution three-dimensional data is created in real-time, then user interaction capability is enhanced, but the processing power and computational requirements increase
Solution Approach 1:
The system performs preliminary actions by continuously capturing invisible light data to pre-compute depth maps and maintaining ready-to-use three-dimensional representations of the environment. This preliminary processing enables rapid user interaction without requiring intensive real-time computation during interaction events, thus enhancing adaptability while managing power requirements
Solution Approach 2:
The system uses feedback from user interactions to selectively update only the portions of the three-dimensional data that are relevant to current user actions. This feedback-driven selective processing enhances user interaction capability by providing responsive updates while reducing overall processing power requirements by avoiding unnecessary computations
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables the creation of high-resolution, interactive three-dimensional images and data in real-time, enhancing user interaction and providing accurate depth information, enabling applications such as augmented reality, 3D imaging, and virtual object manipulation.
Implementation Method 1
a camera adapted to obtain an invisible light image of the environment within the field of view
Implementation Method 2
a projector adapted to project output from the processing and control unit into the environment within the field of view
Data Source
AI summary
The systems and methods described herein include a device that can scan the surrounding environment and construct a 3D image, map, or representation of the surrounding environment using, for example, invisible light projected into the environment. In some implementations, the device can also project into the surrounding environment one or more visible radiation pattern patterns (e.g., a virtual object, text, graphics, images, symbols, color patterns, etc.) that are based at least in part on the 3D map of the surrounding environment.