Projection Surface IR Reflective Elements Touch Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In augmented reality environments, detecting user interactions, particularly touch, with projected images is challenging due to depth resolution and measurement noise issues with existing depth cameras, which make it difficult to accurately differentiate between the projection surface and the user's fingertips.
Innovation Solution
Incorporating passive projection surfaces with reflective elements that reflect non-visible infrared (IR) light, allowing for more accurate detection of user interactions by differentiating distances to the surface and the user's fingertips using IR light reflection patterns.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Difficulty of detecting and measuring
If depth cameras are used to detect user interaction, then user interaction detection capability is provided, but measurement precision deteriorates due to depth resolution limits and noise floor when fingertips are close to the projection surface
Solution Approach 1:
The patent introduces an intermediary substance (substance 10) with distinct optical properties that coats the projection surface 5. This substance acts as a mediator between the depth camera 2 and the projection surface 5, creating a measurable optical contrast that enables precise detection of fingertip proximity and contact without being affected by the inherent depth measurement limitations of the camera system.
Solution Approach 2:
The patent applies a substance with distinct optical properties (different reflectivity, absorption, or emission characteristics) to the projection surface. This creates an optical signature or 'color' difference that the depth camera can detect, allowing it to distinguish the projection surface from the background and accurately measure fingertip interactions even when depth resolution is limited.
2Ease of operation
If standard projection surfaces are used, then projection functionality is provided, but touch detection accuracy deteriorates due to inability to differentiate surface from fingertips
Solution Approach 1:
The substance 10 serves as an intermediary layer on the projection surface 5 that provides optical contrast. This mediator enables the depth camera to accurately detect touch interactions without modifying the projection functionality, as the substance is applied in a way that maintains the surface's ability to display projected images while adding detectable optical properties.
Solution Approach 2:
The patent changes the optical parameters (reflectivity, absorption, emission) of the projection surface by applying substance 10. This parameter change creates a detectable difference between the projection surface and the surrounding environment, enabling accurate touch detection while preserving the surface's projection capabilities.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The use of IR reflective elements on the projection surfaces enhances the accuracy of touch detection and gesture recognition by providing clear distance data, improving interaction detection in augmented reality systems.
Implementation Method 1
Incorporating passive projection surfaces with reflective elements that reflect non-visible infrared (IR) light
Data Source
AI summary
A passive projection screen presents images projected thereon by a projection system. A surface of the screen includes elements that are reflective to non-visible light, such as infrared (IR) light. When non-visible light is directed to the screen, the non-visible light is reflected by the reflective elements back. Part of the reflected light may contact and reflect from a user's fingertip or hand (or other object, such as a stylus) while another part is reflected to the projection system. The projection system differentiates among distances to the surface and distances that include the additional travel to the fingertip. As the fingertip moves closer to the surface, the distances approach equality. When the distances are approximately equal, the finger is detected as touching the surface. In this manner, a projection surface equipped with reflective elements facilitates more accurate touch detection.