Tap Detection on 3D Virtual Images via Vibrometer
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current systems lack effective methods for detecting input directed to virtual images in three-dimensional computer-generated environments, particularly in scenarios where users interact with virtual keyboards through physical surface contacts, leading to inaccuracies in selecting virtual keys and performing operations.
Innovation Solution
The use of a remote sensing vibrometer that emits light beams to detect vibrations on a physical surface, combined with camera-based hand tracking, allows for precise determination of contact locations relative to virtual images, enabling accurate selection of virtual keys and performing operations such as text input or deletion in a three-dimensional environment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a virtual image is displayed on a physical surface in a three-dimensional environment, then user interaction with virtual objects is enabled, but accurate detection of user input (tap contact) on the virtual image is not achieved
Solution Approach 1:
The patent introduces a physical surface as an intermediary between the user and the virtual image. The physical surface captures and transmits tactile input (tap contacts) to the system, enabling the detection of user interactions with virtual objects that are not directly tangible. This mediator bridges the gap between physical user actions and virtual object manipulation.
Solution Approach 2:
The patent replaces traditional mechanical touch detection systems with an optical sensing system. Instead of using physical switches or pressure sensors embedded in the display, the system uses light-based detection methods to sense tap contacts on the physical surface, thereby detecting user input with high precision without mechanical components.
2Loss of information
If camera-based hand tracking is used to determine contact location, then relative position tracking is achieved, but precise contact location detection on the physical surface is insufficient
Solution Approach 1:
The patent merges two different sensing modalities: camera-based hand tracking and physical surface tap contact detection. The camera provides coarse location information and tracks hand movement, while the physical surface detection provides precise contact point data. By combining these two sources, the system achieves both comprehensive tracking and high-precision contact location detection.
Solution Approach 2:
The system uses feedback from the physical surface detection to refine and correct the contact location information initially obtained from camera tracking. When a tap contact is detected on the physical surface, this feedback provides accurate location data that compensates for any limitations in camera-based estimation, ensuring precise mapping of user input to virtual image coordinates.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This solution enables reliable and accurate detection of user inputs on virtual keyboards, allowing for efficient text entry and manipulation within virtual text-entry fields, improving user interaction with virtual interfaces in extended reality environments.
Implementation Method 1
a remote sensing vibrometer that emits light beams to detect vibrations on a physical surface
Implementation Method 2
detects contact with the physical surface based on one or more vibrations in the physical surface that are detected using the one or more light beams
Data Source
AI summary
In some examples, an electronic device may be in communication with one or more input devices, including a camera, and a remote sensing vibrometer. In some examples, the remote sensing vibrometer may be configurable to emit, using a light source, one or more light beams that are incident on the physical surface on which the virtual image is displayed. In some examples, the remote sensing vibrometer detects contact with the physical surface based on one or more vibrations in the physical surface that are detected using the one or more light beams. In some examples, when the physical object contacts the physical surface on which the virtual image is displayed, the electronic device determines a location of the contact relative to the virtual image on the physical surface based on the detected vibrations produced by the contact of the physical object on the physical surface in the computer-generated environment.