3D Virtual Object Touch Projection for Head-Worn Displays
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing head-wearable electronic devices face challenges in accurately receiving intuitive touch inputs for virtual objects in three-dimensional spaces due to issues like user discomfort and errors caused by external objects, leading to low accuracy and inconvenience.
Innovation Solution
The device employs a touch input mode that recognizes a user's hand contact on virtual objects, adjusts depth data to maintain or change the display location of virtual objects within a reference range, and adjusts object sizes to facilitate intuitive and accurate touch inputs.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the virtual object is displayed at its original depth location in 3D space, then the display accuracy and depth perception are improved, but the user cannot perform touch inputs accurately because the object is outside the reachable depth range
Solution Approach 1:
The patent transitions the virtual object from its original 3D depth position to a 2D projection plane at a reference depth within the user's reachable range. This dimensional transformation allows the object to be displayed at a depth suitable for touch interaction while preserving the visual information, enabling accurate touch inputs without compromising the overall 3D spatial context
Solution Approach 2:
The patent introduces an intermediate projection plane at a reference depth as a mediator between the original 3D virtual object and the user's touch interface. This intermediate plane serves as a touchable representation that the user can interact with, while the system maintains awareness of the object's original depth position for accurate depth perception
2Ease of operation
If the virtual object is moved closer to the user within the reference depth range, then the touch input accuracy is improved, but the natural 3D spatial relationship and depth perception are degraded
Solution Approach 1:
The patent creates a 2D copy or projection of the 3D virtual object at the reference depth plane. This copy serves as a touchable interface that replicates the essential visual information needed for interaction, while the original 3D object remains in its proper spatial context, preserving depth perception through the display system's depth cues
3Ease of operation
If the display location of the virtual object is adjusted to enable touch input, then the user comfort and input accuracy are improved, but errors caused by external objects may occur
Solution Approach 1:
The patent performs preliminary depth analysis and object detection before finalizing the touch input interaction. The system proactively identifies potential conflicts with external objects and adjusts the projection or provides warnings in advance, preventing input errors before they occur rather than reacting after the fact
Data Source
AI summary
A head-wearable electronic device includes at least one processor including processing circuitry, a display assembly including a display, and memory, storing one or more programs configured to be executed by the at least one processor individually and/or collectively, and including one or more storage media, and at least one processor, individually and/or collectively, is configured to execute the instructions and to cause the head-wearable electronic device to: while displaying a virtual object in a 3D space provided through the display assembly, enter a touch input mode recognizing a hand of a user being contacted on a user interface (UI) object as a user input, based on entering the touch input mode, identify first depth data of the virtual object, and, based on identifying that the first depth data of the virtual object is outside of a reference depth range, change a display location of the virtual object by adjusting the first depth data of the virtual object to second depth data within the reference depth range.