Head-Mounted Magnification Tool for Accurate 3D Input Mapping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Challenges exist in accurately mapping user inputs in a zoomed portion of a head-mounted device's display area to corresponding objects in the unzoomed area, particularly when using a magnification tool.
Innovation Solution
A method involving ray casting and inverse magnification rendering operations is employed to remap user inputs from a magnified window to corresponding unmagnified objects in a three-dimensional scene, utilizing directional vectors and shifted points to ensure accurate mapping.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a magnification tool is used to magnify a portion of the display area, then the user can see magnified objects in a magnifying window, but it becomes challenging to accurately map the user's input in the zoomed portion to a corresponding unzoomed object in the display area
Solution Approach 1:
The patent applies inverse magnification rendering operations to map user input from the magnified view back to the un magnified scene. Instead of simply scaling coordinates, the system performs ray casting from the user's head position through the remapped point in the un magnified scene, effectively inverting the magnification transformation to achieve accurate input mapping.
Solution Approach 2:
The patent transitions from two-dimensional display coordinates to three-dimensional scene coordinates by performing ray casting operations. The system computes directional vectors from the user's head position and casts rays into the 3D scene to identify objects, adding a spatial dimension to the input mapping process that resolves the complexity of direct 2D coordinate transformation.
2Measurement precision
If ray casting operations are performed to accurately identify objects in the unzoomed scene, then input mapping accuracy is improved, but the computational complexity and processing time increase
Solution Approach 1:
The patent performs remapping operations before the actual input is processed. By pre-computing the relationship between magnified and un magnified coordinates through inverse magnification rendering, the system prepares the mapping transformation in advance, reducing the computational burden during actual user interaction and minimizing processing time.
Solution Approach 2:
The patent introduces a remapped point as an intermediary between the user's input in the magnified view and the actual object in the un magnified scene. This intermediate coordinate system serves as a bridge, allowing the system to perform simpler 2D to 3D transformations rather than direct complex coordinate mapping, thereby reducing computational overhead.
Data Source
AI summary
A head-mounted device is provided that includes displays configured to display an image and to simultaneously display a magnifying window that presents a magnified portion of the image. The magnifying window lies in a magnification plane that is fixed relative to a user's head. One or more processors in the head-mounted device can be used to perform a first ray cast operation to identify an input point where a detected user input intersects the magnifying window, to obtain a remapped point from the input point, to compute a directional vector based on the remapped point and a reference point associated with the user's head, to obtain a shifted point by shifting the remapped point from the magnification plane to another plane parallel to the magnification plane, and to perform a second ray cast operation using the shifted point and the directional vector.