Hand-Mounted Interactive Sensor for Precise XR Ray Casting
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current ray casting technologies in extended reality (XR) environments face challenges with accuracy and convenience, as hand tracking can be imprecise and limited by the need to hold a controller, restricting user interactions.
Innovation Solution
A ray casting system comprising a display, camera, and interactive sensor mounted on the user's hand, which generates and controls a control ray based on hand images and user instructions, allowing precise control without the need for a separate controller.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If hand tracking is used for ray casting control, then the need for a separate controller is eliminated improving ease of operation, but the precision and accuracy of ray casting deteriorates
Solution Approach 1:
The patent combines hand tracking technology with a physical interactive sensor (such as a button or trigger) mounted on the user's hand. This merging allows the system to benefit from both the convenience of hand-based control and the precision of physical interaction, resolving the contradiction between ease of operation and measurement precision
Solution Approach 2:
The interactive sensor acts as an intermediary between the user's hand movements and the virtual environment interactions. It translates physical sensor data into precise control commands for the control ray, thereby improving precision while maintaining the natural hand-based control interface
2Measurement precision
If a controller is held for ray casting control, then precision is improved, but user interactions are restricted reducing adaptability
Solution Approach 1:
The interactive sensor mounted on the hand serves multiple functions: it provides precision control for ray casting while simultaneously allowing the user's other hand or body parts to perform various gestures and interactions. This multi-functionality increases adaptability while maintaining precision control capabilities
Solution Approach 2:
The patent extracts the control function from a separate handheld controller and integrates it directly into the user's hand through the mounted sensor. This extraction eliminates the need to hold a controller, freeing up the user's hands for other interactions while maintaining precise control through the sensor
Data Source
AI summary
A ray casting system is provided. The ray casting system include a display, a camera, an interactive sensor, and a processor. The display is configured to display a virtual environment. The camera is configured to obtain a hand image including a hand of the user. The interactive sensor is configured to obtain a user instruction from the user, wherein the interactive sensor is adapted to be mounted on the hand of the user. The processor is configured to generate a control ray in the virtual environment based on the hand image and apply a displacement to the control ray based on the user instruction.