Virtual Ray Prop Selection for Head-Mounted AR Interfaces
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for interacting with virtual props in augmented and virtual reality environments through head-mounted devices are inefficient and require significant learning and observation, making operations complicated and time-consuming.
Innovation Solution
A method and system that uses a head-mounted device to superimpose a scene editing interface and a virtual ray on a real environment image, allowing users to select and manipulate virtual props by intersecting the virtual ray with prop selection controls and providing real-time feedback through highlighting and ray adjustments.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If function buttons in the head-mounted device are used to trigger operations, then the device can execute corresponding instructions, but the operation process becomes complicated and time-consuming
Solution Approach 1:
The patent extracts the interaction interface from the physical head-mounted device buttons and relocates it to the virtual display environment. Users interact with virtual prop selection controls displayed in the augmented reality scene rather than pressing physical function buttons, thereby simplifying operations and reducing time consumption.
Solution Approach 2:
The patent introduces a virtual ray as an intermediary tool that connects the user's gaze to the virtual prop selection controls. The virtual ray automatically highlights and selects props based on where the user is looking, eliminating the need for manual button pressing and streamlining the interaction process.
2Difficulty of detecting and measuring
If the head-mounted device highlights virtual objects to enable focus, then the user can identify target objects, but the user must make preset operations which complicates the interaction
Solution Approach 1:
The patent implements real-time feedback through the virtual ray system that automatically highlights virtual props based on the user's gaze direction. The system continuously monitors where the user is looking and provides visual feedback by highlighting the corresponding prop, eliminating the need for users to manually trigger highlighting through preset operations.
Solution Approach 2:
The virtual ray system performs automatic prop identification and highlighting without requiring user intervention. The system serves itself by automatically tracking the user's gaze and selecting the appropriate prop, thereby reducing interaction complexity while maintaining accurate object identification.
3Adaptability or versatility
If virtual props are displayed in the real environment, then the augmented reality experience is enhanced, but the interaction method becomes more complex requiring learning and observation
Solution Approach 1:
The patent replaces complex mechanical interaction mechanisms (physical buttons, manual selection procedures) with a gaze-based virtual ray system. This substitution maintains the versatility of AR functionality while dramatically reducing the learning curve, as users naturally understand where to look rather than needing to learn specific button combinations or操作流程.
Data Source
AI summary
Provided are a method and system for displaying a virtual prop in a real environment image, and a terminal device. The method is implemented by a head-mounted device. In the method, a scene editing interface and a virtual ray on the real environment image are superposed and displayed the scene editing interface contains a prop selection list, and the prop selection list contains a prop selection control corresponding to at least one virtual prop; the virtual ray is moved to intersect with a target prop selection control in the real environment image based on ray adjustment data; and in response to a first control instruction, a target virtual prop corresponding to the target prop selection control is displayed in the real environment image.