Virtual Image Display Object Selection Using Auxiliary Tool
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional virtual image display devices limit user comfort and experience in virtual reality environments due to the need for uncomfortable movements to select objects, as the hand obscures accessories and obstructs effective pointing and selection actions.
Innovation Solution
A virtual image display device that captures hand image information and uses an auxiliary tool, either through image or inertial measurement data, to generate position information and display an auxiliary indicator for object selection, allowing users to perform selection actions without restrictive postures.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If the user uses the index finger to point to the object for selection, then the selection action can be performed as a direct response, but the hand obscures the user's worn accessories and the object pointing and selection action cannot be performed effectively
Solution Approach 1:
The patent introduces an auxiliary tool as an intermediary device between the user and the virtual environment. This auxiliary tool, worn on the user's body, serves as a mediator that enables object selection without requiring the user to move their hand into positions that would obscure the tool. The auxiliary tool includes sensors and processors that detect its own position and generate control signals, acting as an intermediary that translates the user's intent into virtual environment interactions while remaining constantly visible and detectable.
2Productivity
If the user performs object selection in the virtual environment, then the selection function is achieved, but the user is limited to apply specific but uncomfortable movements
Solution Approach 1:
The auxiliary tool is designed to be self-sufficient in determining its position and generating control signals. It includes position detection means (such as accelerometers, gyroscopes, or image recognition) and processing means that automatically calculate the tool's position and orientation without requiring the user to perform specific movements. The tool serves itself by autonomously providing the position information needed for virtual environment interaction, freeing the user from uncomfortable positioning requirements while maintaining efficient object selection capability.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enhances user experience by enabling object selection without posture restrictions, allowing habitual movements like using an index finger to point and select virtual objects effectively.
Implementation Method 1
a virtual image display is enabled to capture image information of a hand of a user
Implementation Method 2
generate the position information of the auxiliary tool according to inertial measurement information of the auxiliary tool
Data Source
AI summary
A virtual image display device and an object selection method for virtual image thereof are provided. The object selection method for virtual image includes the following: a virtual image display is enabled to capture image information of a hand of a user; whether an image of an auxiliary tool is present in the image information is determined; position information of the auxiliary tool is generated according to the image of the auxiliary tool when the image of the auxiliary tool is present in the image information; the virtual image display is enabled to generate the position information of the auxiliary tool according to inertial measurement information of the auxiliary tool when the image of the auxiliary tool is not present in the image information; and the virtual image display is enabled to display an auxiliary indicator for selecting object according to the position information.