3D Virtual Object Selection Using Gaze and Wearable Input
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing head-mounted display devices require users to gaze at virtual objects for seconds to determine selection, leading to incorrect selections and increased development costs due to the need for dedicated buttons.
Innovation Solution
A display control apparatus that uses a wearable terminal device to determine virtual objects based on a user's line of sight and input operations, eliminating the need for dedicated buttons and reducing incorrect selections.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If a user gazes at a virtual object for several seconds to determine selection, then the determination operation can be performed without additional hardware, but the operation time increases and incorrect selections occur frequently
Solution Approach 1:
The system performs preliminary action by detecting the user's line of sight direction in advance and displaying a virtual indicator at the indicated location before the determination operation is completed. This allows the selection to be predetermined based on gaze direction, reducing the time required from several seconds to nearly instantaneous while maintaining accuracy through the visual feedback of the virtual indicator.
2Device complexity
If a smartphone is used as an operation device for ray-casting operation, then no dedicated button is needed, but the user must use one hand and take out the smartphone causing operation difficulty
Solution Approach 1:
The head-mounted display device performs self-service by using its own built-in line of sight detection function to determine the user's selection, eliminating the need to use a smartphone or other external devices. The device automatically detects the gaze direction, displays the virtual indicator, and determines selection based on input from wearable terminal devices, making the operation simple and convenient without requiring the user to manually handle additional devices.
3Ease of manufacture
If a smartphone is used for aiming operation, then no dedicated button is required, but fine movement in multiple directions becomes difficult degrading aiming accuracy
Solution Approach 1:
The patent replaces the mechanical system of manually moving a smartphone with an optical detection system. The line of sight detection function uses optical methods to automatically determine the user's gaze direction, providing precise aiming without requiring manual manipulation. This substitution of mechanical movement with optical detection achieves high aiming accuracy while maintaining the benefit of not requiring dedicated buttons.
Data Source
AI summary
A display control apparatus includes a display controller and a determiner. The display controller is configured to cause a pair of glasses device to display one or more virtual objects included in a field of view of the pair of glasses device in a three-dimensional space and to, based on a line of sight of a user of the pair of glasses device, cause the pair of glasses device to display a virtual indicator for selecting one virtual object from the one or more virtual objects. The determiner is configured to determine, to be a target for operation, a virtual object indicated by the virtual indicator at a point in time at which an input operation to a wearable terminal device worn on a body of the user is performed.