Virtual Menu Object Deformation for Natural Finger Contact
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional menu selection in head-mounted displays requires physical buttons or separate devices, leading to a feeling of strangeness when interacting with virtual menu objects.
Innovation Solution
An information processing device that detects fingertip positions in real space, sets virtual objects within a virtual space, and deforms them to create a sense of contact without penetration, allowing direct interaction with virtual menu items.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If physical buttons or separate devices are used for menu selection, then operation reliability is improved, but ease of operation deteriorates due to feeling of strangeness
Solution Approach 1:
The patent creates a virtual copy of the finger that penetrates the virtual menu object, allowing the user to interact with virtual elements as if physically touching them. This virtual finger model replicates the visual appearance and interaction characteristics of a real finger, enabling intuitive menu selection without physical buttons while maintaining operational reliability through realistic visual feedback
Solution Approach 2:
The patent introduces a virtual finger as an intermediary between the user's real finger and the virtual menu object. This virtual finger acts as a mediator that translates real-world finger movements into virtual space interactions, enabling natural menu selection without requiring physical buttons or separate control devices
2Ease of operation
If virtual objects are deformed to show contact, then ease of operation is improved, but manufacturing precision deteriorates
Solution Approach 1:
The patent applies dynamic deformation to virtual menu objects based on the position and movement of the virtual finger. The deformation amount and direction change dynamically as the finger approaches and contacts the object, creating realistic interaction feedback. This dynamic approach maintains operational intuitiveness while using computational geometry rather than fixed precision manufacturing
Data Source
AI summary
An information processing device obtains information regarding the position of each fingertip of a user in a real space, and determines contact between a virtual object set within a virtual space and a finger of the user. The information processing device sets the virtual object in a partly deformed state such that a part of the virtual object, the part corresponding to the position of the finger determined to be in contact with the object among the fingers of the user, is located more to a far side from a user side than the finger, and displays the virtual object having the shape set thereto as an image in the virtual space on a display device.