Virtual Object Deformation for Natural Fingertip Menu Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional menu selection in head-mounted displays requires physical buttons or device movements, leading to a feeling of strangeness when directly interacting with virtual menu objects.
Innovation Solution
An information processing device that detects fingertip positions and orientations in real space, sets virtual objects in a partly deformed state to simulate contact, and displays these objects on a display device to allow direct interaction without a feeling of strangeness.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If physical buttons or device movements are used for menu selection, then menu selection functionality is achieved, but the user experiences a feeling of strangeness when directly interacting with virtual menu objects
Solution Approach 1:
The patent creates a virtual copy of the physical button interface within the virtual space. The virtual menu objects are designed to replicate the appearance and interaction characteristics of physical buttons, allowing users to interact with virtual representations that mirror real-world objects. This copying approach enables direct touching of virtual menu objects while maintaining the familiar interaction pattern of physical buttons, thereby eliminating the feeling of strangeness.
Solution Approach 2:
The patent introduces a virtual space as an intermediary between the user and the menu selection function. Instead of requiring direct interaction with physical buttons or complex device movements, the virtual space provides a mediating environment where virtual menu objects can be touched and manipulated. This intermediary virtual environment bridges the gap between physical interaction and virtual menu selection, making the interaction feel more natural.
2Ease of operation
If separate physical devices are used for menu selection, then menu functionality is achieved, but the operation becomes less intuitive and more complex
Solution Approach 1:
The patent merges the menu selection function with the virtual display space itself. Instead of requiring a separate physical device like a game controller, the menu objects are integrated directly into the virtual space that the user is already viewing. This merging allows users to interact with menu objects using their fingers directly on the display, eliminating the need for additional physical devices and making the operation more intuitive.
Solution Approach 2:
The virtual display space serves multiple functions: it displays visual information and simultaneously provides the interaction interface for menu selection. The same virtual space that presents information also contains the interactive menu objects, making the system multi-functional. This universality eliminates the need for separate specialized devices and allows direct interaction with the display itself.
Data Source
AI summary
An information processing device obtains information regarding the position of each fingertip of a user in a real space, and determines contact between a virtual object set within a virtual space and a finger of the user. The information processing device sets the virtual object in a partly deformed state such that a part of the virtual object, the part corresponding to the position of the finger determined to be in contact with the object among the fingers of the user, is located more to a far side from a user side than the finger, and displays the virtual object having the shape set thereto as an image in the virtual space on a display device.