Tap Device GUI for Compact, Cursor-Free VR/AR Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional graphical user interfaces (GUIs) require significant screen space and precise cursor movements, which can be cumbersome and fatiguing, especially in VR or AR systems where users are often moving, and lack tactile feedback.
Innovation Solution
A GUI controlled by a tap device that occupies a compact area of the screen, using a click-to-select approach with a one-to-one correspondence between displayed items and fingers, eliminating the need for precise cursor movements and allowing users to interact with a relaxed arm.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If a conventional point-and-click GUI is used, then the interface can display multiple items and options, but the GUI occupies a substantial portion of the display screen and obscures other content
Solution Approach 1:
The patent divides the GUI interaction into two distinct components: a compact visual display area showing icons/options, and a separate tactile input device (tap device) worn on the user's finger. This segmentation allows the GUI to occupy minimal screen space while maintaining full interaction capability through the wearable tap device, resolving the contradiction between displaying multiple items and minimizing screen obstruction.
2Adaptability or versatility
If a point-and-click approach is used, then the GUI can be comprehensive, but accuracy is impaired when the user is moving due to difficulty in moving the cursor to the desired location
Solution Approach 1:
The patent replaces the mechanical cursor movement system with a tactile input system. Instead of moving a cursor visually across the screen (which requires precise hand-eye coordination and is difficult when moving), the user taps directly on the wearable device to select items. This substitution eliminates the need for precise cursor positioning while maintaining full GUI functionality, as the tap device communicates selection intent directly to the system without requiring visual tracking.
3Adaptability or versatility
If hand or finger gestures are used to interact with a GUI in a VR or AR system, then the interface can be more immersive, but it causes fatigue of the user's arm due to holding the hand raised in the air
Solution Approach 1:
The patent makes the user's own finger the input device by attaching a tap device to it. The finger serves dual purposes: it is both the body part naturally used for gesturing and the control mechanism itself. This self-service approach eliminates the need to hold the hand raised in the air, as the tap device worn on the finger can detect taps regardless of arm position, thereby maintaining gesture control capability while significantly improving user comfort and reducing arm fatigue.
4Adaptability or versatility
If a point-and-click GUI is used, then the interface can be comprehensive, but visual fatigue occurs because there is no tactile feedback and the user must rely on vision to move their hand to the proper position
Solution Approach 1:
The patent introduces tactile feedback through the wearable tap device. When the user taps the device, they receive immediate tactile confirmation of their input, eliminating the need to visually track hand position. This feedback mechanism allows the user to interact with the comprehensive GUI interface while relying on tactile rather than visual senses, thereby preventing visual fatigue while maintaining full interface functionality.
Data Source
AI summary
An information processing device includes a display, a communication interface configured to receive signals from a tap device, one or more processors, and one or memories storing instructions. Upon execution by the one or more processors, the instructions cause the one or more processors to: display a plurality of icons on the display in a predetermined pattern as a graphical user interface; in response to a selection signal received from the tap device, select one of the plurality of displayed icons; in response to an activation signal received from the tap device, activate a function corresponding to the selected icon; and in response to a shift signal received from the tap device, shift the plurality of icons to different positions in the predetermined pattern.