XR Gesture Menu Conversion for Low-Effort Interface Access

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing Extended Reality (XR) devices face challenges in manual interaction methods, particularly with menu access, which require high user effort and power consumption due to the need for coordinated hand movements, affecting user experience and efficiency.

Innovation Solution

An interactive method that includes displaying a first interactive interface movable with user gestures, converting it into a second interface at a designated area upon satisfying preset conditions, allowing hands or handles to operate independently for selection, reducing power consumption and improving user convenience.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If manual interaction using hands independently of handles or controllers is applied, then the interaction method is simple, but the user effort and power consumption are high due to coordinated hand movements

Engineering Contradiction:

Improveinteraction simplicityVSAvoidpower consumption

Core Design Contradiction:

Ease of operationVSUse of energy by moving object

Solution Approach 1:

The patent introduces a virtual menu system as an intermediary between the user and the device controls. The menu is displayed in the field of view and can be navigated using natural hand gestures or device handles, reducing the need for coordinated complex hand movements while maintaining interaction simplicity

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces traditional mechanical controller operations with virtual interface interactions. Instead of physically manipulating buttons or switches on controllers, users interact with a virtual menu displayed in their field of view, reducing mechanical effort and power consumption

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Adaptability or versatility

If the menu is called up using traditional methods, then the interaction method is established, but the user experience is poor due to difficulty in access

Engineering Contradiction:

Improvemenu access methodVSAvoiduser experience

Core Design Contradiction:

Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent implements a dynamic menu system that adapts to user actions and device state. The menu can be summoned, dismissed, and repositioned based on user gestures or handle operations, providing versatile access methods that improve user experience

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The patent adds a spatial dimension to menu interaction by displaying the menu in the user's field of view rather than on a 2D screen. This allows for more natural pointing and selection gestures, improving accessibility and user experience

Inventive Principle:

Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS12504864B2Interactive method, apparatus, electronic device and storage medium

Publication Date: 2025.12.23 BEIJING ZITIAO NETWORK TECH CO LTD

AI summary

The present disclosure provides an interactive method, an interactive apparatus, an electronic device and a storage medium. The interactive method includes: acquiring a triggering operation of a user; displaying a first interactive interface in a display picture in response to the triggering operation of the user, wherein the position of the first interactive interface is configured to move with a moving operation of the user; and displaying an identification area in the display picture and converting the first interactive interface into a second interactive interface to be displayed at a position of the identification area in response to movement data of the first interactive interface satisfying a preset conversion condition.