XR Interaction Mode Switching for Handle and Hand Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing extended reality (XR) devices require manual selection of interaction modes, limiting efficiency and user experience as they cannot automatically distinguish between handle tracking and gesture recognition.
Innovation Solution
An extended reality interaction method that automatically determines user actions to trigger corresponding interaction modes, including handle tracking and bare hand tracking, using action data acquisition, recognition models, and interaction control instructions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If manual selection of interaction mode is implemented, then device complexity is reduced, but interaction efficiency deteriorates due to user interruption
Solution Approach 1:
The system automatically detects user actions and switches interaction modes without user intervention. The XR device self-determines whether to operate in handle tracking mode or gesture recognition mode by analyzing action data, eliminating the need for manual mode selection and thereby improving interaction efficiency
Solution Approach 2:
The interaction mode is made dynamic and adaptable rather than static. The system continuously monitors action data and automatically adjusts the interaction mode based on real-time user behavior, allowing the device to transition smoothly between handle tracking and gesture recognition modes according to actual usage context
2Productivity
If automatic action recognition is implemented, then interaction efficiency is improved, but device complexity increases due to recognition models
Solution Approach 1:
The manual mechanical selection process is replaced with an automated recognition system. Instead of requiring users to manually switch modes through physical controls or menu selections, the system uses action data recognition (potentially involving computer vision, sensors, or machine learning models) to automatically determine the appropriate interaction mode, substituting automated intelligent processing for manual mechanical operation
Solution Approach 2:
The recognition system is designed to handle multiple interaction modes within a single unified framework. The same action data acquisition and analysis mechanism serves both handle tracking mode and gesture recognition mode, allowing the system to universally process different user actions and appropriately select the corresponding interaction mode without requiring separate dedicated systems for each mode
Data Source
AI summary
The present disclosure provides an extended reality interaction method and apparatus, an electronic device and a storage medium, the extended reality interaction method includes: acquiring action data of a user in an extended reality scene; determining an action type of the user according to the action data; and triggering a corresponding interaction mode according to the action type, the corresponding interaction mode comprising a handle tracking mode and a bare hand tracking mode, according to the method provided by the present disclosure, an action type of the user is recognized and then a target interaction mode according to the action type is triggered for computing processing, without the need to manually set the interaction mode in advance.