3D Interaction Scene Matching for Natural Extended Reality Input
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing extended reality technologies fail to provide users with a rich and natural interaction experience due to unnatural interaction operations.
Innovation Solution
An interaction method and apparatus that sets interaction information and objects based on predefined scenes, allowing for natural interaction by determining target objects and performing appropriate operations based on user input, including ray, gesture, and eye movement information.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If extended reality technology is used to provide virtual interaction space, then users can conduct social interactions and entertainments, but the interaction operations become unnatural and the interaction experience is poor
Solution Approach 1:
The system pre-sets multiple interaction scenes (first interaction scene, second interaction scene, etc.) with predefined interaction information types for each scene. When a user enters a scene, the system automatically activates the corresponding preset interaction mode, eliminating the need for users to manually configure interaction parameters and ensuring natural interactions from the start.
Solution Approach 2:
The system dynamically switches between different interaction scenes based on user actions and environmental context. The interaction information type changes automatically according to the current scene, allowing the interaction mode to adapt dynamically to different situations while maintaining naturalness in each context.
2Ease of operation
If multiple interaction scenes and interaction information types are preset, then natural interaction experience is improved, but the system complexity increases
Solution Approach 1:
The system segments the virtual interaction space into multiple distinct interaction scenes, each with its own predefined interaction information types. This segmentation allows complex interaction logic to be divided into manageable, independent scene modules, making the system easier to manage despite handling multiple interaction modes.
Solution Approach 2:
The system creates a universal framework that handles multiple interaction scenes and information types through a unified scene switching mechanism. This multi-functional design allows a single system structure to manage diverse interaction scenarios without requiring separate dedicated systems for each scene type.
Data Source
Figure 1
Figure 2~3
Figure 4~5
AI summary
The present application discloses an interaction method, an interaction apparatus, an electronic device and a storage medium, and relates to a field of computer technology. The method includes: displaying a computer-generated three-dimensional environment at a display component; presenting an interaction object within the three-dimensional environment; acquiring interaction information input by a user through input devices; inputting the interaction information to an interaction manager; determining a target interaction object corresponding to the interaction information when the interaction manager judges that the interaction information satisfies a current interaction scene; performing an operation corresponding to the interaction information on the target interaction object when the target interaction object accepts the interaction information. The present application could provide a user with a rich and natural interaction experience.