XR Interaction Panel Binding for View-Free Controller Access
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In extended reality (XR) environments, interaction panels often obstruct the user's view and are inconvenient to operate when they do not move with the user, necessitating frequent repositioning or reopening.
Innovation Solution
The interaction panel is designed to move with a target model, such as a virtual controller, by performing preset operations in response to user interactions, including being displayed around and moving with the target model, and optionally changing size and attitude to match the user's perspective.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If the interaction panel is fixed in position, then the user can easily access it, but it obstructs the user's view and requires frequent repositioning
Solution Approach 1:
The interaction panel transitions from a fixed position to a dynamic position that moves with the target model. When the user performs a dragging operation on the panel, it becomes bound to the target model and automatically follows its position and orientation changes, eliminating the need for frequent repositioning while maintaining accessibility.
Solution Approach 2:
The patent introduces a binding mechanism as an intermediary between the interaction panel and the target model. This binding relationship acts as a mediator that transfers the target model's spatial transformations to the panel, allowing the panel to follow the target model without directly being part of it.
2Ease of operation
If the interaction panel is placed in front of the user, then it is easily accessible, but it does not follow user movement and requires frequent reopening
Solution Approach 1:
The interaction panel becomes dynamic by binding to the target model, automatically adjusting its position and orientation as the user moves. This eliminates the need for frequent repositioning and reopening operations, saving user time and improving operational efficiency.
Solution Approach 2:
The system performs preliminary binding between the interaction panel and target model before the user needs to interact with the panel again. This preliminary action ensures the panel is already in the correct position and state, eliminating the need for subsequent repositioning operations.
3Object-affected harmful factors
If the interaction panel is made to move with the target model, then view obstruction is reduced, but the operation complexity increases
Solution Approach 1:
The interaction panel adopts dynamic behavior by binding to the target model, automatically following its position and orientation. This dynamic binding mechanism simplifies the overall system operation compared to manual repositioning, as the panel automatically adapts to user movement and target model changes without requiring complex user interventions.
Data Source
Figure 1~3
Figure 4~5
Figure 6~7
AI summary
Provided in embodiments of the present application are an interaction method and apparatus, a device, a medium and a program. The method comprises: displaying an interaction panel in an extended reality scene; and according to a first operation on the interaction panel, controlling the interaction panel to execute a first preset operation, the first preset operation comprising: displaying around a target model and moving along with the target model, and the target model being a virtual model of a controller corresponding to the extended reality scene. According to the described method, an interaction panel may move along with a user, facilitating the user operating the interaction panel. For the user, it is equivalent to moving the interaction panel in his or her hand, which is more in line with user operations in real scenes and brings the user a better experience.