3D Fake Keyboard and Screen Layout for Extended Reality Input
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional two-dimensional input methods on mobile devices are inefficient and inconvenient when applied to extended reality devices, due to the mismatched planes of keyboards and input boxes, requiring frequent head movements and increasing operation complexity.
Innovation Solution
A method and apparatus that display a fake keyboard in a three-dimensional environment with an adjacent fake screen, synchronizing input content between the input box and extract box to maintain a planar alignment, optimizing the relative location and reducing the need for head movement.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If conventional two-dimensional input methods are used on extended reality devices, then the input interface can be implemented, but the user needs to frequently move their head between the keyboard and input box due to mismatched planes, reducing interaction convenience
Solution Approach 1:
The patent applies dimensionality change by transitioning from traditional 2D planar display to 3D spatial display in the extended reality environment. The keyboard and input box are positioned at different depths in the 3D space, allowing the input box to be placed closer to the user's line of sight while the keyboard remains in a comfortable typing position, eliminating the need for frequent head movements between mismatched planes
Solution Approach 2:
The patent introduces a virtual display screen as an intermediary element between the keyboard and the input box. This virtual screen serves as a mediator that displays the input box content in a location that is visually accessible to the user while maintaining the keyboard in its optimal typing position, thus resolving the spatial mismatch problem
2Adaptability or versatility
If the input box and keyboard are placed at different planes in the three-dimensional environment, then the spatial layout can be established, but the operation complexity increases due to the need for frequent head movements
Solution Approach 1:
The patent utilizes the third dimension (depth) in the extended reality environment to resolve the spatial layout challenge. By positioning the input box and keyboard at different depths along the Z-axis while maintaining their spatial relationship, the system achieves flexible layout adaptation without increasing operational complexity, as users can view both elements within their natural field of view
Solution Approach 2:
The virtual display screen acts as a mediator that simplifies the interaction between the user and the spatially separated keyboard and input box. It consolidates the visual information display function, allowing users to view input content without breaking their focus from the keyboard, thus reducing operation complexity while maintaining spatial flexibility
Data Source
Figure 1~2
Figure 3
Figure 4~5
AI summary
The present application discloses an interaction method, an interaction apparatus, a storage medium, and a terminal device. The method includes: presenting a user interaction interface in a three-dimensional environment, where an input box is displayed on the user interaction interface; displaying a fake keyboard in the three-dimensional environment in response to a first operation for the input box; displaying a fake screen in an adjacent area of a display location of the fake keyboard, where an extract box is displayed on the fake screen; and synchronously displaying corresponding input content in the extract box and the input box in response to a second operation for the fake keyboard. The present application can improve the convenience of interaction and input efficiency on an extended reality device, thereby providing users with a smoother and more natural input experience.