AR Device Virtual Keyboard Adaptive Overlay
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional AR devices display virtual keyboards arbitrarily, leading to reduced user convenience due to low visibility and incomplete display when there is not enough empty space in the user's hand location.
Innovation Solution
An AR device that detects optimal areas in the surrounding environment for overlaying a virtual keyboard, determines the type of keyboard based on shape, size, and input language, and renders the keyboard for display on the detected area.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If the virtual keyboard is displayed in an arbitrary area regardless of the surrounding environment, then the device complexity is reduced, but the visibility and usability of the virtual keyboard deteriorate when there is not enough empty space
Solution Approach 1:
The system performs preliminary scanning of the surrounding real world to detect available flat surfaces and their characteristics before displaying the virtual keyboard. This advance detection of environment information allows the system to pre-determine the optimal display area, ensuring the keyboard is placed on a suitable surface with adequate space before the user needs to interact with it.
Solution Approach 2:
The system dynamically adapts the virtual keyboard display based on detected environmental conditions. It adjusts the keyboard's position, size, and layout according to the characteristics of the detected flat surface and available space, transforming a static arbitrary display into a dynamic environment-responsive display that optimizes usability for each specific context.
2Adaptability or versatility
If the virtual keyboard is displayed on a flat surface with many objects, then the device can be used in cluttered environments, but the visibility of the virtual keyboard is reduced
Solution Approach 1:
The system scans and detects the flat surface characteristics and object distribution in advance before rendering the virtual keyboard. By preliminarily analyzing the environment, it identifies optimal regions with sufficient visibility and adequate space, ensuring the keyboard is placed on a suitable surface before the user needs to interact with it.
Solution Approach 2:
The system applies different display strategies to different regions of the detected surface. It selects specific local areas on the flat surface that have optimal visibility characteristics and sufficient space, rather than uniformly displaying the keyboard across the entire surface. This local optimization ensures high visibility even in cluttered environments.
3Area of stationary object
If the virtual keyboard is displayed in a reduced size to fit limited space, then the keyboard can be displayed completely, but the user convenience is reduced
Solution Approach 1:
The system detects and evaluates multiple candidate areas on the flat surface in advance, assessing each area's size, shape, and suitability for keyboard display. By preliminarily analyzing available spaces, it identifies the optimal region that maximizes keyboard size while ensuring complete display, rather than arbitrarily reducing the keyboard size to fit any available space.
Solution Approach 2:
The system dynamically adjusts keyboard display parameters (size, position, layout) based on the detected environmental characteristics. It changes the keyboard's scale and configuration to optimize the balance between fitting the available space and maintaining usability, transforming a fixed-size keyboard into an adaptive display that responds to spatial constraints.
Data Source
AI summary
An augmented reality (AR) device is provided and is capable of adaptively determining a virtual keyboard and an area where the virtual keyboard is to be overlaid based on attribute information of a surrounding real world and profile information of a virtual keyboard, and an operation method of the AR device is provided. The AR device may detect, by scanning the surrounding real world, at least one area including a plane on which no objects are detected; determine a type of a virtual keyboard capable of being overlaid on the at least one area, based on at least one from among a shape, a size, and an input language of the virtual keyboard; and perform rendering such that the virtual keyboard, having the type, is overlaid and displayed on the at least one area