AR Device Input Mode Switching for Restricted Motion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In situations where the motion of a user wearing an augmented reality (AR) device is restricted, the execution of operations such as switching the screen using gesture inputs or changing the direction of the field of view is limited.
Innovation Solution
An electronic device with a processor, camera, and display that identifies whether a finger mode is required based on specific conditions, executes a finger mode interface, and modifies virtual object properties for display in a specified area, allowing for effective input even in restricted motion scenarios.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If gesture input using both hands is used for screen switching, then input capability is improved, but usability deteriorates when user motion is restricted
Solution Approach 1:
The system dynamically switches between two input modes: a first input mode that recognizes gestures using both hands when motion is unrestricted, and a second input mode that recognizes gestures using one hand when motion is restricted. The processor determines the appropriate mode based on real-time analysis of the captured image to identify whether the user's other hand is visible, enabling adaptive operation under different motion constraints.
2Adaptability or versatility
If finger mode is executed for restricted motion scenarios, then adaptability is improved, but device complexity increases
Solution Approach 1:
The system automatically determines whether to switch between input modes by analyzing the captured image to detect whether the user's other hand is visible. This self-service mechanism eliminates the need for manual mode selection or additional sensors, as the system autonomously adapts to the user's motion state based on visual information already being captured for AR processing.
Data Source
AI summary
An electronic device is provided. The electronic device includes at least one processor, at least one camera, and at least one display, wherein the processor may be configured to identify whether or not a situation requires entering a finger mode for an image including at least one or more objects received through the at least one camera, based on whether or not specified conditions are satisfied for the at least one or more objects, if the situation is identified to require entering the finger mode, execute a finger mode providing a user interface corresponding to the finger mode, and, if there are virtual objects provided before entering the finger mode, modify the properties of at least some of the virtual objects provided before entering the finger mode and display same in a specified area within a display area of the user interface corresponding to the finger mode.