Physical-Surface Input Regions for Efficient 3D Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for interacting with augmented and virtual reality environments are cumbersome, inefficient, and place a significant cognitive burden on users, often requiring multiple inputs and providing insufficient feedback, leading to errors and energy wastage, particularly in battery-operated devices.
Innovation Solution
A computer system that designates and determines input regions on a physical surface in a three-dimensional environment based on detected inputs and properties, using components like eye-tracking, hand-tracking, and sensors to enhance interaction efficiency and reduce the number of user inputs.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If conventional input methods are used in augmented reality environments, then user interaction is possible, but the interaction becomes cumbersome and requires multiple inputs
Solution Approach 1:
The system segments the interaction process by identifying distinct input regions on physical surfaces (e.g., different zones on a table or desk) and assigning specific functions to each region. This allows users to perform different actions by interacting with different spatial zones, eliminating the need for multiple sequential inputs and reducing cognitive burden.
Solution Approach 2:
The patent transitions from traditional two-dimensional touch screen interaction to three-dimensional spatial interaction by mapping virtual controls to physical surfaces in the user's environment. This dimensional expansion allows for more intuitive and efficient interaction, as users can naturally point at and manipulate objects in 3D space rather than navigating 2D interfaces.
2Reliability
If multiple inputs are required to achieve desired outcomes, then system control is possible, but cognitive burden increases and errors occur
Solution Approach 1:
The system automatically tracks the user's gaze and hand position using eye-tracking and hand-tracking components, eliminating the need for users to manually select or activate tracking modes. The system self-adjusts to the user's natural behavior, reducing the number of required inputs and minimizing errors while maintaining reliable control.
Solution Approach 2:
The system provides real-time feedback by displaying visual indicators that show which input region is currently active or selected. This feedback mechanism helps users understand the connection between their physical gestures and system responses, reducing errors and improving interaction reliability without requiring multiple confirmation inputs.
3Productivity
If traditional interaction methods are used, then functionality is achieved, but energy is wasted due to prolonged interaction time
Solution Approach 1:
The system performs preliminary actions by continuously tracking the user's gaze and hand position in the background without requiring active user initiation. This allows the system to be ready to respond immediately when the user interacts with an input region, reducing interaction time and energy consumption while maintaining high productivity.
Solution Approach 2:
The system uses periodic sampling of eye-tracking and hand-tracking data to monitor user intent and update the active input region. This periodic action allows the system to maintain awareness of user behavior with minimal energy expenditure, enabling fast response times without continuous high-power processing.
Data Source
AI summary
In some embodiments, a computer system designates input region on a depiction of a physical surfaced in a displayed three-dimensional environment in response to detecting one or more inputs provided to the computer system. In some embodiments, a computer system determines a pose of an input region on a physical surface in a three-dimensional environment based on one or more properties of the three-dimensional environment.