AR Input Compensation Using Line of Sight and Spatial Data
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality (AR) systems struggle to accurately match user inputs to real objects in three-dimensional space, often failing to generate the desired virtual objects due to shaking or imprecise user interactions, leading to a disconnect between user intention and output.
Innovation Solution
An AR output method that generates line of sight information using sensors or cameras, extracts relevant spatial information, recognizes user inputs, compensates for input inaccuracies, and generates virtual objects based on this information to accurately align with user intentions, allowing for precise placement and movement of virtual objects relative to real objects.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the electronic device generates simple line or graphic symbol based on user input, then the device complexity is reduced, but the measurement precision of user input is insufficient leading to failure in generating desired virtual objects
Solution Approach 1:
The system performs preliminary actions by generating multiple candidate virtual objects before final selection, and by pre-processing user input data to identify intent patterns. This allows the system to compensate for imprecise inputs in advance rather than requiring perfect initial input accuracy.
Solution Approach 2:
The system implements feedback mechanisms by comparing generated virtual objects with expected outcomes and adjusting subsequent generations accordingly. User corrections or selections provide feedback that refines the system's understanding of user intent, improving measurement precision over time.
2Reliability
If the electronic device simply modifies virtual object, then the ease of operation is improved, but the reliability of generating desired output is reduced due to shaking and imprecise interactions
Solution Approach 1:
The system changes parameters by generating multiple variations of virtual objects with different attributes (size, position, orientation) based on the same user input. This allows the system to maintain ease of operation (single input action) while improving reliability (multiple candidate outputs for selection).
Solution Approach 2:
The system performs preliminary generation of multiple candidate virtual objects before final output, allowing user selection or automatic selection from predefined criteria. This preliminary action ensures reliability by providing validated options rather than single uncertain outputs.
3Manufacturing precision
If the electronic device fails to match user input to boundary of ambient object, then the device complexity is reduced, but the manufacturing precision of virtual object placement is insufficient
Solution Approach 1:
The system introduces an intermediary processing layer that maps user input coordinates to the boundary geometry of ambient objects. This intermediary transformation layer enables precise placement on complex surfaces without requiring the device to directly handle high-level spatial reasoning, managing complexity while achieving precision.
Solution Approach 2:
The system transitions from two-dimensional screen coordinates to three-dimensional spatial coordinates by mapping user inputs onto the 3D boundary surfaces of ambient objects. This dimensional transformation enables accurate virtual object placement on complex real-world surfaces while maintaining manageable processing complexity through coordinate system conversion.
Data Source
AI summary
An augmented reality (AR) output method includes generating line of sight information of a user of the electronic device based on at least one of a sensor module or a camera module of the electronic device, extracting line of sight space information corresponding to the line of sight information of the user from three-dimensional (3D) space information corresponding to a real object around the user based on the line of sight information, recognizing a user input using the camera module or the sensor module, comparing a first portion of the line of sight space information with the user input, generating a compensated input information by compensating the user input based on comparing the first portion with the user input, generating a first virtual object based on the compensated input information, and outputting the first virtual object on a display of the electronic device.