Camera and Sensor Augmented Reality Orientation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality technologies face challenges in accurately determining the orientation and position of computing devices in physical environments, leading to potential errors in augmented-reality displays, such as jarring errors from incorrect camera frame classification and drifting issues with inertial measurement unit data over time.
Innovation Solution
The use of a combined basis calculated from both optical data from a camera and sensor data, such as an inertial measurement unit, to verify and correct the orientation and position of a computing device, ensuring a more robust and accurate augmented-reality display by cross-checking optical and sensor bases.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If optical basis from camera and sensor basis from IMU are used separately to determine device orientation and position, then each individual method can be implemented independently, but accuracy and reliability deteriorate due to jarring errors in camera frame classification and drifting issues with IMU data over time
Solution Approach 1:
The patent combines optical basis data from camera frame classification with sensor basis data from IMU measurements into a unified basis determination process. The system integrates these two data sources to compute device orientation and position, leveraging the strengths of both methods while compensating for their individual weaknesses through data fusion.
Solution Approach 2:
The system continuously compares and verifies optical basis and sensor basis data in real-time, using feedback mechanisms to detect discrepancies between camera-based and sensor-based orientation/position estimates. This feedback loop enables error detection and correction, maintaining accuracy over time by identifying and resolving drift issues.
2Device complexity
If only camera data is used to compute optical basis, then implementation is simpler, but reliability worsens due to jarring errors from incorrect camera frame classification
Solution Approach 1:
The patent introduces sensor basis data from IMU as an intermediary verification mechanism for optical basis determination. The sensor data acts as a mediator to verify and correct optical basis calculations, providing an additional layer of validation that reduces errors from incorrect camera frame classification without significantly increasing system complexity.
3Device complexity
If only sensor basis from IMU is used to determine device orientation and position, then implementation is simpler, but reliability worsens due to drifting issues with inertial measurement unit data over time
Solution Approach 1:
The system uses optical basis data from camera frame classification as feedback to verify and correct sensor basis determinations. By continuously comparing IMU-derived orientation and position with camera-based estimates, the system can detect and correct drift in sensor data, maintaining long-term accuracy without requiring complex calibration procedures.
Data Source
AI summary
Camera and sensor augmented reality techniques are described. In one or more implementations, sensor data is obtained from a sensor of a hardware device, the sensor data being associated with the hardware device that is located in an environment, such as in three-dimensional (3D) space. Images of the environment are captured with at least one camera of the hardware device. A position of the hardware device in the environment can then be determined based on at least one of the sensor data and the images of the environment. Further, an orientation of the hardware device in the environment can be determined based on at least one of the sensor data and the images of the environment.