Camera-Based Input Device for Drift-Free 3D Position Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional virtual and augmented reality systems face challenges in accurately tracking the position of external input devices over time due to drift issues with inertial measurement units, which affects precise position correlation in immersive environments.
Innovation Solution
A camera-based input device equipped with an inertial measurement unit and at least two visual light cameras that capture images of the environment, allowing a positioning application to determine and track the device's position independently without external markers or cameras, using algorithms for 3D imaging and simultaneous localization and mapping.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If an inertial measurement unit is used to track device position, then velocity and acceleration can be measured, but position accuracy deteriorates over time due to drift
Solution Approach 1:
The patent combines an inertial measurement unit (IMU) with visual light cameras and a positioning application into an integrated input device. The IMU provides velocity and acceleration data while the cameras capture environmental images, and the positioning application fuses these data streams to determine device position, thereby maintaining both tracking speed and position accuracy over time.
Solution Approach 2:
The positioning application acts as an intermediary that processes and fuses data from the inertial measurement unit and visual light cameras. It correlates motion data with images and uses a map of the environment to compute accurate device positions, mediating between the raw sensor data and the final position output to eliminate drift accumulation.
2Measurement precision
If external cameras are used to track input device motion, then position tracking can be achieved, but the system requires external hardware infrastructure
Solution Approach 1:
The input device performs its own position tracking using onboard visual light cameras that capture images of the environment. The positioning application processes these images locally and determines device position by correlating visual features with a map of the environment, eliminating the need for external cameras or markers and making the system self-sufficient.
Solution Approach 2:
The patent extracts the tracking function from external infrastructure and relocates it into the input device itself. By integrating visual light cameras and a positioning application within the device, the system removes the dependency on external cameras, markers, or complex infrastructure, thereby reducing system complexity while maintaining tracking accuracy.
3Reliability
If visual light cameras are added to the input device, then independent position determination is enabled, but device weight and power consumption increase
Solution Approach 1:
The patent specifies using visual light cameras (as opposed to other types of sensors) and positions them to achieve a maximum field of view of the environment. This parameter optimization allows the cameras to capture sufficient environmental information for reliable position determination while minimizing the number and size of components required, thereby reducing weight and power consumption.
Data Source
AI summary
In embodiments of a camera-based input device, the input device includes an inertial measurement unit that collects motion data associated with velocity and acceleration of the input device in an environment, such as in three-dimensional (3D) space. The input device also includes at least two visual light cameras that capture images of the environment. A positioning application is implemented to receive the motion data from the inertial measurement unit, and receive the images of the environment from the at least two visual light cameras. The positioning application can then determine positions of the input device based on the motion data and the images correlated with a map of the environment, and track a motion of the input device in the environment based on the determined positions of the input device.