AR Virtual Object Alignment via Mobile IMU Pose Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality (AR) and mixed reality (MR) systems face challenges in accurately rendering virtual objects in alignment with mobile devices without relying on complex and resource-intensive image processing, especially when the devices are freely movable, as they require continuous tracking markers which are not suitable for real-life situations.
Innovation Solution
A method and system that utilize an inertial measurement unit (IMU) in mobile devices to provide orientation, motion, and position information to a rendering device via a communication channel, allowing for accurate and efficient alignment of virtual objects with the device's pose without continuous image processing, using a communication channel for real-time updates.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If physical tracking markers are attached to the mobile device to determine position and orientation, then measurement precision is improved, but device complexity and ease of operation deteriorate due to the need for large visible markers and continuous image processing
Solution Approach 1:
The patent replaces the optical-mechanical tracking system (cameras and visual markers) with an inertial measurement system (IMU sensors). The mobile device uses accelerometers, gyroscopes, and magnetometers to self-determine its pose, eliminating the need for external cameras to track visual markers. This substitution fundamentally changes the measurement approach from passive optical tracking to active inertial sensing.
Solution Approach 2:
The mobile device performs self-tracking using its own IMU sensors to determine its position and orientation without requiring external tracking infrastructure. The device independently measures its own motion and orientation changes, eliminating the need for external cameras and complex image processing systems to track visual markers.
2Measurement precision
If continuous image processing is used to track the mobile device, then measurement precision is improved, but use of energy and productivity deteriorate due to resource-intensive computations
Solution Approach 1:
The patent replaces continuous image processing computations with inertial sensor measurements. Instead of continuously capturing and processing images to track the device, the system uses the IMU to directly measure acceleration, angular velocity, and magnetic field orientation, dramatically reducing computational requirements and energy consumption while maintaining real-time tracking capability.
3Measurement precision
If large physical markers are attached to the mobile device, then measurement precision is improved, but ease of operation deteriorates due to the markers being unsuitable for real-life situations
Solution Approach 1:
The patent eliminates the need for external visual markers by using the mobile device's built-in IMU sensors for self-tracking. This allows the device to be used in natural, real-life scenarios without requiring users to attach or manage large tracking markers, while still achieving accurate pose determination through inertial measurement.
Data Source
Figure 1A~1B
Figure 2
Figure 3A~3B
AI summary
A method of rendering a virtual object by a rendering device is described wherein the method comprises: establishing by the rendering device a communication channel with a mobile electronic device, the mobile electronic device comprising an inertial measurement unit IMU; determining or receiving initial pose information of the mobile electronic device, the initial pose information defining an initial position and an initial orientation; receiving device information via the communication channel, the device information including orientation information, motion information, and/or position information for updating the initial pose of the mobile electronic device; using the initial pose information and the device information to determine a current pose of the mobile electronic device, the current pose defining a current position and orientation; receiving first content data from a server system, the first content data representing a virtual object; and, rendering the first content data in the viewport of the rendering device based on the current pose information, wherein the current pose information is used to render the virtual object in spatial alignment with the mobile electronic device.