Vehicle-Motion-Aware XR Rendering with External IMU Stabilization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing XR devices struggle to stabilize the pose of virtual objects in a moving vehicle due to the inability of internal IMU sensors to differentiate between user movements and vehicle movements, leading to incorrect stabilization of virtual objects.
Innovation Solution
A method and system that utilize an external IMU sensor in the vehicle to provide additional input data to the XR device's localization algorithm, calculating the difference between internal and external IMU measurements to stabilize the virtual object's pose relative to the vehicle.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If internal IMU sensor is used for stabilization, then virtual object pose can be stabilized during user movement, but the system cannot differentiate between user movement and vehicle movement in a moving vehicle
Solution Approach 1:
The patent introduces an external IMU sensor as an intermediary device mounted in the vehicle to measure vehicle motion. This external sensor acts as a mediator that separates the measurement of vehicle movement from user movement, allowing the system to differentiate between the two by comparing data from the internal and external sensors.
Solution Approach 2:
The stabilization function is segmented into two independent measurement systems: an internal IMU sensor for capturing user head movements and an external IMU sensor for capturing vehicle movements. This segmentation allows each sensor to specialize in measuring specific types of motion, improving overall measurement accuracy and adaptability to the vehicle environment.
2Adaptability or versatility
If external IMU sensor is added to the system, then the system can differentiate between user movement and vehicle movement, but device complexity increases
Solution Approach 1:
The external IMU sensor serves multiple functions: it measures vehicle acceleration, angular velocity, and orientation. By using a single multi-functional sensor rather than multiple specialized sensors, the system achieves comprehensive vehicle motion tracking while minimizing the increase in device complexity.
Solution Approach 2:
The external IMU sensor is mounted in the vehicle to autonomously measure vehicle motion without requiring additional processing or intervention from the XR device. The sensor independently captures vehicle movement data and transmits it to the XR device, reducing the computational burden and complexity of the overall system.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Effectively stabilizes the virtual object's position and orientation in space, ensuring accurate display despite vehicle movements, by integrating external IMU data into the XR device's localization algorithm.
Implementation Method 1
an IMU sensor component (IMU = Inertial Measurement Unit) of the XR device, which describes the motion states of the XR device's display area
Implementation Method 2
measurement data on the vehicle's motion states are acquired by at least one IMU sensor device external to the XR device
Data Source
Figure 1
Figure 2
AI summary
The subject matter of the invention is the improvement of the representation of at least one virtual object (3) by a mobile XR device (1), such as XR glasses, used by a user (6) in a moving vehicle (4). This is achieved by stabilizing the pose of a virtual object (3) visualized by the XR device (1) using a localization algorithm (e.g. SLAM). For this purpose, in addition to the measurement data describing movement states of the display area, which are recorded by an internal IMU sensor component (2) of the XR device (1), corresponding measurement data on movement states of the vehicle (4) are used as input variables for the localization algorithm. These measurement data are recorded by at least one external IMU sensor device (5) temporarily or permanently fixed in the vehicle (4) and transmitted to the XR device (1).When the localization algorithm is started, a program application processed by the XR device (1) calculates a difference between the measurement data of the IMU sensor component (2) of the XR device (1) and the measurement data of the at least one external IMU sensor device (5), whereby the virtual object (3) is stabilized with respect to the vehicle (4) with regard to its relative position and relative attitude.