AR Camera Attitude Tracking via Initial Image and IMU
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In multiplayer augmented reality (AR) applications, synchronizing camera attitude tracking between devices is challenging due to differences in hardware parameters and camera angles, requiring large data transmission and exceeding network bandwidth, especially in mobile networks.
Innovation Solution
A method where one device transmits an initial image and attitude parameter to another device, allowing the receiving device to calculate camera attitude variations relative to the initial image, using a rotation matrix and displacement vector to ensure synchronized camera tracking without extensive data exchange, utilizing an anchor-switching AR system and inertial measurement units (IMUs) for accurate attitude determination.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If environment map data is synchronized between devices to achieve consistent camera attitude tracking, then tracking consistency is improved, but network bandwidth consumption increases excessively
Solution Approach 1:
The patent extracts only the essential initial image and attitude parameter data from the complete environment map, transmitting only this minimal necessary information between devices. This extraction principle allows devices to achieve consistent camera attitude tracking without transmitting the full environment map data, thereby resolving the contradiction between tracking consistency and data transmission volume.
Solution Approach 2:
The patent performs preliminary calculation of camera attitude variations relative to an initial image on the first device, then transmits only the results. This preliminary action eliminates the need for the second device to process raw environment map data, reducing network bandwidth consumption while maintaining tracking consistency.
2Measurement precision
If complete environment map data is transmitted between devices, then camera attitude tracking accuracy is improved, but network communication overhead increases
Solution Approach 1:
The patent extracts only the critical initial image and attitude parameter from the complete environment map data. This extraction maintains measurement precision by preserving the essential reference information needed for accurate camera attitude tracking, while significantly reducing network communication complexity by minimizing data transmission volume.
Solution Approach 2:
The patent performs preliminary computation of camera attitude variations on the first device before transmission. This preliminary action ensures tracking accuracy is maintained through pre-calculated precise variations, while reducing communication complexity by transmitting only the computed results rather than raw data.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach enables real-time synchronization of camera attitudes between devices with minimal data transmission, optimizing network communication and ensuring consistent tracking results in AR applications, suitable for multiplayer scenarios.
Implementation Method 1
utilizing an anchor-switching AR system and inertial measurement units (IMUs) for accurate attitude determination
Data Source
Figure 1~2
Figure 3~4
Figure 5
AI summary
The present application relates to the field of augmented reality. Disclosed are a camera orientation tracking method and apparatus, a device, and a system. The method comprises: receiving an initial mark image and an initial orientation parameter sent by a first device; obtaining a current image collected by a camera; obtaining a camera orientation variation of the current image with respect to the initial mark image; and obtaining, by means of calculation, according to the initial orientation parameter and the camera orientation variation, a current camera orientation parameter when the camera collects the current image.