Augmented Reality Registration via Mobile-Server Motion Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current augmented reality (AR) systems on mobile devices face limitations in achieving high-resolution registration of supplementary information with the real world due to processing and communication bandwidth constraints, especially when using image-processing-based methods, which require strong processing capabilities and access to large databases.
Innovation Solution
A system and method that utilizes a mobile device connected via a wide area network to a remote server, where the mobile device performs image motion tracking to compensate for processing delays, allowing for real-time alignment of AR information with the scene, and the server processes image registration intermittently to provide precise geographical data for correct alignment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If image-processing-based AR is implemented on mobile devices, then precise pixel-by-pixel registration to geographic database is achieved, but hardware requirements become prohibitive for portable devices
Solution Approach 1:
The system divides the AR processing tasks between the mobile device (capturing images, tracking motion) and the remote server (performing image registration and database queries). This segmentation allows high-precision registration to be achieved without requiring the mobile device to have prohibitive hardware capabilities.
Solution Approach 2:
A remote server acts as an intermediary between the mobile device and the geographic information database. The server receives images from the mobile device, performs the computationally intensive registration process, and returns aligned AR information, thereby eliminating the need for high-end local hardware.
2Power
If remote image processing is used over wide area network, then processing capabilities are improved, but significant delay is introduced due to limited bandwidth
Solution Approach 1:
The mobile device performs image motion tracking locally and continuously before sending images to the server. This preliminary action ensures that when the registered image information is received from the server, the AR content can be quickly aligned and displayed with minimal delay.
Solution Approach 2:
The system maintains continuous image capture and motion tracking on the mobile device, while simultaneously performing registration on the server. This continuous operation ensures that AR information is always available and can be displayed in near real-time without interruption or significant delay.
3Speed
If image motion tracking is performed on mobile device, then real-time compensation for processing delays is achieved, but local processing load increases
Solution Approach 1:
The mobile device performs partial processing (image capture and motion tracking) locally, while the server handles the more energy-intensive registration and database query operations. This division allows real-time response to be achieved without the mobile device consuming excessive energy.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A method of operating a mobile device with a camera, a display and a position sensor to provide a display of supplementary information aligned with a view of a scene. One or more image obtained from the camera is uploaded to a remote server together with corresponding data from the position sensor. Image processing is then performed to track image motion between that image and subsequent images obtained from the camera, determining a mapping between the uploaded image and a current image. Data is then received via the network indicative of a pixel location for display of supplementary information within the reference image. The mapping is used to determine a corresponding pixel location for display of the supplementary information within the current image, and the supplementary information is displayed on the display correctly aligned with the view of the scene.