AR Anchor Positioning via Server-Side Spatial Data Extraction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing technologies face challenges in accurately positioning virtual objects in augmented reality (AR) and virtual reality (VR) environments, particularly on mobile devices with limited computing resources, due to high demands for image rendering and processing.

Innovation Solution

A computing device processes image capture data from remote user devices to determine spatial data for anchoring virtual objects in AR scenes, allowing for accurate placement and orientation of virtual objects within the real-world environment, while conserving computing resources by transmitting only necessary data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If image processing is performed locally on mobile devices to determine anchor positions, then positioning accuracy is improved, but computing resource consumption increases

Engineering Contradiction:
Improvepositioning accuracyVSAvoidcomputing resource consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent extracts the computationally intensive image processing function from mobile devices and relocates it to a server. The server receives image capture data from multiple devices, performs the spatial data determination and anchor position calculation, then transmits only the resulting spatial data back to devices. This extraction resolves the contradiction by maintaining positioning accuracy while eliminating local computing resource consumption.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent introduces a server as an intermediary between mobile devices and the anchor positioning system. The server acts as a mediator that receives raw image data from devices, processes it to determine spatial relationships and anchor positions, and returns processed spatial data. This intermediary approach allows devices to achieve accurate positioning without directly performing heavy computations, thus resolving the resource consumption issue.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If comprehensive image data is transmitted between devices, then AR scene accuracy is improved, but bandwidth requirements increase

Engineering Contradiction:
ImproveAR scene accuracyVSAvoiddata transmission volume
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent extracts only the essential spatial data from comprehensive image data. Instead of transmitting entire images or all processing intermediate results between devices, the system transmits only the determined spatial data (anchor positions, orientations, and relationships). This extraction maintains AR scene accuracy while dramatically reducing the quantity of transmitted data.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent segments the data transmission into distinct components: image capture data is sent to the server for processing, and only the resulting spatial data is transmitted back to devices. This segmentation separates the heavy raw data transmission from the lightweight result transmission, achieving accurate AR scenes with minimized bandwidth usage.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11605204B2Image processing for augmented reality
Publication Date: 2023.03.14 ARM LTD
  • US11605204B2 patent drawing
  • US11605204B2 patent drawing
  • US11605204B2 patent drawing

AI summary

Examples of the present disclosure relate to a computing device for processing images captured in three-dimensional environments, for the generation of augmented reality scenes. The computing device is configured to obtain an augmented reality anchor, the anchor corresponding to a position and orientation in a real-world environment. The computing device is configured to receive image capture data via data communication from a remote user device. The image capture data comprises an image captured by the user device, the image representing the real-world environment as viewed by the user device. The computing device is configured to process the image capture data to determine spatial data which maps the anchor to the image. The spatial data is usable by the remote user device to insert a virtual object into the image, in accordance with the anchor, to generate an augmented reality scene at the remote user device. The computing device is configured to transmit the determined spatial data via data communication to the remote user device.