Shared AR Object Positioning Using Global Pose Data

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing augmented reality (AR) systems struggle with inaccurate positioning of virtual objects due to GPS and compass inaccuracies, limiting user interaction and integration of other users in AR scenes.

Innovation Solution

A method for representing virtual information in a real environment using pose data to accurately position and manipulate virtual objects on a server, integrating GPS and orientation sensors with reference databases for enhanced accuracy and user interaction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If GPS and compass are used for positioning virtual objects, then the system can operate without special optical marks, but the positioning accuracy deteriorates due to inherent device inaccuracies

Engineering Contradiction:
Improveoperation without special optical marksVSAvoidpositioning accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent introduces a server as an intermediary that collects pose data from multiple users and performs coordinate transformations. The server acts as a mediator between individual device measurements and the global coordinate system, aggregating data to improve overall positioning accuracy while maintaining ease of operation.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent combines pose data from multiple users and multiple sensors (GPS, compass, camera) into a unified coordinate system on the server. By merging multiple independent measurements, the system achieves higher positioning accuracy than any single device could provide alone.

Inventive Principle:
Principle #5Merging (Combining)

2Adaptability or versatility

If virtual objects are positioned using individual device pose data, then each user can interact independently, but other users cannot view or interact with the same AR scenes

Engineering Contradiction:
Improveindependent user interactionVSAvoidsystem integration for multi-user access
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent creates a universal AR environment where virtual objects are positioned in a global coordinate system that all users can access. The server provides multi-functional capabilities by storing, transforming, and distributing pose data to enable any user to view and interact with the same AR scenes from their respective device perspectives.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent transitions from individual device-centric coordinate systems to a global coordinate system dimension. By adding the server as a central coordination layer, the system enables multi-user access while preserving individual device independence through coordinate transformations.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Ease of operation

If virtual objects are manipulated locally on each device, then user interaction is simple and direct, but the manipulated objects cannot be shared or viewed by other users

Engineering Contradiction:
Improvelocal manipulation simplicityVSAvoidshared virtual information
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The patent implements a feedback mechanism where local manipulations are transmitted to the server, which then distributes the updated pose data to all users. This feedback loop ensures that changes made by one user are reflected in the AR scenes viewed by all other users, preventing information loss while maintaining operational simplicity.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent performs preliminary coordinate transformations on the server before distributing data to users. By pre-processing the pose data in the global coordinate system, the system enables simple local interactions while ensuring that shared information is properly formatted and positioned for all users.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS12499636B2Method for representing virtual information in a view of a real environment
Publication Date: 2025.12.16 APPLE INC
  • US12499636B2 patent drawing
  • US12499636B2 patent drawing
  • US12499636B2 patent drawing

AI summary

A method for representing virtual information in a view of a real environment comprises providing a virtual object having a global position and orientation with respect to a geographic global coordinate system, with first pose data on the global position and orientation of the virtual object, in a database of a server, taking an image of a real environment by a mobile device and providing second pose data as to at which position and with which orientation with respect to the geographic global coordinate system the image was taken. The method further includes displaying the image on a display of the mobile device, accessing the virtual object in the database and positioning the virtual object in the image on the basis of the first and second pose data, manipulating the virtual object or adding a further virtual object, and providing the manipulated virtual object with modified first pose data or the further virtual object with third pose data in the database.