Shared AR Object Placement Using Global Pose Data
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality systems lack the ability to easily include other users in AR scenes and often suffer from inaccuracies due to reliance on GPS and compass, limiting interactive access and accuracy.
Innovation Solution
A method for displaying virtual information in a real environment using a server-based system that provides virtual objects with global pose data, allowing users to interactively view and manipulate AR scenes created by others, with improved accuracy through reference database comparisons.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If GPS and compass sensors are used to determine device position and orientation, then the system can operate over large areas, but the accuracy becomes highly inaccurate and the devices must be readily available
Solution Approach 1:
The patent introduces pose data as an intermediary that mediates between the virtual object and the real-world environment. Instead of relying directly on inaccurate GPS and compass sensors, the system uses pose data (which includes position and orientation information) as a mediator to accurately place virtual objects in the real world. This pose data can be obtained through various means including visual markers, RFID tags, or other recognition systems, thereby resolving the contradiction between large-area coverage and measurement precision.
2Adaptability or versatility
If traditional AR tagging methods are used, then users can add virtual information to real locations, but other users cannot interactively view or modify these AR scenes
Solution Approach 1:
The patent makes the AR scene system universal by enabling multiple users to interact with the same AR scene. Virtual objects are stored with their pose data on a server, allowing any user with the AR application to access, view, and manipulate the same virtual objects at the same real-world locations. This multi-functional capability resolves the contradiction by making the system adaptable to multiple users while preserving all interactive information.
3Ease of manufacture
If virtual objects are placed based on local image coordinates, then positioning is simple, but the objects cannot be accurately viewed from different locations and orientations
Solution Approach 1:
The patent transitions from two-dimensional local image coordinates to three-dimensional global coordinate system for storing virtual object positions. By using pose data that includes position and orientation in a global coordinate system, virtual objects can be accurately located and viewed from any position and orientation. This dimensional expansion resolves the contradiction by maintaining placement simplicity through automated coordinate transformation while ensuring reliable visibility consistency across different viewing conditions.
Data Source
Figure 1A~1B
Figure 1C
Figure 2
AI summary
The invention relates to a method for displaying virtual information in a view of a real environment, comprising the following steps: providing at least one virtual object (10) with a global position and orientation with respect to a geographic global coordinate system (200), together with first position data (PW10) that allows inferences about the global position and orientation of the virtual object, in a database (3) of a server (2); capturing at least one image (50) of a real environment (40) using a mobile device (30) and providing second position data (PW50) that allows inferences about the position and orientation with which the image was captured with respect to the geographic global coordinate system (200) that represents the image (50); accessing a display (31) of the mobile device.access the virtual object (10) in the database (3) of the server (2) and position the virtual object (10) in the image (50) displayed on the screen based on the first and second position data (PW10, PW50), manipulate the virtual object (10) or add another virtual object (11) by positioning it accordingly in the image (50) displayed on the screen and provide the manipulated virtual object (10) together with the first modified position data (PW10) according to the positioning in the image (50) and the second virtual object (11) together with the third position data according to the positioning in the image (50) in the database (3) of the server (2),The modified first and third position data each allow conclusions to be drawn about the global position and orientation of the manipulated or further virtual object. Instead of using an image of the real environment, the procedure can also be carried out analogously, for example using an HMD view.