AR Device Position Tracking Using Intermediary Coordinate System

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Virtual reality games on handheld devices are limited by simplistic implementations and lack of consideration for the relative location of players and their surroundings, resulting in an unrealistic experience, especially in multiplayer interactions.

Innovation Solution

A method that uses image analysis to determine the relative position of handheld devices in a three-dimensional space, allowing for the generation of interactive scenes tied to a reference point, enabling realistic 3D virtual experiences and multiplayer interactions by synchronizing devices to a common virtual or augmented space.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If virtual reality games are implemented on handheld devices using conventional methods, then the games can be played on portable devices, but the virtual experience is simplistic and lacks realism because relative location of players and surroundings is not considered

Engineering Contradiction:
Improveposition tracking accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent introduces an intermediary coordinate system that acts as a mediator between the device's local coordinate system and the shared virtual space. This intermediary layer enables accurate position tracking and synchronization without requiring complex direct transformations between all devices and the global environment, thus improving measurement precision while managing device complexity.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent creates a universal coordinate system that serves multiple devices simultaneously, allowing each handheld device to track its position and orientation relative to a common reference frame. This multi-functional coordinate system enables realistic multiplayer interactions and environmental awareness across different devices without requiring separate tracking systems for each device.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If multiplayer interactions are implemented without considering relative location, then device synchronization is simpler, but the virtual experience is unrealistic and lacks immersion

Engineering Contradiction:
Improvemultiplayer interaction capabilityVSAvoidspatial relationship information
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The patent transitions from two-dimensional screen-based interactions to three-dimensional spatial awareness by incorporating depth, distance, and orientation data into the virtual reality experience. This dimensional enhancement allows players to understand their relative positions and surroundings, creating realistic multiplayer interactions while preserving spatial relationship information.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent replaces traditional mechanical or simple digital coordination systems with an advanced coordinate transformation system that uses image analysis and geometric calculations. This substitution enables accurate tracking of relative positions and orientations between devices and environmental features, providing immersive spatial awareness without losing critical spatial relationship information.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Measurement precision

If AR tags are used for positioning, then device location can be determined, but the system requires additional physical markers in the environment

Engineering Contradiction:
Improvedevice location accuracyVSAvoidenvironmental requirement complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts the positioning functionality from dependence on external AR tags by using image analysis of the device itself and its relationship to the environment. This extraction eliminates the requirement for additional physical markers while maintaining device location accuracy through alternative visual recognition methods.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent enables the device to determine its own position and orientation by analyzing images captured by its own camera and processing geometric relationships autonomously. This self-service capability eliminates the need for external AR tags or markers, as the device uses its own imaging system and computational resources to achieve accurate positioning.

Inventive Principle:
Principle #25Self-service

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables immersive and realistic 3D virtual experiences on handheld devices by accurately tracking device positions and synchronizing them within a shared virtual space, enhancing multiplayer interactions and eliminating the need for AR tags.

Implementation Method 1

determining a relative position of the second device with reference to the first device, based on image analysis of the taken image to identify a geometry of the second device

Methodology Applied
Scientific EffectImage analysis: Image Processing

Data Source

PatentUS11244469B2Tracking position of device inside-out for augmented reality interactivity
Publication Date: 2022.02.08 SONY INTERACTIVE ENTERTAINMENT LLC
  • US11244469B2 patent drawing
  • US11244469B2 patent drawing
  • US11244469B2 patent drawing

AI summary

Methods, systems, and computer programs are provided for generating an interactive space. One method includes identifying a reference point in a three-dimensional (3D) space using a portable device. The reference point is calibrated to an origin point of the portable device. The method includes determining by the device a position and an orientation of the portable device at the origin point. The position and orientation is determined using data from an inertial sensor of the portable device and data from the camera. The method includes generating by the portable device an augmented reality (AR) space using the reference point. The AR space includes virtual objects imposed over or in the 3D space.