AR Virtual Object Definition via Local Coordinate Transformation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current augmented reality (AR) systems require complex central location definitions for virtual objects, making it difficult to create and change virtual objects in real-time within real environments, especially for mobile devices.

Innovation Solution

A method using a movable communication device with a camera, screen, and user interface to define, create, and modify virtual objects by determining the device's position and orientation in a higher-level spatial coordinate system, allowing users to create and change virtual objects directly through user inputs, such as touch screen gestures, and display them in real-time.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If virtual objects are defined at a central location using complex coordinate systems, then the precision and consistency of virtual object positioning is improved, but the device complexity and difficulty of real-time creation/editing increases

Engineering Contradiction:
Improvepositioning precisionVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent introduces a coordinate transformation mechanism as an intermediary that converts complex global coordinate system operations into simple local device-relative operations. The transformation module acts as a mediator between the global coordinate system (for precision) and the device's local coordinate system (for simplicity), allowing users to define virtual objects using simple relative coordinates while the system automatically handles the complex global coordinate transformations.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent divides the coordinate system management into separate functional modules: a global coordinate system management module, a local device coordinate system module, and a transformation module. This segmentation allows each module to handle specific tasks independently, reducing the complexity burden on the user while maintaining precise positioning through the coordinated work of these modular components.

Inventive Principle:
Principle #1Segmentation

2Reliability

If virtual objects are pre-defined and stored in databases, then the reliability of virtual object data is improved, but the flexibility and productivity of real-time creation and modification decreases

Engineering Contradiction:
Improvedata reliabilityVSAvoidcreation speed
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent implements preliminary action by pre-defining template virtual objects with basic properties that can be stored in databases for reliability. However, when users need to create or modify virtual objects in real-time, the system allows direct definition using simple device-relative coordinates without requiring database operations, thus maintaining both data reliability through templates and high productivity through direct creation.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system dynamically adapts its operation mode based on user needs: it can switch between using pre-defined database templates (for reliability) and direct real-time definition (for productivity). The virtual object management is dynamic, allowing users to choose the most efficient approach for each specific situation, whether creating new objects, modifying existing ones, or retrieving from storage.

Inventive Principle:
Principle #15Dynamics

3Adaptability or versatility

If a global coordinate system is used for virtual objects, then the adaptability of virtual objects across different devices is improved, but the ease of operation and user interface simplicity deteriorates

Engineering Contradiction:
Improvecoordinate system adaptabilityVSAvoiddefinition simplicity
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent inverts the traditional approach by allowing users to define virtual objects in a simple local coordinate system relative to the device, rather than requiring users to work directly with complex global coordinate systems. The system then automatically performs the coordinate transformation to ensure proper placement in the global coordinate system, thus achieving global adaptability through local simplicity.

Inventive Principle:
Principle #13The other way round (Inversion)

Solution Approach 2:

The coordinate transformation module serves as an intermediary that automatically handles the conversion between device-relative local coordinates and global coordinates. This intermediary mechanism transparently manages the complexity of coordinate system adaptability, allowing users to operate with simple local coordinates while the system ensures proper global positioning and multi-device compatibility.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentEP2977961B1Method and communication device for creating and/or editing virtual objects
Publication Date: 2018.06.27 DEUTSCHE TELEKOM AG
  • EP2977961B1 patent drawingFigure 1
  • EP2977961B1 patent drawingFigure 2
  • EP2977961B1 patent drawingFigure 3~4

AI summary

To improve and/or simplify augmented reality systems, the invention proposes a method for creating and/or modifying virtual objects using a movable communication device (130), wherein a definition of at least one virtual object is provided and the position and orientation of the communication device (130) are determined, wherein, based on this, an overlay image is generated and displayed from an image of the real environment captured by a camera (137) of the communication device (130), and wherein, depending on user input, the definition of the virtual object is changed and saved. The invention further proposes a communication device for carrying out the method.