AR Positioning via 3D Image Analysis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In augmented reality (AR) techniques, particularly in vision-based AR, users face a high task load when manually inputting offset values to position virtual objects accurately in relation to real-world objects, leading to inefficiencies in authoring and display processes.

Innovation Solution

A method that involves capturing images from different positions, generating three-dimensional information, and using transformation matrices to accurately determine and set the position of AR content in a virtual real space relative to a marker or object, reducing the need for manual offset input by calculating precise positional relationships.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual offset input is used to position virtual objects, then positioning accuracy can be achieved, but user task load increases and authoring efficiency decreases

Engineering Contradiction:
Improvepositioning accuracyVSAvoiduser task load
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The system automatically calculates three-dimensional positions and offset values using image recognition and coordinate transformation algorithms. The information processing device performs self-service by deriving positioning data from captured images without requiring manual offset input from the user, thereby maintaining positioning accuracy while reducing task load.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces the manual mechanical input method (user typing offset values) with an automated computational system. The system uses image capturing devices, coordinate transformation matrices, and algorithmic calculations to automatically determine virtual object positions, substituting manual operations with automated technical processes.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Manufacturing precision

If manual offset input is required for positioning, then precise placement is possible, but authoring process complexity increases

Engineering Contradiction:
Improveplacement precisionVSAvoidauthoring process complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent extracts the complex calculation tasks from the manual authoring process. By separating the automated coordinate transformation and three-dimensional position calculation functions from manual operations, the system maintains placement precision while simplifying the authoring interface and reducing process complexity.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system introduces an intermediary computational layer that automatically transforms two-dimensional image coordinates into three-dimensional virtual space positions. This intermediary process handles the mathematical transformations and coordinate system conversions, preventing users from directly dealing with the complexity of offset calculations while ensuring precise placement.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Productivity

If automated positioning is implemented, then user workload is reduced, but system complexity increases

Engineering Contradiction:
Improveauthoring efficiencyVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The information processing device performs multiple functions within a unified system: it captures images, recognizes objects, calculates three-dimensional positions, transforms coordinates, and positions virtual objects. This multi-functional approach consolidates various operations into a single automated system, improving productivity while managing system complexity through integration rather than separate components.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system performs preliminary actions by pre-calculating three-dimensional positions and transformation matrices before virtual object placement. By preparing coordinate transformation data and position information in advance through automated algorithms, the system reduces real-time computational requirements and simplifies the actual placement operation, thereby improving productivity without proportionally increasing system complexity.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10074217B2Position identification method and system
Publication Date: 2018.09.11 FUJITSU LTD
  • US10074217B2 patent drawing
  • US10074217B2 patent drawing
  • US10074217B2 patent drawing

AI summary

A method includes acquiring a first image including a specific object and captured at an imaging position, generating first three-dimensional information based on a first shape of the specific object, the first three-dimensional information corresponding to the imaging position, generating second three-dimensional information based on a specific depth value and a designated position on the first image, generating first line information based on the first and the second three-dimensional information, acquiring a second image including the specific object and captured at another imaging position, generating third three-dimensional information based on a second shape of the specific object, the third three-dimensional information corresponding to the another imaging position, generating second line information based on the second and the third three-dimensional information, generating a fourth three-dimensional information based on the first and the second line information, and storing the fourth three-dimensional information associated with a content.