AR Object Positioning via Virtual Marker Backup

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In augmented reality (AR) technology, the display of AR objects is hindered when AR markers are not recognized due to accidental or device-related factors, leading to incorrect positioning and potential disappearance of AR objects, even if they are still present in the camera's view.

Innovation Solution

A system that detects first and second objects from images, generates positional relationship and distortion information, and stores this data to control the display of AR objects even when the second object is not detected, using virtual AR markers to maintain accurate positioning and display AR content based on stored information.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If AR marker recognition is used to position AR objects, then positioning accuracy is improved, but reliability deteriorates when markers are not recognized due to accidental or device-related factors

Engineering Contradiction:
Improvepositioning accuracyVSAvoiddisplay continuity
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent creates virtual AR markers as digital copies of physical AR markers by capturing images of physical markers, extracting their positional and distortion information, and storing this data. These virtual markers serve as backups that can be used when physical markers are not recognized, thereby maintaining display continuity while preserving positioning accuracy through the stored reference information.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The system performs preliminary actions by capturing images of physical AR markers in advance, extracting their positional relationships and distortion information, and storing this data as virtual AR markers before they are needed. This preparation ensures that when physical markers become unrecognized, the system can immediately switch to using pre-prepared virtual markers without interruption.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If virtual AR markers are used to maintain display continuity, then reliability is improved, but device complexity increases due to additional processing and storage requirements

Engineering Contradiction:
Improvedisplay continuityVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent extracts only the essential information needed for marker positioning—positional relationships and distortion information—from the physical AR markers and stores this extracted data as virtual markers. By separating and storing only the critical positioning data rather than complete marker images or complex processing algorithms, the system reduces computational complexity while maintaining reliability.

Inventive Principle:
Principle #2Taking out (Extraction)

3Adaptability or versatility

If multiple objects are detected and stored for AR display, then adaptability is improved, but information processing load increases

Engineering Contradiction:
Improvemarker recognition flexibilityVSAvoidprocessing efficiency
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The system creates simplified digital copies (virtual markers) of physical markers that contain only the essential positional and distortion information needed for AR object positioning. This copying approach enables the system to handle multiple markers adaptively while minimizing information processing load by storing compact representations rather than complete marker data.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS10319110B2Display control method and system
Publication Date: 2019.06.11 FUJITSU LTD
  • US10319110B2 patent drawing
  • US10319110B2 patent drawing
  • US10319110B2 patent drawing

AI summary

A system includes circuitry configured to detect a first object and a second object from a first image captured, generate positional relationship information between the first object and the second object, and distortion information regarding a second shape of the second object in the first image with reference to a first shape of the first object in the first image, store, into a memory, the positional relationship information and the distortion information associated with the second object, acquire a second image, and control a display to display a content associated with the second object based on the positional relationship information and the distortion information when the first object is detected from the second image and when the second object is not detected from the second image, the content data being superimposed on the second image at a specific position with respect to the second object.