AR Marker Positioning via Relative Relation Information

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional augmented reality technologies rely on a single marker for position and attitude processing, limiting flexibility and requiring all markers to be within the imaging device's range, which restricts the movement of the imaging device.

Innovation Solution

An image processing system that includes feature detection, reference acquisition, and relative relation information acquisition means to specify the position and attitude of features like AR markers, allowing for the estimation of additional markers' positions and attitudes, and updating stored information to adapt to changes in marker positions or additions/removals.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If conventional augmented reality technology uses a single marker for position and attitude processing, then the system is simple to operate, but the processing flexibility is low

Engineering Contradiction:
Improveprocessing flexibilityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system segments the reference system into multiple independent markers instead of using a single marker. Each marker can be detected and processed independently, allowing flexible combination of multiple reference points. This segmentation enables the system to handle complex spatial relationships while maintaining operational simplicity through modular processing of individual markers.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent creates a universal reference system where multiple markers can serve different functions simultaneously. The system can use some markers for position reference, others for attitude determination, and still others for spatial calibration. This multi-functionality approach allows a single marker detection mechanism to handle diverse processing needs, improving flexibility without proportionally increasing system complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Ease of operation

If all markers must be within the imaging device's range for processing, then the position and attitude data is complete, but the movement range of the imaging device is restricted

Engineering Contradiction:
Improveimaging device movement freedomVSAvoidmarker position information completeness
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The system performs preliminary action by pre-establishing the relative spatial relationships between multiple markers before actual processing begins. The relative position and attitude information between markers is pre-calculated and stored. This allows the imaging device to capture only a subset of markers at any given time, while the pre-stored relational data compensates for missing information, enabling free movement without losing overall spatial completeness.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces relative position and attitude information as an intermediary element that mediates between the imaging device's limited field of view and the complete marker system. Instead of requiring direct observation of all markers, the system uses pre-computed relational data as an intermediary to reconstruct the complete spatial configuration from partial observations, enabling unrestricted device movement while maintaining information completeness.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Adaptability or versatility

If multiple markers are used to improve processing flexibility, then the adaptability increases, but the difficulty of detecting and measuring increases

Engineering Contradiction:
Improveprocessing flexibilityVSAvoidfeature detection complexity
Core Design Contradiction:
Adaptability or versatilityVSDifficulty of detecting and measuring

Solution Approach 1:

The system merges the detection and measurement processes for multiple markers into a unified computational framework. Instead of treating each marker detection as a separate complex task, the patent combines them into a single batch processing operation that leverages the known relative relationships between markers. This merging approach reduces the overall detection complexity by processing markers collectively rather than individually, while still maintaining the adaptability benefits of multiple reference points.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS9030493B2Image processing system, method and apparatus, and computer-readable medium recording image processing program
Publication Date: 2015.05.12 NINTENDO CO LTD
  • US9030493B2 patent drawing
  • US9030493B2 patent drawing
  • US9030493B2 patent drawing

AI summary

An example image processing apparatus has a captured image acquisition unit for acquiring a captured image captured by an imaging device, a feature detection unit for detecting the markers from the captured image, a reference acquisition unit for acquiring, based on each of the detected markers, a coordinate system serving as a reference indicating a position and attitude in a space, and a relative relation information acquisition unit for acquiring, based on the captured image in which a plurality of the markers are detected, relative relation information indicating a relative relation in position and attitude of a plurality of coordinate systems acquired for the respective markers.