AR Feature Association Dynamics for Visual Variety

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing augmented reality techniques are limited by monotonous visual effects as they simply display three-dimensional image data at the position of a marker, lacking variety and engagement.

Innovation Solution

An information processing program that acquires images of a real space, detects features, changes associations between features and virtual objects, and generates images of virtual spaces for display on a device, allowing for dynamic and varied visual presentations even when the second feature is out of range or detected intermittently.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If a simple marker-based AR technique is used to display three-dimensional image data at the marker position, then the implementation is simple and easy to understand, but the visual effects are monotonous and lack variety

Engineering Contradiction:
Improveease of implementationVSAvoidvisual variety
Core Design Contradiction:
Ease of manufactureVSAdaptability or versatility

Solution Approach 1:

The patent applies dynamics by making the association between markers and virtual objects changeable over time. The system dynamically switches between initial associations (defined in advance) and temporarily acquired associations (obtained through image recognition of second features). This allows the AR display to evolve from static to dynamic, enabling visual variety while maintaining implementation simplicity.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent uses preliminary action by pre-defining associations between first features (markers) and virtual objects before the AR session begins. These initial associations are stored in advance and serve as the baseline for AR display. This preliminary setup enables simple implementation while the system later enhances visual variety through temporary associations acquired during runtime.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If the system continuously tracks and updates virtual objects based on marker detection, then the AR display remains accurate and synchronized, but the experience becomes interrupted when markers are not detected or move out of range

Engineering Contradiction:
Improvedisplay accuracyVSAvoiduser engagement continuity
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent applies beforehand cushioning by preparing multiple association sets (initial associations and temporary associations) in advance. When the current marker detection fails or the marker moves out of range, the system can smoothly switch to previously prepared temporary associations, cushioning the interruption and maintaining display continuity. This ensures reliability while preventing engagement loss.

Inventive Principle:
Principle #11Beforehand cushioning (Prior cushioning)

Solution Approach 2:

The patent implements continuity of useful action by ensuring that virtual objects continue to be displayed even when markers are not detected. The system maintains AR display continuity by switching between initial and temporary associations, allowing the useful action of displaying virtual objects to continue uninterrupted, thereby maintaining user engagement.

Inventive Principle:
Principle #20Continuity of useful action

3Adaptability or versatility

If the system adds complex feature detection and association changing mechanisms to enhance visual variety, then the AR experience becomes more engaging and diverse, but the system complexity increases

Engineering Contradiction:
Improvevisual varietyVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent applies segmentation by dividing the feature association system into distinct components: first features (markers) with initial associations, and second features (additional detectable elements) with temporary associations. This segmentation allows the system to manage complexity by handling different association types separately, enabling visual variety through multiple association sets without overwhelming system complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent uses universality by designing the feature detection system to handle multiple types of features (first features and second features) through a unified framework. The same basic mechanism detects both feature types and manages both initial and temporary associations, achieving visual variety through multi-functionality rather than separate complex systems.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS10062211B2Computer-readable recording medium recording information processing program, information processing apparatus, information processing system, and information processing method
Publication Date: 2018.08.28 NINTENDO CO LTD
  • US10062211B2 patent drawing
  • US10062211B2 patent drawing
  • US10062211B2 patent drawing

AI summary

An example information processing system includes: a computer; an imaging device; a display device; and a first and a second feature placed in a real space. The computer includes: an image acquiring unit that acquires an image of the real space; a feature detecting unit that detects the first feature and the second feature from the image; a changing unit that changes an association of the first feature with a virtual objects by adding a virtual object associated with the second feature, and an generating unit that generates an image of a virtual space in which the virtual object associated with the first feature is placed at a position based on the first feature; and a display controlling unit that displays an image on the display device.