Dynamic Virtual Object Aspect Control in Marker-Based AR

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current augmented reality techniques using markers for superimposing information on real spaces result in monotonous visual effects, lacking variety and engagement.

Innovation Solution

An information processing program that acquires images of a real space, detects features, determines virtual objects and their aspects based on recognition conditions such as elapsed time, number of detections, and posture, generating and displaying a virtual space image that changes dynamically when superimposed on the real space.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a marker is used for augmented reality to superimpose three-dimensional image data at the marker position, then the basic AR function is achieved, but the visual effects become monotonous and lack variety

Engineering Contradiction:
Improvevisual varietyVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent applies dynamics by making the virtual object's display state changeable based on detection conditions. The determining unit changes the virtual object or its aspect dynamically according to whether the feature is detected, creating varied visual effects without requiring multiple separate systems. This resolves the contradiction by introducing temporal variability into a previously static display system.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes parameters of the virtual object (such as its aspect, orientation, or properties) based on the detection condition of the feature. When the feature is detected, the system modifies the virtual object's parameters to create different visual effects. This approach enables visual variety through parameter modification rather than through complex system architecture.

Inventive Principle:
Principle #35Parameter changes

2Productivity

If the same virtual object is displayed repeatedly at the marker position, then the AR function is stable and simple, but user engagement and entertainment value decrease

Engineering Contradiction:
Improveuser engagementVSAvoidtime for user interaction
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The patent implements periodic action by detecting features at regular intervals and changing the virtual object based on detection results. The system periodically checks for feature detection and updates the virtual object accordingly, creating a rhythm of interaction that maintains user engagement over time rather than presenting a static, unchanging display.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system uses feedback by detecting user actions (feature detection events) and responding by changing the virtual object. This feedback loop creates an interactive experience where user actions directly influence the display, increasing engagement and reducing perceived time loss through active participation rather than passive viewing.

Inventive Principle:
Principle #23Feedback

3Ease of manufacture

If simple superposition of virtual objects is used, then the system is easy to implement, but the entertainment properties and visual richness are limited

Engineering Contradiction:
Improveimplementation easeVSAvoidentertainment properties
Core Design Contradiction:
Ease of manufactureVSAdaptability or versatility

Solution Approach 1:

The patent maintains implementation simplicity while enhancing entertainment properties through dynamics. The system uses a straightforward superposition approach but adds the dynamic element of changing virtual objects based on feature detection. This keeps the implementation easy (single superposition mechanism) while dramatically increasing versatility (multiple virtual objects with different aspects) through conditional logic.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS9916687B2Computer-readable recording medium recording information processing program, information processing apparatus, information processing system, and information processing method
Publication Date: 2018.03.13 NINTENDO CO LTD
  • US9916687B2 patent drawing
  • US9916687B2 patent drawing
  • US9916687B2 patent drawing

AI summary

An example computer includes: an image acquiring unit that acquires an image of a real space captured by an imaging device; a feature detecting unit that detects a feature from the image; a determining unit that determines a virtual object, or, a virtual object and an aspect of the virtual object while changing the same in accordance with a recognition condition of the detected feature; an image generating unit that generates an image of a virtual space in which the determined virtual object or the virtual object in the determined aspect is placed on a basis of the feature; and a display controlling unit that displays an image on a display device such that the image of the virtual space is visually recognized by a user while being superimposed on the real space.