Virtual Object Unfolding for Natural Augmented Reality

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing augmented reality systems, such as the game apparatus disclosed in Japanese Laid-Open Patent Publication No. 2006-260602, fail to create a natural augmented reality effect by suddenly displaying virtual objects in real space, disrupting the user's perception of the object's presence in the environment.

Innovation Solution

An information processing program that includes a computer-readable storage medium with features like photographed image data acquisition, virtual camera setting, object positioning, control mechanisms for moving and reshaping virtual objects, texture mapping, and display control to gradually reveal virtual objects within a real space, allowing them to appear as if they are unfolding from a closed shape into an open one, maintaining a natural augmented reality effect.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If a virtual object is suddenly displayed on the screen when a game is started, then the game can begin quickly, but the natural augmented reality effect is spoiled and the user cannot feel as if the virtual object really exists in the real space

Engineering Contradiction:
Improvegame start speedVSAvoidnatural augmented reality effect
Core Design Contradiction:
SpeedVSReliability

Solution Approach 1:

The virtual object is prepared in a closed shape state before being displayed. The system performs preliminary positioning and shape configuration so that when the object is finally displayed, it already has a natural appearance that blends with the real space, avoiding sudden appearance while maintaining quick game start

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The virtual object's shape is dynamically changed from a closed shape to an opened shape after display. This dynamic transformation allows the object to reveal its contents gradually, creating a natural augmented reality effect where the user perceives the object as truly existing in the real space

Inventive Principle:
Principle #15Dynamics

2Device complexity

If a virtual object is displayed in a closed shape, then the initial display is simple, but the user cannot see the contents inside the virtual object

Engineering Contradiction:
Improveinitial display complexityVSAvoidvisibility of internal contents
Core Design Contradiction:
Device complexityVSLoss of information

Solution Approach 1:

The virtual object is segmented into different shape states: a closed shape for initial display and an opened shape for revealing contents. This segmentation allows the system to maintain simplicity in the initial state while providing full visibility information when needed

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The virtual object dynamically transforms from a closed shape to an opened shape, allowing the user to see internal contents such as game cards or other objects stored inside. This dynamic shape change provides information on demand without complicating the initial display

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS8749571B2Storage medium having information processing program stored therein, information processing apparatus, information processing system, and information processing method
Publication Date: 2014.06.10 NINTENDO CO LTD
  • US8749571B2 patent drawing
  • US8749571B2 patent drawing
  • US8749571B2 patent drawing

AI summary

An information processing section of a game apparatus executes a program for implementing a step S100 of acquiring a camera image; a step S200 of detecting a marker; a step S400 of calculating a position and an orientation of a virtual camera; a step S600 of generating an animation in which a hexahedron is caused to appear on the marker when the start of a game is requested; a step S800 of generating an animation in which the hexahedron is unfolded so as to position thereon virtual objects representing targets; a step S900 of mapping the photographed image on objects; a step S1000 of taking an image of the objects by means of the virtual camera; and a step S1100, S1200 of displaying the camera image and an object image which is superimposed on the camera image.