Marker-Based AR Virtual Object Display State Control

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing augmented reality systems face difficulties in accurately changing the display state of virtual objects due to positional changes caused by operator movement, making precise operations challenging, especially when virtual objects are small or displayed in varying sizes and orientations.

Innovation Solution

A virtual object display device that acquires background images, uses marker images to determine display information, and changes the virtual object's state based on the relative relationship between reference and other markers, allowing for accurate adjustments to color, brightness, and opacity through a system of markers and a display state change unit.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a virtual object is displayed using augmented reality with a single marker for position reference, then the virtual object can be displayed at the correct position, but it becomes difficult to accurately change the display state (color, brightness, opacity) when the operator moves

Engineering Contradiction:

Improvedisplay state adjustment precisionVSAvoidoperation stability during movement

Core Design Contradiction:

Measurement precisionVSEase of operation

Solution Approach 1:

The single marker is divided into a reference marker and multiple operation markers. The reference marker remains fixed to maintain virtual object positioning, while operation markers can be moved to adjust display states. This segmentation allows independent functions for positioning and state adjustment without interference.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

Operation markers serve as intermediaries between the operator and the virtual object's display state. By manipulating these markers rather than directly interacting with the virtual object, the system enables precise control of display parameters while maintaining operational stability even during operator movement.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Adaptability or versatility

If multiple markers are used to change display state, then operational flexibility is improved, but the system complexity increases

Engineering Contradiction:

Improvedisplay state control flexibilityVSAvoidmarker system complexity

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

Each operation marker is designed to perform multiple functions: it can adjust different display parameters (color, brightness, opacity) and can be positioned at various locations to control different aspects of the virtual object. This multi-functionality reduces the need for numerous specialized markers, simplifying the overall system.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system dynamically assigns functions to markers based on their positions and relationships. The reference marker maintains a fixed role for positioning, while operation markers can be flexibly configured to adjust various display states. This dynamic allocation optimizes system complexity by activating only the necessary marker functions.

Inventive Principle:

Principle #15Dynamics

3Ease of operation

If the virtual object is displayed in real-time with augmented reality, then the user can interact with the virtual environment, but precise operations become challenging when the virtual object is small or displayed in varying sizes and orientations

Engineering Contradiction:

Improvevirtual object manipulation easeVSAvoidoperation accuracy on small objects

Core Design Contradiction:

Ease of operationVSMeasurement precision

Solution Approach 1:

The system uses marker images as copies or representations of the virtual object's display state parameters. By manipulating these marker copies in the real world, users can precisely control the virtual object's appearance without directly interacting with the small or rotated virtual object, thereby maintaining high precision operations.

Inventive Principle:

Principle #26Copying

Solution Approach 2:

Markers act as intermediaries that translate physical manipulations into precise digital adjustments. When users move or rotate markers in the real world, these physical actions are converted into accurate changes of the virtual object's display parameters, enabling precise control even when the virtual object itself is small or oriented differently.

Inventive Principle:

Principle #24Intermediary (Mediator)

Data Source

PatentUS10359916B2Virtual object display device, method, program, and system

Publication Date: 2019.07.23 FUJIFILM CORP

AI summary

A camera 14 acquires a background image B0, and a virtual object acquisition unit 22 acquires a virtual object S0. A display information acquisition unit 23 acquires display information indicating a position, at which the virtual object S0 is displayed, from the background image B0, and a display control unit 24 displays the virtual object S0 on a display 15 based on the display information. A change information acquisition unit 25 acquires change information for changing the display state of the virtual object S0 according to the relative relationship between a reference marker image 36 and each of the other marker images 37, among a plurality of marker images 36 and 37 for changing the display state of the virtual object S0 that are included in the background image B0. A display state change unit 26 changes the display state of the virtual object according to the change information.