Virtual Marker Projection for Stable AR Overlay

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current augmented reality (AR) technologies face challenges in displaying virtual information with stability and high precision, particularly due to the need for physical markers in marker-based AR and the complexity of calculating spatial relationships in marker-less AR, which can lead to design restrictions, computational demands, and user discomfort.

Innovation Solution

An information processing apparatus that generates and displays virtual information based on the spatial position of a projected marker, allowing continuous display even when the marker is undetectable, using a processor to calculate and update superimposition parameters for stable and precise virtual information overlay on real space.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If marker AR is used to calculate display position and angle of virtual information, then calculation is relatively easy, but time and effort to create the marker, provision of placement space, degradation of the marker with time, and physical and psychological stress by the marker existing in the real space are required

Engineering Contradiction:
Improvecalculation complexityVSAvoidmarker creation and placement
Core Design Contradiction:
Device complexityVSEase of manufacture

Solution Approach 1:

The patent extracts the marker from the physical real space and replaces it with a virtual marker that can be projected and positioned anywhere in the real space without physical constraints. This eliminates the need for physical marker creation, placement, and maintenance while maintaining the calculation simplicity of marker-based AR.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent uses a projected marker image that can be displayed on any surface in the real space, effectively copying the marker functionality to virtual space. This allows the system to maintain marker-based calculation simplicity while eliminating the need for physical markers, as the marker exists only as projected light rather than physical material.

Inventive Principle:
Principle #26Copying

2Ease of manufacture

If marker-less AR is used to avoid marker creation and placement, then no physical marker is needed, but the calculation is complicated due to the construction of a space model in a wide region and therearound for display of the virtual information

Engineering Contradiction:
Improvemarker creation and placementVSAvoidcalculation complexity
Core Design Contradiction:
Ease of manufactureVSDevice complexity

Solution Approach 1:

The patent introduces a projected marker as an intermediary element that bridges the gap between marker-based and marker-less AR. The marker is projected virtually onto surfaces in the real space, providing a reference for calculation without requiring physical markers. This intermediary approach maintains the simplicity of marker-based calculation while achieving the flexibility of marker-less AR.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If a physical marker is disposed in the real space for AR display, then spatial position relationship can be calculated easily, but design restrictions on the marker and physical and psychological stress by the marker existing in the real space occur

Engineering Contradiction:
Improvespatial position relationship calculationVSAvoidmarker design flexibility
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent creates a virtual copy of the marker that can be projected onto any surface in the real space. This virtual marker maintains the precise spatial relationship calculation capabilities of physical markers while eliminating design restrictions, as the marker can be any digital pattern or shape without physical manufacturing constraints.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent changes the physical state of the marker from a fixed physical object to a programmable digital projection. This allows the marker's appearance, size, shape, and position to be dynamically changed through software parameters, eliminating design restrictions while maintaining precise spatial calculation capabilities.

Inventive Principle:
Principle #35Parameter changes

4Ease of operation

If image recognition with a visible-light camera is used for AR, then virtual information can be displayed with respect to the real space, but no possible image recognition in a place too bright or in a place too dark, and intense shades (contrast) on the surface of an existing object may be produced

Engineering Contradiction:
ImproveAR display capabilityVSAvoidimage recognition reliability
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The patent uses a projected marker as an intermediary reference that is independently controllable and visible under various lighting conditions. The projected marker provides a consistent reference point for spatial calculation that is not dependent on the visibility of physical markers or objects in the real space, thereby improving reliability in bright or dark environments.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS10198870B2Information processing apparatus, information processing system, and information processing method
Publication Date: 2019.02.05 SONY GROUP CORP
  • US10198870B2 patent drawing
  • US10198870B2 patent drawing
  • US10198870B2 patent drawing

AI summary

The present disclosure is generally directed to an information processing apparatus, comprising: a processor configured to: detect a real object on a real space; receive first superimposition information that corresponds to superimposition of a virtual object on the real object, wherein the first superimposition information is generated based on a spatial position relationship of a second information processing apparatus and the real object; generate second superimposition information based on spatial positional information of the first information processing apparatus and the received first superimposition information; and display the virtual object based on the generated second superimposition information.