Augmented Reality Marker Virtual Image Plane Calibration

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing augmented reality systems face challenges in generating accurate virtual maps for real environments, especially when the camera is static or features are scarce, leading to difficulties in tracking feature points and creating adequate maps for augmented reality experiences.

Innovation Solution

An entertainment device and method that utilize an augmented reality marker to detect and generate a virtual image plane coplanar with a real surface, reducing the need for multiple point tracking and enabling efficient calibration of the real environment for augmented reality image generation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If feature point tracking is used to generate virtual maps, then map accuracy can be improved, but the system fails when the camera is static or feature points are scarce

Engineering Contradiction:
Improvemap accuracyVSAvoidsystem functionality
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

An augmented reality marker is introduced as an intermediary object to facilitate camera calibration and virtual image plane generation. The marker serves as a reliable reference that bridges the gap between the real world and virtual content, enabling the system to function regardless of camera movement or environmental feature scarcity.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system transitions from relying on natural environmental features to using an artificial marker with controlled parameters. The marker's known geometric properties and detectable features provide stable reference parameters for calibration, replacing the unreliable natural feature points.

Inventive Principle:
Principle #35Parameter changes

2Loss of information

If virtual map generation is performed using traditional methods, then comprehensive environmental mapping can be achieved, but computational resources are excessively consumed

Engineering Contradiction:
Improveenvironmental mapping completenessVSAvoidcomputational resource consumption
Core Design Contradiction:
Loss of informationVSUse of energy by moving object

Solution Approach 1:

The system extracts only the essential information needed for calibration from the environment by focusing on the augmented reality marker. Instead of processing all environmental features to create comprehensive maps, the system selectively uses the marker's geometric properties, significantly reducing computational load while maintaining calibration accuracy.

Inventive Principle:
Principle #2Taking out (Extraction)

3Measurement precision

If the virtual image plane area matches the marker area exactly, then precise marker localization is achieved, but the user interaction area is insufficient

Engineering Contradiction:
Improvemarker localization precisionVSAvoiduser interaction area
Core Design Contradiction:
Measurement precisionVSArea of stationary object

Solution Approach 1:

The system separates the localization function from the interaction function by operating in different dimensional spaces. The marker's 2D image plane coordinates provide precise localization, while the virtual image plane extends into a larger 2D interaction space that encompasses the marker, allowing both precision and sufficient interaction area.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS8542250B2Entertainment device, system, and method
Publication Date: 2013.09.24 SONY COMP ENTERTAINMENT EURO LTD
  • US8542250B2 patent drawing
  • US8542250B2 patent drawing
  • US8542250B2 patent drawing

AI summary

An entertainment device for combining virtual images with real images captured by a video camera so as to generate augmented reality images. The device comprises receiving means operable to receive a sequence of video images from the video camera via a communications link. The device further comprises detecting means operable to detect an augmented reality marker within the received video images, and processing means operable to generate a virtual image plane in dependence upon the detection of the augmented reality marker by the detecting means. The virtual image plane is arranged to be substantially coplanar with a real surface upon which the augmented reality marker is placed so that virtual images may be generated with respect to the real surface. The processing means is operable to generate the virtual image plane within the captured video images such that the virtual image plane is defined with respect to the detected augmented reality marker, and the virtual image plane has an area which is greater than an area which corresponds to the augmented reality marker.