AR Camera Position Detection for Virtual Image Placement

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing Augmented Reality (AR) techniques require users to accurately arrange objects in a real space to display virtual information accurately, increasing user burden and complexity.

Innovation Solution

A system that identifies the position and posture of a camera capturing a real space, allowing for the display of virtual images corresponding to objects on a display without relying on the precise arrangement of the objects, by using image data and depth information to determine the virtual image's position and orientation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the position and posture of objects in real space are used to determine virtual image display positions, then the virtual image can be accurately associated with the object, but the user burden increases due to the need for precise object arrangement

Engineering Contradiction:
Improveaccuracy of virtual image display positionVSAvoiduser burden in object arrangement
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent introduces a camera as an intermediary device to capture images of objects and the real space. Instead of directly using object position and posture, the system uses camera position and posture identification results as a mediator to determine virtual image display positions. This transfers the measurement task from the object itself to the camera, reducing user burden while maintaining accuracy

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces the mechanical arrangement system (manually positioning objects at precise locations) with an image-based identification system. The camera captures images and the system identifies camera position and posture from these images, substituting physical mechanical positioning with optical and computational methods

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If objects must be arranged at predetermined positions to display virtual images at desired positions, then the display accuracy is improved, but the device complexity and design freedom are reduced

Engineering Contradiction:
Improvedisplay accuracy of virtual informationVSAvoidcomplexity of object arrangement system
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent enables dynamic determination of virtual image display positions based on camera position and posture identification results. Instead of fixed predetermined positions, the system dynamically calculates display positions according to the captured image and identified camera parameters, allowing flexible object placement while maintaining display accuracy

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes the parameter basis for virtual image positioning from object-centric parameters (object position, object posture, object features) to camera-centric parameters (camera position, camera posture, captured image data). This parameter transformation simplifies the system by removing the need for complex object arrangement while preserving positioning accuracy

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11832000B2Recording medium, information processing system, and display method
Publication Date: 2023.11.28 KONAMI DIGITAL ENTERTAINMENT CO LTD
  • US11832000B2 patent drawing
  • US11832000B2 patent drawing
  • US11832000B2 patent drawing

AI summary

A program is executed by a processor causes the processor to identify at least one of a position and a posture of a first camera in a real space in which an object is arranged. The first camera is configured to capture an image of the real space. The program causes the processor to display, on a display, a first image generated based on a result of the image captured by the first camera; and display, at a position that is based on an identification result obtained by identifying the at least one of the position and the posture of the first camera within the display, a second image that corresponds to the object.