AR Display Positioning via User Image Analysis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing augmented reality techniques fail to effectively display virtual information in consideration of the user's position, leading to a lack of realism for viewers observing object-use actions, such as games, where the user's and object's images are not accurately positioned relative to each other.

Innovation Solution

A system that uses a first camera to capture the user's image and identify their position, allowing for the precise display of a user image and an object image at corresponding positions on a display, creating a composite image that accurately represents the user and object's spatial relationship.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the image corresponding to the object is displayed without consideration of user position, then the display process is simple, but the sense of reality for viewers is insufficient

Engineering Contradiction:
Improvesense of realityVSAvoiddisplay process complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent replaces complex mechanical marker-based alignment systems with an image processing approach that uses the user's captured image to automatically determine display positions. The processor identifies the user's position from the captured image and uses this information to position the object image, eliminating the need for physical markers and complex mechanical alignment mechanisms.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent creates a composite image by copying and combining the user's captured image with the object image. The user's image is processed to extract position information, and this copied position data is then used to accurately place the object image in the composite, maintaining spatial relationships without requiring physical markers.

Inventive Principle:
Principle #26Copying

2Measurement precision

If marker-based alignment is used to position object images, then positioning accuracy is improved, but the design and manufacturing complexity increases

Engineering Contradiction:
Improvepositioning accuracyVSAvoidcard design complexity
Core Design Contradiction:
Measurement precisionVSEase of manufacture

Solution Approach 1:

The patent extracts position information directly from the user's captured image without requiring separate markers. The processor identifies the user's position, orientation, and scale from the image data itself, removing the need for markers to be attached to cards or objects, thereby simplifying card design and manufacturing.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The user's captured image serves as an intermediary that carries position and orientation information. Instead of using markers as intermediaries, the system processes the user's image to extract spatial relationships, which then mediate the positioning of the object image in the composite, eliminating the need for physical markers on cards.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Reliability

If the user's position is identified and used for display, then the sense of reality is enhanced, but the processing time and computational complexity increase

Engineering Contradiction:
Improvesense of realityVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent performs preliminary processing of the user's captured image to extract position, orientation, and scale information before combining it with the object image. By pre-processing the user's image to identify spatial parameters, the system prepares the necessary data in advance, reducing the computational burden during the final composite image generation and display stages.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11562564B2Recording medium, information processing system, and display method
Publication Date: 2023.01.24 KONAMI DIGITAL ENTERTAINMENT CO LTD
  • US11562564B2 patent drawing
  • US11562564B2 patent drawing
  • US11562564B2 patent drawing

AI summary

A program executed by a processor causes the processor to identify, based on a result of an image captured by a first camera configured to capture an image of a user in a real space, a position of the user; display, based on the result of the image captured by the first camera, on a display, a first image representative of the user; and display, at a position that is based on an identification result obtained by identifying the position of the user, a second image that corresponds to an object in the real space.