Handheld Camera Orientation Estimation Using Retroreflective Markers

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional marker identification technologies for estimating the position and orientation of an operation device in a real space require multiple cameras to be fixed in place, making the setup time-consuming and complex.

Innovation Solution

A simplified orientation and position estimation system using a movable image capturing unit with a stereoscopic image providing unit, detection section, specifying section, estimation section, and image generation section, which includes a contact portion for the user's face and retroreflective markers for enhanced detection and estimation accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If multiple cameras are fixed in place to capture markers, then position and orientation estimation accuracy is improved, but system complexity and setup time increase

Engineering Contradiction:
Improveposition and orientation estimation accuracyVSAvoidsystem configuration complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

Instead of fixing multiple cameras to capture markers, the patent inverts the approach by making the image capturing unit movable and handheld, allowing a single camera to capture markers by moving it to different positions. This reduces system complexity while maintaining estimation accuracy through multiple capture points.

Inventive Principle:
Principle #13The other way round (Inversion)

Solution Approach 2:

The patent transforms the static camera system into a dynamic handheld system. The image capturing unit can be moved freely by the user to capture markers from different positions, replacing the need for multiple fixed cameras while achieving the same measurement objectives.

Inventive Principle:
Principle #15Dynamics

2Measurement precision

If multiple cameras are fixed in place to capture markers, then position and orientation estimation accuracy is improved, but setup time and effort increase

Engineering Contradiction:
Improveposition and orientation estimation accuracyVSAvoidsetup time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent inverts the conventional approach by making the camera movable rather than fixed. This allows a single camera to replace multiple fixed cameras, dramatically reducing setup time while maintaining the ability to capture markers from multiple positions for accurate estimation.

Inventive Principle:
Principle #13The other way round (Inversion)

Solution Approach 2:

The handheld image capturing unit allows the user to independently position and move the device to capture markers, eliminating the need for professional installation and configuration of multiple fixed cameras. The system becomes self-configurable through user movement.

Inventive Principle:
Principle #25Self-service

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This configuration allows for accurate estimation of the device's position and orientation with a simplified setup, enabling more versatile operations and reduced complexity in system arrangement.

Implementation Method 1

the detection subject portion may be made of a retroreflective material that reflects the predetermined light from the light-emitting section

Methodology Applied
Scientific EffectRetroreflection: Retroreflector

Data Source

PatentUS11272152B2Orientation and/or position estimation system, orientation and/or position estimation method, and orientation and/or position estimation apparatus
Publication Date: 2022.03.08 NINTENDO CO LTD
  • US11272152B2 patent drawing
  • US11272152B2 patent drawing
  • US11272152B2 patent drawing

AI summary

The orientation and/or position estimation system includes: a movable operating unit configured to be held by a user and having an image capturing section; and a stereoscopic image providing unit including a display portion configured to display a stereoscopic image, a contact portion configured to come into contact with a part of a face of a user who is viewing the stereoscopic image, and a detection subject portion configured to be captured by the image capturing section. A detection subject portion image in the image captured by the image capturing section is detected and the position and the orientation of the movable image capturing unit are estimated on the basis of the detection subject portion image. On the basis of a result of the estimation, the stereoscopic image is generated and displayed.