Virtual Reality Controller Orientation Detection Using Fiducial Markings

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current gesture recognition technologies face challenges in accurately determining the spatial location and orientation of objects, particularly in real-time applications like virtual reality, where seamless human-computer interaction is required for enhanced user experiences.

Innovation Solution

The proposed solution involves a device with a structure comprising a shaft, a tsuba, and a handgrip, where the tsuba's projection onto the shaft in an image indicates orientation, and fiducial markings aid in determining the 3D spatial location and orientation, utilizing 3D imaging systems to process depth maps and images for precise object and user posture analysis.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional 2D image processing is used for gesture recognition, then device complexity is reduced, but measurement precision of spatial location and orientation deteriorates

Engineering Contradiction:
Improvespatial location and orientation determinationVSAvoidimaging and processing system
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent introduces fiducial markings as an intermediary element attached to the object. These markings serve as a mediator between the 2D imaging system and the 3D spatial information, enabling accurate orientation determination from 2D images without requiring complex 3D imaging hardware. The fiducial markings translate spatial orientation into detectable 2D image features.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent projects the 3D orientation information onto a 2D plane through the fiducial markings' projection pattern. By encoding orientation data in the 2D projection of the fiducial markings, the system achieves 3D measurement capability using 2D imaging, effectively adding dimensional information without requiring 3D cameras.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Measurement precision

If 3D imaging systems with depth maps are used, then measurement precision of object orientation is improved, but use of energy and computational resources increases

Engineering Contradiction:
Improveobject orientation determinationVSAvoidcomputational processing energy
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent extracts only the essential orientation information from the imaging data by focusing on the fiducial markings' projection pattern. Instead of processing entire depth maps or full 3D point clouds, the system extracts orientation data specifically from the fiducial marking features, significantly reducing computational energy requirements while maintaining precision.

Inventive Principle:
Principle #2Taking out (Extraction)

3Measurement precision

If complex fiducial markings are used for accurate orientation detection, then measurement precision is improved, but manufacturing precision requirements increase

Engineering Contradiction:
Improveorientation detection accuracyVSAvoidfiducial marking fabrication
Core Design Contradiction:
Measurement precisionVSManufacturing precision

Solution Approach 1:

The patent employs asymmetric fiducial marking patterns that are inherently sensitive to orientation changes. The asymmetric design ensures that even small orientation variations produce detectable changes in the projection pattern, achieving high measurement precision with simple, easily manufacturable marking structures that do not require tight tolerances.

Inventive Principle:
Principle #4Asymmetry

Data Source

PatentEP2281228B1Controlling virtual reality
Publication Date: 2017.09.27 MICROSOFT INT HLDG BV
  • EP2281228B1 patent drawingFigure 1A~1B
  • EP2281228B1 patent drawingFigure 1C
  • EP2281228B1 patent drawingFigure 2A~2C

AI summary

A method of interfacing a person with a computer, the method comprising: providing the person with a device having: a shaft having an axis; a tsuba connected to the shaft and having a first side that extends away from the axis and faces the shaft; and a handgrip on a second side of the tsuba opposite the first side; acquiring an image of the device; determining an orientation of the device responsive to the image; and generating an action by the computer responsive to the orientation.