Silhouette-Based Object Tracking for Low-Cost VR

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Low-cost virtual reality systems face challenges in accurately tracking user movement due to limitations in sensing technology, leading to reduced precision in monitoring user position within virtual scenes.

Innovation Solution

A tracking system comprising a trackable device with a first orientation sensor and a tracking device with a second orientation sensor, image sensor, and processing circuit, which calculates a two-dimensional silhouette of the trackable device's three-dimensional shape to accurately allocate its coordinates within an image captured by the image sensor.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If low-cost sensing technology is used in virtual reality systems, then the system cost is reduced, but the tracking precision and movement detection accuracy deteriorate

Engineering Contradiction:
Improvesystem costVSAvoidtracking precision
Core Design Contradiction:
Ease of manufactureVSMeasurement precision

Solution Approach 1:

The patent creates a two-dimensional silhouette copy of the trackable device based on its three-dimensional shape and orientation data. This silhouette serves as a template that can be efficiently matched against image sensor data, enabling accurate tracking without requiring expensive specialized sensors. The silhouette copying approach allows low-cost systems to achieve precision comparable to high-end systems.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent transforms the three-dimensional tracking problem into a two-dimensional solution by projecting the 3D shape of the trackable device into a 2D silhouette. This dimensionality reduction simplifies the tracking computation and allows the use of simpler, lower-cost sensors while maintaining tracking accuracy. The 2D silhouette serves as an intermediate representation that bridges the gap between simple image capture and complex 3D tracking.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Device complexity

If simple orientation sensors are used in low-cost tracking systems, then the device complexity is reduced, but the ability to accurately detect user movement and orientation deteriorates

Engineering Contradiction:
Improvesensor complexityVSAvoidmovement detection accuracy
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The patent merges data from multiple simple sensors (orientation sensor in the trackable device and image sensor in the tracking device) to achieve reliable tracking. By combining the orientation information from the low-cost sensor with visual information from the image sensor, the system compensates for the limitations of individual simple sensors and achieves accurate movement detection.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent introduces a processing circuit that acts as an intermediary, transforming raw sensor data into meaningful tracking information. The processing circuit calculates the two-dimensional silhouette from orientation data and uses it to search the image for the trackable device, bridging the gap between simple sensor inputs and accurate tracking outputs.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Device complexity

If traditional image-based tracking without silhouette calculation is used, then the processing complexity is reduced, but the tracking precision under rotation or tilt deteriorates

Engineering Contradiction:
Improveprocessing complexityVSAvoidpositioning accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent implements a dynamic silhouette calculation that adapts to the orientation of the trackable device. Rather than using a fixed template, the system continuously updates the two-dimensional silhouette based on the current orientation data from the orientation sensor. This dynamic adaptation ensures that the silhouette template remains accurate even when the device rotates or tilts, maintaining tracking precision without requiring overly complex processing.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS10467456B2Tracking system for tracking an object based on silhouette
Publication Date: 2019.11.05 HTC CORP
  • US10467456B2 patent drawing
  • US10467456B2 patent drawing
  • US10467456B2 patent drawing

AI summary

A tracking system includes a trackable device and a tracking device. The trackable device has a three-dimensional shape. The trackable device includes a first orientation sensor for sensing a first orientation of the trackable device. The tracking device is communicated with the trackable device. The tracking device includes a second orientation sensor, an image sensor and a processing circuit. The second orientation sensor is configured to sense a second orientation of the tracking device. The image sensor configured to capture an image. The processing circuit is coupled with the second orientation sensor and the image sensor. The processing circuit is operable to calculate a two-dimensional silhouette corresponding to the three-dimensional shape according to the first orientation and the second orientation, and utilize the two-dimensional silhouette to search the image captured by the image sensor for allocating coordinates of the trackable device within the image.