3D Position Tracking via Electronic Marker and Image Sensor

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional interactive computer systems only provide two-dimensional tracking of user input devices, failing to account for movement forward or backward, and often interrupt the user experience with a distracting electronic marker flash.

Innovation Solution

A method and system for x, y, and z tracking using an electronic marker on a display screen and an image sensor on an input device, allowing for three-dimensional interaction by establishing a calibration position and calculating relative positions through image capture and cross-correlation, with the electronic marker flashed intermittently or continuously to minimize user distraction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If conventional two-dimensional tracking is used, then the system complexity is low, but the interaction capability with virtual elements is limited

Engineering Contradiction:
Improveinteraction capabilityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent transitions from two-dimensional tracking to three-dimensional tracking by adding depth information (z-axis) to the position tracking system. This enables the input device to detect movement forward and backward relative to the display screen, providing immersive spatial interaction while maintaining reasonable system complexity through structured calibration and relative position calculation methods.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Measurement precision

If the electronic marker is flashed continuously to enable tracking, then the position tracking accuracy is improved, but the user distraction increases

Engineering Contradiction:
Improveposition tracking accuracyVSAvoiduser distraction
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The patent employs periodic flashing of the electronic marker rather than continuous flashing. The marker is flashed at specific intervals during the display of program frames, which maintains sufficient position tracking accuracy while minimizing user distraction. The timing of the flashes is coordinated with the display refresh rate to ensure accurate capture without creating noticeable interruptions.

Inventive Principle:
Principle #19Periodic action

3Object-affected harmful factors

If the electronic marker flash is made imperceptible to minimize distraction, then the user experience is improved, but the tracking reliability may be compromised

Engineering Contradiction:
Improveuser distractionVSAvoidtracking reliability
Core Design Contradiction:
Object-affected harmful factorsVSReliability

Solution Approach 1:

The patent adjusts the parameters of the electronic marker flash, including duration, intensity, and timing, to achieve a balance between imperceptibility to users and reliability for tracking. By optimizing these parameters, the flash is brief enough and subtle enough not to distract users, yet sufficient to be detected reliably by the image sensor for accurate position calculation.

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables immersive three-dimensional interaction by tracking the input device's position in all axes, enhancing the gaming experience without interrupting the user's view, as the marker's flash is minimized or made imperceptible, allowing seamless movement within virtual environments.

Implementation Method 1

The image of the electronic marker is captured by the image sensor

Methodology Applied
Scientific EffectLight reflection: Reflection

Data Source

PatentUS7978174B2System and method for interactive three-dimensional position tracking
Publication Date: 2011.07.12 AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE LTD
  • US7978174B2 patent drawing
  • US7978174B2 patent drawing
  • US7978174B2 patent drawing

AI summary

A system and method for tracking the x, y and z coordinates of a position of an input device in an interactive computer system is disclosed. An image sensor situated on the input device captures images of an electronic marker displayed on a display screen. As the position of the input device changes, the features of the electronic marker as captured by the image sensor also change. Images of the electronic marker captured during game play are compared to a calibration image of the electronic marker to determine current x, y and z coordinates of positions of the input device. The game display is updated to reflect the movements of the input device.