3D Controller Tracking with Segmented Color Clusters

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Conventional game controllers with single color detecting regions face issues with color blending and geometry determination, leading to unreliable tracking in 3D space, and have complex architectures and high costs.

Innovation Solution

The use of controllers with multiple color clusters on side surfaces and concentric circular areas on top surfaces, along with dual cameras and an object tracking algorithm, enables real-time tracking of movements and rotations by distinguishing between color clusters and performing scale calibration to improve tracking accuracy and reliability.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If a single color detecting region is used on the game controller, then the device architecture is simpler, but color blending problems occur when encountering color interference from the image background

Engineering Contradiction:

Improvedevice architectureVSAvoidtracking reliability

Core Design Contradiction:

Device complexityVSReliability

Solution Approach 1:

The controller is divided into multiple color clusters (e.g., three color clusters) instead of using a single color detecting region. Each color cluster serves as an independent tracking target, allowing the system to distinguish between the controller and background elements, thereby eliminating color blending problems while maintaining reliable tracking.

Inventive Principle:

Principle #1Segmentation

2Ease of manufacture

If a single color detecting region is used on the game controller, then the manufacturing cost is lower, but the geometry and shape determination becomes unreliable

Engineering Contradiction:

Improvemanufacturing costVSAvoidgeometry determination accuracy

Core Design Contradiction:

Ease of manufactureVSMeasurement precision

Solution Approach 1:

The controller incorporates multiple color clusters arranged in specific geometric patterns. By analyzing the relative positions and configurations of these multiple clusters, the system can accurately determine the controller's geometry, shape, and orientation without requiring complex manufacturing processes.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The solution transitions from 2D color detection to 3D spatial tracking by using multiple color clusters distributed in three-dimensional space. This enables the system to determine not only the controller's position but also its orientation and rotation in 3D space, significantly improving geometry determination accuracy.

Inventive Principle:

Principle #17Another dimension (Dimensionality change)

3Device complexity

If a single color detecting region is used on the game controller, then the device structure is simpler, but the tracking fails when the controller is held toward the camera

Engineering Contradiction:

Improvedevice structureVSAvoidtracking reliability during movement

Core Design Contradiction:

Device complexityVSReliability

Solution Approach 1:

The controller is segmented into multiple color clusters positioned at different locations and orientations. This segmentation ensures that at least some color clusters remain visible and detectable even when the controller is held toward the camera or during various movements, preventing complete tracking failure.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

Different color clusters are positioned at different locations on the controller with distinct local characteristics. This local differentiation ensures that regardless of the controller's orientation or movement, the camera can detect at least some color clusters, maintaining tracking reliability throughout the full range of motion.

Inventive Principle:

Principle #3Local quality

4Measurement precision

If multiple color clusters are used on the controller, then the tracking accuracy and reliability improve, but the device complexity increases

Engineering Contradiction:

Improvetracking accuracyVSAvoiddevice architecture

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

The controller is divided into multiple color clusters that are independently detectable by the camera system. This segmentation enables the tracking algorithm to identify and track each cluster separately, significantly improving tracking accuracy and reliability while the modular nature of the solution keeps the overall device architecture manageable.

Inventive Principle:

Principle #1Segmentation

Data Source

PatentUS9182813B2Image-based object tracking system in 3D space using controller having multiple color clusters

Publication Date: 2015.11.10 ULSEE

AI summary

Image-based object tracking system includes at least a controller with two or more color clusters, an input button, a processing unit with a camera, an object tracking algorithm and a display. Camera is configured to capture images of the controller, the processing unit is connected to display to display processed image contents, the controller is directly interacting with displayed processed image content. The controller can have two or three color clusters located on a side surface thereof and two color clusters having concentric circular areas located at a top surface thereof, the color of the first color cluster can be the same as or different from the color of the third color cluster. An object tracking method with or without scale calibration is also provided, which includes color learning and color relearning, image capturing, separating and splitting of the controller and the background, object pairing procedure steps on the controller.