Game Controller Sensor Fusion for Accurate Motion Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional game apparatuses using gyroscopic and acceleration sensors struggle to accurately detect the attitude and motion of an input device, leading to incorrect representation of player gestures, especially when the device is moved in complex paths like zigzags, as they rely solely on either sensor output.

Innovation Solution

A game apparatus that utilizes both acceleration and gyroscopic sensors to obtain operation data, including angular speed and acceleration data, to control the attitude and position of a virtual object, determining if acceleration data satisfies predetermined conditions to initiate specific motions, thereby enhancing the detection of complex movements and providing a more natural gaming experience.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If only acceleration sensor output is used to detect motion, then the device structure is simple, but the attitude detection accuracy deteriorates when the device is moving

Engineering Contradiction:
Improvesensor configurationVSAvoidattitude detection accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent combines acceleration sensor and gyroscopic sensor outputs to detect both motion and attitude of the input device. The acceleration sensor detects linear acceleration while the gyroscopic sensor detects angular velocity, and their outputs are integrated to achieve accurate attitude detection during movement, resolving the contradiction between simple device structure and accurate measurement.

Inventive Principle:
Principle #5Merging (Combining)

2Measurement precision

If only gyroscopic sensor output is used to detect attitude, then the attitude detection is continuous, but the motion direction detection becomes difficult

Engineering Contradiction:
Improveattitude detection continuityVSAvoidmotion direction information
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The patent merges acceleration sensor data (which provides motion direction information) with gyroscopic sensor data (which provides continuous attitude information). The acceleration data compensates for the loss of motion direction information, while the gyroscopic data maintains continuous attitude detection, thus resolving the contradiction between measurement precision and information loss.

Inventive Principle:
Principle #5Merging (Combining)

3Measurement precision

If both acceleration sensor and gyroscopic sensor are used, then the detection accuracy is improved, but the device complexity increases

Engineering Contradiction:
Improvemotion and attitude detection accuracyVSAvoidsensor system configuration
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent makes the sensor system multi-functional by using the acceleration sensor for both motion detection and attitude correction, and the gyroscopic sensor for both attitude detection and motion analysis. This universal usage of sensors achieves high detection accuracy while minimizing the increase in device complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

4Measurement precision

If acceleration sensor is used to detect motion, then the motion intensity can be detected, but the attitude change during motion cannot be correctly detected

Engineering Contradiction:
Improvemotion intensity detectionVSAvoidattitude change information
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The patent combines acceleration sensor output (providing motion intensity) with gyroscopic sensor output (providing attitude change information). The integration of both sensor outputs ensures that neither motion intensity nor attitude change information is lost, resolving the contradiction between motion detection capability and attitude information preservation.

Inventive Principle:
Principle #5Merging (Combining)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach allows for more accurate reflection of player input, improving the operability and enjoyment of games by correctly detecting and responding to both the position and attitude of the input device, even during complex movements, and enhancing the realism of player actions.

Implementation Method 1

an input device (8) including a gyroscopic sensor (55)

Methodology Applied
Scientific EffectGyroscopic effect: Gyroscope

Implementation Method 2

an acceleration sensor (37)

Methodology Applied
Scientific EffectAcceleration sensing: Accelerometer

Data Source

PatentUS8306768B2Game apparatus and computer-readable recording medium recording game program for controlling attitude and position of an object in a virtual space
Publication Date: 2012.11.06 NINTENDO CO LTD
  • US8306768B2 patent drawing
  • US8306768B2 patent drawing
  • US8306768B2 patent drawing

AI summary

Operation data including at least acceleration data and angular speed data is obtained from an input device including at least an acceleration sensor and a gyroscopic sensor. Next, at least one of an attitude and a position of a predetermined object in a virtual space is controlled based on the angular speed data. When at least one of the attitude and the position of the predetermined object is controlled based on the angular speed data, it is determined whether or not the acceleration data satisfies predetermined conditions. As a result, if the acceleration data satisfies the predetermined conditions, the predetermined object is caused to start a predetermined motion.