Gyro Sensor Correction for Gesture Recognition Accuracy

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Portable information processing apparatuses face challenges in accurate recognition processing due to varying relative positions between the device and the user, leading to erroneous recognition of gestures when the device moves relative to a stationary detection target.

Innovation Solution

Incorporating an image pick-up portion, a recognition module, a processing module, and a correction module that utilizes a gyro sensor to detect and correct changes in posture, ensuring accurate recognition by differentiating between actual movement of the detection target and movement of the device itself.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If gesture recognition is performed using a hand-held device, then the user can interact with the device using free hand gestures, but the relative position between the user and the device varies causing recognition errors

Engineering Contradiction:
Improvegesture interaction capabilityVSAvoiddetection target position accuracy
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The system continuously detects device posture changes using a gyro sensor and feeds this information back to the recognition module. The recognition module then corrects the detection target position based on the detected posture changes, creating a closed-loop feedback system that maintains recognition accuracy despite device movement.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The gyro sensor acts as an intermediary that detects device posture changes and provides correction data to the recognition module. This intermediary component enables the system to compensate for device movement without directly affecting the gesture recognition process, maintaining both versatility and precision.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If the device is held and operated portably, then ease of operation is improved, but the device cannot be fixed and position variation occurs

Engineering Contradiction:
Improveportable operation convenienceVSAvoiddevice position stability
Core Design Contradiction:
Ease of operationVSStability of the object's composition

Solution Approach 1:

The patent replaces the mechanical approach of physically stabilizing the device with a computational approach. Instead of fixing the device mechanically, the system uses software-based correction using gyro sensor data to compensate for position variations, maintaining portability while achieving stability through calculation rather than physical constraint.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Measurement precision

If correction processing is performed for posture changes, then recognition accuracy is improved, but device complexity increases

Engineering Contradiction:
Improvedetection target position accuracyVSAvoidsystem structure complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The gyro sensor, already present in modern portable devices for other functions, is utilized for an additional purpose: detecting posture changes for gesture recognition correction. This multi-functional use of an existing component improves recognition accuracy without significantly increasing device complexity, as the sensor hardware is already integrated.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This solution effectively reduces erroneous recognition of gestures by accurately accounting for device posture changes, ensuring precise processing even when the device is moved during operation.

Implementation Method 1

the detection portion may include a gyro sensor

Methodology Applied
Scientific EffectGyroscopic effect: Gyroscope

Data Source

PatentUS9697419B2Information processing apparatus, non-transitory storage medium encoded with computer readable information processing program, information processing system, and information processing method
Publication Date: 2017.07.04 NINTENDO CO LTD
  • US9697419B2 patent drawing
  • US9697419B2 patent drawing
  • US9697419B2 patent drawing

AI summary

A portable information processing apparatus according to one embodiment includes at least an image pick-up portion, a recognition module recognizing a detection target which includes a part of a user within an image obtained by the image pick-up portion and outputting change over time in position of recognition of the detection target, a processing module performing processing in accordance with change over time in position of recognition of the detection target, and a correction module correcting change over time in position of the detection target output by the recognition means in accordance with change in posture of the information processing apparatus.