Head Gesture Recognition via Particle Filter Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing user interfaces for information processing devices are complex and require multiple buttons for input, lacking natural movement-based input methods, which limits user interaction diversity and precision.

Innovation Solution

An information processing device equipped with an image capturing device for tracking head movements, a tracking processing unit to estimate object contours, and a gesture detection unit to analyze time-dependent changes in head orientation or position, allowing for precise gesture recognition and corresponding process execution.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If traditional button-based user interfaces are used, then device functionality can be implemented, but the interface complexity increases and natural input becomes difficult

Engineering Contradiction:
Improvenatural inputVSAvoidinterface complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent replaces mechanical button presses with optical detection of head movements and gestures. The image capturing device detects natural head movements, and the control unit translates these movements into input signals, eliminating the need for physical buttons while maintaining input functionality.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces head movement and gesture recognition as an intermediary between the user and the device. Instead of direct button pressing, the user's natural head movements are captured by the image capturing device and converted into control signals by the control unit, providing a more natural interface.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If multiple buttons are provided for input, then more functions can be accessed, but the input process becomes more complex

Engineering Contradiction:
Improveinput methodsVSAvoidinput process
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent makes the image capturing device serve multiple functions: it captures images for normal display purposes and simultaneously detects head movements and gestures for input control. This multi-functionality eliminates the need for separate input devices while providing versatile input methods.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent enables dynamic input through continuous detection of head movements and gestures. The control unit monitors changes in head position and orientation in real-time, allowing users to interact with the device through natural, dynamic movements rather than static button presses.

Inventive Principle:
Principle #15Dynamics

3Ease of operation

If head gesture recognition is implemented, then natural input is enabled, but detection precision may be compromised

Engineering Contradiction:
Improvegesture inputVSAvoidgesture detection accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The control unit continuously monitors head movement data from the image capturing device and provides real-time feedback by translating movements into corresponding input signals. This feedback mechanism allows for precise interpretation of gesture intent while maintaining natural input capabilities.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent detects changes in head position parameters (coordinates, orientation angles) over time to distinguish intentional gestures from normal movement. By analyzing parameter changes and their temporal patterns, the system achieves accurate gesture recognition while maintaining ease of operation.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentEP2400370B1Information processing device and information processing method
Publication Date: 2018.08.29 SONY INTERACTIVE ENTERTAINMENT LLC
  • EP2400370B1 patent drawingFigure 1~2
  • EP2400370B1 patent drawingFigure 3~4
  • EP2400370B1 patent drawingFigure 5

AI summary

An image acquisition unit 20 of an information processing device 14 acquires data for a moving image including an image of a user and captured by an image capturing device 12. A tracking processing unit 26 uses a particle filter to perform visual tracking in the moving image so as to estimate a head contour of the user. A gesture detection unit 28 identifies a facial region in an area inside the head contour, acquires a parameter indicating the orientation of the face, and keeping a history of parameters. When time-dependent change in the orientation of the face meets a predetermined criterion, it is determined that a gesture is made. The output data generation unit 30 generates output data dependent on a result of detecting a gesture. The output control unit 32 controls the generated output data so as to display the data on the display 16, for example.