Remote Control System Static Gesture Recognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing remote control systems for smart TVs require powerful processors and large memory due to complex image processing for gesture recognition, making them inefficient for operators who need to perform complicated gestures from a distance.

Innovation Solution

A remote control system that includes an object detection unit, an object determination unit, and a static gesture processing unit, which detects and determines gestures using depth images and a gesture database, allowing for simple gestures to generate control commands without the need for complex operations or high computational resources.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If complicated image processing operations are executed to generate operator skeleton, then gesture recognition accuracy is improved, but processor power and memory capacity requirements increase

Engineering Contradiction:
Improvegesture recognition accuracyVSAvoidprocessor power and memory capacity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts only the essential elements needed for gesture recognition (operator position, hand position, and basic skeleton points) from the full image, rather than processing the entire image. This is achieved by detecting the operator's bounding box and extracting only the relevant region, significantly reducing computational load while maintaining recognition accuracy.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The image processing is segmented into distinct stages: first detecting the operator's presence and bounding box, then extracting the hand region, and finally recognizing gestures. This segmentation allows each stage to process only necessary data, reducing overall computational complexity while maintaining accuracy.

Inventive Principle:
Principle #1Segmentation

2Manufacturing precision

If complicated gestures are required for remote control, then control precision is improved, but ease of operation deteriorates

Engineering Contradiction:
Improvecontrol precisionVSAvoidgesture complexity
Core Design Contradiction:
Manufacturing precisionVSEase of operation

Solution Approach 1:

The patent uses partial action by requiring only simple hand movements (raising hand to specific positions) rather than complex gesture sequences. The system recognizes gestures based on hand position relative to the operator's body, requiring minimal movement while maintaining control precision through multiple recognizable positions.

Inventive Principle:
Principle #16Partial or excessive action

3Ease of operation

If simple gestures are used for remote control, then ease of operation is improved, but control precision deteriorates

Engineering Contradiction:
Improvegesture simplicityVSAvoidcontrol precision
Core Design Contradiction:
Ease of operationVSManufacturing precision

Solution Approach 1:

The patent adds spatial dimensionality to simple gestures by recognizing hand positions in different locations relative to the operator's body (e.g., left side, right side, center, different heights). This transforms simple hand-raising actions into precise control commands by utilizing the spatial dimension, maintaining control precision while keeping gestures simple.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS10802594B2Remote control system and method of generating a control command according to at least one static gesture
Publication Date: 2020.10.13 EYS3D MICROELECTRONICS CO
  • US10802594B2 patent drawing
  • US10802594B2 patent drawing
  • US10802594B2 patent drawing

AI summary

A remote control system includes an object detection unit, an object determination unit, and a static gesture processing unit. The object detection unit detects an object corresponding to an operator according to a depth image including the operator and a face detection result corresponding to the operator. The object determination unit utilizes a combination of a gesture database, a color image of the object, and a two-dimensional image corresponding to the depth map to determine a gesture formed by the object when the operator moves the object to a predetermined position. The operator moves the object to the predetermined position and pulls the object after the operator moves the object to the predetermined position within a first predetermined period. The static gesture processing unit generates a first control command to control an electronic device according to at least one static gesture determined by the object determination unit.