3D Gesture Control Zoning for Accurate Distance-Based Device Operation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current gesture recognition systems for controlling devices face challenges with accuracy and usability due to limitations in equipment used and image noise, requiring users to be close to sensors and using distinct audio commands for multiple devices, which restricts intuitive and distant operation.

Innovation Solution

A method and apparatus utilizing a depth sensor to create interaction zones in 3D space, allowing for gesture control of devices like kitchen cabinets through initializing and action zones, enabling control from a distance with improved accuracy and reduced need for close proximity or distinct audio commands.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If motion sensors with narrow detection fields are used to control devices, then detection accuracy is improved, but user convenience deteriorates as users must be very close to the sensor

Engineering Contradiction:
Improvedetection accuracyVSAvoiduser convenience
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent transitions from 2D image-based gesture recognition to 3D depth-based gesture recognition. By using depth sensors to capture three-dimensional spatial information, the system can accurately detect gestures from farther distances without compromising detection precision, thus resolving the contradiction between detection accuracy and user convenience.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent replaces traditional mechanical proximity sensors with depth sensing technology that uses optical fields (time-of-flight or structured light). This substitution enables the system to detect gestures at greater distances while maintaining high accuracy through 3D spatial mapping, eliminating the need for users to be very close to the device.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Adaptability or versatility

If multiple devices are controlled using audio sensors, then device versatility is improved, but operational complexity increases as distinct audio commands are required for each device

Engineering Contradiction:
Improvedevice versatilityVSAvoidoperational complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements a universal gesture control system where a single depth sensor and gesture recognition algorithm can control multiple devices. The system uses spatial zoning to differentiate between devices, allowing one gesture input mechanism to serve multiple functions without requiring device-specific commands, thus reducing operational complexity while maintaining versatility.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent creates virtual copies of physical space through 3D depth mapping, establishing virtual zones that correspond to different devices. This allows the system to distinguish between multiple devices through spatial positioning rather than requiring distinct audio commands for each, simplifying the user interface while maintaining the ability to control multiple devices.

Inventive Principle:
Principle #26Copying

3Ease of operation

If image-based gesture recognition is used, then gesture control capability is achieved, but recognition accuracy deteriorates due to image noise and inconsistent lighting

Engineering Contradiction:
Improvegesture control capabilityVSAvoidrecognition accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent replaces 2D image-based gesture recognition with 3D depth-based gesture recognition. By using time-of-flight or structured light depth sensing, the system captures accurate three-dimensional spatial information that is independent of lighting conditions, thereby maintaining high recognition accuracy while preserving gesture control capability.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent changes the fundamental parameter of gesture detection from 2D image coordinates to 3D depth coordinates. This parameter change allows the system to measure actual spatial positions and gesture movements in three dimensions, making recognition accurate and consistent regardless of lighting variations or image noise.

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables intuitive and cost-effective gesture control of devices from a distance, improving accuracy and usability by using depth sensors to define zones for gesture recognition, allowing multiple devices to be controlled with a single gesture, and reducing the risk of interference from background objects or noise.

Implementation Method 1

The gesture is captured using a depth sensor, in particular using a time-of-flight sensor or structured light sensor

Methodology Applied
Scientific EffectTime of Flight: Time of Flight

Data Source

PatentEP2921936B1Method and apparatus for gesture control of a device
Publication Date: 2018.11.28 MONSTER & DEVICES
  • EP2921936B1 patent drawingFigure 1
  • EP2921936B1 patent drawingFigure 2A~2C
  • EP2921936B1 patent drawingFigure 3

AI summary

The object of the present invention is a method for gesture control of a device, the method comprising the steps of: recognizing a gesture using a gesture recognition sensor having a given coverage area; controlling the device based on said recognized gesture; the method further comprising the steps of: defining an initializing zone in the area covered by the gesture recognition sensor; defining an action zone in the area covered by the gesture recognition sensor; associating said initializing zone with said action zone and said action zone with said controlled device; wherein the associated action zone is the first zone located in proximity to the controlled device and its associated initialization zone is located further away from the controlled device than the action zone; detecting a person the initializing zone and generating an event notifying that the initialization has been executed; detecting the person's gesture in the action zone and generating an action event by the respective action zone; sending a control signal to the controlled device when both the initialization has been executed and said action event has been generated.