Gesture Load Control Using Skeletal Tracking and Regional Mapping

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current load control systems require users to manage multiple devices and have limited control due to predefined interfaces and limited instructions, making them inconvenient and not commercially viable, especially with the experimental nature of gesture-based systems that lack essential features.

Innovation Solution

A gesture-based load control system that uses motion capture devices to identify user gestures and send control instructions to load control devices, allowing users to control electrical loads without remote controls by analyzing images and comparing skeletal outlines to predefined gestures, enabling regional mapping and vector-based identification of devices and instructions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If traditional load control systems use multiple devices and predefined interfaces, then control functionality is provided, but user convenience deteriorates and system complexity increases

Engineering Contradiction:
Improveuser convenienceVSAvoidsystem complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent combines multiple control functions (device identification, gesture recognition, and control instruction generation) into a single integrated system. The motion capture device captures user gestures, the processor identifies the targeted load control device, and control instructions are automatically generated and transmitted, eliminating the need for separate remote controls or complex device management interfaces.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system enables users to naturally control electrical loads through intuitive gestures without requiring them to learn complex interfaces or manage multiple devices. The processor automatically identifies which device the user intends to control based on gesture direction and generates appropriate control instructions, making the system adapt to user intent rather than requiring users to adapt to system constraints.

Inventive Principle:
Principle #25Self-service

2Measurement precision

If gesture-based control is implemented without regional mapping, then system simplicity is maintained, but control precision and device identification accuracy deteriorate

Engineering Contradiction:
Improvegesture recognition accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system performs preliminary regional mapping during system setup or initialization, dividing the environment into distinct regions and associating each region with specific load control devices. This pre-established spatial framework enables accurate device identification during gesture recognition without requiring complex real-time calculations, as the processor can directly map gesture directions to pre-defined regions and their associated devices.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11068066B2Gesture-based load control
Publication Date: 2021.07.20 LUTRON TECHNOLOGY COMPANY LLC
  • US11068066B2 patent drawing
  • US11068066B2 patent drawing
  • US11068066B2 patent drawing

AI summary

A load control system may include load control devices for controlling an amount of power provided to an electrical load. The load control devices may be capable of controlling the amount of power provided to the electrical load based on control instructions received from a gesture-based control device. The gesture-based control device may identify gestures performed by a user for controlling a load control device and provide control instructions to the load control device based on the identified gestures. The gestures may be identified based on images received from a motion capture device. A gesture may be associated with a scene that includes a configuration of one or more load control devices in a load control system. The user may perform one or more gestures to program the gesture-based control device.