Gesture Unlocking via Multi-Sensor Fusion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing electronic device unlocking methods using image sensors face challenges such as difficulty in identifying living bodies in certain scenarios and susceptibility to environmental interference, particularly with gesture control systems being influenced by ambient factors.

Innovation Solution

An electronic device that utilizes a combination of image and gesture sensors, along with temperature sensing and wearable device space information, to recognize and unlock based on predetermined and user-defined gestures, reducing environmental interference and improving control accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If image sensor is used for unlocking, then it can detect human face image, but it is easily affected by ambient light and difficult to identify living body in some scenarios

Engineering Contradiction:
Improveunlocking reliabilityVSAvoidambient light interference
Core Design Contradiction:
ReliabilityVSObject-affected harmful factors

Solution Approach 1:

The patent combines multiple sensing modalities (image sensor, gesture sensor, temperature sensor, space information from wearable device) into a unified recognition system. This multi-sensor fusion approach allows the system to cross-validate data sources and distinguish living bodies more reliably, overcoming the limitations of any single sensor type when affected by environmental factors.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The gesture sensor acts as an intermediary that detects hand gestures as a preliminary step before face recognition. This intermediate gesture detection provides an additional layer of verification that helps distinguish real human presence from environmental interference or fake images, thereby improving overall system reliability.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If gesture control is used, then it can provide contactless operation, but it is easily influenced by environment such as other humans or objects similar to hand shape

Engineering Contradiction:
Improvecontactless controlVSAvoidgesture recognition accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The system merges gesture recognition with multiple other detection methods including temperature sensing and space information from wearable devices. This combination allows the system to verify that the detected gesture originates from a legitimate user by cross-checking with temperature data (human body heat) and spatial positioning, thereby reducing false positives from environmental objects.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent adds additional dimensions of verification beyond simple gesture shape recognition. By incorporating temperature sensing (thermal dimension) and space information from wearable devices (spatial dimension), the system creates a multi-dimensional verification framework that significantly reduces environmental interference and improves gesture recognition precision.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Reliability

If physiological characteristics are used for unlocking, then it can provide secure authentication, but it requires registering all users' characteristics which is very troublesome

Engineering Contradiction:
Improveauthentication securityVSAvoiduser registration complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system uses a universal gesture-based authentication method that does not require user-specific physiological data registration. The same gesture recognition framework works for all users, eliminating the need for individual fingerprint or facial feature registration while maintaining secure authentication through multi-sensor verification.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system performs automatic multi-sensor verification without requiring manual user registration. The temperature sensor, gesture sensor, and space information from wearable devices automatically work together to verify user identity, eliminating the need for users to manually register their physiological characteristics.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS20230282023A1Electronic device unlocked and controlled by gesture recognition
Publication Date: 2023.09.07 PIXART IMAGING INC
  • US20230282023A1 patent drawing
  • US20230282023A1 patent drawing
  • US20230282023A1 patent drawing

AI summary

There is provided an electronic device capable of improving the difficulty of breaking a digital electronic lock and the accuracy of gesture control. The electronic device is unlocked according to gestures of a single hand or two hands, an operation hand, a gesture position, a staying time of gesture and a gesture variation of a user. The electronic device further improves the accuracy of gesture control in conjunction with an accessory pattern, temperature sensing and space information of a wearable device. The present disclosure further provides an electronic device that identifies legitimacy of moving the electronic device according to a variation sequence of 3-axis accelerations of an accelerometer.