Head-Mounted Display Gesture Passcode Unlocking Without Biometrics

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing head-mounted displays face challenges in unlocking features without the use of text input devices or biometric authentication, which are cumbersome or impractical, and require additional space and power, while also posing privacy concerns.

Innovation Solution

A multi-modal gesture-based unlocking mechanism using a plurality of sensors on the head-mounted display to detect a sequence of passcode gestures, including head orientation, eye state, hand gestures, and facial gestures, to authenticate and unlock features.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If traditional text input devices or biometric authentication are used for unlocking, then authentication reliability is improved, but device complexity and power consumption increase

Engineering Contradiction:
Improveauthentication reliabilityVSAvoiddevice complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent applies multi-functionality by utilizing existing sensors (camera, microphone, IMU) for multiple purposes: the camera detects both visual content and gestures for unlocking, the microphone captures audio for authentication and environmental awareness, and the IMU sensor provides both motion data for tracking and orientation data for gesture recognition. This eliminates the need for dedicated unlocking hardware while maintaining security.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system performs self-service authentication by automatically detecting gestures and processing authentication requests without requiring manual input through traditional interfaces. The sensors continuously monitor for unlocking gestures, and the system autonomously processes the authentication sequence, reducing the need for complex user interaction mechanisms.

Inventive Principle:
Principle #25Self-service

2Reliability

If additional sensors and authentication mechanisms are added, then security is improved, but power consumption increases

Engineering Contradiction:
ImprovesecurityVSAvoidpower consumption
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The system maintains continuous monitoring for unlocking gestures through the existing sensors without requiring additional power-intensive components. The camera, microphone, and IMU sensors operate continuously at low power to detect gestures, and only activate full processing when authentication is requested, ensuring continuous security monitoring with minimal power consumption.

Inventive Principle:
Principle #20Continuity of useful action

Solution Approach 2:

The system changes operational parameters by adjusting sensor sensitivity and processing intensity based on context. The sensors operate at baseline levels for continuous monitoring and increase processing intensity only when unlocking gestures are detected, optimizing the balance between security monitoring and power consumption.

Inventive Principle:
Principle #35Parameter changes

3Reliability

If biometric authentication is implemented, then authentication reliability is improved, but ease of operation deteriorates

Engineering Contradiction:
Improveauthentication reliabilityVSAvoidease of operation
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent replaces traditional mechanical or electronic authentication mechanisms (fingerprint scanners, password keyboards) with gesture-based authentication using the camera and microphone. Users authenticate through natural hand gestures and body movements rather than complex mechanical interactions, significantly improving ease of operation while maintaining security through the multi-sensor detection system.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS12585751B2Multi-modal gesture sequence passcode unlocking apparatus for a head-mounted display
Publication Date: 2026.03.24 STMICROELECTRONICS INT NV
  • US12585751B2 patent drawing
  • US12585751B2 patent drawing
  • US12585751B2 patent drawing

AI summary

An example apparatus, a computer-implemented method, and a computer program product for utilizing a plurality of sensors on a head-mounted display to unlock locked features of the head-mounted display are provided. The example apparatus includes a head-mounted display, a plurality of sensors mounted on the head-mounted display and configured to detect a gesture of a user of the head-mounted display, and a multi-modal unlocking model. The multi-modal unlocking model further includes one or more processors and one or more storage devices storing instructions that are operable, when executed by the one or more processors, to cause the one or more processors to detect a gesture sequence passcode comprising one or more passcode gestures in a series of passcode gestures delimited by a physical interaction with the head-mounted display, and unlock a locked feature of the head-mounted display based on the gesture sequence passcode.