In-Vehicle Mid-Air Gesture Verification for Safe User-Specific Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Ensuring safe driving while improving interaction experience in vehicles through mid-air gestures is a challenge due to the sensitivity of vehicle scenarios to safety and the need for precise user identification and response management.

Innovation Solution

A mid-air gesture-based interaction method that includes detecting user gestures, determining user attributes such as identity and location, and matching these attributes with appropriate response operations to ensure safe and targeted interactions, preventing unintended responses and enhancing user experience.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If the electronic apparatus directly responds to any mid-air gesture initiated by any user, then the interaction experience is improved, but the driving safety and information security deteriorate

Engineering Contradiction:
Improveinteraction experienceVSAvoiddriving safety
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The patent introduces an intermediary verification mechanism that checks user identity and gesture attributes before executing responses. This mediator layer prevents direct response to any gesture, ensuring that only authenticated gestures from authorized users trigger actions, thus maintaining both interaction quality and driving safety

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system performs preliminary verification of user identity and gesture attributes before executing any response operation. By checking user permissions and gesture validity in advance, the system prevents unsafe responses while maintaining smooth interaction experience for authorized users

Inventive Principle:
Principle #10Preliminary action

2Reliability

If the system verifies user identity and matches response operations, then the driving safety is improved, but the device complexity increases

Engineering Contradiction:
Improvedriving safetyVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The verification system is segmented into distinct functional modules: user identification module, gesture attribute detection module, matching logic module, and response execution module. This segmentation allows each component to handle specific tasks independently, making the complex verification process more manageable and maintainable

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The camera system serves multiple functions: capturing user images for identification, detecting mid-air gestures, and determining user location. This multi-functionality reduces the need for separate sensors and systems, thereby limiting the increase in device complexity while maintaining comprehensive verification capabilities

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If the camera detects user location and identity, then the user identification accuracy is improved, but the loss of time increases

Engineering Contradiction:
Improveuser identification accuracyVSAvoidverification time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs user identification and gesture verification in parallel before response execution. By preparing user context information and gesture attributes simultaneously rather than sequentially, the system reduces total verification time while maintaining high identification accuracy

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system uses the existing camera infrastructure and real-time image stream to perform both user identification and gesture detection without requiring additional dedicated sensors or separate processing systems. This self-service approach leverages available resources efficiently, minimizing time loss

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS12572221B2In-vehicle mid-air gesture-based interaction method, electronic apparatus, and system
Publication Date: 2026.03.10 HUAWEI TECH CO LTD
  • US12572221B2 patent drawing
  • US12572221B2 patent drawing
  • US12572221B2 patent drawing

AI summary

This application provides an in-vehicle mid-air gesture-based interaction method, an electronic apparatus, and a system, and relates to the field of intelligent vehicle technologies. The method includes: obtaining a first mid-air gesture detected by a camera; and starting, when a preset response operation corresponding to the first mid-air gesture matches a first user who initiates the first mid-air gesture, the preset response operation corresponding to the first mid-air gesture in response to the first mid-air gesture. The method can be used in an in-vehicle mid-air gesture-based interaction scenario, reduce a mid-air gesture misoperation rate, and ensure driving safety and interaction experience.