Smart Glasses Eye Behavior Recognition for Dynamic Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current eye tracker technologies face limitations in accuracy, scope of application, cost, data processing complexity, and user experience due to factors like head movement, environmental interference, and high apparatus costs, making them unsuitable for dynamic environments and personalized control demands.

Innovation Solution

An apparatus control method utilizing smart glasses to acquire facial images, perform eye behavior recognition, and determine target control instructions based on eye behavior information, enabling personalized control of devices such as smart home appliances and multimedia resources.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional eye tracker technology is used, then eye movement tracking is achieved, but accuracy deteriorates due to head movement and environmental interference

Engineering Contradiction:
Improveeye movement tracking accuracyVSAvoidhead movement and environmental interference
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The patent introduces facial images as an intermediary reference frame. Instead of directly tracking eye movements in dynamic conditions, the system captures facial images containing eye positions, processes them to extract eye behavior information, and uses this intermediate data for control instructions. This intermediary approach isolates the measurement from direct head movement interference.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces traditional mechanical eye tracker hardware with a software-based image processing system. By using facial image capture and computational analysis to determine eye behavior, the system eliminates the need for complex mechanical tracking apparatus that are sensitive to head movement and environmental factors.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Ease of operation

If traditional control methods (voice control, mobile APP control, remote control) are used, then apparatus control is achieved, but personalized control deteriorates

Engineering Contradiction:
Improveapparatus control convenienceVSAvoidpersonalized control capability
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The system continuously captures facial images and analyzes eye behavior in real-time, creating a feedback loop that adapts to user preferences and behaviors. This feedback mechanism enables personalized control by learning from and responding to individual eye movement patterns and attention focus.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system automatically analyzes eye behavior information and generates control instructions without requiring explicit user commands. The apparatus serves itself by interpreting eye gaze patterns and autonomously executing control actions, eliminating the need for voice commands, mobile APP operations, or remote control usage.

Inventive Principle:
Principle #25Self-service

3Device complexity

If data processing complexity is reduced, then system simplicity is improved, but measurement precision deteriorates

Engineering Contradiction:
Improvedata processing complexityVSAvoideye behavior recognition accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The system extracts only the essential eye behavior information from facial images, focusing on key features such as gaze direction and eye movement patterns. By extracting only the necessary data elements rather than processing complete image data, the system reduces computational complexity while maintaining measurement precision.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS20250014386A1Apparatus control method, model training method and electronic apparatus
Publication Date: 2025.01.09 BEIJING XIAOMI MOBILE SOFTWARE CO LTD
  • US20250014386A1 patent drawing
  • US20250014386A1 patent drawing
  • US20250014386A1 patent drawing

AI summary

An apparatus control method includes: acquiring one or more facial images; performing eye behavior recognition based on at least one of the facial images to obtain eye behavior information on at least one of the facial images; determining a target control instruction based on eye behavior information on the one or more facial images; and performing apparatus control based on the target control instruction.