Eye-Gaze Notification Handling for Touch-Free Message Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing interaction methods, such as touch controls, are inconvenient for users who cannot physically interact with electronic devices, particularly in one-handed operations or when touch is not possible.
Innovation Solution
The method utilizes eye movement recognition to determine user interest in notification messages by tracking gaze points and durations, enabling contactless interaction through eye movements to display or unfold notification content.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If touch control is used for interaction, then operation precision is improved, but ease of operation deteriorates for users who cannot physically touch the device
Solution Approach 1:
The patent replaces the mechanical touch control system with an optical recognition system. Instead of requiring physical contact with the display screen, the system uses an image sensor to capture eye movement data and processes this data to determine user intent, thereby eliminating the need for mechanical touch interaction while maintaining precise control capability
Solution Approach 2:
The patent introduces eye movement as an intermediary between the user and the device. Rather than direct touch, the user's eye movements serve as a mediator to convey interaction intent. The system captures eye movement data through the image sensor and translates this physiological signal into control commands, enabling contactless interaction
2Ease of operation
If eye movement recognition is used for interaction, then ease of operation is improved for contactless interaction, but device complexity increases
Solution Approach 1:
The patent makes the image sensor multi-functional by using it for both primary imaging purposes and eye movement recognition. Instead of adding a dedicated eye tracking component, the system leverages the existing image sensor to capture eye movement data, thereby achieving contactless interaction without proportionally increasing device complexity
Solution Approach 2:
The system performs self-calibration and automatic eye movement tracking without requiring additional specialized hardware. The processing unit automatically analyzes image data to determine eye movement patterns and translates them into interaction commands, enabling the device to serve itself in the eye movement recognition process
Data Source
AI summary
This application provides a message processing method. The method includes: displaying a first interface that includes a notification message, and collecting first image data that includes an eye image of the user. Then, first eye movement data of the user is determined based on the first image data, where the first eye movement data includes coordinates of a first gaze point and first gaze duration. When the user gazes at the notification message in the first interface, the electronic device determines that the coordinates of the first gaze point are in a display area of the notification message, and the first gaze duration is greater than a first preset duration threshold. This indicates that the user is interested in viewing the notification message. Therefore, the electronic device May display a second interface, and the second interface is a display interface of an application corresponding to the notification message.