Gaze-Triggered Notification Expansion on Mobile Terminals
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing terminal technologies require manual user interaction to process notifications, which can be inconvenient, especially when the user is occupied with other tasks.
Innovation Solution
A notification displaying method that uses a front image acquisition device to determine the user's gaze area and process notifications automatically, including expanding the notification area or displaying specific content, without manual operation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If manual operation is required to process notifications, then the notification processing is reliable and controllable, but the ease of operation deteriorates when the user is occupied with other tasks
Solution Approach 1:
The front image acquisition device, originally designed for general photography purposes, is repurposed to detect user gaze direction for notification processing. This allows the same hardware component to serve multiple functions: capturing images for normal use and detecting gaze direction for automated notification interaction, thereby improving ease of operation without adding dedicated gaze detection hardware.
Solution Approach 2:
The system enables notifications to process themselves by detecting the user's natural gaze direction toward the notification area. When the gaze detection module determines the user is looking at a notification, the system automatically expands or displays the notification content without requiring manual interaction, making the notification processing self-activating based on user attention.
2Productivity
If the notification area is expanded automatically based on gaze detection, then the productivity of notification processing is improved, but the device complexity increases due to additional processing modules
Solution Approach 1:
The image processing functionality is divided into distinct modules: a front image acquisition device for capturing images, a gaze detection module for analyzing gaze direction, and a notification processing module for executing actions. This segmentation allows each module to perform its specific function efficiently while working together to achieve automated notification processing based on gaze detection.
Solution Approach 2:
The system performs partial image processing by focusing only on detecting gaze direction toward the notification area rather than analyzing the entire image content. The gaze detection module specifically looks for gaze vectors pointing to notification coordinates, performing just enough processing to determine user attention without exhaustive image analysis, thereby improving productivity with controlled complexity.
3Loss of time
If gaze area determination is used to trigger notification processing, then the loss of time for manual operations is reduced, but the measurement precision requirements increase for accurate gaze detection
Solution Approach 1:
The system continuously monitors gaze direction and provides feedback to the notification processing module. When the gaze detection module detects that the user's line of sight is directed toward a notification, it triggers automatic notification processing such as expansion or display. This feedback mechanism eliminates the need for manual interaction and reduces time loss by automatically responding to user attention in real-time.
Data Source
Figure 1~2A
Figure 2B~3A
Figure 3B~4
AI summary
The present invention relates to the field of terminal technologies, and specifically provides a notification displaying method and apparatus, a device, and a computer-readable storage medium. The method is executed by a terminal in which a front image acquisition device is disposed, the method includes: acquiring (S101) an image through the front image acquisition device when notification of a received message is displayed; determining (S102) a gaze area of a user's line of sight in the acquired image; and processing (S103) a first area of the notification if the gaze area is within the first area, wherein modes of the processing include expanding the first area and/or displaying a specific content of the message in the first area.