Context-Aware Reminder Delivery via Gaze Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Intelligent automated assistants often deliver location-based reminders at inconvenient times, leading to missed or forgotten notifications, as they do not consider the user's current visual context or field of view.
Innovation Solution
An electronic device determines whether a reminder object is within the user's visual context by receiving user input, obtaining object positions, current location, and gaze direction, and provides the reminder only when the object is visible, optionally providing directional indications if not visible.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If location-based reminders are delivered at specific locations, then reminder convenience is improved, but reminder accuracy deteriorates because the system does not consider the user's visual context
Solution Approach 1:
The patent transitions from two-dimensional location-based reminders to three-dimensional context-aware reminders by incorporating the user's field of view and gaze direction. The system now considers not just where the user is (location) but also what the user is looking at (visual context), adding a spatial dimension to reminder delivery accuracy.
Solution Approach 2:
The system uses gaze detection feedback to determine whether to deliver a reminder. By monitoring the user's eye direction and comparing it with the location of relevant objects, the system dynamically adjusts reminder delivery based on real-time visual context, ensuring reminders are provided only when the user is actually looking at or near the relevant object.
2Reliability
If reminders are repeated or resurfaced, then reminder reliability is improved, but user experience deteriorates due to unnecessary notifications
Solution Approach 1:
The system serves itself by using automated gaze detection to determine the optimal moment for reminder delivery. Instead of requiring manual user intervention or repeated notifications, the system autonomously monitors the user's visual context and delivers reminders at the most appropriate moment, eliminating the need for redundant notifications.
Solution Approach 2:
The system performs preliminary gaze analysis before delivering a reminder to ensure the user is in the correct visual context. By checking the user's field of view and gaze direction in advance, the system prevents missed reminders while avoiding unnecessary repetitions, delivering notifications only when visually appropriate.
3Measurement precision
If visual context detection is implemented, then reminder accuracy is improved, but device complexity increases
Solution Approach 1:
The patent leverages the existing camera and processing capabilities of modern electronic devices, which are already designed for photography and video. These universal components are repurposed for gaze detection and visual context analysis, avoiding the need for specialized hardware and minimizing additional device complexity.
Solution Approach 2:
The system uses image processing algorithms as intermediaries to translate raw camera data into meaningful gaze direction information. Rather than directly complex hardware interactions, the intermediary software layer processes visual data to determine whether the user is looking at relevant objects, simplifying the overall system architecture.
4Loss of time
If continuous monitoring of user context is performed, then reminder delivery timing is improved, but energy consumption increases
Solution Approach 1:
Instead of continuous monitoring, the system employs periodic gaze detection triggered by specific events such as location changes or scheduled reminder times. The camera and processing resources are activated only when needed to check visual context, rather than running continuously, significantly reducing energy consumption while maintaining accurate timing.
Data Source
AI summary
Systems and processes for operating an intelligent automated assistant are provided. For example, a user input instantiating a reminder to be performed with respect to a first object is received. After receiving the input, if a user of the intelligent automated assistant is determined to be in the location of the first object and to be viewing the first object, the reminder is provided. If the user is in the location of the first object but not viewing the first object, a directional indication to the object is provided prior to providing the reminder.