Handsfree Notification Management Using Gaze and Voice Input
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users struggle to efficiently manage and interact with notifications on electronic devices without handsfree capabilities, leading to reduced productivity due to the need for manual interaction when their hands are occupied.
Innovation Solution
A digital assistant system that enables users to interact with notifications using voice and visual inputs, allowing for handsfree management of notifications through gaze detection and speech recognition.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If manual interaction with notifications is required, then notification management functionality is achieved, but user productivity decreases and interaction time increases when hands are occupied
Solution Approach 1:
The patent replaces manual mechanical interaction (touching, tapping, swiping notifications with fingers) with voice-based acoustic interaction. Users can manage notifications through spoken commands like 'read notifications,' 'dismiss notifications,' or 'respond to notifications,' eliminating the need for hand contact with the device while maintaining full notification management capability.
Solution Approach 2:
The patent introduces a digital assistant as an intermediary between the user and the notification system. This intermediary processes voice inputs, interprets user intent, and executes appropriate notification actions, serving as a mediator that translates natural language commands into system operations without requiring direct manual interaction.
2Ease of operation
If manual notification management is required, then notification control is achieved, but time spent on interaction increases
Solution Approach 1:
The system substitutes time-consuming manual navigation through notification interfaces with rapid voice command execution. Users can dismiss multiple notifications or request specific information through single spoken phrases, dramatically reducing the time required compared to manually tapping, scrolling, and selecting through traditional notification interfaces.
Solution Approach 2:
The digital assistant maintains a ready-state listening mode where it pre-processes potential commands and keeps the notification management system primed for immediate execution. When a user speaks a notification command, the system can rapidly retrieve and process the relevant notifications without requiring initial navigation or loading steps, effectively performing preliminary preparation for common interaction patterns.
3Productivity
If handsfree notification management is enabled, then user convenience and productivity are improved, but system complexity increases
Solution Approach 1:
The patent implements a universal digital assistant framework that handles multiple functions beyond notification management, including messaging, scheduling, information retrieval, and device control. By creating a multi-functional voice interface system, the notification management feature leverages the same underlying speech recognition, natural language processing, and command execution infrastructure used for other assistant functions, distributing the complexity across a broader utility base rather than creating a separate specialized system.
Data Source
Figure 1
Figure 2A
Figure 2B
AI summary
This relates generally to intelligent automated assistants and, more specifically, to provide a handsfree notification management system. An example method includes displaying one or more notifications by the electronic device. In response to displaying the one or more notifications, the method includes detecting a visual interaction of a user with the one or more notifications, identifying a notification from the one or more notifications based on the visual interaction, receiving a speech input related to the notification from the user, determining one or more actions associated with the notification based on the speech input, and performing the one or more actions.