Computerized Glasses Suggestions Tuned to Gaze and Display Limits
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users often fail to discover the full capabilities of automated assistants due to unfamiliarity with their features, leading to inefficient task handling and resource wastage in unfamiliar environments.
Innovation Solution
An automated assistant integrated with computerized glasses provides context-aware suggestions based on user gaze and input, limiting suggestions to relevant options and adapting dynamically to changes in environment and user interaction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If the automated assistant provides a large number of suggestions based on all objects and locations in the visual scope, then the user can discover more assistant functionality and capabilities, but the computational resources of the computerized glasses are consumed more rapidly and the display interface becomes cluttered
Solution Approach 1:
The patent applies local quality by providing different levels of suggestion detail based on the user's current gaze location. Instead of uniformly presenting all suggestions, the system focuses computational resources on generating and displaying suggestions for objects currently in the user's visual scope, particularly where the user is gazing. This selective approach reduces overall computational load while maintaining functionality discovery for relevant objects.
Solution Approach 2:
The patent implements dynamics by making the suggestion set adaptive and dynamic rather than static. The suggestions are continuously updated based on real-time user gaze data, allowing the system to respond to changing user interest. This dynamic adaptation ensures computational resources are allocated efficiently to generate suggestions only for objects the user is currently observing, reducing energy consumption while maintaining versatility.
2Adaptability or versatility
If the automated assistant displays multiple suggestions simultaneously on the computerized glasses interface, then the user can see more options, but the display interface becomes obstructed and the user's view of the environment is blocked
Solution Approach 1:
The patent applies segmentation by dividing the suggestion display into multiple temporal segments rather than showing all suggestions simultaneously. The system presents suggestions in a sequence based on user gaze, displaying one or a limited number of suggestions at a time. This temporal segmentation allows the full set of suggestion options to be made available to the user across multiple display moments without obstructing the view at any single moment.
Solution Approach 2:
The patent transitions from a two-dimensional spatial display constraint to a three-dimensional temporal-spatial solution. By adding the time dimension to suggestion presentation, the system can display multiple suggestions sequentially across different time points rather than being constrained to displaying only a few suggestions simultaneously in the limited display space. This resolves the conflict between providing comprehensive options and maintaining unobstructed viewing.
3Loss of information
If the automated assistant processes all contextual data including location, time, and gaze information, then more relevant suggestions can be provided, but the computational processing time and energy consumption increase
Solution Approach 1:
The patent applies preliminary action by pre-processing and organizing contextual data structures in advance, so that when gaze data becomes available, the system can quickly filter and match suggestions without performing complete re-processing. The system maintains pre-computed information about objects, locations, and potential suggestions, allowing rapid retrieval and filtering based on current gaze direction rather than processing all contextual data from scratch each time.
4Productivity
If the user manually interacts with computing devices without assistant suggestions, then the user maintains control and avoids resource consumption, but time is wasted scrolling through suggestions and the user experience is less efficient
Solution Approach 1:
The patent applies self-service by enabling the automated assistant to proactively identify and present relevant suggestions based on user gaze, reducing the need for users to manually search through all available functionalities. The system serves itself by automatically filtering and presenting only the most relevant suggestions for currently observed objects, allowing users to quickly discover and access assistant capabilities without manual browsing or extensive interaction.
Data Source
AI summary
Implementations set forth herein relate to an automated assistant that can render selectable suggestion(s) at a display interface of computerized glasses, and can adapt the suggestions according to changes to a gaze direction of the user and/or other further inputs from the user. The selectable suggestion(s) can be initially rendered based on contextual data that may be associated with a user who is directing their gaze into an environment that includes different environmental features. Certain environmental features can be identified by the automated assistant as being predicted to be of interest to the user and—when a user expresses interest in a particular feature—the selectable suggestions can be adapted. Interest of the user in the particular environmental feature can be expressed by redirecting their gaze towards the particular feature and/or providing further input relevant to the particular feature.