Assistant Device Display Content Prioritization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional standalone voice-responsive speakers lack effective mechanisms for managing display content when multiple registered users are present, leading to potential privacy issues and missed targeted content due to lack of user identification upon activation.

Innovation Solution

A standalone multi-modal assistant device that detects users using various technologies and renders targeted and general-purpose data items on a display, prioritizing content based on user identity and priorities, allowing interactive management of displayed items like cards or tiles, and ensuring registered users do not miss targeted content even if swiped away by others.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If the display activates in response to detecting an unidentified person, then the device can provide content to users, but it cannot determine which registered user's targeted content to display

Engineering Contradiction:
Improvedisplay activationVSAvoiduser identity information
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The system performs user identification in advance before displaying targeted content. When the display activates upon detecting a person, the device immediately attempts to identify the user through voice recognition or other detection technologies. This preliminary identification action ensures that the correct targeted content can be displayed without delay once the user is identified, resolving the contradiction between activating the display and knowing which user's content to show.

Inventive Principle:
Principle #10Preliminary action

2Speed

If targeted content is displayed before user identification, then the display can show content quickly, but the wrong user's content may be displayed causing privacy issues

Engineering Contradiction:
Improvecontent display speedVSAvoidprivacy violation
Core Design Contradiction:
SpeedVSObject-affected harmful factors

Solution Approach 1:

User identification is performed as a preliminary step before displaying targeted content. The system activates the display and immediately initiates user detection and identification processes. Only after successful identification does the system retrieve and display the specific registered user's targeted content. This ensures both speed (immediate activation and identification) and privacy (correct user content displayed).

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system introduces an intermediary user identification process between display activation and targeted content display. This intermediary step acts as a mediator that verifies user identity before releasing targeted content, preventing privacy violations while maintaining efficient content delivery through streamlined identification processes.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Ease of operation

If a user swipes away targeted content before identification, then the interface responds to user interaction, but the content may be dismissed by the wrong user

Engineering Contradiction:
Improveuser interactionVSAvoidtargeted content
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

User identification is performed in advance before displaying or allowing interaction with targeted content. The system completes the identification process and establishes user context prior to making content interactive. This ensures that only the authenticated user can interact with their own targeted content, preventing wrong-user dismissal while maintaining responsive interaction.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system introduces user identification as an intermediary step between display activation and enabling content interaction. This mediator verifies user identity before allowing swipe or other interactive operations on targeted content, ensuring that only the correct user can dismiss their own content while maintaining ease of operation through natural gestures.

Inventive Principle:
Principle #24Intermediary (Mediator)

4Adaptability or versatility

If the display shows general content without user identification, then the device can provide useful information, but registered users may miss their personalized targeted content

Engineering Contradiction:
Improvecontent varietyVSAvoidpersonalized content
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The system performs user identification in advance before determining what content to display. Upon activation, the device immediately identifies the user and then retrieves both general content and the specific registered user's targeted content. This preliminary identification enables the display to show personalized content without delay, maintaining adaptability to show various content types while ensuring personalized content is not missed.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11455176B2Selecting content to render on display of assistant device
Publication Date: 2022.09.27 GOOGLE LLC
  • US11455176B2 patent drawing
  • US11455176B2 patent drawing
  • US11455176B2 patent drawing

AI summary

Techniques are described related to selecting content to display using a standalone multi-modal assistant device. In various implementations, an unidentified user may be detected as co-present with a standalone multi-modal assistant device equipped with a display. Based on the detecting, in various implementations, a plurality of data items targeted at one or more registered users may be obtained. The one or more registered users may have accounts accessible to an automated assistant that operates at least in part on the standalone multi-modal assistant device. The plurality of data items may be obtained based on the accounts of the registered users. The plurality of data items may be ranked based on various signals, such as registered user-related and non-registered user-related priorities. Graphical information may be rendered on the display indicative of the ranked plurality of data items.