Video Playback Assistant Suggestions for In-App Actions

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing automated assistants interrupt video playback when initiating actions, necessitating a refresh or re-download of video content, disrupting the user experience.

Innovation Solution

An automated assistant renders selectable assistant suggestions at a separate application interface based on content being processed, allowing interactions without interrupting video playback by integrating with the video application and other applications to perform actions upon user selection.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If the automated assistant initializes performance of actions during video playback, then user interaction capability is improved, but video playback continuity deteriorates causing temporary loss of video data

Engineering Contradiction:

Improveuser interaction capabilityVSAvoidvideo playback continuity

Core Design Contradiction:

Ease of operationVSStability of the object's composition

Solution Approach 1:

The display interface is segmented into multiple portions: a first portion for video content rendering and a second portion for assistant suggestions. This spatial segmentation allows both video playback and assistant interactions to occur simultaneously without interfering with each other, resolving the contradiction between user interaction capability and video playback continuity.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent transitions from a single-display-mode approach to a multi-dimensional display architecture where assistant suggestions are rendered in a separate portion of the display interface. This dimensional separation enables concurrent video playback and assistant interaction, eliminating the need to choose between maintaining video continuity or enabling user interaction.

Inventive Principle:

Principle #17Another dimension (Dimensionality change)

2Extent of automation

If the automated assistant removes the graphical user interface to render assistant content, then assistant functionality is improved, but application interface availability deteriorates

Engineering Contradiction:

Improveassistant functionalityVSAvoidapplication interface availability

Core Design Contradiction:

Extent of automationVSAdaptability or versatility

Solution Approach 1:

The patent merges the assistant interface with the existing application interface by rendering assistant suggestions in a second portion of the same display interface. This consolidation allows both the video application GUI and assistant content to coexist on the same display, maintaining application interface availability while enabling assistant functionality.

Inventive Principle:

Principle #5Merging (Combining)

Solution Approach 2:

The display interface is designed with multi-functionality, serving both as the video application interface and as the assistant suggestion interface. This universal design allows the same display hardware to fulfill multiple functions simultaneously, eliminating the need to remove the application GUI to render assistant content.

Inventive Principle:

Principle #6Universality (Multi-functionality)

3Productivity

If the automated assistant requests data to occupy memory buffer during video playback, then assistant data processing capability is improved, but video data buffering deteriorates causing temporary loss of video data

Engineering Contradiction:

Improveassistant data processing capabilityVSAvoidvideo data buffering

Core Design Contradiction:

ProductivityVSQuantity of substance

Solution Approach 1:

The memory buffer is segmented into separate allocation regions for video data and assistant data. This segmentation allows the assistant to request and occupy memory buffers for data processing without interfering with the video data buffer, thereby maintaining both assistant data processing capability and video data buffering integrity.

Inventive Principle:

Principle #1Segmentation

Data Source

PatentUS12437760B2Generating and/or causing rendering of video playback-based assistant suggestion(s) that link to other application(s)

Publication Date: 2025.10.07 GOOGLE LLC

AI summary

Implementations set forth herein relate to incorporating automated assistant suggestions into an interface of a video application, when the video application is rendering video content. The video content—as well as any relevant content, can provide a basis for the automated assistant suggestions. The assistant suggestions can optionally link to one or more additional applications, which can be controlled in response to a user selecting one or more of the automated assistant suggestions. In response to a selection of an assistant suggestion, resulting data generated by another application can be rendered over an interface of the video application, while video content is being rendered and/or otherwise played. This can allow the user to control relevant actions of other applications without completely leaving an interface of the video application, thereby preserving memory and other computational resources that may be consumed when switching between application interfaces.