Secure Digital Assistant Integration via Intent Manifest

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing systems face challenges in securely integrating digital assistants with web pages on client computing devices, particularly due to limited input interfaces and restricted computing environments, which hinders efficient user input and data transfer while maintaining security.

Innovation Solution

A system that includes a data processing system with APIs, a JavaScript library, and a voice navigation system, allowing secure hosting of digital assistant functionality on web pages, enabling secure data transfer and input provision through an intent manifest, onsite intent execution API, and onsite state sharing API, while restricting access to sensitive data until authorized.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If digital assistant functionality is integrated with web pages on client computing devices, then user input efficiency and data transfer capability are improved, but security risks and system complexity increase

Engineering Contradiction:
Improveuser input efficiencyVSAvoidsecurity
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent introduces a data exchange component as an intermediary between the digital assistant functionality and the web page. This component acts as a secure gateway that mediates all data transfers and communications, allowing efficient user input while maintaining security through controlled access mechanisms and authorization protocols.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system is divided into distinct components with specific security responsibilities: a data exchange component for secure communication, an authorization component for access control, and an intent execution component for action processing. This segmentation allows each component to be optimized for its specific function while maintaining overall system security.

Inventive Principle:
Principle #1Segmentation

2Reliability

If secure data transfer mechanisms are implemented between digital assistant and web pages, then security is improved, but processor and memory consumption increase

Engineering Contradiction:
ImprovesecurityVSAvoidprocessor and memory consumption
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

Authorization tokens and security credentials are obtained in advance before data transfer operations. The authorization component pre-validates access rights and caches authorization states, eliminating the need for repeated authentication checks during data transfer, thus reducing processor and memory consumption while maintaining security.

Inventive Principle:
Principle #10Preliminary action

3Reliability

If access to sensitive data is restricted until authorized, then security is improved, but input process complexity increases

Engineering Contradiction:
ImprovesecurityVSAvoidinput process complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The authorization component automatically manages access control by obtaining and validating authorization tokens without requiring manual user intervention for each data access request. The system self-regulates data access based on pre-established authorization rules, maintaining security while simplifying the user input process.

Inventive Principle:
Principle #25Self-service

Data Source

PatentEP4235456A1Secure digital assistant integration in web pages
Publication Date: 2023.08.30 GOOGLE LLC
  • EP4235456A1 patent drawingFigure 1
  • EP4235456A1 patent drawingFigure 2
  • EP4235456A1 patent drawingFigure 3

AI summary

Secure digital assistant integration with web pages is provided. The system receives an intent manifest data structure that maps actions of a digital assistant with link templates of an electronic resource developed by a third-party developer device. The system validates the electronic resource based on the intent manifest data structure. The system receives, from a data exchange component of an iframe of the electronic resource loaded by a client computing device, an identifier of the client computing device. The system receives a foreground state of the electronic resource from an onsite state sharing API. The system selects a data value for a parameter based on the foreground state and the intent manifest data structure. The system provides the data value. An authorization component generates an authorization prompt, receives input, and transmits the data value to an onsite intent execution API of the electronic resource to execute an action.