Selective On-Device Processing for Lower Voice Interface Latency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems experience latency issues due to the need for remote processing of user input data, which can hinder synchronized output of actions and introduce security risks in voice interface devices.
Innovation Solution
Implementing on-device processing functionality by preloading commands and content on user devices for specific applications, allowing local processing of user input data and reducing reliance on remote systems for non-time-sensitive tasks.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Power
If user input data is sent to remote systems for processing, then processing power and storage capacity are improved, but latency increases and security risks arise
Solution Approach 1:
The patent segments processing tasks into two categories: time-sensitive tasks processed remotely with full processing power, and non-time-sensitive tasks processed locally on the device. This segmentation allows the system to leverage remote processing capabilities while avoiding latency for critical responses, and reduces remote system involvement for less time-sensitive operations.
Solution Approach 2:
The patent preloads commands and content onto the user device in advance, so that when user input occurs, the device can immediately process certain tasks locally without waiting for remote system responses. This preliminary action reduces latency for non-time-sensitive tasks while maintaining security by limiting remote system exposure.
2Power
If user input data is sent to remote systems for processing, then processing capability is improved, but security risks increase
Solution Approach 1:
The patent segments processing tasks based on security considerations, keeping certain processing capabilities locally on the device while sending only necessary data to remote systems. This segmentation reduces the attack surface and security risks associated with constant remote communication, while still providing access to enhanced processing capability when needed.
Solution Approach 2:
The patent introduces an intermediary layer that determines which tasks should be processed locally versus remotely. This intermediary evaluates each processing request and routes it appropriately, reducing security risks by minimizing unnecessary remote communication while maintaining access to remote processing capability when required.
3Device complexity
If all processing is done remotely, then device complexity is reduced, but latency and remote system involvement increase
Solution Approach 1:
The patent implements partial on-device processing rather than complete local processing. By processing only non-time-sensitive tasks locally and leaving time-sensitive tasks for remote processing, the system achieves sufficient latency reduction without requiring the full complexity of complete on-device processing capability.
Data Source
AI summary
Systems and methods for selective on-device latency reduction include receiving data requesting that an application associated with a user device be utilized and identifying on-device functionality enabled for the application. Data may be generated that includes a subset of content associated with the on-device functionality and is configured to be utilized by a device in the environment to perform the on-device functionality. This data may be sent to the device in question and may configure the device to process input data associated with the on-device functionality and utilize commands associated with the subset of content based at least in part on processing the input data with the on-device functionality.