Voice Control for Non-Voice Applications via Remote Intent Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users of computing devices often rely on tactile input methods like remote controls, mice, and keyboards to interact with content, but there is a need for additional input means, especially when interacting with third-party applications that are not optimized for voice control.
Innovation Solution
The system enables voice control of computing devices by capturing audio commands, performing automatic speech recognition, and using natural language understanding to determine user intents, even for third-party applications not originally designed for voice interaction, through a remote system that processes audio data and generates directives for the device to perform actions on displayed content.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If voice control is implemented for third-party applications not originally designed for it, then input versatility is improved, but system complexity increases
Solution Approach 1:
The patent introduces a remote system as an intermediary between the user device and third-party applications. This remote system captures audio data, performs speech recognition, determines user intent, and generates directives that are sent back to the user device. By placing the voice processing complexity in a separate remote system rather than within the third-party application itself, the patent enables voice control versatility while isolating the complexity away from the application layer.
Solution Approach 2:
The patent segments the voice control functionality into distinct components: audio capture by the user device, audio data transmission to the remote system, speech recognition and intent determination by the remote system, and directive execution by the user device. This segmentation allows third-party applications to gain voice control capability without each application needing to implement its own voice processing logic, thus improving versatility while managing system complexity through modular architecture.
2Power
If voice commands are processed through a remote system, then processing capability is improved, but communication overhead increases
Solution Approach 1:
The patent extracts the computationally intensive speech recognition and intent determination processes from the user device and places them in a remote system. This extraction allows complex processing to be performed on powerful remote servers rather than being constrained by the limited processing capability of the user device. The audio data is transmitted to the remote system, processed there, and only the essential directive results are sent back, balancing processing capability with communication overhead.
Data Source
AI summary
Systems and methods for voice control of computing devices are disclosed. Applications may be downloaded and/or accessed by a device having a display, and content associated with the applications may be displayed. Many applications do not allow for voice commands to be utilized to interact with the displayed content. Improvements described herein allow for non-voice-enabled applications to utilize voice commands to interact with displayed content by determining screen data displayed by the device and utilizing the screen data to determine an intent associated with the application. Directive data to perform an action corresponding to the intent may be sent to the device and may be utilized to perform the action on an object associated with the displayed content.