Remote Device Management for Speech Processing on IoT

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Speech recognition systems face challenges in processing audio commands on functionally limited devices, such as IoT devices with reduced processing power, which lack sufficient memory to execute complex instructions for tasks like audio processing.

Innovation Solution

A remote device-management system allocates computing resources, including virtual machines, to handle processing tasks that would otherwise require significant local resources, allowing these devices to communicate and execute commands through speech processing systems by transcoding audio data and utilizing neural networks for wakeword detection.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If speech recognition processing is executed locally on functionally limited devices, then speech-based command execution is enabled, but device processing power and memory requirements increase beyond available resources

Engineering Contradiction:
Improvespeech-based command executionVSAvoidmemory resources
Core Design Contradiction:
Ease of operationVSQuantity of substance

Solution Approach 1:

A remote device-management system acts as an intermediary between functionally limited devices and speech processing capabilities. The system receives audio data from devices, performs speech recognition and natural-language understanding processing remotely, then returns commands or text data to the device. This mediator approach enables speech-based operation without requiring the limited device to possess sufficient local processing power or memory for complex speech processing tasks.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If complex speech processing instructions are executed locally, then speech recognition accuracy improves, but device processing power requirements exceed available capacity

Engineering Contradiction:
Improvespeech recognition accuracyVSAvoidprocessing power
Core Design Contradiction:
Measurement precisionVSPower

Solution Approach 1:

The patent extracts complex speech processing instructions from the functionally limited device and relocates them to a remote device-management system. By removing the computationally intensive speech recognition and natural-language understanding processing from the resource-constrained device, the system enables accurate speech recognition without requiring the device to have sufficient local processing power. The device simply captures audio and transmits it remotely for processing.

Inventive Principle:
Principle #2Taking out (Extraction)

3Speed

If local processing resources are allocated for speech recognition, then real-time command processing is enabled, but device complexity increases

Engineering Contradiction:
Improvereal-time command processingVSAvoidprocessing architecture
Core Design Contradiction:
SpeedVSDevice complexity

Solution Approach 1:

The remote device-management system serves as an intermediary that handles complex speech processing operations, allowing functionally limited devices to maintain simple architectures while still achieving real-time command processing capability. The device captures audio in real-time and transmits it to the remote system, which processes the speech and returns results, effectively distributing the processing complexity away from the constrained device.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11495240B1Management of local devices
Publication Date: 2022.11.08 AMAZON TECH INC
  • US11495240B1 patent drawing
  • US11495240B1 patent drawing
  • US11495240B1 patent drawing

AI summary

A device-management system performs processing, such as audio processing, in an instance of a virtual machine corresponding to a functionally limited (local) device. To register the local device, the device-management system receives a registration request that includes device information, encryption data, and an indication of an associated user account. The device-management system then sends this registration data to a service-provider system, which returns a shared encryption key. The device-management system and the local device may use this shared encryption key to securely communicate. The device-management system may de-allocate the instance upon detecting a period of inactivity of the local device and may re-allocate the instance when new activity is detected. The device-management system may further determine when and if audio data to be sent to the local device is encoded using a codec not implemented by the local device. Upon this determination, the device-management system may transcode the audio data such that is encoded using a known codec.