Natural Language Control for Remote Devices

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users face difficulty in controlling one computing device with another, leading to frustration due to the complexity of existing control methods.

Innovation Solution

A system where a computing device sends a request to a remote device for a natural language description, mapping natural language strings to functionalities, and uses a natural language assistant to monitor inputs, identifying matching commands and communicating them to the remote device for execution.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If traditional device control methods are used, then device functionality can be controlled, but user operation becomes complex and frustrating

Engineering Contradiction:
Improvedevice control easeVSAvoidcontrol system complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent introduces a natural language assistant as an intermediary between the user and the device control system. The assistant translates natural language inputs into device-specific commands, eliminating the need for users to directly interact with complex control interfaces. The natural language description file serves as a mediator that maps between user-friendly language and device command protocols.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces traditional mechanical or graphical user interfaces (buttons, menus, sliders) with a natural language processing system. Instead of manipulating physical or visual controls, users simply speak or type natural language, which is then processed and converted into device commands through the natural language assistant.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Ease of operation

If natural language processing is implemented for device control, then ease of operation improves, but development time and system complexity increase

Engineering Contradiction:
Improvenatural language controlVSAvoiddevelopment time
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The patent implements preliminary action by creating natural language description files that pre-map natural language strings to device commands before runtime. This preparation work is done in advance, allowing the system to quickly process user inputs without performing complex analysis during actual device control operations, thereby reducing development and processing time.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses copying by creating a natural language description file that is a simplified representation or copy of the actual device command structure. This description file contains mappings between natural language phrases and device-specific commands, allowing the system to work with simplified text representations rather than complex device protocols directly.

Inventive Principle:
Principle #26Copying

3Reliability

If device-specific control interfaces are created for each remote device, then control precision improves, but device complexity and integration difficulty increase

Engineering Contradiction:
Improvecontrol precisionVSAvoidinterface complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent implements universality by creating a single natural language assistant that can control multiple different types of devices through a common interface. The natural language description files serve as universal adapters that translate between the standardized natural language input and various device-specific protocols, allowing one system to control many different devices without requiring separate control interfaces for each.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent applies segmentation by separating the control system into distinct components: the natural language assistant, the natural language description files, and the device-specific command handlers. This modular approach allows each component to be developed and maintained independently, reducing overall system complexity while maintaining precise device control through specialized handlers.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS10229678B2Device-described natural language control
Publication Date: 2019.03.12 MICROSOFT TECHNOLOGY LICENSING LLC
  • US10229678B2 patent drawing
  • US10229678B2 patent drawing
  • US10229678B2 patent drawing

AI summary

A remote device has an associated natural language description that includes a record of commands supported by the remote device. This record of commands includes command names, the command functions to which those names correspond, and natural language strings that are the natural language words or phrases that correspond to the command. A computing device includes a device control module that obtains the natural language description for the remote device and provides the natural language strings to a natural language assistant on the computing device. The natural language assistant monitors the natural language inputs to the computing device, and notifies the device control module when a natural language input matches one of the natural language strings. The device control module uses the natural language description to determine the command name that corresponds to the matching natural language string, and communicates the command name to the remote device.