Augmented Reality Command Routing for Multi-Device Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems struggle to manage multiple user commands efficiently across multiple smart devices, particularly when users wish to communicate commands in quick succession, such as turning on a smart heater, lights, and television while carrying groceries.
Innovation Solution
A system utilizing augmented reality (AR) devices, sensors, and machine learning models to identify and execute user commands on the appropriate smart devices based on speech and gesture recognition, with feedback loops for model improvement.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If users verbally communicate commands to multiple smart devices in quick succession, then the speed of command issuance is improved, but the system's ability to accurately manage and execute commands on the correct devices deteriorates
Solution Approach 1:
The system segments the stream of rapid commands by using augmented reality overlays to visually associate each command with its target device. The AR interface divides the command processing into discrete, visually-distinguished units, allowing the system to handle multiple commands in quick succession while maintaining accurate device mapping through spatial visualization.
Solution Approach 2:
The augmented reality interface acts as an intermediary between the user's rapid verbal commands and the smart devices. The AR system captures commands, displays them with visual indicators showing intended target devices, and then processes them for execution. This intermediary layer provides users with visual feedback and confirmation, ensuring command accuracy even when issued in quick succession.
2Adaptability or versatility
If the system manages multiple commands across multiple devices, then the versatility of command management is improved, but the complexity of the system increases
Solution Approach 1:
The augmented reality interface serves multiple functions simultaneously: it displays the current command, indicates the target device, provides visual feedback on command status, and assists with command selection. This multi-functional approach consolidates what would otherwise require multiple separate systems into a single versatile interface, managing complexity while enhancing versatility.
Solution Approach 2:
The system uses the AR device's own display capabilities to provide visual feedback and confirmation to the user. Rather than requiring additional external displays or complex notification systems, the AR interface leverages its inherent display function to show command information, device indicators, and execution status, thereby managing system complexity while maintaining versatility.
3Ease of operation
If the system uses augmented reality to display command information, then the ease of operation is improved, but the use of energy by the AR device increases
Solution Approach 1:
The augmented reality interface updates command information and device indicators periodically or on-demand rather than continuously. The system refreshes the display when new commands are issued or when command status changes, rather than maintaining constant visual updates. This periodic update approach reduces energy consumption while preserving the ease of operation by providing necessary visual feedback at appropriate intervals.
Data Source
AI summary
The exemplary embodiments disclose a method, a computer program product, and a computer system for managing user commands. The exemplary embodiments may include a user giving one or more commands to one or more devices, collecting data of the one or more commands, extracting one or more features from the collected data, and determining which one or more of the commands should be executed on which one or more of the devices based on the extracted one or more features and one or more models.