AR Smart Device Identification for Unified Mobile Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional user interfaces require users to manually search for and interact with multiple applications or voice commands to control smart devices, leading to inefficiency and increased network processing and bandwidth usage.
Innovation Solution
A virtual assistant application on a mobile device identifies smart devices through image recognition, generating customized user interface controls for these devices using augmented reality, allowing users to control them intuitively without additional interactions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If conventional user interfaces require manual search and multiple applications to control smart devices, then control functionality is achieved, but user convenience and operational efficiency deteriorate
Solution Approach 1:
The patent merges the functions of multiple applications and control interfaces into a single unified interface. The system integrates image recognition, device identification, and control functionality into one cohesive application, eliminating the need for users to manually search through multiple applications or use separate voice command applications.
Solution Approach 2:
The system employs self-service mechanisms where the interface automatically identifies smart devices through image recognition and presents relevant controls without requiring user initiation or manual searching. The interface autonomously determines which devices are visible and displays appropriate controls, reducing operational steps.
2Productivity
If multiple requests and interactions are required to control smart devices, then control functionality is achieved, but network bandwidth consumption and processing overhead increase
Solution Approach 1:
The system performs preliminary actions by pre-identifying and caching information about visible smart devices before user interaction. The image recognition system continuously monitors and identifies devices in the environment, preparing control data in advance so that when a user interacts with the interface, the controls are already available and ready for immediate use, reducing the need for multiple requests.
Solution Approach 2:
The unified interface serves multiple functions simultaneously: it acts as an image recognition system, a device identification system, and a control interface all in one. This multi-functionality consolidates what would otherwise require separate systems making multiple network requests into a single integrated system that reduces overall network bandwidth consumption.
Data Source
AI summary
Methods, systems, and apparatus for controlling smart devices are described. In one aspect a method includes receiving image data for an image captured by a camera of a mobile device of a user and determining that the image depicts at least one of a smart device or a physical control for the smart device. In response to determining that that the image depicts a smart device or a physical control for the smart device, identifying one or more user interface controls for controlling the smart device, and generating and presenting, at a display of the mobile device, the one or more user interface controls for controlling the smart device. The method can further include detecting, at the display of the mobile device, user interaction with at least one of the one or more user interface controls, and controlling the smart device based on the detected user interaction.