IoT Device Management via Image Recognition and Macro Commands
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing IoT device management systems require separate programs for control and monitoring, making it inconvenient for users to manage and generate macro commands across multiple devices.
Innovation Solution
A user terminal apparatus that identifies devices in a photographed image using mapping information, allowing users to control and monitor devices through a processor that displays information, generates macro commands, and communicates with network apparatuses for function execution.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If separate programs are used for each IoT device control and monitoring, then device functionality is provided, but user convenience deteriorates due to the need to connect to multiple web services and select devices manually
Solution Approach 1:
The patent combines multiple device control and monitoring functions into a single integrated system. The server consolidates web service connections for multiple IoT devices, allowing users to access and control all devices through one interface rather than connecting to separate web services for each device.
Solution Approach 2:
The control terminal device is designed with multi-functional capabilities to perform both control and monitoring operations across different IoT devices through a unified application. The system provides universal access to various device types (lighting, temperature control, security) through a single platform.
2Productivity
If manual device selection from web services is required, then device control is achieved, but time consumption increases due to the need to navigate and select devices
Solution Approach 1:
The system performs preliminary actions by pre-establishing connections to IoT devices and preparing control interfaces in advance. When a user wants to control a device, the interface is already ready for immediate interaction, eliminating the need for users to navigate through web services and select devices manually each time.
Solution Approach 2:
The control terminal device acts as an intermediary between the user and multiple IoT devices. It maintains pre-established connections with devices and provides a unified interface that translates user commands into device-specific protocols, eliminating the need for users to directly interact with individual device web services.
3Ease of operation
If a unified system is implemented for device management, then user convenience is improved, but system complexity increases due to integration requirements
Solution Approach 1:
The control terminal device serves as an intermediary layer between the user and multiple IoT devices with different protocols. It handles protocol translation and communication coordination, providing a unified interface while managing the complexity of integrating with various device types through standardized interaction methods.
Solution Approach 2:
The system implements feedback mechanisms where the control terminal receives status information from multiple IoT devices and presents it in a unified manner. The server consolidates feedback from various devices and relays it through the control terminal, allowing users to monitor all devices through a single interface without managing individual device complexities.
Data Source
Figure 1~2a
Figure 2b
Figure 3
AI summary
A user terminal apparatus is provided. The user terminal apparatus includes a storage configured to store mapping information wherein at least one device in a predetermined service space and a corresponding image are mapped, a camera, a display configured to display a photographed image in which the at least one device in the predetermined service space is captured by the camera, and a processor configured to identify a device included in the photographed image based on the mapping information, and in response to receiving a command (e.g., a user command) related to the identified device, to display information based on the received command on the photographed image. Accordingly, at least one device in the predetermined service space can be managed, thereby improving user convenience.