IoT Device Control via AR Spatial Positioning
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users face inconvenience when trying to select and control multiple IoT devices of the same type installed in a single space, as existing methods require manual selection from a list without intuitive interface options for devices without display units.
Innovation Solution
An IoT device control system and method using virtual reality and augmented reality, where a user terminal captures images of real spaces with IoT devices, matches and registers the device's position and posture, and displays a control screen for selected devices, allowing users to control them through user inputs, both in real and virtual spaces.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a list of devices is provided for user selection, then device control capability is enabled, but user convenience deteriorates when multiple IoT devices of the same type are installed in one space
Solution Approach 1:
The patent creates a virtual copy of the real space where IoT devices are visually represented in their actual spatial positions. Users interact with virtual representations of devices rather than selecting from abstract lists, making device selection intuitive through visual recognition of device locations and appearances in the virtual environment.
Solution Approach 2:
The patent transitions from traditional 2D list-based selection to a 3D virtual space representation. Devices are positioned in three-dimensional space corresponding to their real-world locations, allowing users to select devices by spatial orientation and position rather than scrolling through flat lists, thereby improving ease of operation.
2Use of energy by moving object
If IoT devices are miniaturized for low power consumption, then energy efficiency is improved, but user interface capability deteriorates due to lack of display units and input means
Solution Approach 1:
The patent introduces a smartphone or terminal device as an intermediary between the user and the miniaturized IoT devices. The terminal device's display and input interfaces serve the IoT devices that lack these capabilities, allowing users to control and monitor energy-efficient IoT devices through the intermediary's rich user interface while the IoT devices themselves remain power-saving.
Solution Approach 2:
The terminal device serves multiple functions: it acts as a display unit for IoT devices without screens, an input device for controlling IoT devices without input means, and a communication bridge between users and IoT devices. This universal interface solution enables miniaturized IoT devices to maintain low power consumption while still providing full user interaction capabilities.
Data Source
AI summary
The present disclosure relates to an IoT device control system and method, including: by a user terminal, capturing an image of a real space that includes therein one or more IoT devices; when capturing the image, matching and registering at least one of a position and a posture of the user terminal with an IoT device selected by a user; displaying a control screen for the selected IoT device when the user terminal satisfies a condition, wherein the condition is determined by using at least one of the position and the posture of the user terminal matched and registered with the selected IoT device; and controlling the selected IoT device according to a user input received through the control screen. According to the present disclosure, a user can conveniently check and control an IoT device to be controlled, by using virtual reality and augmented reality.