Augmented Reality Interface for IoT Device Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Controlling Internet of Things (IoT) devices in an IoT environment is not user-friendly due to difficulties in recognizing, connecting to, and managing these devices.

Innovation Solution

A method and apparatus that utilize a processor and transceiver to detect controllable devices, generate user interfaces for display, and transmit signals to control the devices based on user inputs, enabling intuitive control of IoT devices through augmented reality displays on remote devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If traditional control methods are used for IoT devices, then device control functionality is achieved, but user-friendliness deteriorates due to difficulty in recognizing, connecting to, and controlling devices

Engineering Contradiction:
Improveuser-friendlinessVSAvoidcontrol complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent introduces an augmented reality interface as an intermediary between the user and IoT devices. This AR interface overlays virtual control elements directly onto the physical device view, serving as a mediator that simplifies the interaction process. Users can see and control devices through the AR display without needing to navigate complex menus or understand technical connection details, thus improving ease of operation while managing control complexity.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent adds a visual/spatial dimension to device control by using augmented reality. Instead of traditional 2D screen interfaces or text-based controls, the system projects control interfaces into the 3D space where devices are physically located. This dimensional change allows users to interact with devices in their natural spatial context, making recognition and control more intuitive and user-friendly.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Ease of operation

If augmented reality interface is implemented, then ease of operation improves through intuitive visual control, but device complexity increases due to additional software and processing requirements

Engineering Contradiction:
Improveease of controlVSAvoidsystem complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent implements a universal augmented reality control system that can manage multiple types of IoT devices through a single interface. The AR platform provides multi-functional capabilities, allowing users to control various devices (lights, cameras, sensors, etc.) through the same visual interface paradigm. This universality reduces the need for device-specific control applications, thereby managing system complexity while improving ease of operation.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system incorporates automatic device detection and identification features that allow the AR interface to self-configure based on the environment. The system automatically discovers available IoT devices, retrieves their control parameters, and generates appropriate virtual control elements without requiring manual setup or complex configuration by the user. This self-service capability reduces the operational burden on users while managing the complexity through automated processes.

Inventive Principle:
Principle #25Self-service

Data Source

PatentEP3549004B1Augmented reality control of internet of things devices
Publication Date: 2023.04.26 SAMSUNG ELECTRONICS CO LTD
  • EP3549004B1 patent drawingFigure 1~2
  • EP3549004B1 patent drawingFigure 3~4A
  • EP3549004B1 patent drawingFigure 4B~4C

AI summary

The present disclosure relates to a sensor network, Machine Type Communication (MTC), Machine-to-Machine (M2M) communication, and technology for Internet of Things (IoT). The present disclosure may be applied to intelligent services based on the above technologies, such as smart home, smart building, smart city, smart car, connected car, health care, digital education, smart retail, security and safety services. A wearable device includes a display, a transceiver, and a processor. The processor is configured to detect, via the transceiver, a device controllable by the wearable device. The processor is also configured to generate a user interface (UI) associated with the device for display on the display based on the detected device. The processor detects an input based on the UI and transmits, via the transceiver, a signal to the device to control the device based on the detected input.