AR Remote Control Notification for IoT Devices

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing systems fail to accurately determine whether an IoT device can be remotely controlled within a displayed screen, making it difficult for users to identify and interact with remotely controllable devices during augmented reality-based instruction.

Innovation Solution

A computer system that acquires images of IoT devices, determines which devices are remotely controllable through image recognition, and displays a remote control status using augmented reality, allowing users to visually confirm and interact with the devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If augmented reality is used to display instructing content on wearable terminals, then the ease of operation is improved, but the ability to accurately determine and identify remotely controllable IoT devices deteriorates

Engineering Contradiction:
Improveease of operationVSAvoiddetermination accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The notification unit displays the determined remotely controllable IoT device with a specific color or visual indicator in the augmented reality overlay, enabling the user to quickly identify which device can be controlled. This visual differentiation resolves the contradiction by maintaining ease of AR operation while improving device identification accuracy through color-coded feedback.

Inventive Principle:
Principle #32Color changes

2Measurement precision

If image recognition is performed to determine remotely controllable devices, then the determination accuracy is improved, but the device complexity increases

Engineering Contradiction:
Improvedetermination accuracyVSAvoiddevice complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system introduces an intermediary determination unit that acts as a mediator between image capture and device control. This unit processes image data to identify IoT devices and their controllability status, then communicates findings to the notification unit. The intermediary approach maintains high determination accuracy while managing system complexity through modular architecture.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Loss of information

If the system displays status information for all detected devices, then the completeness of information is improved, but the ease of operation deteriorates due to information overload

Engineering Contradiction:
Improveinformation completenessVSAvoidease of operation
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The notification unit extracts and displays only the critical information - specifically which IoT device is remotely controllable - from the full set of detected devices. By filtering out non-essential information and focusing only on the controllable device status, the system maintains information completeness for decision-making while improving ease of operation through reduced visual clutter.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS10887195B2Computer system, remote control notification method and program
Publication Date: 2021.01.05 OPTIM
  • US10887195B2 patent drawing
  • US10887195B2 patent drawing
  • US10887195B2 patent drawing

AI summary

Provided are a computer system, a remote control notification method and a program. This computer system acquires an image of an IoT device, determines, from the acquired image, the IoT device which is capable of being remotely controlled by a user who visually confirms the image, and, in a position where the image of the IoT device determined to be remotely controllable is captured, displays with augmented reality that remote control is possible. Further, the computer system pre-stores images of the remotely controllable IoT device, and, on the basis of the pre-stored images of the IoT device, determines that the IoT device is remotely controllable through image recognition which involves comparing the pre-stored images with the acquired image.