AR Remote Control via Image-Based Protocol Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality-based device control systems require pre-secured model information and server relays, limiting their practicality and flexibility in controlling devices without prior configuration.
Innovation Solution
An augmented reality-based device control method and apparatus that uses image recognition to detect remote control protocols by obtaining real images of devices, verifying controllability, and displaying virtual input interfaces to users, allowing for device control without pre-secured information or server relays.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If pre-secured model information and server relays are used for device control, then control reliability is improved, but device complexity and system configuration complexity increase
Solution Approach 1:
The patent extracts the essential control function from complex server-based systems and implements it directly in the portable terminal through image recognition and protocol detection. By removing the mandatory server relay component and using only essential image processing capabilities, the system achieves device control without requiring complex server infrastructure, push message servers, or application servers.
Solution Approach 2:
The portable terminal performs self-service by autonomously detecting device protocols through image recognition and automatically generating control signals without external server assistance. The terminal independently captures device images, recognizes device types and protocols, and executes control operations, eliminating dependency on server-based configuration and relay systems.
2Measurement precision
If pre-secured model information is required for device control, then control precision is improved, but adaptability to unknown devices deteriorates
Solution Approach 1:
The system performs preliminary protocol detection and device recognition through image analysis before actual control operations. By pre-detecting device types, models, and communication protocols using image recognition technology, the system prepares control parameters in advance, enabling precise control while simultaneously adapting to previously unknown devices through automatic protocol identification.
Solution Approach 2:
The patent dynamically changes control parameters based on real-time image recognition results. Instead of relying on fixed pre-secured model information, the system adjusts device identification parameters, protocol selection, and control signals according to the actually detected device characteristics, thereby achieving both precision for known devices and adaptability for unknown devices.
3Stability of the object's composition
If server relay is used between control device and remote controller, then control stability is improved, but ease of operation deteriorates due to configuration requirements
Solution Approach 1:
The patent introduces image recognition technology as an intermediary between the control device and the target device. Instead of using complex server relay infrastructure, the system employs image-based device identification and protocol detection as a mediating mechanism that automatically establishes stable control connections without requiring manual configuration or server intervention.
Solution Approach 2:
The system replaces the mechanical/server-based relay configuration system with an optical/image-based recognition system. By substituting physical server infrastructure and manual configuration processes with image recognition and automatic protocol detection, the system maintains control stability while dramatically improving ease of operation.
Data Source
AI summary
An augmented reality-based device control method and a control apparatus thereof are disclosed. The augmented reality-based device control method includes obtaining a real image with a device to be controlled as a subject, as an image which configures an augmented reality (AR)-based remote controller and detecting a remote control (RC) protocol of the device to be controlled by recognizing the real image. The detecting of an RC protocol of the device to be controlled includes verifying whether the device to be controlled is controllable through a candidate RC protocol based on whether the device to be controlled operates according to the real image. According to the present disclosure, the device can be controlled based on the augmented reality using artificial intelligence (AI)-based image recognition through a 5G network.