AR Anchor Smart Device Control for Angle-Independent Identification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Traditional methods for controlling smart devices, such as hardware switches and remote controls, are inefficient and fail to accurately control devices due to the need for manual search and angle-dependent image identification, especially when multiple devices of the same type are present.

Innovation Solution

A device control method and apparatus using AR anchors created based on spatial locations, allowing for the acquisition of AR anchors in images captured by a terminal, determining the target device, displaying its control menu, and generating control instructions for efficient device control, independent of the camera's angle or position.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If traditional hardware switches or remote controls are used to control smart devices, then the control method is simple, but the control efficiency is low and cannot satisfy users' efficient control needs

Engineering Contradiction:
Improvecontrol efficiencyVSAvoidcontrol system complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent replaces traditional mechanical control methods (hardware switches, remote controls) with an AR-based visual recognition system. The terminal device captures images, recognizes device features through image processing, and presents control options virtually, substituting mechanical interaction with optical recognition and digital processing to achieve faster, more efficient device control

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces an AR control interface as an intermediary between the user and the smart device. Instead of direct mechanical control, the system processes images, identifies devices, and presents virtual control menus that mediate the interaction, enabling efficient control while maintaining system manageability

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If the control menu is found through mobile phone APP, then the device can be controlled, but the operation process is complex and time-consuming

Engineering Contradiction:
Improveoperation convenienceVSAvoidtime to locate control menu
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The patent performs preliminary actions by pre-processing device features and storing them for rapid matching. When a device is captured in an image, the system can quickly retrieve and match device features without requiring users to manually search through apps, significantly reducing the time to locate and control devices

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent creates a visual copy of the device control interface directly over the captured image. Instead of navigating to separate control menus in an APP, the system overlays virtual control buttons and information directly on the device image, allowing users to control devices immediately without additional navigation steps

Inventive Principle:
Principle #26Copying

3Measurement precision

If device image identification is used to control smart devices, then the device can be identified, but the identification is angle-dependent and cannot accurately control devices when multiple devices of the same type are present

Engineering Contradiction:
Improvedevice identification accuracyVSAvoidangle independence
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent transitions from two-dimensional image pattern recognition to three-dimensional spatial feature recognition. By extracting spatial coordinates, depth information, and positional relationships from images, the system can identify devices from any angle and distinguish between multiple devices of the same type based on their spatial locations, achieving both high accuracy and angle independence

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent segments the device identification process into multiple independent feature extraction steps: spatial position extraction, device feature extraction, and matching operations. This segmentation allows the system to process multiple devices simultaneously and accurately distinguish between them based on their unique spatial and feature characteristics

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11435891B2Augment reality techniques for controlling smart devices
Publication Date: 2022.09.06 BEIJING XIAOMI MOBILE SOFTWARE CO LTD
  • US11435891B2 patent drawing
  • US11435891B2 patent drawing
  • US11435891B2 patent drawing

AI summary

The present disclosure relates to a device control method and apparatus, and a storage medium. The method includes: acquiring an AR anchor in an image captured by the camera, in which the AR anchor is created in advance according to a spatial location of a target device; determining the target device bound to the spatial location anchored by the AR anchor; displaying a control menu of the target device; generating a control instruction in response to an operation on the control menu, and controlling the target device according to the control instruction.