AR Home Device Control via Visual Recognition Menus

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Conventional home device control methods through applications or voice commands are cumbersome and inefficient, lacking direct interaction between the user and the device, leading to poor user experience and low control efficiency.

Innovation Solution

A method utilizing augmented reality (AR) to display control menus directly on the target home device within an image, allowing users to control the device through intuitive menu interactions, with potential cloud or local processing for device identification and instruction delivery.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If conventional application-based control methods are used, then device control functionality is achieved, but the operation procedure becomes complex and control efficiency decreases

Engineering Contradiction:

Improvecontrol operation simplicityVSAvoidcontrol procedure time

Core Design Contradiction:

Ease of operationVSLoss of time

Solution Approach 1:

The patent replaces the mechanical interaction of navigating through application menus with optical recognition technology. The terminal device uses a camera to capture images of the home device, and image recognition algorithms automatically identify the device and present control options, substituting manual menu navigation with automated visual recognition and selection.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The home device itself becomes part of the control interface by being visually recognized. The control menu is superimposed on the image of the home device, allowing the user to control the device by interacting with its visual representation rather than searching through application interfaces. The system serves itself by using its own visual appearance as the control target.

Inventive Principle:

Principle #25Self-service

2Ease of operation

If application-based control interfaces are used, then device control is achieved, but user interaction becomes indirect and experience deteriorates

Engineering Contradiction:

Improveuser interaction qualityVSAvoidcontrol interface complexity

Core Design Contradiction:

Ease of operationVSDevice complexity

Solution Approach 1:

The patent merges the control interface with the visual representation of the home device. The control menu is superimposed directly on the image of the home device captured by the camera, combining the object being controlled with the controls for that object into a single integrated view, eliminating the need to switch between viewing the device and controlling it.

Inventive Principle:

Principle #5Merging (Combining)

Solution Approach 2:

The patent transitions from a traditional two-dimensional application screen to an augmented reality dimension where control elements are overlaid on the real-world image of the home device. This adds a spatial dimension to the interface, allowing controls to appear in the context of the actual device rather than in an abstract menu structure.

Inventive Principle:

Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS12562935B2Home device control method, terminal device, and computer-readable storage medium

Publication Date: 2026.02.24 PETAL CLOUD TECH CO LTD

AI summary

A method includes obtaining an image corresponding to a target area for control of a home device, determining a target home device based on the image, obtaining a control menu corresponding to the target home device, displaying the control menu in the image using an augmented reality (AR) technology, and controlling, in response to a selection operation in the control menu, the target home device to execute a target control instruction corresponding to the selection operation.