AR Device Recognition for Intuitive Multi-Device Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for selecting and interacting with multiple electronic devices are cumbersome, requiring complex user operations such as menus, maps, or NFC, and lack intuitive device identification and control mechanisms.
Innovation Solution
A device identification method using a camera-equipped electronic device that captures images, applies image recognition to identify devices, determines their location and type, and superimposes labels or controls in real-time augmented reality, enabling intuitive device interaction and control through simple operations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If menu/list or map methods are used to select devices, then device selection capability is provided, but user operation complexity increases
Solution Approach 1:
The patent replaces traditional mechanical interaction methods (menu navigation, map selection, NFC tapping) with an optical recognition system. The camera captures images of devices, and image recognition algorithms automatically identify target devices, substituting complex manual operations with automated visual detection and selection.
Solution Approach 2:
The system enables devices to be self-identifiable through visual features. Instead of requiring users to manually search through lists or menus, the camera-based system allows devices to present their identity information visually, and the system automatically recognizes and identifies them, making the selection process intuitive and self-service oriented.
2Loss of information
If traditional device selection methods are used, then device identification is achieved, but interaction intuitiveness deteriorates
Solution Approach 1:
The patent employs visual display elements including colored bounding boxes, labels, and graphical overlays on the captured image to indicate device identity and selection status. Different colors and visual cues are used to distinguish between different devices and their states, making identity information immediately visible and intuitive to users.
Solution Approach 2:
The system transitions from traditional 2D menu interfaces to an augmented reality overlay on the camera's real-world view. Device identity information is displayed in the same spatial context where the device physically exists in the user's field of view, creating a seamless integration between the digital information layer and the physical world layer.
3Adaptability or versatility
If multiple devices are present, then device diversity is increased, but selection difficulty increases
Solution Approach 1:
The system segments the visual field into distinct regions, each containing one or more devices. The image recognition algorithm separately identifies and bounds each device with its own visual indicators (bounding boxes, labels), allowing users to clearly distinguish between multiple devices and select the desired one without confusion.
Solution Approach 2:
The patent introduces visual intermediaries in the form of bounding boxes, labels, and graphical overlays that mediate between the physical devices and the user's selection intent. These visual elements serve as intermediaries that make invisible device identities visible and selectable, bridging the gap between multiple physical devices and the user's cognitive understanding.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A device identification method and a related apparatus are disclosed. The method includes: A first electronic device receives a first operation, displays a first interface, and starts a camera, where the first interface includes a preview image captured by the camera, and a second electronic device is included in the preview image; the first electronic device determines a display location of a first label of the second electronic device in the preview image according to an image recognition technology and a wireless positioning technology, where the first label is used to identify the second electronic device; and the first electronic device outputs a second interface when the first electronic device detects a user operation for the first label, where the second interface includes one or more controls for controlling the second electronic device. In this application, a correspondence between the first label and the second electronic device is presented in real time in an augmented reality display manner, and interaction between the first electronic device and the second electronic device is implemented by using the first label, thereby implementing coordination control between a plurality of devices, and improving user experience.