Visual Remote Control for Touch-Enabled Devices
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing remote control systems for touch-controllable devices require users to manually select devices from a list, making it difficult to identify and control multiple devices, especially when there are many, and rely on graphical interfaces for simulated parameter adjustments.
Innovation Solution
A visual remote control method and system that uses a control center device to obtain a video image, extract local features, match them with stored visual features, and send the video image and identifiers to a remote device, allowing users to directly control touch-controllable devices within the video image, with the ability to adjust parameters in real-time.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If users manually select devices from a device list, then device control is possible, but it becomes difficult to identify and control multiple devices when there are many types and a large quantity
Solution Approach 1:
The patent replaces the manual mechanical selection process (scrolling through lists, clicking device names) with an optical recognition system. A camera captures images of devices in the physical space, and image recognition algorithms automatically identify and select devices based on their visual appearance, eliminating the need for manual list navigation.
Solution Approach 2:
The system creates a visual copy (image) of the physical device environment and processes this copy to identify devices. Instead of interacting with abstract device identifiers in a list, users see actual images of devices and can select them visually, making the selection process intuitive even when managing many devices.
2Adaptability or versatility
If remote control uses graphical interface for device status, then remote control capability is achieved, but the user cannot conveniently determine which device to control from video image
Solution Approach 1:
The patent merges the video feed from the camera with the device identification information. Device identifiers, names, or other relevant information are overlaid directly on the corresponding devices in the video image, combining visual information with identification data in a single integrated display that helps users quickly determine which device to control.
Solution Approach 2:
The system introduces an intermediary layer between the camera and the user - an image processing system that automatically detects devices in the video feed and annotates them with identification information. This intermediary processes the raw video to extract meaningful device information and presents it in a user-friendly format.
3Quantity of substance
If users scroll through device lists to find devices, then all devices can be accessed, but it consumes significant time and reduces efficiency
Solution Approach 1:
The system performs preliminary actions by automatically detecting, identifying, and organizing devices in the environment before the user needs to select them. The image recognition system pre-processes the device list by visually identifying devices and preparing their information for quick access, eliminating the need for users to manually search through lists.
Solution Approach 2:
The patent transitions from a one-dimensional device list (text-based, linear scrolling) to a two-dimensional visual space (video image with spatial arrangement). Devices are presented in their physical spatial context rather than an arbitrary list order, allowing users to quickly locate devices based on their visual position and appearance in the environment.
Data Source
Figure 1~2
Figure 3
Figure 4
AI summary
Embodiments of the present invention provide a visual remote control method and system for a touch-controllable device, and a related device. The method includes: obtaining, by a control center device, a video image; determining, by the control center device, an identifier of each of at least one touch-controllable device in the video image; and sending, by the control center device, the video image and the identifier of each touch-controllable device to a remote device, so that a user can control the touch-controllable device in the video image by using the remote device. According to the foregoing technical solution, the user can conveniently determine and control, from the video image, a touch-controllable device that can be remotely controlled.