AR Device Remote Control via Smart Plug Intermediary
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems lack the ability to remotely control devices without electrical coupling or communication, limiting the functionality of augmented reality (AR) applications in interacting with physical objects to activate and control devices such as computers, televisions, and radios.
Innovation Solution
An AR device uses computer vision and wireless means to detect and identify physical objects associated with devices, determining their position and orientation to trigger commands for activation or control, even when the objects are not electrically connected, by communicating with servers or smart plugs connected to the devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If AR device uses computer vision to detect physical objects for remote control, then ease of operation is improved, but device complexity increases
Solution Approach 1:
The patent introduces smart plugs as intermediary devices that bridge the gap between the AR device and target devices. The smart plug detects physical objects using sensors and communicates control commands to devices through electrical coupling, allowing the AR device to control devices remotely without direct physical interaction or complex integration with each target device.
Solution Approach 2:
The patent replaces traditional mechanical control methods (physical buttons, switches, and direct electrical coupling) with computer vision-based detection and wireless communication. The AR device uses cameras and image processing to detect physical objects and their orientations, then transmits control commands wirelessly through smart plugs, eliminating the need for direct mechanical or electrical connections.
2Adaptability or versatility
If AR device controls devices without electrical coupling, then adaptability is improved, but reliability worsens
Solution Approach 1:
The smart plug serves as a reliable intermediary that maintains electrical coupling with the target device while the AR device remains electrically uncoupled. The smart plug receives control commands from the AR device and executes them by establishing electrical connections with the target device, thus ensuring reliable control while maintaining adaptability to various devices.
Solution Approach 2:
The system creates a virtual representation of the physical control environment through computer vision. The AR device captures images of physical objects and their orientations, processes this visual information to determine control commands, and transmits these commands to smart plugs. This copying approach allows the AR device to adapt to various devices without direct physical coupling while maintaining control reliability through accurate visual recognition and command transmission.
Data Source
AI summary
An augmented-reality (AR) device detects a physical device located within a first predefined distance of the augmented-reality device. The AR device detects, using an optical sensor, a physical object located within a second predefined distance of the physical device, the physical object being electronically unconnected to the physical device. The AR device determines that the physical object is associated with the physical device and identifies a command based on an identification of both the physical object and the physical device. The physical device is configured to operate the command and display, in the display, virtual content as an overlay to the physical object.