Camera-Based Remote Control via Visual Recognition
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing remote control systems for home appliances require users to physically locate and interact with switches or remote controllers, which can be cumbersome and require remembering device-specific controls.
Innovation Solution
An information processor with a camera and display that recognizes target devices and overlays operation images on the user's field of view, allowing finger gestures to control the devices remotely by detecting finger position and size changes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a remote controller is used to operate a target device, then the operator does not need to move to the device location, but the operator must look for the remote controller and remember device-specific button positions
Solution Approach 1:
The patent replaces the mechanical remote controller system with an optical-based system. Instead of using a physical remote controller with buttons, the system uses a camera to capture images of the target device and a display to show operation interfaces overlaid on the captured image. This substitution eliminates the need to carry and operate a separate remote controller, reducing operational complexity while maintaining remote operation capability.
Solution Approach 2:
The system creates a universal operation interface that can control multiple different target devices through a single integrated system. The operation image display unit can adaptively show different operation interfaces based on the captured device image, making one system capable of operating various devices without requiring device-specific remote controllers or memorization of different button layouts.
2Ease of operation
If the switch location is changed for each target device, then device operation can be simplified, but the operator must remember the switch location for each device
Solution Approach 1:
The patent replaces the physical switch interface with a visual operation image interface displayed on a screen. Instead of requiring users to locate and press physical switches on devices, the system captures images of devices with a camera and overlays virtual operation images showing where to touch on the screen. This substitution eliminates the need to remember physical switch locations across different devices.
Solution Approach 2:
The system creates a visual copy or representation of the device interface through captured images and overlaid operation images. This copying approach allows users to see the operation interface directly on the device image, eliminating the need to remember abstract switch locations and providing intuitive visual guidance for each device.
3Ease of operation
If a unified remote console with augmented reality interface is used, then appliance identification and operation can be simplified, but the system requires camera, display, and vision-based recognition algorithms
Solution Approach 1:
The patent merges the camera function, display function, and operation control function into an integrated system. The camera captures device images, the display shows overlaid operation interfaces on those images, and the operation input unit processes user interactions. This merging creates a unified remote console that provides augmented reality-like operation without requiring separate complex subsystems.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Disclosed herein is an information processor including, a storage section configured to store data representing the appearance features of a target device and data of an operation image used for operation of the target device, an acquisition section configured to acquire an image captured by a camera, a recognition section configured to recognize an object included in the image based on the feature quantity data stored in the storage section, and a display control section configured to display the operation image based on the data of the operation image stored in the storage section if the object included in the image is recognized by the recognition section as the target device.