Mobile Device Universal Remote Control via Visual Recognition
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing communication devices using proximity wireless communication for home appliances require multiple operations and devices to control and register apparatuses, leading to complexity and inefficiency, especially when managing multiple controlled apparatuses.
Innovation Solution
A wireless communication terminal, such as a mobile device, equipped with RFID, GPS, and motion sensors, provides an extended user interface for home appliances by simplifying the control process through a universal remote control functionality, allowing for easy registration and operation of multiple devices using a single mobile device.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a conventional remote controller with IC tag reading unit is used to control multiple apparatuses, then apparatus information can be read and registered, but the user needs to perform multiple operations via display unit, buttons, and keys to select and control the desired apparatus
Solution Approach 1:
The patent replaces the mechanical button-pressing system with a camera-based visual recognition system. The camera captures an image of the apparatus, and image recognition technology automatically identifies the apparatus type and model, eliminating the need for manual selection through buttons and keys. This substitution dramatically reduces the time and complexity of apparatus selection while maintaining accurate control.
2Ease of operation
If operation sheets are prepared for each electronic apparatus to enable proximity wireless communication control, then control information can be easily accessed, but the number of operation sheets increases significantly as the number of electronic apparatuses increases
Solution Approach 1:
The patent implements a universal remote control system where a single operation sheet with a camera can control multiple different electronic apparatuses. The camera captures images of various apparatuses, and the system automatically recognizes and adapts to different device types, eliminating the need for separate operation sheets for each apparatus. This multi-functional approach reduces the quantity of operation sheets from multiple to just one.
3Ease of operation
If angle sensors and multiple devices (remote control device, control device, display device) are used to determine pointed location, then the operator can select buttons by pointing, but the system complexity increases with multiple devices needed
Solution Approach 1:
The patent merges the functions of the remote control device, control device, and display device into a single integrated smartphone. The smartphone combines the camera for image capture, processing unit for image recognition, display for showing control options, and communication unit for transmitting commands. This consolidation reduces the system from multiple separate devices to one unified device, simplifying the overall system while maintaining the pointing selection functionality.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The solution enables a streamlined and intuitive control of home appliances using a mobile device, reducing the need for multiple devices and operations, enhancing user convenience and efficiency in managing multiple apparatuses.
Implementation Method 1
a NFC unit that reads apparatus information from an IC tag
Data Source
Figure 1
Figure 2(a)~2(c)
Figure 3
AI summary
A mobile device (102) includes a position sensing unit (206), a remote control information obtainment unit (212), and a storage unit (213). Position information obtained by the position sensing unit (206) is stored in the storage unit (213) in association with remote control information. The mobile device (102) further includes a directional space obtainment unit (208) and an apparatus specification unit (209). The mobile device (102) recognizes a direction pointed by a user using the mobile device (102), and enables operation of a terminal apparatus (101) existing in the pointing direction.