Camera-Based Device Interaction via Screen Image Recognition
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current methods for device interaction, such as cable connections, Bluetooth, and Wi-Fi, are limited by distance, cost, and stability, and often require manual user intervention, posing safety hazards, especially in vehicle-mounted systems.
Innovation Solution
A method and apparatus utilizing image recognition to capture and transmit images of applications from one device to another, allowing for wireless interaction without manual operation, using a camera to identify and run corresponding applications on the second device.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If cable connection is used for device interaction, then connection stability is improved, but device complexity and cost increase due to cable requirements
Solution Approach 1:
The patent replaces the mechanical cable connection system with an optical system using camera to capture screen images and transmit application information wirelessly, eliminating the need for physical cables while maintaining connection functionality
Solution Approach 2:
The patent uses optical copying by capturing the screen display through a camera to obtain application information, creating a visual copy of the interface data without requiring direct device connection
2Device complexity
If Bluetooth connection is used for device interaction, then device complexity is reduced, but connection distance is limited
Solution Approach 1:
The patent transitions from radio wave transmission in three-dimensional space to optical image transmission in two-dimensional visual space, allowing the receiving device to capture application information from any position within camera range rather than being constrained by Bluetooth distance limits
3Length of moving object
If Wi-Fi connection is used for device interaction, then connection distance is improved, but connection stability deteriorates due to signal interference
Solution Approach 1:
The patent replaces the electromagnetic radio wave transmission system with an optical imaging system, substituting signal-based communication with visual information capture that is immune to electromagnetic interference and signal instability
4Adaptability or versatility
If manual switching between devices is implemented, then connection flexibility is improved, but safety hazards increase due to user distraction
Solution Approach 1:
The system performs automatic application recognition and switching without requiring user intervention. The camera automatically captures the screen, the system automatically identifies the application, and automatically executes the corresponding operation on the second device, making the entire process self-service and eliminating user distraction
Solution Approach 2:
The system pre-configures multiple devices and their corresponding applications, establishing binding relationships in advance. When the camera captures the screen, the system can immediately match and execute the pre-configured application without requiring real-time user decision-making
5Ease of operation
If image recognition technology is used for device interaction, then ease of operation is improved, but measurement precision requirements increase for accurate application identification
Solution Approach 1:
The system performs preliminary processing by capturing the entire screen image and preprocessing it to extract application icon regions before detailed recognition, improving recognition accuracy by focusing computational resources on relevant areas
Data Source
AI summary
The present invention relates to a method and apparatus for interaction between devices. The method comprises: receiving an image related to a first application from a first device, the image being captured by a camera from a screen of the first device; searching a second device for a second application according to the received image; and after the second application is found from the second device, running the second application in the second device, wherein the first application and the second application are the same applications or are applications of the same type.