Gesture-Based Mobile Terminal Control for In-Vehicle Remote Operation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current methods for controlling mobile terminals in vehicles are inconvenient as they require drivers or passengers to physically interact with vehicle terminal buttons, necessitating proximity and manual button pressing.
Innovation Solution
A vehicle terminal system that captures user gestures using a camera-equipped mobile terminal and sends corresponding operation instructions to another mobile terminal, allowing control through image recognition and a mapping relation between gestures and operations, enabling remote operation without physical button pressing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If physical buttons of the vehicle terminal are used to control the mobile terminal, then the control operation can be executed, but the driver or passenger must be close to the vehicle terminal and manually locate and press the desired button, which reduces convenience
Solution Approach 1:
The patent replaces the mechanical button-pressing system with an optical recognition system. The image capturing device captures images of gestures, and the processor recognizes these gestures to generate control instructions, substituting mechanical interaction with optical-field interaction. This resolves the contradiction by eliminating the need for physical proximity to buttons while maintaining control functionality.
Solution Approach 2:
The patent introduces an intermediary system consisting of the image capturing device, processor, and mapping relation database. This intermediary translates physical gestures into control instructions for the mobile terminal, serving as a mediator between the user and the target device. This resolves the contradiction by providing a new interaction pathway that doesn't require direct physical contact with vehicle terminal buttons.
2Ease of operation
If gesture recognition is used to control the mobile terminal, then remote operation without physical button pressing is enabled, but the system requires image capturing device, processing unit, and mapping relations between gestures and operations
Solution Approach 1:
The patent makes the mobile terminal with image capturing device serve multiple functions: it acts as both the gesture input device and the target control object. The same device that captures images can also be controlled through gestures captured by another instance of the same device type. This universality reduces system complexity by eliminating the need for dedicated separate components.
Solution Approach 2:
The patent uses the existing mobile terminal's display and image capturing capabilities as a template or model for the control system. The mapping relation database stores pre-defined gesture patterns that are copied and applied to generate control instructions. This copying approach simplifies the system by leveraging existing device functionalities rather than requiring entirely new components.
Data Source
Figure 1
Figure 2
Figure 3~5
AI summary
The present invention relates to a method and an apparatus for controlling a mobile terminal. The apparatus comprises: a receiving module for receiving gesture information from a first mobile terminal with an image capturing device, wherein the gesture information is from a user; and a sending module for sending a particular operation instruction to a second mobile terminal whose graphic user interface is being currently displayed on a display screen of a display device, so as to instruct the second mobile terminal to execute an operation corresponding to the particular operation instruction, wherein the particular operation instruction is related to the received gesture information. The method and the apparatus may improve convenience of controlling of the mobile terminal.