3D Finger Pointing Interaction for Richer Vehicle Cockpit Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current gesture recognition systems in automobiles are limited in recognizing hand actions, resulting in fewer and simpler functions being implemented for human-computer interaction, restricting the richness of interactions possible in vehicle cockpits.
Innovation Solution
An interaction method that recognizes the direction pointed by a finger in a three-dimensional coordinate system, allowing for the adjustment of vehicle parameters or display of information based on the direction, enabling more complex and intuitive control of vehicle functions such as opening or closing windows and sunroofs.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If a single camera is used to recognize gestures, then the device complexity is reduced, but the measurement precision of finger pointing direction is insufficient
Solution Approach 1:
The patent transforms the two-dimensional image coordinates from a single camera into three-dimensional spatial coordinates by introducing depth information through multiple cameras. This dimensional upgrade enables precise determination of finger pointing direction in 3D space, resolving the precision limitation of single-camera systems while maintaining reasonable device complexity.
Solution Approach 2:
The patent combines data from multiple cameras to achieve accurate gesture recognition. By merging the image data and coordinate information from multiple camera sources, the system achieves high-precision measurement of finger pointing direction that would be unattainable with a single camera, while the integrated processing maintains system manageability.
2Device complexity
If limited hand actions are recognized, then the device complexity is reduced, but the adaptability of interaction functions is limited
Solution Approach 1:
The patent creates a universal gesture recognition system that can identify multiple types of hand actions including pointing, waving, and pinching gestures. The system uses a unified coordinate transformation approach that works across different gesture types, enabling the automobile device to adapt to various interaction scenarios without requiring separate recognition systems for each gesture type.
Solution Approach 2:
The patent implements dynamic gesture recognition that can adapt to different interaction contexts. The system dynamically determines the interaction target based on the calculated finger pointing direction and adjusts the response accordingly, allowing the same hardware to support diverse interaction functions from simple pointing to complex multi-gesture sequences.
Data Source
Figure 1~2
Figure 3~4
Figure 5(a)~6
AI summary
Embodiments of this application relate to the automotive field, and provide an interaction method and an electronic device. A direction pointed to by a finger can be recognized, so that a user can interact with the device based on the direction pointed to by the finger, to implement rich functions. The method includes: obtaining first spatial coordinates of a finger, where the first spatial coordinates are coordinates in a three-dimensional coordinate system; determining, based on the first spatial coordinates, a first direction to which the finger points; and adjusting a parameter of a target device, or displaying information about a target object based on the first direction.