In-Vehicle Multi-Screen Gesture Transfer for Safer Display Sharing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional vehicle display systems require drivers to manually operate buttons or drag content to share information across displays, diverting attention and posing safety risks during vehicle travel.
Innovation Solution
A multi-screen interaction method that uses gesture recognition to trigger the display of a sub-image on another screen, allowing content to be shared by detecting specific hand gestures, such as five-finger or two-finger captures, and automatically moving the sub-image to the target display based on movement distance and orientation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If manual button operation or dragging content is used to share information across displays, then multi-screen interaction functionality is achieved, but driver attention is diverted and safety problems occur
Solution Approach 1:
The patent replaces manual mechanical operations (button pressing, dragging) with gesture recognition technology. The system detects gestures through sensors and automatically triggers content sharing between displays, eliminating the need for manual interaction while maintaining the multi-screen functionality. This substitution of mechanical operations with automated gesture detection resolves the contradiction by improving ease of operation without compromising safety.
2Reliability
If gesture recognition is used to trigger display content sharing, then driver distraction is reduced and safety is improved, but system complexity increases
Solution Approach 1:
The system performs self-service by automatically detecting gestures and executing content sharing operations without requiring manual confirmation or complex configuration. The gesture recognition system is integrated into the existing display architecture, allowing it to autonomously determine when content should be shared between screens based on detected gestures, thereby limiting the increase in system complexity.
3Ease of operation
If sub-image movement is associated with gesture movement, then interaction intuitiveness is improved, but processing time increases
Solution Approach 1:
The system performs preliminary action by pre-calculating and pre-positioning the sub-image at its destination before the gesture is fully completed. As the user performs the gesture, the system has already prepared the target display and is ready to transfer the content immediately upon gesture completion, thereby reducing the actual processing time while maintaining the intuitive visual feedback of sub-image movement throughout the gesture trajectory.
Data Source
AI summary
A multi-screen interaction method and apparatus, a terminal device, and a vehicle are provided, and relate to the field of intelligent vehicle technologies. In this method, after it is detected a specific gesture, content displayed on a first display is converted into a sub-image, and an identifier of another display capable of displaying the sub-image and orientation information relative to the first display are displayed on the first display, so that a user can intuitively see a movement direction of a subsequent gesture. Then, a second display is determined based on a movement direction of the specific gesture, and the sub-image is controlled to move as the specific gesture moves on the first display. When it is detected that a movement distance of the specific gesture is greater than a specified threshold, the sub-image moves to the second display. Therefore, a multi-screen interaction function is implemented.