Vehicle Infotainment Gesture Control via Camera Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current vehicle infotainment systems lack intuitive control methods, especially for multiple occupants, as they require manual interaction with complex interfaces, which can be cumbersome and inefficient in autonomous vehicles where occupants are not engaged in driving.
Innovation Solution
A control method and apparatus using a camera to monitor the vehicle interior and display graphical user interfaces (GUIs) based on detected object motions in predefined regions, allowing occupants to control infotainment systems through gesture recognition and pointer interactions, enabling intuitive and simultaneous control by multiple users.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If manual interaction with complex interfaces is used, then control functionality is comprehensive, but ease of operation deteriorates
Solution Approach 1:
The patent replaces manual mechanical interaction with touchscreens or buttons by using gesture recognition through camera-based object detection. The system detects hand movements and gestures in the vehicle interior to control infotainment functions, substituting physical interface operations with optical detection and automated interpretation of user gestures.
Solution Approach 2:
The system automatically detects and interprets user gestures without requiring manual activation or complex menu navigation. The camera continuously monitors the vehicle interior, automatically identifies hand movements, and executes corresponding control functions, allowing the system to serve itself by interpreting user intent directly from visual data.
2Adaptability or versatility
If single-user control is implemented, then control simplicity is maintained, but adaptability to multiple occupants deteriorates
Solution Approach 1:
The patent divides the vehicle interior into multiple detection regions, each associated with specific seats or zones. The camera system segments the monitoring area to identify which occupant is making which gesture, allowing independent control assignments for different users based on their spatial location within the vehicle.
Solution Approach 2:
The gesture recognition system serves multiple functions: it identifies different occupants, determines their intended actions, and controls various infotainment functions. A single camera-based detection system handles user identification, gesture recognition, and control execution, making the system universally applicable to multiple users and multiple control tasks.
3Extent of automation
If autonomous driving is implemented, then driving automation is improved, but occupancy control complexity increases
Solution Approach 1:
The system replaces manual infotainment control operations with automated gesture recognition. Since autonomous driving already removes manual driving operations, this extends automation to infotainment control, allowing occupants to interact with the system through natural gestures rather than complex interfaces.
Data Source
AI summary
Disclosed are a control method and a control apparatus of vehicle infotainment, which use a camera monitoring a vehicle's interior, and a display providing a GUI of infotainment apparatuses. A processor obtains a monitoring image through the camera, displays a first GUI on the display in response to a first object motion detected in a first interest region which has been set beforehand in the monitoring image, and display a second GUI on the display in response to a second object motion detected in a second interest region which has been set beforehand in the monitoring image and which is separated from the first interest region. One or more of an autonomous vehicle, a user terminal and a server of the present invention can be associated with artificial intelligence modules, drones (unmanned aerial vehicles (UAVs)), robots, augmented reality (AR) devices, virtual reality (VR) devices, devices related to 5G service, etc.