Human-vehicle interaction method and system based on gesture recognition

Abstract

The invention is suitable for the technical field of man-vehicle interaction, and provides a man-vehicle interaction method and system based on gesture recognition, and the method comprises the following steps: receiving a gesture recognition starting instruction, starting a recognition camera, setting a display area of a central control screen as a pure color pattern, and enabling the recognition camera to directly face the central control screen; capturing a gesture in front of the central control screen through an identification camera to obtain a gesture image with the pure color pattern as a background and the user gesture as a foreground; the gesture image is transmitted to an instrument screen to be displayed, so that a user can conveniently carry out gesture adjustment according to the displayed gesture image; gesture features in the gesture image are recognized, a matched interaction command is determined, and the interaction command is displayed on an instrument screen; and receiving an interaction command confirmation instruction, and executing a corresponding interaction command. The gesture image is transmitted to the instrument screen to be displayed, so that a user can intuitively see the gesture action made by himself / herself, the adjustment is convenient, and the accuracy of the gesture is ensured.

Description

Technical Field

[0001] The present invention relates to the technical field of human-vehicle interaction, and specifically to a human-vehicle interaction method and system based on gesture recognition. Background Art

[0002] In the current automotive industry, with the continuous development of intelligent technologies, the human-vehicle interaction methods are also constantly innovating. Traditional human-vehicle interaction methods, such as buttons, knobs, and touchscreens, although meeting the needs of users to a certain extent, still have limitations in terms of convenience and intelligence. In recent years, gesture recognition, as a new type of human-vehicle interaction method, has received extensive attention due to its intuitive and natural characteristics. Through gesture recognition, users can interact with the vehicle through specific gesture actions, thereby achieving control of the vehicle. However, when existing gesture recognition technologies are applied to human-vehicle interaction, they still face some challenges. First, when users perform gesture operations in the vehicle, their line of sight often focuses on the front, while the capture direction of the camera usually points to the user's gestures. The capture directions of the human eye and the camera are often different, and there are differences between the gesture actions made by the user and the gesture actions captured by the camera, which affects the accuracy of gesture recognition. Second, in a relatively dark environment, combined with the complex background environment of the carriage, the recognition and capture of the camera will be interfered, further reducing the accuracy of gesture recognition. Therefore, it is necessary to provide a human-vehicle interaction method and system based on gesture recognition to solve the above problems. Summary of the Invention

[0003] Aiming at the deficiencies existing in the prior art, the purpose of the present invention is to provide a human-vehicle interaction method and system based on gesture recognition to solve the problems existing in the above background art.

[0004] The present invention is implemented as follows. A human-vehicle interaction method based on gesture recognition, the method includes the following steps:

[0005] Receive a gesture recognition start instruction input by the user, turn on the recognition camera, set the display area of the central control screen to a solid color pattern, and the recognition camera is directly opposite to the central control screen;

[0006] Capture the gesture in front of the central control screen through the recognition camera to obtain a gesture image with the solid color pattern as the background and the user's gesture as the foreground;

[0007] Transmit the gesture image to the instrument screen for display, facilitating the user to adjust the gesture according to the displayed gesture image;

[0008] Identify the gesture features in the gesture image, determine the matching interaction command, and display the interaction command on the instrument screen;

[0009] Receive an interaction command confirmation instruction and execute the corresponding interaction command.

[0010] As a further solution of the present invention: the step of setting the display area of the central control screen to a solid color pattern specifically includes:

[0011] Collect the light intensity of the vehicle cabin environment through a light sensor, and determine the display brightness of the central control screen according to the light intensity;

[0012] Retrieve the solid color pattern dedicated to gesture recognition, so that the display area of the central control screen is displayed according to the display brightness and the solid color pattern.

[0013] As a further solution of the present invention: the step of identifying the gesture features in the gesture image, determining the matching interaction command, and displaying the interaction command on the instrument screen specifically includes:

[0014] Remove the background color of the gesture image according to the color of the solid color pattern to obtain a gesture contour;

[0015] Input the gesture contour into the gesture library for matching, determine the gesture patterns and corresponding control commands with the top N matching values, where N is a fixed value;

[0016] Arrange and display the N gesture patterns and corresponding control commands on the instrument screen according to the matching values, and determine the control command ranked first as the interaction command.

[0017] As a further solution of the present invention: the step of receiving the interaction command confirmation instruction and executing the corresponding interaction command further includes:

[0018] Input the executed interaction command into the corresponding library of command levels, and output the next-level control command and corresponding gesture pattern corresponding to the interaction command;

[0019] Display several next-level control commands and gesture patterns on the instrument screen to give gesture prompts to the user.

[0020] As a further solution of the present invention: the method further includes:

[0021] Record user gesture interaction data, where the user gesture interaction data includes interaction commands and usage scenarios;

[0022] When receiving a gesture recognition start instruction, determine the current scenario, and determine the high-frequency interaction command according to the current scenario and user gesture interaction data;

[0023] Determine the high-frequency gesture pattern according to the high-frequency interaction command, and display the high-frequency gesture pattern and corresponding control command on the instrument screen.

[0024] As a further solution of the present invention: the gesture recognition start instruction is set on the steering wheel, and the interaction command confirmation instruction is triggered by touching any position on the central control screen.

[0025] Another object of the present invention is to provide a vehicle-human interaction system based on gesture recognition, and the system includes:

[0026] A gesture recognition start module, configured to receive a gesture recognition start instruction input by a user, turn on the recognition camera, set the display area of the central control screen to a solid color pattern, and the recognition camera is directly opposite the central control screen;

[0027] A gesture image acquisition module, configured to capture a gesture in front of the central control screen through the recognition camera to obtain a gesture image with the solid color pattern as the background and the user's gesture as the foreground;

[0028] A gesture image display module, configured to transmit the gesture image to the instrument screen for display, so that the user can adjust the gesture according to the displayed gesture image;

[0029] An interaction command display module, configured to recognize gesture features in the gesture image, determine a matching interaction command, and display the interaction command on the instrument screen;

[0030] An interaction command execution module, configured to receive an interaction command confirmation instruction and execute the corresponding interaction command.

[0031] As a further solution of the present invention: the interaction command display module includes:

[0032] A gesture contour determination unit, configured to remove the background color of the gesture image according to the color of the solid color pattern to obtain a gesture contour;

[0033] A gesture contour matching unit, configured to input the gesture contour into a gesture library for matching, determine gesture patterns and corresponding control commands with the top N matching values, where N is a fixed value;

[0034] A gesture pattern display unit, configured to arrange and display N gesture patterns and corresponding control commands on the instrument screen according to the matching value, and determine the control command ranked first as the interaction command.

[0035] As a further solution of the present invention: the interaction command execution module includes:

[0036] A subordinate control command unit, configured to input the executed interaction command into a command level corresponding library, and output the next-level control command corresponding to the interaction command and the corresponding gesture pattern;

[0037] A gesture display prompt unit for displaying a number of lower-level control commands and gesture patterns on the instrument screen to give gesture prompts to the user.

[0038] As a further solution of the present invention: The system further includes a user interaction recording module, and the user interaction recording module specifically includes:

[0039] An interaction data recording unit for recording user gesture interaction data, where the user gesture interaction data includes interaction commands and usage scenarios;

[0040] A high-frequency interaction command unit for determining the current scenario when receiving a gesture recognition start instruction, and determining high-frequency interaction commands according to the current scenario and user gesture interaction data;

[0041] A high-frequency gesture pattern unit for determining high-frequency gesture patterns according to high-frequency interaction commands, and displaying the high-frequency gesture patterns and corresponding control commands on the instrument screen.

[0042] Compared with the prior art, the beneficial effects of the present invention are:

[0043] When the present invention performs gesture recognition, the display area of the central control screen is set to a solid color pattern, and the recognition camera is directly facing the central control screen. The gesture in front of the central control screen is captured by the recognition camera to obtain a gesture image with the solid color pattern as the background and the user gesture as the foreground. In this way, the background of the gesture image is extremely simple, reducing the interference factors during camera recognition and capture, and improving the accuracy of gesture recognition. In addition, the solid color pattern on the central control screen can also be used as a light source, and the foreground gesture can be clearly recognized even in a dim environment. In addition, the present invention also transmits the gesture image to the instrument screen for display, and the user can intuitively see the gesture actions they make. In this way, the user can adjust their gesture actions according to the displayed gesture image to ensure the accuracy and standardization of the gestures. Description of the Drawings

[0044] Figure 1 It is a flowchart of a vehicle-human interaction method based on gesture recognition.

[0045] Figure 2 It is a flowchart of setting the display area to a solid color pattern in a vehicle-human interaction method based on gesture recognition.

[0046] Figure 3 It is a flowchart of recognizing gesture features in a gesture image in a vehicle-human interaction method based on gesture recognition.

[0047] Figure 4 It is a flowchart of displaying lower-level control commands and gesture patterns on the instrument screen in a vehicle-human interaction method based on gesture recognition.

[0048] Figure 5 It is a flowchart for recording user gesture interaction data in a vehicle - human interaction method based on gesture recognition.

[0049] Figure 6 It is a schematic structural diagram of a vehicle - human interaction system based on gesture recognition. Detailed implementation manners

[0050] To make the objectives, technical solutions and advantages of the present invention clearer, the present invention will be further described in detail below with reference to the accompanying drawings and specific embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0051] The following describes the specific implementation of the present invention in detail with reference to specific embodiments.

[0052] As Figure 1 shown, an embodiment of the present invention provides a vehicle - human interaction method based on gesture recognition. The method includes the following steps:

[0053] S100, Receive a gesture recognition start instruction input by the user, turn on the recognition camera, and set the display area of the central control screen to a solid - color pattern. The recognition camera is directly facing the central control screen;

[0054] S200, Capture a gesture in front of the central control screen through the recognition camera to obtain a gesture image with the solid - color pattern as the background and the user gesture as the foreground;

[0055] S300, Transmit the gesture image to the instrument screen for display, facilitating the user to adjust the gesture according to the displayed gesture image;

[0056] S400, Recognize the gesture features in the gesture image, determine the matching interaction command, and display the interaction command on the instrument screen;

[0057] S500, Receive an interaction command confirmation instruction and execute the corresponding interaction command.

[0058] It should be noted that gesture recognition, as a new type of vehicle-human interaction method, has received extensive attention due to its intuitive and natural characteristics. Through gesture recognition, users can interact with the vehicle through specific gesture actions, thereby achieving control of the vehicle. However, when existing gesture recognition technologies are applied to vehicle-human interaction, they still face some challenges. First, when users perform gesture operations in the vehicle, their line of sight often focuses on the front, while the capture direction of the camera usually points to the user's gestures. The capture directions of the human eye and the camera are often different, and there are differences between the gesture actions made by the user and the gesture actions captured by the camera, which affects the accuracy of gesture recognition. Second, in a relatively dark environment, combined with the complex background environment of the carriage, the recognition and capture of the camera will be interfered, further reducing the accuracy of gesture recognition. The embodiments of the present invention aim to solve the above problems.

[0059] In the embodiments of the present invention, when a user needs to use gestures for vehicle-human interaction, first, a gesture recognition start instruction needs to be input. For the convenience of the driver's operation, the gesture recognition start instruction is set on the steering wheel. Then, the user needs to move one hand above the central control screen to make gesture actions. After receiving the gesture recognition start instruction, the recognition camera will be automatically turned on. The recognition camera is used to collect the user's gestures. At the same time, the display area of the central control screen will be set to a solid color pattern, such as white, green, etc. It should be noted that the recognition camera is directly facing the central control screen. Through this recognition camera, the gesture in front of the central control screen is captured, and a gesture image with the solid color pattern as the background and the user's gesture as the foreground is obtained. In this way, the background of the gesture image is extremely simple, reducing the interference factors during camera recognition and capture, and improving the accuracy of gesture recognition. In addition, the solid color pattern on the central control screen can also be used as a light source. In a relatively dark environment, the foreground gesture can also be clearly recognized. Then, the gesture image will be transmitted to the instrument screen for display. The user can intuitively see the gesture actions they have made. In this way, the user can adjust their gesture actions according to the displayed gesture image to ensure the accuracy and standardization of the gestures. Then, the embodiments of the present invention will automatically recognize the gesture features in the gesture image, determine the matching interaction command, and display the interaction command on the instrument screen. Finally, when the user inputs an interaction command confirmation instruction, the embodiments of the present invention will automatically execute the corresponding interaction command. For convenience, the interaction command confirmation instruction is triggered by touching any position on the central control screen. In this way, the user does not need to turn their head to look at the central control screen to trigger it, which is efficient and convenient.

[0060] As Figure 2 shown, as a preferred embodiment of the present invention, the step of setting the display area of the central control screen to a solid color pattern specifically includes:

[0061] S101. Collect the light intensity of the carriage environment through a light sensor, and determine the display brightness of the central control screen according to the light intensity.

[0062] S102. Retrieve the solid-color pattern dedicated to gesture recognition, so that the display area of the central control screen is displayed according to the display brightness and the solid-color pattern.

[0063] In the embodiment of the present invention, in order to obtain a better acquisition effect of the gesture image, a light sensor is installed in the carriage. When receiving the gesture recognition start instruction input by the user, the light sensor will also be turned on. The light intensity of the carriage environment is collected through the light sensor, and the display brightness of the central control screen is determined according to the light intensity. The corresponding relationship between the light intensity and the display brightness needs to be set in advance. Then, the solid-color pattern dedicated to gesture recognition is retrieved, so that the display area of the central control screen is displayed according to the display brightness and the solid-color pattern. In this way, the effect is better.

[0064] As Figure 3 shown, as a preferred embodiment of the present invention, the steps of recognizing the gesture features in the gesture image, determining the matching interaction command, and displaying the interaction command on the instrument screen specifically include:

[0065] S401. Remove the background color of the gesture image according to the color of the solid-color pattern to obtain the gesture contour.

[0066] S402. Input the gesture contour into the gesture library for matching, and determine the gesture patterns and corresponding control commands with the top N matching values, where N is a fixed value.

[0067] S403. Arrange and display the N gesture patterns and corresponding control commands on the instrument screen according to the matching values, and determine the control command ranked first as the interaction command.

[0068] In the embodiment of the present invention, after the gesture image is collected, the background color of the gesture image will be automatically removed according to the color of the solid-color pattern to obtain the gesture contour. In this way, the gesture contour can be obtained accurately and efficiently. Then, the gesture contour is input into the gesture library for matching. The gesture library needs to be formulated in advance. The gesture library includes several gesture patterns, and each gesture pattern corresponds to a control command. Then, the gesture contour is sequentially matched with all the gesture patterns to determine the gesture patterns and corresponding control commands with the top N matching values, where N is a fixed value, for example, five. Finally, these five gesture patterns and corresponding control commands are arranged and displayed on the instrument screen according to the matching values, and the control command ranked first is determined as the interaction command.

[0069] As Figure 4As shown, as a preferred embodiment of the present invention, the step of receiving an interactive command confirmation instruction and executing a corresponding interactive command further includes:

[0070] S501, input the executed interactive command into the command level corresponding library, and output the next-level control command corresponding to the interactive command and the corresponding gesture pattern;

[0071] S502, display a plurality of next-level control commands and gesture patterns on the instrument screen to give gesture prompts to the user.

[0072] In the embodiment of the present invention, it is easy to understand that as the functions of the car are increasing and the in-vehicle commands are also increasing, it is difficult for users to remember a large number of gesture patterns. Based on this, the embodiment of the present invention constructs a command level corresponding library, which includes gesture patterns of several levels and corresponding control commands. Users only need to remember the gesture patterns of the first level, and the gesture patterns of subsequent levels will be reminded. Specifically, the interactive command determined by the user to be executed will be automatically input into the command level corresponding library, and the next-level control command corresponding to the interactive command and the corresponding gesture pattern will be output. Then, a plurality of next-level control commands and gesture patterns will be displayed on the instrument screen to give gesture prompts to the user, and the user can make the next-level gesture pattern according to the needs, which is more convenient to use.

[0073] As Figure 5 shown, as a preferred embodiment of the present invention, the method further includes:

[0074] S601, record user gesture interaction data, where the user gesture interaction data includes interactive commands and usage scenarios;

[0075] S602, when receiving a gesture recognition start instruction, determine the current scenario, and determine the high-frequency interactive command according to the current scenario and the user gesture interaction data;

[0076] S603, determine the high-frequency gesture pattern according to the high-frequency interactive command, and display the high-frequency gesture pattern and the corresponding control command on the instrument screen.

[0077] In the embodiment of the present invention, the user gesture interaction data will also be recorded. The user gesture interaction data includes interactive commands and usage scenarios, and the usage scenarios include high-temperature weather, rain and fog weather, cold weather, etc. When receiving a gesture recognition start instruction, the weather forecast will be retrieved to determine the current scenario, and the high-frequency interactive commands frequently used by the user in the current scenario will be determined according to the current scenario and the user gesture interaction data. Then, the high-frequency gesture pattern will be determined according to the high-frequency interactive command, and the high-frequency gesture pattern and the corresponding control command will be displayed on the instrument screen to give gesture prompts to the user.

[0078] AsFigure 6 As shown in Figure 6 , an embodiment of the present invention further provides a vehicle - human interaction system based on gesture recognition, and the system includes:

[0079] A gesture recognition start module 100, configured to receive a gesture recognition start instruction input by a user, turn on an identification camera, and set a display area of a central control screen as a solid - color pattern, where the identification camera is directly facing the central control screen;

[0080] A gesture image acquisition module 200, configured to capture a gesture in front of the central control screen through the identification camera, and obtain a gesture image with the solid - color pattern as the background and the user's gesture as the foreground;

[0081] A gesture image display module 300, configured to transmit the gesture image to an instrument screen for display, so that the user can adjust the gesture according to the displayed gesture image;

[0082] An interaction command display module 400, configured to identify gesture features in the gesture image, determine a matching interaction command, and display the interaction command on the instrument screen;

[0083] An interaction command execution module 500, configured to receive an interaction command confirmation instruction and execute the corresponding interaction command.

[0084] As a preferred embodiment of the present invention, the interaction command display module 400 includes:

[0085] A gesture contour determination unit, configured to remove the background color of the gesture image according to the color of the solid - color pattern to obtain a gesture contour;

[0086] A gesture contour matching unit, configured to input the gesture contour into a gesture library for matching, determine gesture patterns and corresponding control commands with the top N matching values, where N is a fixed value;

[0087] A gesture pattern display unit, configured to arrange and display N gesture patterns and corresponding control commands on the instrument screen according to the matching values, and determine the control command ranked first in the arrangement as the interaction command.

[0088] As a preferred embodiment of the present invention, the interaction command execution module 500 includes:

[0089] A subordinate control command unit, configured to input the executed interaction command into a command - level corresponding library, and output the next - level control command corresponding to the interaction command and the corresponding gesture pattern;

[0090] A gesture display prompt unit, configured to display several next - level control commands and gesture patterns on the instrument screen to give gesture prompts to the user.

[0091] As a preferred embodiment of the present invention, the system further includes a user interaction recording module, and the user interaction recording module specifically includes:

[0092] An interaction data recording unit for recording user gesture interaction data, where the user gesture interaction data includes interaction commands and usage scenarios;

[0093] A high-frequency interaction command unit for determining the current scenario when receiving a gesture recognition start instruction, and determining high-frequency interaction commands according to the current scenario and user gesture interaction data;

[0094] A high-frequency gesture pattern unit for determining high-frequency gesture patterns according to high-frequency interaction commands, and displaying the high-frequency gesture patterns and corresponding control commands on the instrument screen.

[0095] The above only describes the preferred embodiments of the present invention in detail, and is not intended to limit the present invention. Any modifications, equivalent replacements, and improvements made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

[0096] It should be understood that although the steps in the flowcharts of the embodiments of the present invention are shown in sequence according to the arrows, these steps do not necessarily have to be executed in the order indicated by the arrows. Unless clearly stated in this article, the execution of these steps has no strict order limitation, and these steps can be executed in other orders. Moreover, at least some of the steps in each embodiment may include multiple sub-steps or multiple stages. These sub-steps or stages do not necessarily have to be executed at the same time, but can be executed at different times. The execution order of these sub-steps or stages does not necessarily have to be sequential, but can be executed alternately or alternately with at least a part of other steps or sub-steps or stages of other steps.

[0097] Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be completed by instructing relevant hardware through a computer program. The program can be stored in a non-volatile computer-readable storage medium. When the program is executed, it can include the processes of the embodiments of the above methods. Among them, any reference to a memory, storage, database, or other medium used in the embodiments provided in the present application can include non-volatile and / or volatile memories. Non-volatile memories can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memories can include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), Rambus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and Rambus dynamic RAM (RDRAM), etc.

[0098] After considering the specification and the disclosure of the embodiments, those skilled in the art will readily conceive of other embodiments of the present disclosure. The present application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include known common knowledge or conventional technical means in the technical field not disclosed in the present disclosure. The specification and the embodiments are only regarded as exemplary, and the true scope and spirit of the present disclosure are pointed out by the claims.

Claims

1. A vehicle - human interaction method based on gesture recognition, characterized in that, The method includes the following steps: Receive a gesture recognition start instruction input by the user, turn on the recognition camera, set the display area of the central control screen to a solid color pattern, and the recognition camera faces the central control screen directly; Capture the gesture in front of the central control screen through the recognition camera to obtain a gesture image with the solid color pattern as the background and the user's gesture as the foreground; Transmit the gesture image to the instrument screen for display, facilitating the user to adjust the gesture according to the displayed gesture image; Recognize the gesture features in the gesture image, determine the matching interaction command, and display the interaction command on the instrument screen; Receive an interaction command confirmation instruction and execute the corresponding interaction command.

2. The method for vehicle-human interaction based on gesture recognition according to claim 1, wherein The step of setting the display area of the central control screen to a solid color pattern specifically includes: Collect the light intensity of the carriage environment through a light sensor and determine the display brightness of the central control screen according to the light intensity; Retrieve the solid color pattern dedicated to gesture recognition, so that the display area of the central control screen is displayed according to the display brightness and the solid color pattern.

3. The method for vehicle - human interaction based on gesture recognition according to claim 1, wherein, The step of recognizing the gesture features in the gesture image, determining the matching interaction command, and displaying the interaction command on the instrument screen specifically includes: Remove the background color of the gesture image according to the color of the solid color pattern to obtain a gesture contour; Input the gesture contour into the gesture library for matching, determine the gesture samples and corresponding control commands with the top N matching values, where N is a fixed value; Arrange and display the N gesture samples and corresponding control commands on the instrument screen according to the matching values, and determine the control command ranked first as the interaction command.

4. The vehicle-human interaction method based on gesture recognition according to claim 1, wherein The step of receiving the interaction command confirmation instruction and executing the corresponding interaction command further includes: Input the executed interaction command into the corresponding library of command levels, and output the next-level control command corresponding to the interaction command and the corresponding gesture sample; Display several next-level control commands and gesture samples on the instrument screen to give gesture prompts to the user.

5. The method for vehicle-human interaction based on gesture recognition according to claim 1, wherein The method further includes: Record the user gesture interaction data, where the user gesture interaction data includes interaction commands and usage scenarios; When receiving a gesture recognition start instruction, determine the current scenario, and determine the high-frequency interaction command according to the current scenario and the user gesture interaction data; Determine the high-frequency gesture sample according to the high-frequency interaction command, and display the high-frequency gesture sample and the corresponding control command on the instrument screen.

6. The vehicle-human interaction method based on gesture recognition according to claim 1, characterized in that, The gesture recognition start instruction is set on the steering wheel, and the interaction command confirmation instruction is triggered by touching any position of the central control screen.

7. A vehicle-human interaction system based on gesture recognition, characterized in that, The system includes: A gesture recognition start module for receiving a gesture recognition start instruction input by the user, turning on the recognition camera, setting the display area of the central control screen to a solid color pattern, and the recognition camera faces the central control screen directly; A gesture image acquisition module for capturing the gesture in front of the central control screen through the recognition camera to obtain a gesture image with the solid color pattern as the background and the user's gesture as the foreground; A gesture image display module for transmitting the gesture image to the instrument screen for display, facilitating the user to adjust the gesture according to the displayed gesture image; An interactive command display module, which is used to identify the gesture features in the gesture image, determine the matching interactive command, and display the interactive command on the instrument screen; An interactive command execution module, which is used to receive an interactive command confirmation instruction and execute the corresponding interactive command.

8. The vehicle-human interaction system based on gesture recognition according to claim 7, wherein The interactive command display module includes: A gesture contour determination unit, which is used to remove the background color of the gesture image according to the color of the solid color pattern to obtain a gesture contour; A gesture contour matching unit, which is used to input the gesture contour into the gesture library for matching, determine the gesture patterns and corresponding control commands with the top N matching values, where N is a fixed value; A gesture pattern display unit, which is used to arrange and display N gesture patterns and corresponding control commands on the instrument screen according to the matching values, and determine the control command ranked first in the arrangement as the interactive command.

9. The vehicle-human interaction system based on gesture recognition according to claim 7, characterized in that The interactive command execution module includes: A subordinate control command unit, which is used to input the executed interactive command into the corresponding library of command levels, and output the next-level control command and corresponding gesture pattern corresponding to the interactive command; A gesture display prompt unit, which is used to display several next-level control commands and gesture patterns on the instrument screen to give gesture prompts to the user.

10. The vehicle-human interaction system based on gesture recognition according to claim 7, wherein, The system further includes a user interaction record module, and the user interaction record module specifically includes: An interaction data recording unit, which is used to record user gesture interaction data, and the user gesture interaction data includes interactive commands and usage scenarios; A high-frequency interactive command unit, which is used to determine the current scenario when receiving a gesture recognition start instruction, and determine the high-frequency interactive command according to the current scenario and user gesture interaction data; A high-frequency gesture pattern unit, which is used to determine the high-frequency gesture pattern according to the high-frequency interactive command, and display the high-frequency gesture pattern and the corresponding control command on the instrument screen.

Images