Gesture recognition-based vehicle gear shifting method, device, equipment, and storage medium

Abstract

This application discloses a vehicle gear shifting method, apparatus, device, and storage medium based on gesture recognition, relating to the field of vehicle control technology. The disclosed method includes: determining a gear position gesture recognition function activation result based on at least one of the current gear position, brake pedal state information, accelerator pedal state information, and vehicle speed information; acquiring dynamic gestures of the driver's left hand and / or right hand based on the activation result, and determining a target gesture recognition strategy; and determining the vehicle gear shifting result based on the driver's left hand and / or right hand dynamic gestures using the target gesture recognition strategy. This provides a simplified gear shifting scheme to improve the accuracy of gesture recognition during gear shifting.

Description

Technical Field

[0001] This application relates to the field of vehicle control technology, and in particular to a vehicle gear shifting method, device, equipment and storage medium based on gesture recognition. Background Technology

[0002] With the continuous advancement of intelligent technology, automotive human-machine interaction control technology has evolved from traditional physical button control systems to touch control systems and voice control systems, and is gradually evolving towards higher-level interaction methods such as gesture control, vision control, and brainwave control. The automotive industry is undergoing a transformation from mechanization to intelligence, and physical switches, buttons, knobs, gear levers, and other similar devices are gradually being phased out or eliminated.

[0003] Some existing intelligent shifting schemes require the driver to look at the screen and slide their finger across a specific area, which is not simplified enough, easily distracts the driver, and is detrimental to driving safety. Other intelligent shifting schemes control the vehicle through gesture recognition, but to reduce misidentification, secondary gesture recognition is required, which is inconvenient for the driver. Therefore, providing a simpler shifting scheme to improve the accuracy of gesture recognition during shifting is a problem that needs to be solved.

[0004] The above content is only used to help understand the technical solution of this application and does not represent an admission that the above content is prior art. Summary of the Invention

[0005] The main objective of this application is to provide a vehicle gear shifting method, device, equipment, and storage medium based on gesture recognition, aiming to solve the technical problem of how to provide a simple gear shifting scheme to improve the accuracy of gesture recognition during gear shifting.

[0006] To achieve the above objectives, this application proposes a vehicle gear shifting method based on gesture recognition, the method comprising:

[0007] The activation result of the gear position gesture recognition function is determined based on at least one of the current gear position, brake pedal status information, accelerator pedal status information, and vehicle speed information.

[0008] Based on the activation result of the gear position gesture recognition function, the driver's left-hand dynamic gesture and / or the driver's right-hand dynamic gesture are collected, and the target gesture recognition strategy is determined;

[0009] The target gesture recognition strategy determines the vehicle's gear shifting result based on the driver's left-hand dynamic gesture and / or the driver's right-hand dynamic gesture.

[0010] In one embodiment, the step of determining the gear position gesture recognition function activation result based on at least one of the current gear position, brake pedal state information, accelerator pedal state information, and vehicle speed information includes:

[0011] When the current gear is park, determine whether to activate the neutral hand gesture recognition function based on the brake pedal status information and the accelerator pedal status information, and obtain the first activation result;

[0012] When the first activation result is that the neutral gear gesture recognition function is activated, the reverse gear gesture recognition function and the forward gear gesture recognition function are determined based on the vehicle speed information to obtain the second activation result.

[0013] The activation result of the gear position gesture recognition function is determined based on the first activation result and / or the second activation result.

[0014] In one embodiment, the step of determining the gear position gesture recognition function activation result based on at least one of the current gear position, brake pedal state information, accelerator pedal state information, and vehicle speed information includes:

[0015] When the current gear is neutral, the system identifies whether the parking gear gesture recognition function is activated based on the vehicle speed information, and obtains a third activation result.

[0016] When the third activation result is that the parking gear gesture recognition function is activated, the reverse gear gesture recognition function and the forward gear gesture recognition function are determined based on the brake pedal status information and the accelerator pedal status information to obtain the fourth activation result.

[0017] When the third activation result is that the parking gear gesture recognition function is not activated, the reverse gear gesture recognition function and the forward gear gesture recognition function are activated based on the accelerator pedal status information to obtain the fourth activation result.

[0018] The activation result of the gear shift gesture recognition function is determined based on the third activation result and the fourth activation result.

[0019] In one embodiment, the step of determining the gear position gesture recognition function activation result based on at least one of the current gear position, brake pedal state information, accelerator pedal state information, and vehicle speed information includes:

[0020] When the current gear is drive or reverse, activate the neutral gear gesture recognition function, and determine whether to activate the parking gear gesture recognition function based on the vehicle speed information to obtain the fifth activation result;

[0021] When the fifth activation result is that the parking gear gesture recognition function is activated, the reverse gear gesture recognition function or the forward gear gesture recognition function is activated based on the brake pedal status information and the accelerator pedal status information, and the sixth activation result is obtained.

[0022] The activation result of the gear shift gesture recognition function is determined based on the fifth activation result and / or the sixth activation result.

[0023] In one embodiment, the step of acquiring the driver's left-hand dynamic gesture and / or the driver's right-hand dynamic gesture based on the activation result of the gear position gesture recognition function, and determining the target gesture recognition strategy, includes:

[0024] When the activation result of the gear position gesture recognition function is that the reverse gear gesture recognition function and / or the neutral gear gesture recognition function are activated, the driver's left hand dynamic gesture is collected, and the target gesture recognition strategy is determined to be the reverse gear gesture recognition strategy and / or the neutral gear gesture recognition strategy.

[0025] When the activation result of the gear position gesture recognition function is that the parking gear gesture recognition function and / or the forward gear gesture recognition function are activated, the driver's right-hand dynamic gesture is collected, and the target gesture recognition strategy is determined to be the parking gear gesture recognition strategy and / or the forward gear gesture recognition strategy.

[0026] In one embodiment, the step of determining the vehicle gear shift result based on the driver's left-hand dynamic gesture and / or the driver's right-hand dynamic gesture using the gesture recognition strategy includes:

[0027] The target gesture recognition strategy identifies whether a target gear shifting gesture exists based on the driver's left-hand dynamic gesture and / or the driver's right-hand dynamic gesture, and obtains the gear shifting gesture recognition result, wherein the target gear shifting gesture is a dynamic gesture composed of two consecutive preset static gestures;

[0028] When the gear shift gesture recognition result indicates the existence of the target gear shift gesture, the vehicle gear shift result is determined based on the recognized target gear shift gesture.

[0029] In one embodiment, after determining the gear position gesture recognition function activation result based on at least one of the current gear position, brake pedal state information, accelerator pedal state information, and vehicle speed information, the method further includes:

[0030] If the gear shift gesture recognition function is not activated, the vehicle's gear shift result is determined to be to keep the current gear without switching.

[0031] Furthermore, to achieve the above objectives, this application also proposes a vehicle gear shifting device based on gesture recognition, the gesture recognition-based vehicle gear shifting device comprising:

[0032] The activation module is used to determine the activation result of the gear gesture recognition function based on at least one of the current gear position, brake pedal status information, accelerator pedal status information, and vehicle speed information.

[0033] The acquisition module is used to acquire the driver's left-hand dynamic gesture and / or the driver's right-hand dynamic gesture based on the activation result of the gear position gesture recognition function, and to determine the target gesture recognition strategy.

[0034] The determination module is used to determine the vehicle gear shifting result based on the driver's left-hand dynamic gesture and / or the driver's right-hand dynamic gesture using the target gesture recognition strategy.

[0035] In addition, to achieve the above objectives, this application also proposes a vehicle gear shifting device based on gesture recognition, the device comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, the computer program being configured to implement the steps of the vehicle gear shifting method based on gesture recognition as described above.

[0036] In addition, to achieve the above objectives, this application also proposes a storage medium, which is a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, it implements the steps of the gesture recognition-based vehicle gear shifting method described above.

[0037] In addition, to achieve the above objectives, this application also provides a computer program product, which includes a computer program that, when executed by a processor, implements the steps of the gesture recognition-based vehicle gear shifting method described above.

[0038] One or more technical solutions proposed in this application have at least the following technical effects:

[0039] The activation result of the gear shift gesture recognition function is determined based on at least one of the current gear position, brake pedal status information, accelerator pedal status information, and vehicle speed information. Based on the activation result, the driver's left-hand dynamic gesture and / or right-hand dynamic gesture are collected, and a target gesture recognition strategy is determined. The vehicle's gear shift result is then determined based on the driver's left-hand dynamic gesture and / or right-hand dynamic gesture using the target gesture recognition strategy. The activation of the gesture recognition function is determined based on the vehicle's current status information to avoid recognizing gear shift gestures under unsafe conditions, thus preventing threats to driving safety. By using different gestures from the left and right hands, the difference in gestures is increased, improving the accuracy of gesture recognition during gear shifting. Attached Figure Description

[0040] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0041] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0042] Figure 1 This is a flowchart illustrating a first embodiment of the vehicle gear shifting method based on gesture recognition in this application.

[0043] Figure 2 This is a schematic diagram of the installation of the left and right cameras provided in Embodiment 1 of the vehicle gear shifting method based on gesture recognition in this application;

[0044] Figure 3 This is a schematic diagram of the shifting gesture recognition provided in Embodiment 1 of the vehicle shifting method based on gesture recognition in this application;

[0045] Figure 4 This is a flowchart illustrating Embodiment 2 of the vehicle gear shifting method based on gesture recognition in this application;

[0046] Figure 5 This is a simplified flowchart illustrating the vehicle gear shifting method based on gesture recognition provided in Embodiment 2 of this application.

[0047] Figure 6 This is a schematic diagram of the module structure of a vehicle gear shifting device based on gesture recognition according to an embodiment of this application;

[0048] Figure 7 This is a schematic diagram of the device structure of the hardware operating environment involved in the vehicle gear shifting method based on gesture recognition in the embodiments of this application.

[0049] The purpose, features, and advantages of this application will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation

[0050] It should be understood that the specific embodiments described herein are merely illustrative of the technical solutions of this application and are not intended to limit this application.

[0051] To better understand the technical solution of this application, a detailed description will be provided below in conjunction with the accompanying drawings and specific implementation methods.

[0052] The main solution of this application embodiment is: to determine the gear position gesture recognition function activation result based on at least one of the current gear position, brake pedal status information, accelerator pedal status information, and vehicle speed information; to collect the driver's left-hand dynamic gesture and / or the driver's right-hand dynamic gesture based on the gear position gesture recognition function activation result, and to determine the target gesture recognition strategy; and to determine the vehicle gear shifting result based on the driver's left-hand dynamic gesture and / or the driver's right-hand dynamic gesture through the target gesture recognition strategy.

[0053] Existing intelligent shifting schemes require drivers to look at the screen and slide their fingers across specific areas, making the shifting operation cumbersome, easily distracting drivers, and compromising driving safety. Other intelligent shifting schemes use gesture recognition for vehicle control, but to reduce misidentification, secondary gesture recognition is required, which is inconvenient for drivers. Therefore, providing a simpler shifting scheme to improve the accuracy of gesture recognition during shifting is a problem that needs to be solved.

[0054] This application provides a solution that determines the activation of the gesture recognition function based on the current vehicle status information, avoiding the recognition of gear shifting gestures in unsafe situations that could threaten driving safety. By using different gestures from the left and right hands, the difference in gestures is increased, thereby improving the accuracy of gesture recognition during gear shifting.

[0055] It should be noted that the executing entity in this embodiment can be a computing service device with data processing, network communication, and program execution functions, such as a tablet computer, personal computer, or mobile phone, or an electronic device or vehicle terminal capable of performing the above functions. The following description uses a vehicle terminal as an example to illustrate this embodiment and the subsequent embodiments.

[0056] Based on this, embodiments of this application provide a vehicle gear shifting method based on gesture recognition, referring to... Figure 1 , Figure 1 This is a flowchart illustrating the first embodiment of the vehicle gear shifting method based on gesture recognition in this application.

[0057] In this embodiment, the vehicle gear shifting method based on gesture recognition includes steps S10 to S30:

[0058] Step S10: Determine the gear position gesture recognition function activation result based on at least one of the current gear position, brake pedal status information, accelerator pedal status information, and vehicle speed information.

[0059] It should be understood that the current gear indicates the vehicle's current gear position, which can include Park (P), Reverse (R), Neutral (N), and Drive (D). The vehicle's control system monitors and records this information in real time to determine the vehicle's current operating state. Brake pedal status information indicates the operation of the brake pedal, including both depressed and undepressed states, used to determine if the driver intends to stop or decelerate. This information is obtained in real time through vehicle sensors. Accelerator pedal status information is the accelerator pedal opening (in %), used to determine the driver's acceleration intention. Vehicle speed information is the vehicle's speed data (in km / h), used to determine if the vehicle is within the appropriate speed range for shifting to the corresponding gear. This information is obtained in real time through vehicle speed sensors.

[0060] It should be noted that the activation result of the gear shift gesture recognition function is determined based on the current gear, brake pedal status, accelerator pedal status, and vehicle speed information, including two cases: "gear shift gesture recognition function not activated" and "gear shift gesture recognition function activated". Furthermore, for the case of "gear shift gesture recognition function activated", the activation result corresponds to at least one of the following: reverse gear gesture recognition function activated, drive gear gesture recognition function activated, park gear gesture recognition function activated, and neutral gear gesture recognition function activated.

[0061] Additionally, it's important to note that existing solutions often rely on static, single gesture recognition for gear shifting. When a corresponding gesture is recognized, the vehicle is controlled to perform the gear shift. Improvements to these solutions primarily focus on the accuracy of the gesture recognition process, as they cannot prevent interference from environmental factors or unintentional driver actions. By checking vehicle status parameters (at least one of brake pedal status, accelerator pedal status, and vehicle speed) based on the current gear position to determine whether to activate gesture recognition, accidental gear shifting in unsafe situations (such as excessive speed or failure to apply the brakes) can be avoided, thus increasing safety.

[0062] In one feasible implementation, after step S10, the method may further include: when the gear position gesture recognition function activation result is that the gear position gesture recognition function is not activated, determining that the vehicle shifting result is to keep the current gear position unchanged.

[0063] It should be understood that if the gear shift gesture recognition function is not activated, even if the driver makes a gear shift gesture, the vehicle will remain in the current gear because the gear shift gesture recognition function is not activated, so as to prevent the driver from accidentally triggering the gear shift operation by making a gear shift gesture unintentionally or in an unsafe environment.

[0064] In one feasible implementation, step S10 may include steps A11 to A13:

[0065] Step A11: When the current gear is park, determine whether to activate the neutral hand gesture recognition function based on the brake pedal status information and the accelerator pedal status information, and obtain the first activation result;

[0066] It should be noted that when the current gear is Park (P), the system will monitor the status information of the brake pedal and the accelerator pedal to determine whether to activate the Neutral (N) gear gesture recognition function and obtain the first activation result, so as to avoid accidental gear switching while driving or when the driver has an acceleration need.

[0067] For example, after the vehicle is started and in Park (P) gear, if the driver presses the brake pedal and the accelerator pedal opening is less than a preset value TBD1%, it will be determined that the conditions for activating the Neutral (N) gear gesture recognition function are met. Under these conditions, when the Neutral (N) gear gesture is successfully recognized, the vehicle's gear will shift from Park (P) gear to Neutral (N) gear.

[0068] Step A12: When the first activation result is that the neutral gear gesture recognition function is activated, determine whether to activate the reverse gear gesture recognition function and the forward gear gesture recognition function based on the vehicle speed information to obtain the second activation result;

[0069] It should be noted that if the first activation result is to activate the neutral gear gesture recognition function, it means that the brake pedal status information and the accelerator pedal status information meet the corresponding safety conditions. At the same time, it will further determine whether the vehicle is close to a complete stop based on the vehicle speed information, and then determine whether to activate the reverse gear (R gear) gesture recognition function and the drive gear (D gear) gesture recognition function, thus obtaining the second activation result of preparing to recognize the reverse gear gesture and the drive gear gesture.

[0070] For example, after the vehicle is started, when the vehicle is in Park (P) gear, if the first activation result is activation of the neutral gear gesture recognition function, and the vehicle speed is less than or equal to TBD2 km / h (e.g., 3 km / h), it will be determined that the conditions for activating the reverse (R) gear and drive (D) gear gesture recognition functions are met. Under these conditions, when the reverse (R) gear or drive (D) gear gesture is successfully recognized, the vehicle's gear will shift from Park (P) gear to reverse (R) gear or drive (D) gear.

[0071] Step A13: Determine the gear position gesture recognition function activation result based on the first activation result and / or the second activation result.

[0072] It should be understood that if the first activation result is that the neutral gear gesture recognition function is not activated, then the gear position gesture recognition function activation result is that the gear position gesture recognition function is not activated; if the first activation result is that the neutral gear gesture recognition function is activated and the second activation result is that the reverse gear gesture recognition function and the drive gear gesture recognition function are activated, then the gear position gesture recognition function activation result is that the neutral gear, reverse gear, and drive gear gesture recognition functions are activated; if the first activation result is that the neutral gear gesture recognition function is activated and the second activation result is that the reverse gear and drive gear gesture recognition functions are not activated, then the gear position gesture recognition function activation result is that the neutral gear gesture recognition function is activated.

[0073] In another feasible implementation, step S10 may include steps A21 to A24:

[0074] Step A21: When the current gear is neutral, determine whether the parking gear gesture recognition function is activated based on the vehicle speed information to obtain the third activation result;

[0075] It should be noted that when the vehicle is in neutral (N), the vehicle speed information needs to be monitored to determine whether to activate the parking (P) gear gesture recognition function. This ensures that the parking gear gesture recognition function will only be activated within an appropriate speed range (when the vehicle is close to a complete stop), thus obtaining the third activation result for recognizing the parking gear gesture.

[0076] For example, after the vehicle is started, if the vehicle speed is less than or equal to 2 km / h (e.g., 3 km / h) when it is in neutral (N), the conditions for activating the parking (P) gear gesture recognition function are met. Under these conditions, when the parking (P) gear gesture is successfully recognized, the vehicle's gear will shift from neutral (N) to parking (P).

[0077] Step A22: When the third activation result is that the parking gear gesture recognition function is activated, determine whether to activate the reverse gear gesture recognition function and the forward gear gesture recognition function based on the brake pedal status information and the accelerator pedal status information, and obtain the fourth activation result.

[0078] It should be noted that if the third activation result is the activation of the parking gear gesture recognition function, it means that the vehicle is close to a complete stop. Further determination is needed based on the brake pedal status and accelerator pedal status to determine whether the reverse (R) gear gesture recognition function and the forward (D) gear gesture recognition function are allowed to be activated, resulting in the fourth activation result. This ensures that the reverse or forward gear gesture recognition is activated only in a safe operating environment.

[0079] For example, after the vehicle is started, when the vehicle is in neutral (N), if the third activation result is activation of the reverse gear gesture recognition function and the forward gear gesture recognition function, the brake pedal is depressed, and the accelerator pedal opening is less than the preset value TBD1%, then it is determined that the conditions for activating the reverse gear and forward gear gesture recognition functions are met. Under these conditions, if the driver makes the corresponding reverse gear (R) or forward gear (D) gesture, the vehicle will switch from neutral (N) to reverse gear (R) or forward gear (D).

[0080] Step A23: When the third activation result is that the parking gear gesture recognition function is not activated, determine whether to activate the reverse gear gesture recognition function and the forward gear gesture recognition function based on the accelerator pedal status information, and obtain the fourth activation result.

[0081] It should be noted that if the third activation result is that the parking gear gesture recognition function is not activated, it means that the vehicle is already in normal driving state. There is no need to activate the reverse (R) gear and drive (D) gear gesture recognition functions based on the brake pedal state. It is only necessary to determine whether the reverse (R) gear and drive (D) gear gesture recognition functions are allowed based on the accelerator pedal state, and then obtain the fourth activation result.

[0082] For example, after the vehicle is started, when the vehicle is in neutral (N), if the third activation result indicates that the reverse gear gesture recognition function and the drive gear gesture recognition function are not activated, and the accelerator pedal opening is less than the preset value TBD1%, then it is determined that the conditions for activating the reverse gear and drive gear gesture recognition functions are met. Under these conditions, if the driver makes the corresponding reverse gear (R) or drive gear (D) gesture, the vehicle will switch from neutral (N) to reverse gear (R) or drive gear (D).

[0083] Step A24: Determine the gear shift gesture recognition function activation result based on the third activation result and the fourth activation result.

[0084] It should be noted that if the third activation result is that the neutral gear gesture recognition function is not activated, and the fourth activation result is that the reverse gear gesture recognition function and the drive gear gesture recognition function are not activated, then the gear gesture recognition function activation result is that the gear shift gesture recognition function is not activated; if the third activation result is that the neutral gear gesture recognition function is not activated, and the fourth activation result is that the reverse gear gesture recognition function and the drive gear gesture recognition function are activated, then the gear gesture recognition function activation result is that the reverse gear and drive gear gesture recognition functions are activated; if the third activation result is that the neutral gear gesture recognition function is activated, and the fourth activation result is that the reverse gear gesture recognition function and the drive gear gesture recognition function are activated, then the gear gesture recognition function activation result is that the neutral gear, reverse gear, and drive gear gesture recognition functions are activated.

[0085] In another feasible implementation, step S10 may include steps A31 to A33:

[0086] Step A31: When the current gear is forward or reverse, activate the neutral gear gesture recognition function, and determine whether to activate the parking gear gesture recognition function based on the vehicle speed information to obtain the fifth activation result;

[0087] It should be understood that when the vehicle is moving forward or reversing, and is in drive (D) or reverse (R), the neutral (N) gesture recognition function can be activated directly. Simultaneously, the system will determine whether the vehicle is approaching a complete stop based on speed information, and then activate the park (P) gesture recognition function, resulting in a fifth activation result.

[0088] For example, after the vehicle is started, if it is in drive (D) or reverse (R) and the speed is less than or equal to a preset value TBD2 km / h (e.g., 3 km / h), the conditions for activating the neutral and parking gear gesture recognition function are met. Under these conditions, if the driver makes the corresponding neutral (N) or parking (P) gesture, the vehicle will switch from reverse (R) or drive (D) to neutral (N) or parking (P).

[0089] Step A32: When the fifth activation result is that the parking gear gesture recognition function is activated, determine whether to activate the reverse gear gesture recognition function or the forward gear gesture recognition function based on the brake pedal status information and the accelerator pedal status information, and obtain the sixth activation result.

[0090] It should be noted that if the fifth activation result is activation of the parking gear gesture recognition function, it indicates that the vehicle is already in normal driving mode. The sixth activation result is then determined based on the brake pedal and accelerator pedal states to decide whether to allow activation of the reverse (R) or drive (D) gear gesture recognition function. Specifically, if the fifth activation result is activation of the parking gear gesture recognition function, when the current gear is drive, the brake pedal and accelerator pedal states are used to determine whether to allow activation of the reverse (R) gear gesture recognition function; when the current gear is reverse, the brake pedal and accelerator pedal states are used to determine whether to allow activation of the drive (D) gear gesture recognition function.

[0091] For example, after the vehicle is started, when the vehicle is in drive (D) gear, if the fifth activation result is to activate the parking gear gesture recognition function, the accelerator pedal opening is less than 1% of TBD, and the vehicle speed is less than or equal to TBD2 km / h (e.g., 3 km / h), then it is determined that the conditions for activating the reverse gear gesture recognition function are met. When the vehicle is in reverse (R) gear, if the fifth activation result is to activate the parking gear gesture recognition function, the accelerator pedal opening is less than 1% of TBD, and the vehicle speed is less than or equal to TBD2 km / h (e.g., 3 km / h), then it is determined that the conditions for activating the drive gear gesture recognition function are met. Under these conditions, if the driver makes the corresponding reverse (R) or drive (D) gear gesture, the vehicle will switch from drive (D) gear or reverse (R) gear to reverse (R) gear or drive (D) gear.

[0092] Step A33: Determine the gear shift gesture recognition function activation result based on the fifth activation result and / or the sixth activation result.

[0093] It should be noted that if the fifth activation result is to activate the neutral gear gesture recognition function but not the parking gear gesture recognition function, then the gear gesture recognition function activation result is to activate the neutral gear gesture recognition function; if the fifth activation result is to activate both the neutral gear and parking gear gesture recognition functions, and the sixth activation result is to not activate the reverse gear or drive gear gesture recognition function, then the gear gesture recognition function activation result is to activate both the neutral gear and parking gear gesture recognition functions; if the fifth activation result is to activate both the neutral gear and parking gear gesture recognition functions, and the sixth activation result is to activate either the reverse gear or drive gear gesture recognition function, then the gear gesture recognition function activation result is to activate both the neutral gear and parking gear gesture recognition functions, and also activate either the reverse gear or drive gear gesture recognition function.

[0094] Step S20: Collect the driver's left-hand dynamic gesture and / or the driver's right-hand dynamic gesture based on the activation result of the gear position gesture recognition function, and determine the target gesture recognition strategy;

[0095] It should be noted that a left-side camera is installed on the left side of the driver's seat, and a right-side camera is installed on the right side of the driver's seat. (See reference...) Figure 2 , Figure 2 This diagram illustrates the installation of the left and right cameras provided in Embodiment 1 of the vehicle gear shifting method based on gesture recognition according to this application. The left camera captures the driver's left-hand dynamic gestures and identifies reverse (R) and neutral (N) gear gestures. The right camera captures the driver's right-hand dynamic gestures and identifies park (P) and drive (D) gears, preventing misidentification or other interfering gestures from causing incorrect gear shifting. Based on the activation result of the gear gesture recognition function, the left camera is activated to capture the driver's left-hand dynamic gestures and / or the right camera is activated to capture the right-hand dynamic gestures, and a target gesture recognition strategy is determined. The target gesture recognition strategy includes at least one of the following: reverse gear gesture recognition strategy, neutral gear gesture recognition strategy, park gear gesture recognition strategy, or drive gear gesture recognition strategy.

[0096] Step S30: Determine the vehicle shifting result based on the driver's left-hand dynamic gesture and / or the driver's right-hand dynamic gesture using the target gesture recognition strategy.

[0097] It should be noted that the target gesture recognition strategy is used to determine whether there is a corresponding gear shifting gesture in the driver's left-hand dynamic gesture and / or the driver's right-hand dynamic gesture, so as to obtain the vehicle's gear shifting result. If it exists, the vehicle will be shifted according to the recognized gear shifting gesture; if it does not exist, the original gear will remain unchanged.

[0098] In one feasible implementation, step S30 may include: identifying whether a target shifting gesture exists based on the driver's left-hand dynamic gesture and / or the driver's right-hand dynamic gesture using the target gesture recognition strategy, and obtaining a shifting gesture recognition result, wherein the target shifting gesture is a dynamic gesture composed of two consecutive preset static gestures; when the shifting gesture recognition result indicates that the target shifting gesture exists, determining the vehicle shifting result based on the recognized target shifting gesture.

[0099] It should be noted that the target gear shifting gesture is a dynamic gesture consisting of two consecutive preset static gestures. The camera needs to recognize the change from gesture 1 to gesture 2 to define it as a valid gear shifting gesture. The target gear shifting gesture includes at least one of the following: reverse (R) gesture, drive (D) gesture, neutral (N) gesture, and park (P) gesture. (See reference...) Figure 3 , Figure 3 This is a schematic diagram of the gear shifting gesture recognition provided in Embodiment 1 of the vehicle gear shifting method based on gesture recognition in this application. Figure 3As shown, the left camera captures the driver's left-hand dynamic gestures, recognizing reverse (R) and neutral (N) gear gestures, while the right camera captures the driver's right-hand dynamic gestures, recognizing park (P) and drive (D) gears. The image processor performs algorithmic processing on the captured left-hand and / or right-hand dynamic gestures according to a target gesture recognition strategy, identifies the presence of a target gear shifting gesture, obtains the gear shifting gesture recognition result, and sends the result to the vehicle control unit. The vehicle control unit generates a corresponding gear shift request gesture signal based on the recognition result and sends it to the motor controller or transmission controller to perform the gear shifting.

[0100] This embodiment determines the activation result of the gear shift gesture recognition function based on at least one of the current gear position, brake pedal status information, accelerator pedal status information, and vehicle speed information. Based on the activation result, it collects the driver's left-hand dynamic gesture and / or right-hand dynamic gesture, and determines a target gesture recognition strategy. Using this strategy, it determines the vehicle's gear shift result based on the driver's left-hand and / or right-hand dynamic gestures. The gesture recognition function activation is determined based on the vehicle's current status information to avoid recognizing gear shift gestures under unsafe conditions, thus preventing safety threats to driving. By using different left-hand and right-hand gestures, the difference in gestures is increased, improving the accuracy of gesture recognition during gear shifting.

[0101] Based on the first embodiment of this application, in the second embodiment of this application, the content that is the same as or similar to that in the first embodiment described above can be referred to the above description, and will not be repeated hereafter. Based on this, please refer to... Figure 4 Step S20 may include steps S21 to S22:

[0102] Step S21: When the gear gesture recognition function activation result is that the reverse gear gesture recognition function and / or neutral gear gesture recognition function are activated, the driver's left hand dynamic gesture is collected, and the target gesture recognition strategy is determined to be the reverse gear gesture recognition strategy and / or the neutral gear gesture recognition strategy.

[0103] It should be understood that if the gear position gesture recognition function is activated as the reverse gear gesture recognition function and / or the neutral gear gesture recognition function, the left camera will be activated to capture the driver's left-hand dynamic gestures. Specifically, if the gear position gesture recognition function is activated as the reverse gear gesture recognition function, the target gesture recognition strategy will be determined as the reverse gear gesture recognition strategy; if the gear position gesture recognition function is activated as the neutral gear gesture recognition function, the target gesture recognition strategy will be determined as the neutral gear gesture recognition strategy; if the gear position gesture recognition function is activated as both the reverse gear and neutral gear gesture recognition functions, the target gesture recognition strategies will be determined as both the reverse gear and neutral gear gesture recognition strategies. The reverse gear gesture recognition strategy is used to identify whether a preset reverse gear gesture exists among the captured left-hand dynamic gestures, and the neutral gear gesture recognition strategy is used to identify whether a preset neutral gear gesture exists among the captured left-hand dynamic gestures.

[0104] Step S22: When the gear position gesture recognition function activation result is that the parking gear gesture recognition function and / or the forward gear gesture recognition function are activated, the driver's right-hand dynamic gesture is collected, and the target gesture recognition strategy is determined to be the parking gear gesture recognition strategy and / or the forward gear gesture recognition strategy.

[0105] It should be understood that if the gear position gesture recognition function is activated as a parking gear gesture recognition function and / or a drive gear gesture recognition function, the left camera will be activated to capture the driver's left-hand dynamic gestures. Specifically, if the gear position gesture recognition function is activated as a parking gear gesture recognition function, the target gesture recognition strategy will be determined as the parking gear gesture recognition strategy; if the gear position gesture recognition function is activated as a drive gear gesture recognition function, the target gesture recognition strategy will be determined as the drive gear gesture recognition strategy; if the gear position gesture recognition function is activated as a parking gear gesture recognition function and a drive gear gesture recognition function, the target gesture recognition strategy will be determined as both the parking gear gesture recognition strategy and the drive gear gesture recognition strategy. The parking gear gesture recognition strategy is used to identify whether a preset parking gear gesture exists among the captured left-hand dynamic gestures, and the drive gear gesture recognition strategy is used to identify whether a preset neutral gear gesture exists among the captured left-hand dynamic gestures.

[0106] In this embodiment, when the gear position gesture recognition function is activated as reverse gear gesture recognition and / or neutral gear gesture recognition, the driver's left-hand dynamic gesture is captured, and the target gesture recognition strategy is determined to be reverse gear gesture recognition strategy and / or neutral gear gesture recognition strategy. When the gear position gesture recognition function is activated as park gear gesture recognition and / or drive gear gesture recognition, the driver's right-hand dynamic gesture is captured, and the target gesture recognition strategy is determined to be park gear gesture recognition strategy and / or drive gear gesture recognition strategy. Different cameras are used to recognize drive gear and reverse gear, and different gestures of the left and right hands are used respectively to increase the difference in gestures, improve recognition accuracy, and ensure that drive gear and reverse gear are not misidentified.

[0107] For example, to help understand the implementation process of the gesture recognition-based vehicle gear shifting method obtained by combining this embodiment with the above embodiment one, please refer to... Figure 5 , Figure 5 A simplified flowchart of a vehicle gear shifting method based on gesture recognition is provided, specifically:

[0108] After the vehicle starts, the activation of the corresponding shift gesture recognition is determined based on vehicle speed, the status of the brake and accelerator pedals, and the gesture recognition function. When the vehicle is currently in P gear, if the brake pedal is depressed and the accelerator pedal opening is less than 1% of TBD, the N gear gesture recognition function will be activated; if the brake pedal is depressed, the accelerator pedal opening is less than 1% of TBD, and the vehicle speed is less than or equal to TBD2 km / h (e.g., 3 km / h), the D and R gear gesture recognition functions will be activated. Similarly, when the vehicle is currently in N gear, if the vehicle speed is less than or equal to TBD2 km / h (e.g., 3 km / h), the P gear gesture recognition function will be activated; if the accelerator pedal opening is less than 1% of TBD, the vehicle speed is less than or equal to TBD2 km / h (e.g., 3 km / h), and the brake pedal is depressed, the D and R gear gesture recognition functions will be activated; if the accelerator pedal opening is less than 1% of TBD, and the vehicle speed is greater than TBD2 km / h (e.g., 3 km / h), the D and R gear gesture recognition functions will be activated. When the vehicle is currently in Drive (D), the Neutral (N) gear gesture recognition function will be activated. If the vehicle speed is less than or equal to TBD2 km / h (e.g., 3 km / h), the Park (P) gear gesture recognition function will be activated. If the brake pedal is depressed, the accelerator pedal opening is less than 1% of TBD, and the vehicle speed is less than or equal to TBD2 km / h (e.g., 3 km / h), the Reverse (R) gear gesture recognition function will be activated. If the corresponding shift gesture is detected while the corresponding P, N, D, or R gear gesture recognition function is activated, the vehicle will shift gears; otherwise, the current gear will remain unchanged.

[0109] It should be noted that the above examples are only for understanding this application and do not constitute a limitation on the vehicle gear shifting method based on gesture recognition in this application. Any simple modifications based on this technical concept are within the protection scope of this application.

[0110] This application also provides a vehicle gear shifting device based on gesture recognition, please refer to... Figure 6 The gesture recognition-based vehicle gear shifting device includes:

[0111] Activation module 10 is used to determine the gear gesture recognition function activation result based on at least one of the current gear position, brake pedal status information, accelerator pedal status information and vehicle speed information.

[0112] The acquisition module 20 is used to acquire the driver's left-hand dynamic gesture and / or the driver's right-hand dynamic gesture based on the activation result of the gear position gesture recognition function, and to determine the target gesture recognition strategy.

[0113] The determination module 30 is used to determine the vehicle shifting result based on the driver's left-hand dynamic gesture and / or the driver's right-hand dynamic gesture through the target gesture recognition strategy.

[0114] In one embodiment, the activation module 10 is further configured to, when the current gear is parking, determine whether to activate the neutral gear gesture recognition function based on the brake pedal state information and the accelerator pedal state information, and obtain a first activation result; when the first activation result is that the neutral gear gesture recognition function is activated, determine whether to activate the reverse gear gesture recognition function and the forward gear gesture recognition function based on the vehicle speed information, and obtain a second activation result; and determine the gear gesture recognition function activation result based on the first activation result and / or the second activation result.

[0115] In one embodiment, the activation module 10 is further configured to, when the current gear is neutral, identify whether the parking gear gesture recognition function is activated based on vehicle speed information to obtain a third activation result; when the third activation result indicates that the parking gear gesture recognition function is activated, determine whether the reverse gear gesture recognition function and the forward gear gesture recognition function are activated based on brake pedal status information and accelerator pedal status information to obtain a fourth activation result; when the third activation result indicates that the parking gear gesture recognition function is not activated, determine whether the reverse gear gesture recognition function and the forward gear gesture recognition function are activated based on the accelerator pedal status information to obtain the fourth activation result; and determine the gear gesture recognition function activation result based on the third activation result and the fourth activation result.

[0116] In one embodiment, the activation module 10 is further configured to activate the neutral gear gesture recognition function when the current gear is a forward gear or a reverse gear, and determine whether to activate the parking gear gesture recognition function based on the vehicle speed information to obtain a fifth activation result; when the fifth activation result is that the parking gear gesture recognition function is activated, determine whether to activate the reverse gear gesture recognition function or the forward gear gesture recognition function based on the brake pedal state information and the accelerator pedal state information to obtain a sixth activation result; and determine the gear gesture recognition function activation result based on the fifth activation result and / or the sixth activation result.

[0117] In one embodiment, the acquisition module 20 is further configured to acquire the driver's left-hand dynamic gesture when the gear position gesture recognition function activation result is the activation of the reverse gear gesture recognition function and / or the neutral gear gesture recognition function, and determine the target gesture recognition strategy as the reverse gear gesture recognition strategy and / or the neutral gear gesture recognition strategy; and to acquire the driver's right-hand dynamic gesture when the gear position gesture recognition function activation result is the activation of the parking gear gesture recognition function and / or the forward gear gesture recognition function, and determine the target gesture recognition strategy as the parking gear gesture recognition strategy and / or the forward gear gesture recognition strategy.

[0118] In one embodiment, the determining module 30 is further configured to identify whether a target shifting gesture exists based on the driver's left-hand dynamic gesture and / or the driver's right-hand dynamic gesture using the target gesture recognition strategy, and obtain a shifting gesture recognition result, wherein the target shifting gesture is a dynamic gesture composed of two consecutive preset static gestures; when the shifting gesture recognition result indicates that the target shifting gesture exists, the vehicle shifting result is determined based on the identified target shifting gesture.

[0119] In one embodiment, the determining module 30 is further configured to determine that the vehicle shifting result is to keep the current gear without switching when the gear gesture recognition function activation result is that the gear gesture recognition function is not activated.

[0120] The vehicle gear shifting device based on gesture recognition provided in this application, employing the vehicle gear shifting method based on gesture recognition in the above embodiments, can solve the technical problem of how to provide a simple gear shifting scheme to improve the accuracy of gesture recognition during gear shifting. Compared with the prior art, the beneficial effects of the vehicle gear shifting device based on gesture recognition provided in this application are the same as those of the vehicle gear shifting method based on gesture recognition provided in the above embodiments, and other technical features in the vehicle gear shifting device based on gesture recognition are the same as those disclosed in the methods of the above embodiments, and will not be repeated here.

[0121] This application provides a vehicle gear shifting device based on gesture recognition. The vehicle gear shifting device based on gesture recognition includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to execute the vehicle gear shifting method based on gesture recognition in the first embodiment described above.

[0122] The following is for reference. Figure 7 This document illustrates a structural schematic diagram of a gesture-based vehicle gear shifting device suitable for implementing embodiments of this application. The gesture-based vehicle gear shifting device in this application embodiment may include, but is not limited to, mobile terminals such as mobile phones, laptops, digital radio receivers, PDAs (Personal Digital Assistants), PADs (Portable Application Description), PMPs (Portable Media Players), in-vehicle terminals (e.g., in-vehicle navigation terminals), and fixed terminals such as digital TVs and desktop computers. Figure 7 The gesture recognition-based vehicle gear shifting device shown is merely an example and should not impose any limitations on the functionality and scope of use of the embodiments of this application.

[0123] like Figure 7 As shown, a gesture-based vehicle gear shifting device may include a processing unit 1001 (e.g., a central processing unit, a graphics processing unit, etc.), which can perform various appropriate actions and processes according to a program stored in ROM (Read Only Memory) 1002 or a program loaded from storage device 1003 into RAM (Random Access Memory) 1004. RAM 1004 also stores various programs and data required for the operation of the gesture-based vehicle gear shifting device. The processing unit 1001, ROM 1002, and RAM 1004 are interconnected via bus 1005. Input / output (I / O) interface 1006 is also connected to the bus. Typically, the following systems can be connected to I / O interface 1006: input devices 1007 including, for example, touchscreens, touchpads, keyboards, mice, image sensors, microphones, accelerometers, gyroscopes, etc.; output devices 1008 including, for example, LCDs (Liquid Crystal Displays), speakers, vibrators, etc.; storage devices 1003 including, for example, magnetic tapes, hard disks, etc.; and communication devices 1009. Communication device 1009 allows the gesture-based vehicle shifting device to communicate wirelessly or wiredly with other devices to exchange data. Although gesture-based vehicle shifting devices with various systems are shown in the figures, it should be understood that it is not required to implement or possess all of the systems shown. More or fewer systems may be implemented alternatively.

[0124] Specifically, according to the embodiments disclosed in this application, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments disclosed in this application include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via a communication device, or installed from storage device 1003, or installed from ROM 1002. When the computer program is executed by processing device 1001, it performs the functions defined in the methods of the embodiments disclosed in this application.

[0125] The vehicle gear shifting device based on gesture recognition provided in this application, employing the vehicle gear shifting method based on gesture recognition in the above embodiments, can solve the technical problem of how to provide a simple gear shifting scheme to improve the accuracy of gesture recognition during the gear shifting process. Compared with the prior art, the beneficial effects of the vehicle gear shifting device based on gesture recognition provided in this application are the same as those of the vehicle gear shifting method based on gesture recognition provided in the above embodiments, and other technical features in this vehicle gear shifting device based on gesture recognition are the same as those disclosed in the method of the previous embodiment, and will not be repeated here.

[0126] It should be understood that the various parts disclosed in this application can be implemented using hardware, software, firmware, or a combination thereof. In the description of the above embodiments, specific features, structures, materials, or characteristics can be combined in any suitable manner in one or more embodiments or examples.

[0127] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

[0128] This application provides a computer-readable storage medium having computer-readable program instructions (i.e., a computer program) stored thereon, the computer-readable program instructions being used to execute the gesture recognition-based vehicle gear shifting method in the above embodiments.

[0129] The computer-readable storage medium provided in this application may be, for example, a USB flash drive, but is not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to: electrical connections having one or more wires, portable computer disks, hard disks, RAM (Random Access Memory), ROM (Read Only Memory), EPROM (Erasable Programmable Read Only Memory), or flash memory, optical fiber, CD-ROM (CD-Read Only Memory), optical storage devices, magnetic storage devices, or any suitable combination thereof. In this embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, system, or device. The program code contained on the computer-readable storage medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (Radio Frequency), etc., or any suitable combination thereof.

[0130] The aforementioned computer-readable storage medium may be included in a gesture-based vehicle gear shifting device; or it may exist independently and not be installed in a gesture-based vehicle gear shifting device.

[0131] The aforementioned computer-readable storage medium carries one or more programs that, when executed by a gesture-based vehicle gear shifting device, cause the gesture-based vehicle gear shifting device to: determine a gear position gesture recognition function activation result based on at least one of the current gear position, brake pedal state information, accelerator pedal state information, and vehicle speed information; acquire the driver's left-hand dynamic gesture and / or the driver's right-hand dynamic gesture based on the gear position gesture recognition function activation result, and determine a target gesture recognition strategy; and determine the vehicle gear shifting result based on the driver's left-hand dynamic gesture and / or the driver's right-hand dynamic gesture using the target gesture recognition strategy.

[0132] Computer program code for performing the operations of this application can be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, and C++, as well as conventional procedural programming languages ​​such as "C" or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including LAN (Local Area Network) or WAN (Wide Area Network)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0133] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this application. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0134] The modules described in the embodiments of this application can be implemented in software or hardware. The names of the modules do not necessarily limit the functionality of the unit itself.

[0135] The readable storage medium provided in this application is a computer-readable storage medium that stores computer-readable program instructions (i.e., a computer program) for executing the above-described gesture recognition-based vehicle gear shifting method. This solves the technical problem of how to provide a simple gear shifting scheme to improve the accuracy of gesture recognition during gear shifting. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided in this application are the same as those of the gesture recognition-based vehicle gear shifting method provided in the above embodiments, and will not be repeated here.

[0136] This application also provides a computer program product, including a computer program that, when executed by a processor, implements the steps of the gesture recognition-based vehicle gear shifting method described above.

[0137] The computer program product provided in this application solves the technical problem of how to provide a simple shifting scheme to improve the accuracy of gesture recognition during the shifting process. Compared with the prior art, the beneficial effects of the computer program product provided in this application are the same as those of the gesture recognition-based vehicle shifting method provided in the above embodiments, and will not be repeated here.

[0138] The above description is only a part of the embodiments of this application and does not limit the patent scope of this application. All equivalent structural transformations made under the technical concept of this application and using the contents of the specification and drawings of this application, or direct / indirect applications in other related technical fields, are included in the patent protection scope of this application.

Claims

1. A vehicle gear shifting method based on gesture recognition, characterized in that, The vehicle gear shifting method based on gesture recognition includes: The activation result of the gear gesture recognition function is determined based on at least one of the current gear position, brake pedal status information, accelerator pedal status information, and vehicle speed information. Based on the activation result of the gear position gesture recognition function, the driver's left-hand dynamic gesture and / or the driver's right-hand dynamic gesture are collected, and the target gesture recognition strategy is determined; The vehicle gear shifting result is determined based on the driver's left-hand dynamic gesture and / or the driver's right-hand dynamic gesture using the target gesture recognition strategy. The step of determining the gear position gesture recognition function activation result based on at least one of the current gear position, brake pedal status information, accelerator pedal status information, and vehicle speed information includes: When the current gear is park, determine whether to activate the neutral hand gesture recognition function based on the brake pedal status information and the accelerator pedal status information, and obtain the first activation result; When the first activation result is that the neutral gear gesture recognition function is activated, the reverse gear gesture recognition function and the forward gear gesture recognition function are determined based on the vehicle speed information to obtain the second activation result. The activation result of the gear position gesture recognition function is determined based on the first activation result and / or the second activation result.

2. The method as described in claim 1, characterized in that, The step of determining the gear position gesture recognition function activation result based on at least one of the current gear position, brake pedal status information, accelerator pedal status information, and vehicle speed information includes: When the current gear is neutral, the system identifies whether the parking gear gesture recognition function is activated based on the vehicle speed information, and obtains a third activation result. When the third activation result is that the parking gear gesture recognition function is activated, the reverse gear gesture recognition function and the forward gear gesture recognition function are determined based on the brake pedal status information and the accelerator pedal status information to obtain the fourth activation result. When the third activation result is that the parking gear gesture recognition function is not activated, the reverse gear gesture recognition function and the forward gear gesture recognition function are activated based on the accelerator pedal status information to obtain the fourth activation result. The activation result of the gear shift gesture recognition function is determined based on the third activation result and the fourth activation result.

3. The method as described in claim 1, characterized in that, The step of determining the gear position gesture recognition function activation result based on at least one of the current gear position, brake pedal status information, accelerator pedal status information, and vehicle speed information includes: When the current gear is drive or reverse, activate the neutral gear gesture recognition function, and determine whether to activate the parking gear gesture recognition function based on the vehicle speed information to obtain the fifth activation result; When the fifth activation result is that the parking gear gesture recognition function is activated, the reverse gear gesture recognition function or the forward gear gesture recognition function is activated based on the brake pedal status information and the accelerator pedal status information, and the sixth activation result is obtained. The activation result of the gear shift gesture recognition function is determined based on the fifth activation result and / or the sixth activation result.

4. The method as described in claim 1, characterized in that, The step of acquiring the driver's left-hand dynamic gesture and / or the driver's right-hand dynamic gesture based on the activation result of the gear position gesture recognition function, and determining the target gesture recognition strategy, includes: When the activation result of the gear position gesture recognition function is that the reverse gear gesture recognition function and / or the neutral gear gesture recognition function are activated, the driver's left hand dynamic gesture is collected, and the target gesture recognition strategy is determined to be the reverse gear gesture recognition strategy and / or the neutral gear gesture recognition strategy. When the activation result of the gear position gesture recognition function is that the parking gear gesture recognition function and / or the forward gear gesture recognition function are activated, the driver's right-hand dynamic gesture is collected, and the target gesture recognition strategy is determined to be the parking gear gesture recognition strategy and / or the forward gear gesture recognition strategy.

5. The method as described in claim 1, characterized in that, The step of determining the vehicle gear shift result based on the driver's left-hand dynamic gesture and / or the driver's right-hand dynamic gesture using the gesture recognition strategy includes: The target gesture recognition strategy identifies whether a target gear shifting gesture exists based on the driver's left-hand dynamic gesture and / or the driver's right-hand dynamic gesture, and obtains the gear shifting gesture recognition result, wherein the target gear shifting gesture is a dynamic gesture composed of two consecutive preset static gestures; When the gear shift gesture recognition result indicates that the target gear shift gesture exists, the vehicle gear shift result is determined based on the recognized target gear shift gesture.

6. The method according to any one of claims 1 to 5, characterized in that, After the step of determining the gear position gesture recognition function activation result based on at least one of the current gear position, brake pedal status information, accelerator pedal status information, and vehicle speed information, the method further includes: If the gear shift gesture recognition function is not activated, the vehicle's gear shift result is determined to be to keep the current gear without switching.

7. A vehicle gear shifting device based on gesture recognition, characterized in that, The device includes: The activation module is used to determine the activation result of the gear gesture recognition function based on at least one of the current gear position, brake pedal status information, accelerator pedal status information, and vehicle speed information. The acquisition module is used to acquire the driver's left-hand dynamic gesture and / or the driver's right-hand dynamic gesture based on the activation result of the gear position gesture recognition function, and to determine the target gesture recognition strategy. The determination module is used to determine the vehicle gear shifting result based on the driver's left-hand dynamic gesture and / or the driver's right-hand dynamic gesture using the target gesture recognition strategy; The activation module is further configured to determine whether to activate the neutral gear gesture recognition function based on the brake pedal status information and the accelerator pedal status information when the current gear is park, thereby obtaining a first activation result; when the first activation result indicates that the neutral gear gesture recognition function is activated, determine whether to activate the reverse gear gesture recognition function and the forward gear gesture recognition function based on the vehicle speed information, thereby obtaining a second activation result; and determine the gear gesture recognition function activation result based on the first activation result and / or the second activation result.

8. A vehicle gear shifting device based on gesture recognition, characterized in that, The device includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, the computer program being configured to implement the steps of the gesture recognition-based vehicle shifting method as described in any one of claims 1 to 6.

9. A storage medium, characterized in that, The storage medium is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, it implements the steps of the vehicle gear shifting method based on gesture recognition as described in any one of claims 1 to 6.

Images