Vehicle gear shifting method, device and equipment based on gesture recognition and storage medium

By activating the gesture recognition function in the vehicle based on the current status information, collecting and identifying the driver's gestures, and determining the vehicle's shift results, the problems of unsimplified shifting operations and inaccurate gesture recognition in the prior art are solved, and driving safety and operation convenience are improved.

CN120096576AActive Publication Date: 2025-06-06VOYAH AUTOMOBILE TECH CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
CN202510374225.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-03-27
Publication Date
2025-06-06
Estimated Expiration
2045-03-27

AI Technical Summary

Technical Problem

The existing intelligent gear shifting solution is not simplified enough in gear shifting operations, which can easily cause distraction from the driver, and the gesture recognition is not accurate enough, requiring secondary gesture recognition, which is inconvenient to operate.

Method used

By determining the activation result of the gear gesture recognition function based on the vehicle's current gear position, brake pedal status, accelerator pedal status and vehicle speed information, dynamic gestures of the driver's left or right hand are collected, and the vehicle shift result is determined through the target gesture recognition strategy.

Benefits of technology

Simplifies gear shifting operations, improves the accuracy of gesture recognition, avoids misidentifying gear shifting gestures in unsafe situations, and enhances driving safety.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120096576A_ABST
    Figure CN120096576A_ABST
Patent Text Reader

Abstract

The invention discloses a vehicle gear shifting method, device and equipment based on gesture recognition and a storage medium, relates to the technical field of vehicle control, and discloses the vehicle gear shifting method based on gesture recognition. Comprising the steps of determining a gear gesture recognition function activation result according to at least one of a current gear, brake pedal state information, accelerator pedal state information and vehicle speed information; according to the gear gesture recognition function activation result, a driver left hand dynamic gesture and / or a driver right hand dynamic gesture are / is collected, and a target gesture recognition strategy is determined; and determining a vehicle gear shifting result through the target gesture recognition strategy according to the dynamic gesture of the left hand of the driver and / or the dynamic gesture of the right hand of the driver. A simple and convenient gear shifting scheme can be provided to improve the accuracy of gesture recognition in the gear shifting process.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of vehicle control technology, and in particular to a vehicle gear shifting method, device, equipment and storage medium based on gesture recognition. Background Art

[0002] With the continuous advancement of intelligent technology, automobile human-machine interaction control technology has evolved from traditional physical button control systems to touch control systems and voice control systems, and is gradually evolving towards higher-level interaction methods such as gesture control systems, visual control, and brain-electromechanical control. The automotive industry is undergoing a transformation from mechanization to intelligence, and physical switches, buttons, knobs, gear levers, etc. are slowly being eliminated or cancelled.

[0003] Some existing intelligent shifting solutions require the driver to look at the screen and slide his finger in a specific area. The shifting operation is not simple enough, which can easily distract the driver and is not conducive to driving safety. Some intelligent shifting solutions control the vehicle through gesture recognition. In order to reduce misidentification, the driver needs to perform a second gesture recognition, which is inconvenient for the driver to operate. How to provide a simple shifting solution to improve the accuracy of gesture recognition during the shifting process has become a problem to be solved.

[0004] The above contents are only used to assist in understanding the technical solution of the present application and do not constitute an admission that the above contents are prior art. Summary of the invention

[0005] The main purpose of the present application is to provide a vehicle shifting method, device, equipment and storage medium based on gesture recognition, aiming to solve the technical problem of how to provide a simple shifting solution to improve the accuracy of gesture recognition during the shifting process.

[0006] To achieve the above objectives, the present application proposes a vehicle shifting method based on gesture recognition, the method comprising:

[0007] determining an activation result of the gear position gesture recognition function according to at least one of the current gear position, brake pedal state information, accelerator pedal state information, and vehicle speed information;

[0008] collecting the driver's left hand dynamic gesture and / or the driver's right hand dynamic gesture according to the activation result of the gear gesture recognition function, and determining a target gesture recognition strategy;

[0009] The target gesture recognition strategy is used to determine a vehicle shift result according to the driver's left-hand dynamic gesture and / or the driver's right-hand dynamic gesture.

[0010] In one embodiment, the step of determining the activation result of the gear position gesture recognition function according to at least one of the current gear position, brake pedal state information, accelerator pedal state information and vehicle speed information comprises:

[0011] When the current gear is the parking gear, determining whether to activate the neutral gear gesture recognition function according to the brake pedal state information and the accelerator pedal state information to obtain a first activation result;

[0012] When the first activation result is to activate the neutral gear gesture recognition function, determining whether to activate the reverse gear gesture recognition function and the forward gear gesture recognition function according to the vehicle speed information, to obtain a second activation result;

[0013] An activation result of the gear position gesture recognition function is determined according to the first activation result and / or the second activation result.

[0014] In one embodiment, the step of determining the activation result of the gear position gesture recognition function according to at least one of the current gear position, brake pedal state information, accelerator pedal state information and vehicle speed information comprises:

[0015] When the current gear is neutral, identifying whether to activate the parking gear gesture recognition function according to the vehicle speed information to obtain a third activation result;

[0016] When the third activation result is to activate the parking gear gesture recognition function, determining whether to activate the reverse gear gesture recognition function and the forward gear gesture recognition function according to the brake pedal state information and the accelerator pedal state information, to obtain a fourth activation result;

[0017] When the third activation result is not activating the parking gear gesture recognition function, determining whether to activate the reverse gear gesture recognition function and the forward gear gesture recognition function according to the accelerator pedal state information, to obtain the fourth activation result;

[0018] An activation result of the gear position gesture recognition function is determined according to the third activation result and the fourth activation result.

[0019] In one embodiment, the step of determining the activation result of the gear position gesture recognition function according to at least one of the current gear position, brake pedal state information, accelerator pedal state information and vehicle speed information comprises:

[0020] When the current gear is a forward gear or a reverse gear, activating the neutral gear gesture recognition function, and determining whether to activate the parking gear gesture recognition function according to the vehicle speed information, to obtain a fifth activation result;

[0021] When the fifth activation result is to activate the parking gear gesture recognition function, determining whether to activate the reverse gear gesture recognition function or the forward gear gesture recognition function according to the brake pedal state information and the accelerator pedal state information, to obtain a sixth activation result;

[0022] An activation result of the gear position gesture recognition function is determined according to the fifth activation result and / or the sixth activation result.

[0023] In one embodiment, the step of collecting the driver's left hand dynamic gesture and / or the driver's right hand dynamic gesture according to the activation result of the gear gesture recognition function and determining the target gesture recognition strategy includes:

[0024] When the gear gesture recognition function activation result is to activate the reverse gear gesture recognition function and / or the neutral gear gesture recognition function, collecting the driver's left hand dynamic gesture, and determining the target gesture recognition strategy to be the reverse gear gesture recognition strategy and / or the neutral gear gesture recognition strategy;

[0025] When the gear gesture recognition function activation result is activating the parking gear gesture recognition function and / or the forward gear gesture recognition function, the driver's right hand dynamic gesture is collected, and the target gesture recognition strategy is determined to be the parking gear gesture recognition strategy and / or the forward gear gesture recognition strategy.

[0026] In one embodiment, the step of determining the vehicle shift result according to the driver's left hand dynamic gesture and / or the driver's right hand dynamic gesture through the gesture recognition strategy includes:

[0027] identifying whether there is a target gear shift gesture according to the driver's left hand dynamic gesture and / or the driver's right hand dynamic gesture through the target gesture recognition strategy, and obtaining a gear shift gesture recognition result, wherein the target gear shift gesture is a dynamic gesture composed of two consecutive preset static gestures;

[0028] When the gear shift gesture recognition result indicates that the target gear shift gesture exists, a vehicle gear shift result is determined according to the recognized target gear shift gesture.

[0029] In one embodiment, after the step of determining the activation result of the gear position gesture recognition function according to at least one of the current gear position, brake pedal state information, accelerator pedal state information and vehicle speed information, the step further includes:

[0030] When the gear position gesture recognition function activation result is to not activate the gear position gesture recognition function, determining the vehicle gear shift result is to maintain the current gear position without switching.

[0031] In addition, to achieve the above-mentioned purpose, the present application also proposes a vehicle shifting device based on gesture recognition, and the vehicle shifting device based on gesture recognition includes:

[0032] an activation module, configured to determine an activation result of the gear position gesture recognition function according to at least one of the current gear position, brake pedal state information, accelerator pedal state information, and vehicle speed information;

[0033] A collection module, used for collecting the left hand dynamic gesture of the driver and / or the right hand dynamic gesture of the driver according to the activation result of the gear gesture recognition function, and determining a target gesture recognition strategy;

[0034] A determination module is used to determine a vehicle shift result according to the driver's left hand dynamic gesture and / or the driver's right hand dynamic gesture through the target gesture recognition strategy.

[0035] In addition, to achieve the above-mentioned purpose, the present application also proposes a vehicle gear shifting device based on gesture recognition, the device comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, the computer program being configured to implement the steps of the vehicle gear shifting method based on gesture recognition as described above.

[0036] In addition, to achieve the above-mentioned purpose, the present application also proposes a storage medium, which is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by the processor, the steps of the vehicle shifting method based on gesture recognition as described above are implemented.

[0037] In addition, to achieve the above-mentioned purpose, the present application also provides a computer program product, which includes a computer program, and when the computer program is executed by a processor, the steps of the vehicle shifting method based on gesture recognition as described above are implemented.

[0038] One or more technical solutions proposed in this application have at least the following technical effects:

[0039] The activation result of the gear gesture recognition function is determined according to at least one of the current gear position, brake pedal status information, accelerator pedal status information and vehicle speed information; the driver's left hand dynamic gestures and / or the driver's right hand dynamic gestures are collected according to the activation result of the gear gesture recognition function, and a target gesture recognition strategy is determined; the vehicle gear shifting result is determined according to the driver's left hand dynamic gestures and / or the driver's right hand dynamic gestures through the target gesture recognition strategy; the gesture recognition function activation judgment is made according to the vehicle's current status information, so as to avoid recognizing the gear shifting gesture in an unsafe situation and posing a threat to driving safety; and different gestures for the left and right hands are adopted to increase the difference in gestures and improve the accuracy of gesture recognition during the gear shifting process. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0041] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0042] Figure 1 A flow chart of a first embodiment of a vehicle shifting method based on gesture recognition according to the present application;

[0043] Figure 2 A schematic diagram of the installation of a left camera and a right camera provided in Embodiment 1 of the vehicle shifting method based on gesture recognition of the present application;

[0044] Figure 3 A schematic diagram of shift gesture recognition provided in Embodiment 1 of the vehicle shift method based on gesture recognition of the present application;

[0045] Figure 4 A flow chart of a second embodiment of a vehicle shifting method based on gesture recognition according to the present application;

[0046] Figure 5 A schematic diagram of a simplified process of a vehicle shifting method based on gesture recognition provided in Embodiment 2 of the present application;

[0047] Figure 6 This is a schematic diagram of the module structure of a vehicle shifting device based on gesture recognition according to an embodiment of the present application;

[0048] Figure 7 Schematic diagram of the device structure of the hardware operating environment involved in the vehicle shifting method based on gesture recognition in the embodiment of the present application.

[0049] The purpose, features and advantages of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0050] It should be understood that the specific embodiments described herein are only used to explain the technical solutions of the present application and are not used to limit the present application.

[0051] In order to better understand the technical solution of the present application, a detailed description will be given below in conjunction with the accompanying drawings and specific implementation methods.

[0052] The main solution of the embodiment of the present application is: determine the activation result of the gear gesture recognition function according to at least one of the current gear position, brake pedal status information, accelerator pedal status information and vehicle speed information; collect the driver's left hand dynamic gestures and / or the driver's right hand dynamic gestures according to the gear gesture recognition function activation result, and determine the target gesture recognition strategy; determine the vehicle gear shifting result according to the driver's left hand dynamic gestures and / or the driver's right hand dynamic gestures through the target gesture recognition strategy.

[0053] Since some existing intelligent shifting solutions require the driver to look at the screen and slide his fingers in a specific area, the shifting operation is not simple enough, which can easily distract the driver and is not conducive to driving safety; some intelligent shifting solutions control the vehicle through gesture recognition, and in order to reduce misidentification, the driver needs to perform a second gesture recognition, which is inconvenient for the driver to operate. How to provide a simple shifting solution to improve the accuracy of gesture recognition during the shifting process has become a problem to be solved.

[0054] The present application provides a solution to determine the activation of the gesture recognition function based on the current state information of the vehicle, so as to avoid recognizing the gear shifting gesture in an unsafe situation and posing a threat to driving safety. By adopting different gestures for the left and right hands, the difference in gestures is increased, thereby improving the accuracy of gesture recognition during the gear shifting process.

[0055] It should be noted that the execution subject of this embodiment may be a computing service device with data processing, network communication and program running functions, such as a tablet computer, a personal computer, a mobile phone, etc., or an electronic device capable of realizing the above functions, a vehicle terminal, etc. The following takes the vehicle terminal as an example to illustrate this embodiment and the following embodiments.

[0056] Based on this, the embodiment of the present application provides a vehicle shifting method based on gesture recognition, referring to Figure 1 , Figure 1 This is a flow chart of the first embodiment of the vehicle shifting method based on gesture recognition in this application.

[0057] In this embodiment, the vehicle shifting method based on gesture recognition includes steps S10 to S30:

[0058] Step S10, determining the activation result of the gear position gesture recognition function according to at least one of the current gear position, brake pedal state information, accelerator pedal state information and vehicle speed information;

[0059] It should be understood that the current gear position indicates the gear position of the vehicle at the current moment, which may include parking gear (P gear), reverse gear (R gear), neutral gear (N gear), and forward gear (D gear). The current gear position of the vehicle can be obtained through real-time monitoring and recording by the vehicle control system to determine the current working state of the vehicle. The brake pedal status information indicates the operation of the vehicle's brake pedal, which may include the two conditions of stepping on the brake pedal and not stepping on the brake pedal. It is used to determine whether the driver intends to stop or slow down. The brake pedal status information can be obtained through real-time monitoring of the vehicle's sensors. The accelerator pedal status information is the accelerator pedal opening (unit: %), which is used to determine the driver's acceleration intention. The vehicle speed information is the speed data of the vehicle when it is driving (unit: km / h), which is used to determine whether the vehicle is in a speed range suitable for shifting to the corresponding gear position, and can be obtained in real time through the vehicle speed sensor.

[0060] It should be noted that the gear gesture recognition function activation result is the result of determining whether to activate the gesture shift function based on the current gear, brake pedal status, accelerator pedal status and vehicle speed information, including two cases of "not activating the gear gesture recognition function" and "activating the gear gesture recognition function". Further, for the case of "activating the gear gesture recognition function", the gear gesture recognition function activation result corresponds to at least one of activating the reverse gear gesture recognition function, activating the forward gear gesture recognition function, activating the parking gear gesture recognition function and activating the neutral gear gesture recognition function.

[0061] In addition, it should be noted that existing solutions often rely on static, single gesture recognition to shift the vehicle, and control the vehicle to perform corresponding shift operations when the corresponding gesture is recognized. The focus of improvement is also on the accuracy of the gesture recognition process, and it is impossible to avoid other environmental factors or unconscious actions of the driver interfering with the shift operation. By checking the corresponding vehicle state parameters (at least one of the brake pedal state information, accelerator pedal state information, and vehicle speed information) based on the current gear position of the vehicle to determine whether to activate gesture recognition, it is possible to avoid erroneous triggering of the shift operation in unsafe situations (such as excessive speed, no brake, etc.), thereby increasing safety.

[0062] In a feasible implementation manner, after step S10, the method may further include: when the activation result of the gear gesture recognition function is to deactivate the gear gesture recognition function, determining that the vehicle shifting result is to maintain the current gear without switching.

[0063] It should be understood that when the gear gesture recognition function is not activated, even if the driver makes a gear shift gesture, the vehicle will maintain the current gear position unchanged because the gear gesture recognition function is not activated, so as to prevent the driver from accidentally triggering the gear shift operation by making a gear shift gesture inadvertently or in an unsafe environment.

[0064] In a feasible implementation, step S10 may include steps A11 to A13:

[0065] Step A11, when the current gear is the parking gear, determining whether to activate the neutral gear gesture recognition function according to the brake pedal state information and the accelerator pedal state information, and obtaining a first activation result;

[0066] It should be noted that when the current gear is the parking gear (P gear), the brake pedal status information and the accelerator pedal status information will be monitored to determine whether to activate the neutral gear (N gear) gesture recognition function to obtain the first activation result, so as to avoid accidental gear switching during driving or when the driver needs to accelerate.

[0067] For example, after the vehicle is started, when the vehicle is in the parking gear (P gear) state, if the driver steps on the brake pedal and the opening of the accelerator pedal is less than the preset value TBD1%, it will be judged that the conditions for activating the neutral gear (N gear) gesture recognition function are met. Under this condition, when the neutral gear (N gear) gesture is successfully recognized, the vehicle's gear will be switched from the parking gear (P gear) to the neutral gear (N gear).

[0068] Step A12, when the first activation result is to activate the neutral gear gesture recognition function, determining whether to activate the reverse gear gesture recognition function and the forward gear gesture recognition function according to the vehicle speed information, to obtain a second activation result;

[0069] It should be noted that if the first activation result is to activate the neutral gear gesture recognition function, it means that the brake pedal status information and the accelerator pedal status information meet the corresponding safety conditions. At the same time, it will further determine whether the vehicle is close to a stopped state based on the vehicle speed information, and then determine whether to activate the reverse gear (R gear) gesture recognition function and the forward gear (D gear) gesture recognition function, and obtain the second activation result of preparing to recognize the reverse gear gesture and the forward gear gesture.

[0070] For example, after the vehicle is started, when the vehicle is in the parking gear (P gear) state, if the first activation result is to activate the neutral gear gesture recognition function, and the vehicle speed is less than or equal to TBD2 km / h (such as 3km / h), it will be judged that the conditions for activating the reverse gear (R gear) and forward gear (D gear) gesture recognition functions are met. Under this condition, when the reverse gear (R gear) or forward gear (D gear) gesture is successfully recognized, the gear of the vehicle will be switched from the parking gear (P gear) to the reverse gear (R gear) or forward gear (D gear).

[0071] Step A13: determining an activation result of a gear position gesture recognition function according to the first activation result and / or the second activation result.

[0072] It should be understood that if the first activation result is deactivating the neutral gear gesture recognition function, then the activation result of the gear gesture recognition function is deactivating the gear gesture recognition function; if the first activation result is activating the neutral gear gesture recognition function and the second activation result is activating the reverse gear gesture recognition function and the forward gear gesture recognition function, then the activation result of the gear gesture recognition function is activating the neutral, reverse gear and forward gear gesture recognition functions; if the first activation result is activating the neutral gear gesture recognition function and the second activation result is deactivating the reverse gear gesture recognition function and the forward gear gesture recognition function, then the activation result of the gear gesture recognition function is activating the neutral gear gesture recognition function.

[0073] In another feasible implementation, step S10 may include steps A21 to A24:

[0074] Step A21, when the current gear is neutral, identifying whether to activate the parking gear gesture recognition function according to the vehicle speed information, and obtaining a third activation result;

[0075] It should be noted that when the vehicle is in neutral (N gear), it is necessary to monitor the vehicle speed information to determine whether to activate the parking gear (P gear) gesture recognition function, so as to ensure that the parking gear gesture recognition function is activated only within an appropriate speed range (the vehicle is close to a stationary state), and obtain the third activation result of preparing to recognize the parking gear gesture.

[0076] For example, after the vehicle is started, when the vehicle is in neutral (N gear), if the vehicle speed is less than or equal to TBD2km / h (for example, 3km / h), the condition for activating the parking gear (P gear) gesture recognition function is met. Under this condition, when the parking gear (P gear) gesture is successfully recognized, the vehicle's gear position will be switched from neutral (N gear) to parking gear (P gear).

[0077] Step A22, when the third activation result is to activate the parking gear gesture recognition function, determining whether to activate the reverse gear gesture recognition function and the forward gear gesture recognition function according to the brake pedal state information and the accelerator pedal state information, to obtain a fourth activation result;

[0078] It should be noted that if the third activation result is to activate the parking gear gesture recognition function, it means that the vehicle is close to a stationary state, and it is necessary to further determine whether to allow activation of the reverse gear (R gear) gesture recognition function and the forward gear (D gear) gesture recognition function based on the brake pedal state and the accelerator pedal state, and obtain the fourth activation result to ensure that the reverse gear or forward gear gesture recognition is activated again in a safe operating environment.

[0079] For example, after the vehicle is started, when the vehicle is in neutral (N gear), if the third activation result is to activate the reverse gear gesture recognition function and the forward gear gesture recognition function, the brake pedal is in a stepped state, and the accelerator pedal opening is less than the preset value TBD1%, it is determined that the conditions for activating the reverse gear and forward gear gesture recognition functions are met. Under this condition, if the driver makes a corresponding reverse gear (R gear) or forward gear (D gear) gesture, the vehicle will switch from neutral (N gear) to reverse gear (R gear) or forward gear (D gear).

[0080] Step A23, when the third activation result is not activating the parking gear gesture recognition function, determining whether to activate the reverse gear gesture recognition function and the forward gear gesture recognition function according to the accelerator pedal state information, to obtain the fourth activation result;

[0081] It should be noted that if the third activation result is not activating the parking gear gesture recognition function, it means that the vehicle is already in a normal driving state, and there is no need to activate the reverse gear (R gear) gesture recognition function and the forward gear (D gear) gesture recognition function according to the brake pedal state. It is only necessary to judge whether to allow the activation of the reverse gear (R gear) gesture recognition function and the forward gear (D gear) gesture recognition function according to the accelerator pedal state to obtain the fourth activation result.

[0082] For example, after the vehicle is started, when the vehicle is in neutral (N gear), if the third activation result is not to activate the reverse gear gesture recognition function and the forward gear gesture recognition function, and the accelerator pedal opening is less than the preset value TBD1%, it is determined that the conditions for activating the reverse gear and forward gear gesture recognition functions are met. Under this condition, if the driver makes a corresponding reverse gear (R gear) or forward gear (D gear) gesture, the vehicle will switch from neutral (N gear) to reverse gear (R gear) or forward gear (D gear).

[0083] Step A24, determining an activation result of the gear position gesture recognition function according to the third activation result and the fourth activation result.

[0084] It should be noted that, if the third activation result is to deactivate the neutral gear gesture recognition function, and the fourth activation result is to deactivate the reverse gear gesture recognition function and the forward gear gesture recognition function, then the activation result of the gear gesture recognition function is to deactivate the gear shift gesture recognition function; if the third activation result is to deactivate the neutral gear gesture recognition function, and the fourth activation result is to activate the reverse gear gesture recognition function and the forward gear gesture recognition function, then the activation result of the gear gesture recognition function is to activate the reverse gear and forward gear gesture recognition functions; if the third activation result is to activate the neutral gear gesture recognition function, and the fourth activation result is to deactivate the reverse gear gesture recognition function and the forward gear gesture recognition function, then the activation result of the gear gesture recognition function is to activate the neutral gear gesture recognition function; if the third activation result is to activate the neutral gear gesture recognition function, and the fourth activation result is to activate the reverse gear gesture recognition function and the forward gear gesture recognition function, then the activation result of the gear gesture recognition function is to activate the neutral gear, reverse gear and forward gear gesture recognition functions.

[0085] In another feasible implementation, step S10 may include steps A31 to A33:

[0086] Step A31, when the current gear is a forward gear or a reverse gear, activating the neutral gear gesture recognition function, and determining whether to activate the parking gear gesture recognition function according to the vehicle speed information, to obtain a fifth activation result;

[0087] It should be understood that when the vehicle is in the forward gear (D gear) or reverse gear (R gear) during the forward or reverse process, the neutral gear (N gear) gesture recognition function can be directly activated. At the same time, the vehicle speed information is used to determine whether the vehicle is close to a stationary state to determine whether to activate the parking gear (P gear) gesture recognition function, thereby obtaining the fifth activation result.

[0088] For example, after the vehicle is started, when the vehicle is in the forward gear (D gear) or reverse gear (R gear) state, and the vehicle speed is less than or equal to the preset value TBD2 km / h (for example, 3km / h), the condition for activating the neutral and parking gear gesture recognition function is met. Under this condition, if the driver makes the corresponding neutral gear (N gear) or parking gear (P gear) gesture, the vehicle will switch from the reverse gear (R gear) or forward gear (D gear) to the neutral gear (N gear) or parking gear (P gear).

[0089] Step A32, when the fifth activation result is to activate the parking gear gesture recognition function, determine whether to activate the reverse gear gesture recognition function or the forward gear gesture recognition function according to the brake pedal state information and the accelerator pedal state information, to obtain a sixth activation result;

[0090] It should be noted that if the fifth activation result is to activate the parking gear gesture recognition function, it means that the vehicle is already in a normal driving state, and it is necessary to determine whether to activate the reverse gear (R gear) gesture recognition function or the forward gear (D gear) gesture recognition function according to the brake pedal state and the accelerator pedal state, and obtain the sixth activation result. Among them, if the fifth activation result is to activate the parking gear gesture recognition function, when the current gear is the forward gear, it is determined whether to activate the reverse gear (R gear) gesture recognition function according to the brake pedal state and the accelerator pedal state; when the current gear is the reverse gear, it is determined whether to activate the forward gear (D gear) gesture recognition function according to the brake pedal state and the accelerator pedal state.

[0091] Exemplarily, after the vehicle is started, when the vehicle is in the forward gear (D gear) state, if the fifth activation result is to activate the parking gear gesture recognition function, the accelerator pedal opening is less than TBD1%, and the vehicle speed is less than or equal to TBD2km / h (such as 3km / h), then it is judged that the conditions for activating the reverse gear gesture recognition function are met; when the vehicle is in the reverse gear (R gear) state, if the fifth activation result is to activate the parking gear gesture recognition function, the accelerator pedal opening is less than TBD1%, and the vehicle speed is less than or equal to TBD2km / h (such as 3km / h), then it is judged that the conditions for activating the forward gear gesture recognition function are met. Under this condition, if the driver makes a corresponding reverse gear (R gear) or forward gear (D gear) gesture, the vehicle will switch from the forward gear (D gear) or reverse gear (R gear) to the reverse gear (R gear) or forward gear (D gear).

[0092] Step A33: determining an activation result of the gear position gesture recognition function according to the fifth activation result and / or the sixth activation result.

[0093] It should be noted that if the fifth activation result is to activate the neutral gear gesture recognition function and not to activate the parking gear gesture recognition function, then the activation result of the gear gesture recognition function is to activate the neutral gear gesture recognition function; if the fifth activation result is to activate the neutral gear gesture recognition function and the parking gear gesture recognition function, and the sixth activation result is to not activate the reverse gear gesture recognition function or the forward gear gesture recognition function, then the activation result of the gear gesture recognition function is to activate the neutral gear and the parking gear gesture recognition function; if the fifth activation result is to activate the neutral gear gesture recognition function and the parking gear gesture recognition function, and the sixth activation result is to activate the reverse gear gesture recognition function or the forward gear gesture recognition function, then the activation result of the gear gesture recognition function is to activate the neutral gear and the parking gear gesture recognition functions, and activate the reverse gear gesture recognition function or the forward gear gesture recognition function.

[0094] Step S20, collecting the driver's left hand dynamic gesture and / or the driver's right hand dynamic gesture according to the activation result of the gear gesture recognition function, and determining a target gesture recognition strategy;

[0095] It should be noted that a left camera is installed on the left side of the vehicle's driver's seat, and a right camera is installed on the right side of the driver's seat. Figure 2 , Figure 2 The schematic diagram of the installation of the left camera and the right camera provided in the first embodiment of the vehicle shifting method based on gesture recognition of the present application. The left camera is used to collect the dynamic gestures of the driver's left hand and identify the gestures of the reverse gear (R gear) and the neutral gear (N gear). The right camera is used to collect the dynamic gestures of the driver's right hand and identify the parking gear (P gear) and the forward gear (D gear) to avoid misidentification or other interference gestures that cause the vehicle to shift gear incorrectly. According to the activation result of the gear gesture recognition function, the left camera will be started to collect the dynamic gestures of the driver's left hand and / or the right camera will be started to collect the dynamic gestures of the right hand, and the target gesture recognition strategy will be determined. The target gesture recognition strategy includes at least one of the reverse gear gesture recognition strategy, the neutral gear gesture recognition strategy, the parking gear gesture recognition strategy or the forward gear gesture recognition strategy.

[0096] Step S30 , determining a vehicle shift result according to the driver's left hand dynamic gesture and / or the driver's right hand dynamic gesture through the target gesture recognition strategy.

[0097] It should be noted that the target gesture recognition strategy is used to determine whether there is a corresponding gear shift gesture in the driver's left hand dynamic gesture and / or the driver's right hand dynamic gesture, and obtain the vehicle gear shift result. If so, the vehicle is shifted according to the recognized gear shift gesture; if not, the original gear position is maintained unchanged.

[0098] In a feasible implementation, step S30 may include: determining whether there is a target gear shift gesture according to the driver's left hand dynamic gesture and / or the driver's right hand dynamic gesture through the target gesture recognition strategy, and obtaining a gear shift gesture recognition result, wherein the target gear shift gesture is a dynamic gesture composed of two consecutive preset static gestures; when the gear shift gesture recognition result is that the target gear shift gesture exists, determining the vehicle gear shift result according to the identified target gear shift gesture.

[0099] It should be noted that the target gear shift gesture is a dynamic gesture composed of two consecutive preset static gestures. The camera needs to recognize the change from gesture 1 to gesture 2 to define it as a legal gear shift gesture. The target gear shift gesture includes at least one of the reverse gear (R gear) gesture, forward gear (D gear) gesture, neutral gear (N gear) gesture and parking gear (P gear) gesture. Figure 3 , Figure 3 This is a schematic diagram of the shift gesture recognition provided in the first embodiment of the vehicle shift method based on gesture recognition in this application. Figure 3As shown, the left camera is used to collect the dynamic gestures of the driver's left hand and identify the reverse gear (R gear) and neutral gear (N gear) gestures, and the right camera is used to collect the dynamic gestures of the driver's right hand and identify the parking gear (P gear) and forward gear (D gear). The image processor is used to perform algorithmic processing on the collected dynamic gestures of the driver's left hand and / or the driver's right hand according to the target gesture recognition strategy, identify whether there is a target gear shift gesture, obtain the gear shift gesture recognition result, and send the gear shift gesture recognition result to the vehicle control unit. The vehicle control unit will generate a corresponding gear shift request gesture signal based on the gear shift gesture recognition result, and send the gear shift request gesture signal to the motor controller or the gearbox controller to perform the vehicle's gear shift.

[0100] This embodiment determines the activation result of the gear gesture recognition function according to at least one of the current gear position, brake pedal status information, accelerator pedal status information and vehicle speed information, collects the driver's left hand dynamic gestures and / or the driver's right hand dynamic gestures according to the gear gesture recognition function activation result, and determines the target gesture recognition strategy, determines the vehicle gear shifting result according to the driver's left hand dynamic gestures and / or the driver's right hand dynamic gestures through the target gesture recognition strategy, and makes a gesture recognition function activation judgment according to the vehicle's current status information to avoid recognizing the gear shifting gesture in an unsafe situation, which poses a threat to driving safety, and increases the difference in gestures by adopting different gestures for the left and right hands, thereby improving the accuracy of gesture recognition during the gear shifting process.

[0101] Based on the first embodiment of the present application, in the second embodiment of the present application, the same or similar contents as those in the above-mentioned embodiment 1 can be referred to the above introduction, and will not be repeated in the following. Figure 4 , step S20 may include steps S21 to S22:

[0102] Step S21, when the activation result of the gear gesture recognition function is to activate the reverse gear gesture recognition function and / or the neutral gear gesture recognition function, collecting the driver's left hand dynamic gesture, and determining the target gesture recognition strategy to be the reverse gear gesture recognition strategy and / or the neutral gear gesture recognition strategy;

[0103] It should be understood that if the result of the gear gesture recognition function activation is to activate the reverse gear gesture recognition function and / or the neutral gear gesture recognition function, the left camera will be started to collect the driver's left hand dynamic gestures. Specifically, if the result of the gear gesture recognition function activation is to activate the reverse gear gesture recognition function, the target gesture recognition strategy will be determined to be the reverse gear gesture recognition strategy; if the result of the gear gesture recognition function activation is to activate the neutral gear gesture recognition function, the target gesture recognition strategy will be determined to be the neutral gear gesture recognition strategy; if the result of the gear gesture recognition function activation is to activate the reverse gear gesture recognition function and the neutral gear gesture recognition function, the target gesture recognition strategy will be determined to be the reverse gear gesture recognition strategy and the neutral gear gesture recognition strategy. Among them, the reverse gear gesture recognition strategy is used to identify whether there is a preset reverse gear gesture in the collected left hand dynamic gestures, and the neutral gear gesture recognition strategy is used to identify whether there is a preset neutral gear gesture in the collected left hand dynamic gestures.

[0104] Step S22, when the activation result of the gear gesture recognition function is to activate the parking gear gesture recognition function and / or the forward gear gesture recognition function, collect the driver's right hand dynamic gesture, and determine the target gesture recognition strategy as the parking gear gesture recognition strategy and / or the forward gear gesture recognition strategy.

[0105] It should be understood that if the result of the gear gesture recognition function activation is to activate the parking gear gesture recognition function and / or the forward gear gesture recognition function, the left camera will be started to collect the driver's left hand dynamic gestures. Specifically, if the result of the gear gesture recognition function activation is to activate the parking gear gesture recognition function, the target gesture recognition strategy will be determined to be the parking gear gesture recognition strategy; if the result of the gear gesture recognition function activation is to activate the forward gear gesture recognition function, the target gesture recognition strategy will be determined to be the forward gear gesture recognition strategy; if the result of the gear gesture recognition function activation is to activate the parking gear gesture recognition function and the forward gear gesture recognition function, the target gesture recognition strategy will be determined to be the parking gear gesture recognition strategy and the forward gear gesture recognition strategy. Among them, the parking gear gesture recognition strategy is used to identify whether there is a preset parking gear gesture in the collected left hand dynamic gestures, and the forward gear gesture recognition strategy is used to identify whether there is a preset neutral gear gesture in the collected left hand dynamic gestures.

[0106] In this embodiment, when the activation result of the gear gesture recognition function is to activate the reverse gear gesture recognition function and / or the neutral gear gesture recognition function, the driver's left hand dynamic gesture is collected, and the target gesture recognition strategy is determined to be the reverse gear gesture recognition strategy and / or the neutral gear gesture recognition strategy; when the activation result of the gear gesture recognition function is to activate the parking gear gesture recognition function and / or the forward gear gesture recognition function, the driver's right hand dynamic gesture is collected, and the target gesture recognition strategy is determined to be the parking gear gesture recognition strategy and / or the forward gear gesture recognition strategy; different cameras are used to recognize the forward gear and the reverse gear, and different gestures of the left hand and the right hand are used respectively, so as to increase the difference in gestures, improve recognition accuracy, and ensure that the forward gear and the reverse gear are not misrecognized.

[0107] For example, in order to help understand the implementation process of the vehicle shifting method based on gesture recognition obtained by combining this embodiment with the above-mentioned embodiment 1, please refer to Figure 5 , Figure 5 A brief flow chart of a vehicle shifting method based on gesture recognition is provided, specifically:

[0108] After the vehicle is started, the activation of the corresponding gear shift gesture recognition is determined based on the vehicle speed, the state of the brake pedal and the accelerator pedal, and the gesture recognition function. When the vehicle is currently in P gear, if the brake pedal is pressed and the accelerator pedal opening is less than TBD1%, the N gear gesture recognition function will be activated; if the brake pedal is pressed, the accelerator pedal opening is less than TBD1%, and the vehicle speed is less than or equal to TBD2 km / h (such as 3km / h), the D and R gear gesture recognition functions will be activated. When the vehicle is currently in N gear, if the vehicle speed is less than or equal to TBD2km / h (such as 3km / h), the P gear gesture recognition function will be activated; if the accelerator pedal opening is less than TBD1%, the vehicle speed is less than or equal to TBD2km / h (such as 3km / h), the brake pedal is pressed, and the D and R gear gesture recognition functions will be activated; if the accelerator pedal opening is less than TBD1%, and the vehicle speed is greater than TBD2km / h (such as 3km / h), the D and R gear gesture recognition functions will be activated. When the vehicle's current gear is D gear, the N gear gesture recognition function will be activated. If the vehicle speed is less than or equal to TBD2km / h (such as 3km / h), the P gear gesture recognition function will be activated; if the brake pedal is pressed, the accelerator pedal opening is less than TBD1%, and the vehicle speed is less than or equal to TBD2km / h (such as 3km / h), the R gear gesture recognition function will be activated. When the vehicle's current gear is R gear, the N gear gesture recognition function will be activated. If the vehicle speed is less than or equal to TBD2km / h (such as 3km / h), the P gear gesture recognition function will be activated; if the brake pedal is pressed, the accelerator pedal opening is less than TBD1%, and the vehicle speed is less than or equal to TBD2km / h (such as 3km / h), the D gear gesture recognition function will be activated. If the corresponding P, N, D, and R gear gesture recognition functions are activated and the corresponding gear shift gesture is recognized, the vehicle will be controlled to shift gears, otherwise the original gear will be maintained without switching.

[0109] It should be noted that the above examples are only used to understand the present application and do not constitute a limitation on the vehicle shifting method based on gesture recognition in the present application. More simple transformations based on this technical concept are all within the protection scope of the present application.

[0110] This application also provides a vehicle shifting device based on gesture recognition, please refer to Figure 6 , the vehicle shifting device based on gesture recognition comprises:

[0111] an activation module 10, configured to determine an activation result of the gear position gesture recognition function according to at least one of the current gear position, brake pedal state information, accelerator pedal state information, and vehicle speed information;

[0112] A collection module 20, configured to collect the driver's left hand dynamic gesture and / or the driver's right hand dynamic gesture according to the activation result of the gear position gesture recognition function, and determine a target gesture recognition strategy;

[0113] The determination module 30 is used to determine the vehicle shifting result according to the driver's left hand dynamic gesture and / or the driver's right hand dynamic gesture through the target gesture recognition strategy.

[0114] In one embodiment, the activation module 10 is further used to determine whether to activate the neutral gear gesture recognition function according to the brake pedal status information and the accelerator pedal status information when the current gear is the parking gear, and obtain a first activation result; when the first activation result is to activate the neutral gear gesture recognition function, determine whether to activate the reverse gear gesture recognition function and the forward gear gesture recognition function according to the vehicle speed information, and obtain a second activation result; determine the activation result of the gear gesture recognition function according to the first activation result and / or the second activation result.

[0115] In one embodiment, the activation module 10 is further used to identify whether to activate the parking gear gesture recognition function according to the vehicle speed information when the current gear is neutral, and obtain a third activation result; when the third activation result is to activate the parking gear gesture recognition function, determine whether to activate the reverse gear gesture recognition function and the forward gear gesture recognition function according to the brake pedal status information and the accelerator pedal status information, and obtain a fourth activation result; when the third activation result is not to activate the parking gear gesture recognition function, determine whether to activate the reverse gear gesture recognition function and the forward gear gesture recognition function according to the accelerator pedal status information, and obtain the fourth activation result; determine the gear gesture recognition function activation result according to the third activation result and the fourth activation result.

[0116] In one embodiment, the activation module 10 is further used to activate the neutral gear gesture recognition function when the current gear is the forward gear or the reverse gear, and determine whether to activate the parking gear gesture recognition function based on the vehicle speed information to obtain a fifth activation result; when the fifth activation result is to activate the parking gear gesture recognition function, determine whether to activate the reverse gear gesture recognition function or the forward gear gesture recognition function based on the brake pedal status information and the accelerator pedal status information to obtain a sixth activation result; determine the gear gesture recognition function activation result based on the fifth activation result and / or the sixth activation result.

[0117] In one embodiment, the acquisition module 20 is further used to acquire the driver's left hand dynamic gestures and determine the target gesture recognition strategy to be the reverse gear gesture recognition strategy and / or the neutral gear gesture recognition strategy when the activation result of the gear gesture recognition function is to activate the reverse gear gesture recognition function and / or the neutral gear gesture recognition function; and to acquire the driver's right hand dynamic gestures and determine the target gesture recognition strategy to be the parking gear gesture recognition strategy and / or the forward gear gesture recognition strategy when the activation result of the gear gesture recognition function is to activate the parking gear gesture recognition function and / or the forward gear gesture recognition function.

[0118] In one embodiment, the determination module 30 is further used to identify whether there is a target gear shift gesture according to the driver's left hand dynamic gesture and / or the driver's right hand dynamic gesture through the target gesture recognition strategy, and obtain a gear shift gesture recognition result, wherein the target gear shift gesture is a dynamic gesture composed of two consecutive preset static gestures; when the gear shift gesture recognition result is that the target gear shift gesture exists, the vehicle gear shift result is determined according to the identified target gear shift gesture.

[0119] In one embodiment, the determination module 30 is further configured to determine that the vehicle shifting result is to maintain the current gear without switching when the gear gesture recognition function activation result is to deactivate the gear gesture recognition function.

[0120] The vehicle shifting device based on gesture recognition provided by the present application adopts the vehicle shifting method based on gesture recognition in the above-mentioned embodiment, and can solve the technical problem of how to provide a simple shifting scheme to improve the accuracy of gesture recognition during the shifting process. Compared with the prior art, the beneficial effects of the vehicle shifting device based on gesture recognition provided by the present application are the same as the beneficial effects of the vehicle shifting method based on gesture recognition provided by the above-mentioned embodiment, and the other technical features of the vehicle shifting device based on gesture recognition are the same as the features disclosed in the above-mentioned embodiment method, which will not be described in detail here.

[0121] The present application provides a vehicle gear shifting device based on gesture recognition, and the vehicle gear shifting device based on gesture recognition includes: at least one processor; and a memory connected to the at least one processor in communication; wherein the memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the vehicle gear shifting method based on gesture recognition in the above-mentioned embodiment one.

[0122] Reference below Figure 7 , which shows a schematic diagram of the structure of a vehicle shifting device based on gesture recognition suitable for implementing the embodiment of the present application. The vehicle shifting device based on gesture recognition in the embodiment of the present application may include but is not limited to mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Portable Application Descriptions, tablet computers), PMPs (Portable Media Players, portable multimedia players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 7 The vehicle shifting device based on gesture recognition shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0123] like Figure 7 As shown, the vehicle shifting device based on gesture recognition may include a processing device 1001 (e.g., a central processing unit, a graphics processing unit, etc.), which can perform various appropriate actions and processes according to the program stored in ROM (Read Only Memory) 1002 or the program loaded from the storage device 1003 to RAM (Random Access Memory) 1004. In RAM 1004, various programs and data required for the operation of the vehicle shifting device based on gesture recognition are also stored. The processing device 1001, ROM 1002, and RAM 1004 are connected to each other via a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus. Typically, the following systems can be connected to the I / O interface 1006: input devices 1007 including, for example, a touch screen, a touchpad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; output devices 1008 including, for example, an LCD (Liquid Crystal Display), a speaker, a vibrator, etc.; storage devices 1003 including, for example, a magnetic tape, a hard disk, etc.; and communication devices 1009. The communication device 1009 can allow the vehicle shifting device based on gesture recognition to communicate wirelessly or wired with other devices to exchange data. Although the figure shows a vehicle shifting device based on gesture recognition with various systems, it should be understood that it is not required to implement or have all the systems shown. More or fewer systems may be implemented or have alternatively.

[0124] In particular, according to the embodiments disclosed in the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, the embodiments disclosed in the present application include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device, or installed from a storage device 1003, or installed from a ROM 1002. When the computer program is executed by the processing device 1001, the above-mentioned functions defined in the method of the embodiment disclosed in the present application are executed.

[0125] The vehicle shifting device based on gesture recognition provided by the present application adopts the vehicle shifting method based on gesture recognition in the above-mentioned embodiment, which can solve the technical problem of how to provide a simple shifting scheme to improve the accuracy of gesture recognition during the shifting process. Compared with the prior art, the beneficial effects of the vehicle shifting device based on gesture recognition provided by the present application are the same as the beneficial effects of the vehicle shifting method based on gesture recognition provided by the above-mentioned embodiment, and the other technical features of the vehicle shifting device based on gesture recognition are the same as the features disclosed in the method of the previous embodiment, which will not be repeated here.

[0126] It should be understood that the various parts disclosed in this application can be implemented by hardware, software, firmware or a combination thereof. In the description of the above embodiments, specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner.

[0127] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

[0128] The present application provides a computer-readable storage medium having computer-readable program instructions (ie, computer programs) stored thereon, and the computer-readable program instructions are used to execute the vehicle shifting method based on gesture recognition in the above-mentioned embodiment.

[0129] The computer-readable storage medium provided in the present application may be, for example, a USB flash drive, but is not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, systems or devices, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, RAM (Random Access Memory), ROM (Read Only Memory), EPROM (Erasable Programmable Read Only Memory) or flash memory, optical fiber, CD-ROM (CD-Read Only Memory, portable compact disk read-only memory), optical storage device, magnetic storage device, or any suitable combination of the above. In the present embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program, which may be used by or in combination with an instruction execution system, system or device. The program code contained on the computer-readable storage medium may be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (Radio Frequency), etc., or any suitable combination of the above.

[0130] The computer-readable storage medium may be included in the vehicle gear shifting device based on gesture recognition; or may exist independently without being assembled into the vehicle gear shifting device based on gesture recognition.

[0131] The computer-readable storage medium carries one or more programs. When the one or more programs are executed by a vehicle shifting device based on gesture recognition, the vehicle shifting device based on gesture recognition: determines the activation result of the gear gesture recognition function according to at least one of the current gear, brake pedal status information, accelerator pedal status information and vehicle speed information; collects the driver's left hand dynamic gestures and / or the driver's right hand dynamic gestures according to the gear gesture recognition function activation result, and determines the target gesture recognition strategy; determines the vehicle shifting result according to the driver's left hand dynamic gestures and / or the driver's right hand dynamic gestures through the target gesture recognition strategy.

[0132] The computer program code for performing the operation of the present application can be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as an independent software package, partially on the user's computer and partially on the remote computer, or completely on the remote computer or server. In the case of a remote computer, the remote computer can be connected to the user's computer through any type of network, including a LAN (Local Area Network) or a WAN (Wide Area Network), or it can be connected to an external computer (e.g., using an Internet service provider to connect through the Internet).

[0133] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present application. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0134] The modules involved in the embodiments described in this application may be implemented by software or hardware, wherein the name of the module does not constitute a limitation on the unit itself in some cases.

[0135] The readable storage medium provided in the present application is a computer-readable storage medium, which stores computer-readable program instructions (i.e., computer programs) for executing the above-mentioned vehicle shifting method based on gesture recognition, and can solve the technical problem of how to provide a simple shifting scheme to improve the accuracy of gesture recognition during the shifting process. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided in the present application are the same as the beneficial effects of the vehicle shifting method based on gesture recognition provided in the above-mentioned embodiment, and will not be repeated here.

[0136] The present application also provides a computer program product, including a computer program, which implements the steps of the vehicle shifting method based on gesture recognition as described above when the computer program is executed by a processor.

[0137] The computer program product provided by the present application can solve the technical problem of how to provide a simple gear shifting solution to improve the accuracy of gesture recognition during the gear shifting process. Compared with the prior art, the beneficial effects of the computer program product provided by the present application are the same as the beneficial effects of the vehicle gear shifting method based on gesture recognition provided by the above embodiment, and will not be elaborated here.

[0138] The above descriptions are only some embodiments of the present application, and are not intended to limit the patent scope of the present application. All equivalent structural changes made using the contents of the present application specification and drawings under the technical concept of the present application, or direct / indirect applications in other related technical fields are included in the patent protection scope of the present application.

Claims

1. A vehicle shifting method based on gesture recognition, characterized in that: The vehicle shifting method based on gesture recognition includes: determining an activation result of the gear position gesture recognition function according to at least one of the current gear position, brake pedal state information, accelerator pedal state information, and vehicle speed information; collecting the driver's left hand dynamic gesture and / or the driver's right hand dynamic gesture according to the activation result of the gear gesture recognition function, and determining a target gesture recognition strategy; The target gesture recognition strategy is used to determine a vehicle shift result according to the driver's left-hand dynamic gesture and / or the driver's right-hand dynamic gesture.

2. The method according to claim 1, characterized in that The step of determining the activation result of the gear position gesture recognition function according to at least one of the current gear position, brake pedal state information, accelerator pedal state information and vehicle speed information comprises: When the current gear is the parking gear, determining whether to activate the neutral gear gesture recognition function according to the brake pedal state information and the accelerator pedal state information to obtain a first activation result; When the first activation result is to activate the neutral gear gesture recognition function, determining whether to activate the reverse gear gesture recognition function and the forward gear gesture recognition function according to the vehicle speed information, to obtain a second activation result; An activation result of the gear position gesture recognition function is determined according to the first activation result and / or the second activation result.

3. The method according to claim 1, characterized in that The step of determining the activation result of the gear position gesture recognition function according to at least one of the current gear position, brake pedal state information, accelerator pedal state information and vehicle speed information comprises: When the current gear is neutral, identifying whether to activate the parking gear gesture recognition function according to the vehicle speed information to obtain a third activation result; When the third activation result is to activate the parking gear gesture recognition function, determining whether to activate the reverse gear gesture recognition function and the forward gear gesture recognition function according to the brake pedal state information and the accelerator pedal state information, to obtain a fourth activation result; When the third activation result is not activating the parking gear gesture recognition function, determining whether to activate the reverse gear gesture recognition function and the forward gear gesture recognition function according to the accelerator pedal state information, to obtain the fourth activation result; An activation result of the gear position gesture recognition function is determined according to the third activation result and the fourth activation result.

4. The method according to claim 1, characterized in that The step of determining the activation result of the gear position gesture recognition function according to at least one of the current gear position, brake pedal state information, accelerator pedal state information and vehicle speed information comprises: When the current gear is a forward gear or a reverse gear, activating the neutral gear gesture recognition function, and determining whether to activate the parking gear gesture recognition function according to the vehicle speed information, to obtain a fifth activation result; When the fifth activation result is to activate the parking gear gesture recognition function, determining whether to activate the reverse gear gesture recognition function or the forward gear gesture recognition function according to the brake pedal state information and the accelerator pedal state information, to obtain a sixth activation result; An activation result of the gear position gesture recognition function is determined according to the fifth activation result and / or the sixth activation result.

5. The method according to claim 1, characterized in that The step of collecting the driver's left hand dynamic gesture and / or the driver's right hand dynamic gesture according to the activation result of the gear gesture recognition function and determining the target gesture recognition strategy includes: When the gear gesture recognition function activation result is to activate the reverse gear gesture recognition function and / or the neutral gear gesture recognition function, collecting the driver's left hand dynamic gesture, and determining the target gesture recognition strategy to be the reverse gear gesture recognition strategy and / or the neutral gear gesture recognition strategy; When the gear gesture recognition function activation result is activating the parking gear gesture recognition function and / or the forward gear gesture recognition function, the driver's right hand dynamic gesture is collected, and the target gesture recognition strategy is determined to be the parking gear gesture recognition strategy and / or the forward gear gesture recognition strategy.

6. The method according to claim 1, characterized in that The step of determining the vehicle shift result according to the driver's left hand dynamic gesture and / or the driver's right hand dynamic gesture by using the gesture recognition strategy comprises: identifying whether there is a target gear shift gesture according to the driver's left hand dynamic gesture and / or the driver's right hand dynamic gesture through the target gesture recognition strategy, and obtaining a gear shift gesture recognition result, wherein the target gear shift gesture is a dynamic gesture composed of two consecutive preset static gestures; When the gear shift gesture recognition result indicates that the target gear shift gesture exists, a vehicle gear shift result is determined according to the recognized target gear shift gesture.

7. The method according to any one of claims 1 to 6, characterized in that After the step of determining the activation result of the gear position gesture recognition function according to at least one of the current gear position, brake pedal state information, accelerator pedal state information and vehicle speed information, the method further includes: When the gear position gesture recognition function activation result is to not activate the gear position gesture recognition function, determining the vehicle gear shift result is to maintain the current gear position without switching.

8. A vehicle shifting device based on gesture recognition, characterized in that: The device comprises: an activation module, configured to determine an activation result of the gear position gesture recognition function according to at least one of the current gear position, brake pedal state information, accelerator pedal state information, and vehicle speed information; A collection module, used for collecting the left hand dynamic gesture of the driver and / or the right hand dynamic gesture of the driver according to the activation result of the gear gesture recognition function, and determining a target gesture recognition strategy; A determination module is used to determine a vehicle shift result according to the driver's left hand dynamic gesture and / or the driver's right hand dynamic gesture through the target gesture recognition strategy.

9. A vehicle shifting device based on gesture recognition, characterized in that: The device comprises: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the vehicle gear shifting method based on gesture recognition as claimed in any one of claims 1 to 7.

10. A storage medium, characterized in that: The storage medium is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, the steps of the vehicle shifting method based on gesture recognition as described in any one of claims 1 to 7 are implemented.

Citation Information

Patent Citations

  • Gear switching control method and device, electronic equipment and storage medium

    CN111391852A

  • Gear control method, terminal, vehicle and product

    CN115681487A

  • Touch screen type gear shifting device, touch screen type key, automobile and gear shifting method

    CN115789234A

  • Method for operating a transmission system in a motor vehicle and motor vehicle

    DE102016001104A1

  • Gear shifting method for vehicle, apparatus, and vehicle

    WO2022161016A1