Method and device for controlling vehicle based on gestures

Abstract

The invention provides a method and device for controlling a vehicle based on gestures. The method comprises the steps that the corresponding relation between the gestures and control signals is preset; when the target vehicle enters the gesture driving mode, gesture action data of a driver are collected through a camera in the vehicle; wherein the gesture action data comprises gesture action images and / or gesture action videos; determining a current vehicle control signal according to the corresponding relationship between the gesture and the control signal and the gesture action data; and controlling the target vehicle to execute corresponding operation according to the current vehicle control signal. According to the method and the device, the driving control of the vehicle can be realized only by identifying the gesture action of the user through the camera without depending on holographic projection equipment, the system architecture is simplified, and the technical realization threshold is reduced.

Description

Technical Field

[0001] The present application relates to the field of vehicle control technology, and more specifically, to a method and device for controlling a vehicle based on gestures. Background Art

[0002] As vehicles play an increasingly important role in daily life and work, intelligent vehicle services have become a key trend in the development of the vehicle industry. In the existing technology, in order to realize gesture control of the vehicle, it is often necessary to use holographic projection equipment to project the vehicle's operating interface such as buttons and steering wheels, and then the user interacts with these projected interfaces. However, this method not only relies on holographic projection, which is not yet popular and the technology is not yet mature, but also faces problems such as difficulty in implementation and high cost. Summary of the invention

[0003] The purpose of this application is to provide a method and device for controlling a vehicle based on gestures, which does not rely on holographic projection equipment and can achieve driving control of the vehicle only by recognizing the user's gestures through a camera, thereby simplifying the system architecture and lowering the threshold for technical implementation.

[0004] A first aspect of the present application provides a method for controlling a vehicle based on gestures, comprising:

[0005] Pre-set the correspondence between gestures and control signals;

[0006] When the target vehicle enters the gesture driving mode, the driver's gesture action data is collected through the in-vehicle camera; wherein the gesture action data includes a gesture action image and / or a gesture action video;

[0007] Determining a current vehicle control signal according to the corresponding relationship between the gesture and the control signal and the gesture action data;

[0008] The target vehicle is controlled to perform corresponding operations according to the current vehicle control signal.

[0009] In the above implementation process, the method can realize the driving control of the vehicle only by recognizing the user's gestures through the camera without relying on holographic projection equipment, which simplifies the system architecture and lowers the threshold for technical implementation.

[0010] Further, determining the current vehicle control signal according to the correspondence between the gesture and the control signal and the gesture action data includes:

[0011] Performing gesture recognition on the gesture action data to obtain current gesture data;

[0012] A current vehicle control signal is determined according to the correspondence between the gesture and the control signal and the current gesture data.

[0013] Further, performing gesture recognition on the gesture action data to obtain current gesture data includes:

[0014] Determining the current control hand of the driver according to the gesture action data; wherein the current control hand is the left hand or the right hand;

[0015] Identify the gesture action and gesture action amplitude of the current controlling hand according to the gesture action data;

[0016] The current control hand, the gesture action and the gesture action amplitude are summarized to obtain current gesture data.

[0017] Further, in the gesture driving mode, the target vehicle shields the accelerator pedal operation signal, the brake pedal operation signal, the steering wheel operation signal and the shift handle operation signal, and only receives the gesture control signal;

[0018] The gesture action includes at least one of an action of extending a palm, an action of making a fist, an action of extending a single finger, and an action of opening five fingers;

[0019] The gesture action amplitude includes at least one of the palm orientation corresponding to the palm extension action, the five-finger opening degree corresponding to the five-finger opening action, the fist orientation corresponding to the fist clenching action, and the name of the extended finger corresponding to the single finger extension action.

[0020] Further, determining the current vehicle control signal according to the correspondence between the gesture and the control signal and the current gesture data includes:

[0021] Determine a vehicle control function according to the correspondence between the gesture and the control signal and the current control hand; wherein the vehicle control function is one or more of controlling the throttle, braking depth, steering angle and gear position;

[0022] Determining a unique target control function according to the correspondence between the gesture and the control signal, the gesture action and the vehicle control function;

[0023] Determining control parameters according to the corresponding relationship between the gesture and the control signal, the target control function and the gesture movement amplitude;

[0024] A current vehicle control signal is generated according to the target control function and the control parameter.

[0025] A second aspect of the present application provides a device for controlling a vehicle based on gestures, the device for controlling a vehicle based on gestures comprising:

[0026] A setting unit, used to pre-set the corresponding relationship between gestures and control signals;

[0027] A gesture collection unit, used to collect the driver's gesture action data through an in-vehicle camera when the target vehicle enters the gesture driving mode; wherein the gesture action data includes a gesture action image and / or a gesture action video;

[0028] a determination unit, configured to determine a current vehicle control signal according to the correspondence between the gesture and the control signal and the gesture action data;

[0029] A control unit is used to control the target vehicle to perform corresponding operations according to the current vehicle control signal.

[0030] Furthermore, the determining unit includes:

[0031] The recognition subunit is used to perform gesture recognition on the gesture action data to obtain current gesture data;

[0032] The determination subunit is used to determine the current vehicle control signal according to the corresponding relationship between the gesture and the control signal and the current gesture data.

[0033] Furthermore, the identification subunit includes:

[0034] A first determination module, used to determine the current control hand of the driver according to the gesture action data; wherein the current control hand is the left hand or the right hand;

[0035] A recognition module, used for recognizing the gesture action and gesture action amplitude of the current controlling hand according to the gesture action data;

[0036] The summarizing module is used to summarize the current controlling hand, the gesture action and the gesture action amplitude to obtain current gesture data.

[0037] Further, in the gesture driving mode, the target vehicle shields the accelerator pedal operation signal, the brake pedal operation signal, the steering wheel operation signal and the shift handle operation signal, and only receives the gesture control signal;

[0038] The gesture action includes at least one of an action of extending a palm, an action of making a fist, an action of extending a single finger, and an action of opening five fingers;

[0039] The gesture action amplitude includes at least one of the palm orientation corresponding to the palm extension action, the five-finger opening degree corresponding to the five-finger opening action, the fist orientation corresponding to the fist clenching action, and the name of the extended finger corresponding to the single finger extension action.

[0040] Further, the determining subunit includes:

[0041] A second determination module is used to determine a vehicle control function according to the correspondence between the gesture and the control signal and the current control hand; wherein the vehicle control function is one or more of controlling the throttle, braking depth, steering angle and gear position;

[0042] The second determination module is further used to determine a unique target control function according to the correspondence between the gesture and the control signal, the gesture action and the vehicle control function;

[0043] The second determination module is further used to determine the control parameter according to the correspondence between the gesture and the control signal, the target control function and the gesture movement amplitude;

[0044] A generating module is used to generate a current vehicle control signal according to the target control function and the control parameter.

[0045] A third aspect of the present application provides an electronic device, comprising a memory and a processor, wherein the memory is used to store a computer program, and the processor runs the computer program to enable the electronic device to execute the method for controlling a vehicle based on gestures as described in any one of the first aspect of the present application.

[0046] A fourth aspect of the present application provides a computer-readable storage medium storing computer program instructions. When the computer program instructions are read and executed by a processor, the method for controlling a vehicle based on gestures described in any one of the first aspect of the present application is executed.

[0047] The beneficial effects of the present application are as follows: the method and device enable the driver to control the vehicle through gestures, thereby making the vehicle driving operation more intelligent and user-friendly, thereby simplifying the system architecture and lowering the threshold for technical implementation. BRIEF DESCRIPTION OF THE DRAWINGS

[0048] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments of the present application will be briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present application and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0049] Figure 1 A flowchart of a method for controlling a vehicle based on gestures provided in an embodiment of the present application;

[0050] Figure 2 A flowchart of another method for controlling a vehicle based on gestures provided in an embodiment of the present application;

[0051] Figure 3A schematic diagram of a vehicle architecture for executing a method for controlling a vehicle based on gestures provided in an embodiment of the present application;

[0052] Figure 4 A schematic diagram of another vehicle architecture for executing a method for controlling a vehicle based on gestures provided in an embodiment of the present application;

[0053] Figure 5 A schematic diagram of the structure of a device for controlling a vehicle based on gestures provided in an embodiment of the present application;

[0054] Figure 6 A schematic diagram of the structure of another device for controlling a vehicle based on gestures provided in an embodiment of the present application. DETAILED DESCRIPTION

[0055] The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application.

[0056] It should be noted that similar reference numerals and letters represent similar items in the following drawings, so once an item is defined in one drawing, it does not need to be further defined and explained in subsequent drawings. At the same time, in the description of this application, the terms "first", "second", etc. are only used to distinguish the description and cannot be understood as indicating or implying relative importance.

[0057] Example 1

[0058] Please see Figure 1 , Figure 1 A flowchart of a method for controlling a vehicle based on gestures provided in this embodiment. The method for controlling a vehicle based on gestures includes:

[0059] S101, presetting a correspondence between gestures and control signals.

[0060] S102: When the target vehicle enters the gesture driving mode, the driver's gesture action data is collected through the in-vehicle camera; wherein the gesture action data includes a gesture action image and / or a gesture action video.

[0061] In this embodiment, in the gesture driving mode, the target vehicle shields the accelerator pedal operation signal, the brake pedal operation signal, the steering wheel operation signal and the shift handle operation signal, and only receives the gesture control signal;

[0062] The hand gesture action includes at least one of the following: extending a palm action, making a fist action, extending a single finger action, and opening five fingers action;

[0063] The gesture movement amplitude includes at least one of the palm direction corresponding to the palm extension movement, the five-finger opening degree corresponding to the five-finger opening movement, the fist direction corresponding to the fist clenching movement, and the name of the extended finger corresponding to the single finger extension movement.

[0064] S103: Determine a current vehicle control signal according to the corresponding relationship between the gesture and the control signal and the gesture action data.

[0065] S104: Control the target vehicle to perform corresponding operations according to the current vehicle control signal.

[0066] In this embodiment, the method can drive the vehicle by replacing the accelerator, brake and steering wheel with gestures, providing a new control method for vehicle driving, providing convenience for special groups of people, and also providing a certain convenience for remote rescue.

[0067] In this embodiment, the execution subject of the method may be a computing device such as a computer or a server, and no limitation is made in this embodiment.

[0068] In this embodiment, the execution subject of the method may also be a smart device such as a smart phone, a tablet computer, etc., which is not limited in this embodiment.

[0069] It can be seen that the method of controlling a vehicle based on gestures described in this embodiment no longer needs to rely on holographic projection equipment, and the driving control of the vehicle can be achieved only by recognizing the user's gestures through the camera, which simplifies the system architecture and lowers the threshold for technical implementation.

[0070] Example 2

[0071] Please see Figure 2 , Figure 2 A flowchart of a method for controlling a vehicle based on gestures provided in this embodiment. The method for controlling a vehicle based on gestures includes:

[0072] S201, presetting a correspondence between gestures and control signals.

[0073] S202: When the target vehicle enters the gesture driving mode, the driver's gesture action data is collected through the in-vehicle camera.

[0074] In this embodiment, the gesture action data includes a gesture action image and / or a gesture action video.

[0075] In this embodiment, the method can collect the driver's gesture action information through a gesture collection camera.

[0076] In this embodiment, in the gesture driving mode, the vehicle automatically blocks the operation of the accelerator pedal, brake pedal, steering wheel and shift handle, and only accepts the throttle, brake, steering angle and gear position signals from the control signal interpretation module.

[0077] S203: Determine the driver's current control hand according to the gesture action data.

[0078] In this embodiment, the current controlling hand is the left hand or the right hand.

[0079] S204: Identify the gesture action and gesture action amplitude of the current controlling hand according to the gesture action data.

[0080] S205: Summarize the current controlling hand, gesture action, and gesture action amplitude to obtain current gesture data.

[0081] S206: Determine a vehicle control function according to the correspondence between the gesture and the control signal and the current control hand.

[0082] In this embodiment, the vehicle control function is to control one or more of the throttle, braking depth, steering angle and gear position.

[0083] In this embodiment, the method can interpret the driver's gesture into a corresponding control signal through a control signal interpretation module, wherein the control signal mainly includes throttle depth, brake depth, steering angle (the steering angle can represent right turn and left turn in the form of positive and negative values, respectively), gear position, etc.

[0084] S207: Determine a unique target control function according to the corresponding relationship between the gesture and the control signal, the gesture action and the vehicle control function.

[0085] S208: Determine control parameters according to the corresponding relationship between the gesture and the control signal, the target control function and the gesture movement amplitude.

[0086] S209: Generate a current vehicle control signal according to the target control function and the control parameters.

[0087] In this embodiment, the control signal interpretation module can send specific signal instructions to the vehicle control module, so that the vehicle control module executes the operation instructions sent by the control signal interpretation module and feeds back the status after execution.

[0088] In this embodiment, the driver can control the vehicle through specific gestures. The main control operations include throttle depth, brake depth and steering angle. There is no fixed form for specific gestures. For ease of understanding, the following examples are given here:

[0089] The right hand is used to control the throttle and brake depth, and the left hand controls the steering angle and gear. The right palm is facing up to control the throttle. Five fingers straighten corresponds to 100% throttle opening, and five fingertips converged corresponds to 0% throttle opening. The five fingers correspond to different throttle openings in the process of full opening and full convergence. The right palm is facing down to control the brake. Five fingers straighten corresponds to 0% brake depth, and five fingertips converged corresponds to 100% brake depth. The five fingers correspond to different brake depths in the process of full opening and full convergence. When the right palm is facing up to control the throttle, the brake depth defaults to 0%, and when the right palm is facing down to control the brake, the throttle depth defaults to 0%. The left hand controls Steering angle, make a fist with five fingers, and control the steering angle according to the center axis of the fist. When the center axis is perpendicular to the horizontal plane, it corresponds to 0°. When the fist is flat with the palm facing down (the center axis rotates 90°), it corresponds to the maximum right steering angle. When the center axis is between 0° and 90°, it corresponds to different right steering angles. Similarly, when the fist is flat with the palm facing up (the center axis rotates -90°), it corresponds to the maximum left steering angle. When the center axis is between 0° and -90°, it corresponds to different left steering angles. When the left hand is in a fist state, extending the thumb represents a reverse gear (R gear) request, extending the index finger represents a forward gear (D gear) request, and extending all five fingers represents a parking gear (P gear) request.

[0090] It can be seen that according to the above gesture control rules, the driver can make different movements with his left and right hands respectively, so that they can be converted into three signal values ​​of throttle depth, braking depth and steering angle respectively, and the corresponding operation instructions are input to the vehicle (i.e., the current vehicle control signal is generated).

[0091] S210: Control the target vehicle to perform corresponding operations according to the current vehicle control signal.

[0092] In this embodiment, the above-mentioned vehicle control module is used to execute all instructions related to vehicle control, including but not limited to throttle torque control, steering angle control, turn signal control, brake depth control, turn signal control, headlight control and air conditioning control. At the same time, the vehicle control module can also feed back the current state of the vehicle to the control signal interpretation module so that the control signal interpretation module can accurately identify the driver's control intention.

[0093] Please see Figure 3 , Figure 3 A schematic diagram of a vehicle architecture for executing a method for controlling a vehicle based on gestures is shown.

[0094] In this embodiment, the vehicle controller controls the vehicle to complete related operations according to the instructions sent by the control signal interpretation module. For example, if the control signal interpretation module sends a control signal of throttle opening = 50%, the vehicle controller controls the engine or motor to output the torque corresponding to 50% throttle opening, and the execution of other control instructions is similar.

[0095] Please see Figure 4 , Figure 4 Another vehicle architecture diagram for executing a method for controlling a vehicle based on gestures is shown. The method can realize emergency rescue by using a field of view acquisition camera on the vehicle, a video display device in a remote control room, and a gesture acquisition camera in the remote control room.

[0096] For example, emergency rescue personnel can remotely control the vehicle through hand gestures in the remote control room based on the real-time scene images displayed on the display device.

[0097] It can be seen that when a vehicle driver has a sudden illness and cannot continue to drive the vehicle, in order to send the driver to the hospital for treatment as soon as possible, the rescue personnel can drive the rescue vehicle in the remote control room after the driver issues an emergency rescue, and send the driver to a nearby hospital for timely rescue. Based on this, the method can provide an efficient solution for rescuing injured or sick people in an emergency, and at the same time buy more precious time for rescue work.

[0098] In this embodiment, the execution subject of the method may be a computing device such as a computer or a server, and no limitation is made in this embodiment.

[0099] In this embodiment, the execution subject of the method may also be a smart device such as a smart phone, a tablet computer, etc., which is not limited in this embodiment.

[0100] It can be seen that the method of controlling a vehicle based on gestures described in this embodiment no longer needs to rely on holographic projection equipment, and the driving control of the vehicle can be achieved only by recognizing the user's gestures through the camera, which simplifies the system architecture and lowers the threshold for technical implementation.

[0101] Example 3

[0102] Please see Figure 5 , Figure 5 FIG. 1 is a schematic diagram of a structure of a device for controlling a vehicle based on gestures provided in this embodiment. Figure 5 As shown, the device for controlling a vehicle based on gestures includes:

[0103] A setting unit 310, used to pre-set the correspondence between gestures and control signals;

[0104] The gesture collection unit 320 is used to collect the driver's gesture action data through the in-vehicle camera when the target vehicle enters the gesture driving mode; wherein the gesture action data includes gesture action images and / or gesture action videos;

[0105] A determination unit 330, configured to determine a current vehicle control signal according to a correspondence between the gesture and the control signal and the gesture action data;

[0106] The control unit 340 is used to control the target vehicle to perform corresponding operations according to the current vehicle control signal.

[0107] In this embodiment, the explanation of the device for controlling a vehicle based on gestures may refer to the description in Embodiment 1 or Embodiment 2, and will not be further elaborated in this embodiment.

[0108] It can be seen that the device for controlling a vehicle based on gestures described in this embodiment no longer needs to rely on holographic projection equipment, and can achieve driving control of the vehicle only by recognizing the user's gestures through the camera, which simplifies the system architecture and lowers the threshold for technical implementation.

[0109] Example 4

[0110] Please see Figure 6 , Figure 6 FIG. 1 is a schematic diagram of a structure of a device for controlling a vehicle based on gestures provided in this embodiment. Figure 6 As shown, the device for controlling a vehicle based on gestures includes:

[0111] A setting unit 310, used to pre-set the corresponding relationship between gestures and control signals;

[0112] The gesture collection unit 320 is used to collect the driver's gesture action data through the in-vehicle camera when the target vehicle enters the gesture driving mode; wherein the gesture action data includes gesture action images and / or gesture action videos;

[0113] A determination unit 330, configured to determine a current vehicle control signal according to a correspondence between the gesture and the control signal and the gesture action data;

[0114] The control unit 340 is used to control the target vehicle to perform corresponding operations according to the current vehicle control signal.

[0115] As an optional implementation manner, the determining unit 330 includes:

[0116] The recognition subunit 331 is used to perform gesture recognition on the gesture action data to obtain current gesture data;

[0117] The determination subunit 332 is used to determine the current vehicle control signal according to the corresponding relationship between the gesture and the control signal and the current gesture data.

[0118] As an optional implementation, the identification subunit 331 includes:

[0119] A first determination module is used to determine the current control hand of the driver according to the gesture action data; wherein the current control hand is the left hand or the right hand;

[0120] A recognition module, used to recognize the gesture action and gesture action amplitude of the current controlling hand according to the gesture action data;

[0121] The summarizing module is used to summarize the current controlling hand, gesture action and gesture action amplitude to obtain the current gesture data.

[0122] In this embodiment, in the gesture driving mode, the target vehicle shields the accelerator pedal operation signal, the brake pedal operation signal, the steering wheel operation signal and the shift handle operation signal, and only receives the gesture control signal;

[0123] The hand gesture action includes at least one of the following: extending a palm action, making a fist action, extending a single finger action, and opening five fingers action;

[0124] The gesture movement amplitude includes at least one of the palm direction corresponding to the palm extension movement, the five-finger opening degree corresponding to the five-finger opening movement, the fist direction corresponding to the fist clenching movement, and the name of the extended finger corresponding to the single finger extension movement.

[0125] As an optional implementation manner, the determining subunit 332 includes:

[0126] A second determination module is used to determine a vehicle control function according to a correspondence between a gesture and a control signal and a current control hand; wherein the vehicle control function is one or more of controlling a throttle, a braking depth, a steering angle and a gear position;

[0127] The second determination module is further used to determine a unique target control function according to the corresponding relationship between the gesture and the control signal, the gesture action and the vehicle control function;

[0128] The second determination module is further used to determine the control parameters according to the corresponding relationship between the gesture and the control signal, the target control function and the gesture movement amplitude;

[0129] The generation module is used to generate the current vehicle control signal according to the target control function and control parameters.

[0130] In this embodiment, the explanation of the device for controlling a vehicle based on gestures may refer to the description in Embodiment 1 or Embodiment 2, and will not be further elaborated in this embodiment.

[0131] It can be seen that the device for controlling a vehicle based on gestures described in this embodiment no longer needs to rely on holographic projection equipment, and can achieve driving control of the vehicle only by recognizing the user's gestures through the camera, which simplifies the system architecture and lowers the threshold for technical implementation.

[0132] An embodiment of the present application provides an electronic device, including a memory and a processor, wherein the memory is used to store a computer program, and the processor runs the computer program to enable the electronic device to execute the method for controlling a vehicle based on gestures in Embodiment 1 or Embodiment 2 of the present application.

[0133] An embodiment of the present application provides a computer-readable storage medium storing computer program instructions. When the computer program instructions are read and executed by a processor, the method for controlling a vehicle based on gestures in Embodiment 1 or Embodiment 2 of the present application is executed.

[0134] In several embodiments provided in the present application, it should be understood that the disclosed devices and methods can also be implemented in other ways. The device embodiments described above are merely schematic. For example, the flowcharts and block diagrams in the accompanying drawings show the possible architecture, functions and operations of the devices, methods and computer program products according to multiple embodiments of the present application. In this regard, each box in the flowchart or block diagram can represent a module, a program segment or a part of a code, and the module, a program segment or a part of a code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of boxes in the block diagram and / or flowchart can be implemented with a dedicated hardware-based system that performs a specified function or action, or can be implemented with a combination of dedicated hardware and computer instructions.

[0135] In addition, the functional modules in the various embodiments of the present application may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.

[0136] If the functions are implemented in the form of software function modules and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application can be essentially or partly embodied in the form of a software product that contributes to the prior art. The computer software product is stored in a storage medium, including several instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0137] The above description is only an embodiment of the present application and is not intended to limit the scope of protection of the present application. For those skilled in the art, the present application may have various changes and variations. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application should be included in the scope of protection of the present application. It should be noted that similar reference numerals and letters represent similar items in the following drawings, so once an item is defined in one drawing, it does not need to be further defined and explained in the subsequent drawings.

[0138] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

[0139] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.

Claims

1. A method for controlling a vehicle based on gestures, characterized in that: include: Pre-set the correspondence between gestures and control signals; When the target vehicle enters the gesture driving mode, the driver's gesture action data is collected through the in-vehicle camera; wherein the gesture action data includes a gesture action image and / or a gesture action video; Determining a current vehicle control signal according to the corresponding relationship between the gesture and the control signal and the gesture action data; The target vehicle is controlled to perform corresponding operations according to the current vehicle control signal.

2. The method for controlling a vehicle based on gestures according to claim 1, characterized in that: The determining the current vehicle control signal according to the correspondence between the gesture and the control signal and the gesture action data includes: Performing gesture recognition on the gesture action data to obtain current gesture data; A current vehicle control signal is determined according to the correspondence between the gesture and the control signal and the current gesture data.

3. The method for controlling a vehicle based on gestures according to claim 2, characterized in that: The performing gesture recognition on the gesture action data to obtain current gesture data includes: Determining the current control hand of the driver according to the gesture action data; wherein the current control hand is the left hand or the right hand; Identify the gesture action and gesture action amplitude of the current controlling hand according to the gesture action data; The current control hand, the gesture action and the gesture action amplitude are summarized to obtain current gesture data.

4. The method for controlling a vehicle based on gestures according to claim 3, characterized in that: In the gesture driving mode, the target vehicle shields the accelerator pedal operation signal, the brake pedal operation signal, the steering wheel operation signal and the shift handle operation signal, and only receives the gesture control signal; The gesture action includes at least one of an action of extending a palm, an action of making a fist, an action of extending a single finger, and an action of opening five fingers; The gesture action amplitude includes at least one of the palm orientation corresponding to the palm extension action, the five-finger opening degree corresponding to the five-finger opening action, the fist orientation corresponding to the fist clenching action, and the name of the extended finger corresponding to the single finger extension action.

5. The method for controlling a vehicle based on gestures according to claim 3, characterized in that: The determining the current vehicle control signal according to the correspondence between the gesture and the control signal and the current gesture data includes: Determine a vehicle control function according to the correspondence between the gesture and the control signal and the current control hand; wherein the vehicle control function is one or more of controlling the throttle, braking depth, steering angle and gear position; Determining a unique target control function according to the correspondence between the gesture and the control signal, the gesture action and the vehicle control function; Determining control parameters according to the corresponding relationship between the gesture and the control signal, the target control function and the gesture movement amplitude; A current vehicle control signal is generated according to the target control function and the control parameter.

6. A device for controlling a vehicle based on gestures, characterized in that: The device for controlling a vehicle based on gestures comprises: A setting unit, used to pre-set the corresponding relationship between gestures and control signals; A gesture collection unit, used to collect the driver's gesture action data through an in-vehicle camera when the target vehicle enters the gesture driving mode; wherein the gesture action data includes a gesture action image and / or a gesture action video; a determination unit, configured to determine a current vehicle control signal according to the correspondence between the gesture and the control signal and the gesture action data; A control unit is used to control the target vehicle to perform corresponding operations according to the current vehicle control signal.

7. The device for controlling a vehicle based on gestures according to claim 6, characterized in that: The determining unit comprises: The recognition subunit is used to perform gesture recognition on the gesture action data to obtain current gesture data; The determination subunit is used to determine the current vehicle control signal according to the corresponding relationship between the gesture and the control signal and the current gesture data.

8. The device for controlling a vehicle based on gestures according to claim 7, characterized in that: The identification subunit comprises: A first determination module, used to determine the current control hand of the driver according to the gesture action data; wherein the current control hand is the left hand or the right hand; A recognition module, used for recognizing the gesture action and gesture action amplitude of the current controlling hand according to the gesture action data; The summarizing module is used to summarize the current controlling hand, the gesture action and the gesture action amplitude to obtain current gesture data.

9. An electronic device, characterized in that: The electronic device comprises a memory and a processor, wherein the memory is used to store a computer program, and the processor runs the computer program to enable the electronic device to perform the method for controlling a vehicle based on gestures according to any one of claims 1 to 5.

10. A readable storage medium, characterized in that: The readable storage medium stores computer program instructions, and when the computer program instructions are read and executed by a processor, the method for controlling a vehicle based on gestures as claimed in any one of claims 1 to 5 is executed.

Images