Vehicle control method and device based on palmprint and gesture, electronic equipment and storage medium

Abstract

The invention discloses a vehicle control method and device based on palm prints and gestures, electronic equipment and a storage medium. The method comprises the following steps: acquiring first texture information through a first control component, and verifying the first texture information; if the verification of the first texture information is passed, obtaining target action information through the first control component; matching target instruction information from the candidate instruction information according to the target action information; and controlling the target vehicle according to the target instruction information. According to the method, the vehicle is verified through the first texture information, the dependence on third-party auxiliary identification is avoided, the possibility that third-party equipment is attacked during wireless communication is also avoided, and the safety of the vehicle in the driving process is also improved while the property safety of a vehicle owner is ensured.

Description

Technical Field

[0001] The present invention relates to the technical field of vehicle automatic driving, and in particular to a vehicle control method, device, electronic device and storage medium based on palm prints and gestures. Background Art

[0002] In terms of vehicle control, traditional vehicles use car keys or mobile phones to connect to third-party devices through wireless communication technologies such as Bluetooth, the Internet, and NFC, and send them to vehicle components through distance changes or specific instructions to complete operations such as opening doors, locking the car, and starting the vehicle. The dependence on third-party devices is high. When controlling a vehicle, it is usually controlled by touch or gestures, which can easily cause safety problems when the vehicle is driving. Summary of the invention

[0003] The present invention provides a vehicle control method, device, electronic device and storage medium based on palm prints and gestures, so as to solve the problem that accidents are easily caused by controlling the vehicle through touch or image acquisition gestures.

[0004] According to one aspect of the present invention, a vehicle control method based on palm prints and gestures is provided, comprising:

[0005] Acquire first texture information through a first control component and verify the first texture information, wherein the first texture information is texture information of a first target part of a target contact object, the first control component is a component for controlling a vehicle, and a first acquisition sensor is configured on the first control component, and the first acquisition sensor can acquire texture information and motion information of the contact object;

[0006] If the first texture information is verified, the target action information is obtained through the first control component, the target action information is information sent by the target contact object to indicate the operation of the vehicle, and the target action information includes second texture information and external trigger information, the second texture information is texture information of the second target part of the target contact object, the second target part is a part of the first target part, and the external trigger information is used to characterize the action sent by the second target part;

[0007] Matching target instruction information from candidate instruction information according to the target action information, the candidate instruction information is instruction information for automatically controlling the target vehicle, the target instruction information includes: driving instruction information, parking instruction information and comprehensive instruction information, the driving instruction information is instruction information that can only take effect during the driving process of the target vehicle, the parking instruction information is instruction information that can only take effect when the target vehicle is in a parking state, and the comprehensive instruction information is instruction information that can take effect when the vehicle is in a driving or parking state;

[0008] The target vehicle is controlled according to the target instruction information.

[0009] According to another aspect of the present invention, there is provided a vehicle control device based on palm prints and gestures, comprising:

[0010] A verification module, used to obtain first texture information through a first control component and verify the first texture information, wherein the first texture information is texture information of a first target part of a target contact object, the first control component is a component for controlling a vehicle, and a first acquisition sensor is configured on the first control component, and the first acquisition sensor can acquire texture information and motion information of the contact object;

[0011] a target action information determination module, configured to obtain target action information through the first control component if the first texture information is verified, wherein the target action information is information issued by the target contact object for indicating the operation of the vehicle, and the target action information includes second texture information and external trigger information, wherein the second texture information is texture information of a second target part of the target contact object, the second target part is a part of the first target part, and the external trigger information is used to characterize the action issued by the second target part;

[0012] a target instruction information determination module, used for matching target instruction information from candidate instruction information according to the target action information, wherein the candidate instruction information is instruction information for automatically controlling the target vehicle, and the target instruction information includes: driving instruction information, parking instruction information and comprehensive instruction information, wherein the driving instruction information is instruction information that can only be effective during the driving process of the target vehicle, the parking instruction information is instruction information that can only be effective when the target vehicle is in a parking state, and the comprehensive instruction information is instruction information that can be effective when the vehicle is in a driving or parking state;

[0013] A control module is used to control the target vehicle according to the target instruction information.

[0014] According to another aspect of the present invention, an electronic device is provided, the electronic device comprising:

[0015] at least one processor; and

[0016] a memory communicatively connected to the at least one processor; wherein,

[0017] The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the vehicle control method based on palm prints and gestures described in any embodiment of the present invention.

[0018] According to another aspect of the present invention, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the vehicle control method based on palm prints and gestures described in any embodiment of the present invention when executed.

[0019] The technical solution of the embodiment of the present invention is to obtain the first texture information through the first control component and verify the first texture information. The verification through the first texture information is because the first texture information contains more information of the target contact object and is unique, so the recognition success rate is higher than the information of other parts, and it also avoids the dependence of the traditional vehicle opening method on auxiliary devices such as car keys; if the first texture information is verified, the target action information is obtained through the first control component, and the target action information is monitored after the verification, so as to ensure that the control information of the target vehicle is obtained in time and the control intention of the target contact object is responded to in time; according to the target action information, the target instruction information is matched from the candidate instruction information, and the establishment of the candidate instruction information can meet the driving habits of different target contact objects, avoiding the inconvenience caused by using a set of candidate instruction information; according to the target instruction information, the target vehicle is controlled, and the target contact object can realize the control of the vehicle without leaving the first control component, thereby ensuring the driving safety of the vehicle. The method realizes the verification of the vehicle through the first texture information, avoids the dependence on the third-party auxiliary identification, and avoids the possibility of the third-party device being attacked during wireless communication, while ensuring the property safety of the owner, it also improves the safety of the vehicle during driving.

[0020] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present invention, nor are they intended to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0022] Figure 1 A flowchart of a vehicle control method based on palm prints and gestures provided by an embodiment of the present invention;

[0023] Figure 2 A flow chart of vehicle verification provided by an embodiment of the present invention;

[0024] Figure 3A flow chart of vehicle control provided by an embodiment of the present invention;

[0025] Figure 4 A flow chart of door opening verification provided by an embodiment of the present invention;

[0026] Figure 5 A flowchart of driving behavior monitoring provided by an embodiment of the present invention;

[0027] Figure 6 A schematic diagram of the structure of a vehicle control device based on palm prints and gestures provided by an embodiment of the present invention;

[0028] Figure 7 A schematic diagram of the structure of an electronic device for implementing the vehicle control method based on palm prints and gestures according to an embodiment of the present invention. DETAILED DESCRIPTION

[0029] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0030] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0031] Figure 1 This is a flowchart of a vehicle control method based on palm prints and gestures provided by an embodiment of the present invention. This embodiment is applicable to the situation where the vehicle is directly controlled without the support of auxiliary equipment. The method can be executed by a vehicle control device based on palm prints and gestures. The vehicle control device based on palm prints and gestures can be implemented in the form of hardware and / or software. The vehicle control device based on palm prints and gestures can be configured in any electronic device with network communication function. Figure 1 As shown, the method includes:

[0032] S110. Acquire first texture information through a first control component, and verify the first texture information.

[0033] The first texture information is texture information of a first target part of the target contact object. The first target part may be a part of the target contact object that contacts the first control component. Exemplarily, the first target part may be a hand. The first texture information may be texture information of the hand of the target contact object, i.e., palm print information.

[0034] In the above steps, palmprint information is used because palmprint information is specific and unique. This characteristic determines that palmprint information has high security and irreplaceability, and can ensure the security of target vehicle control, identification and authentication.

[0035] The first control component is a component for controlling the vehicle. The first control component is provided with a first acquisition sensor, which can acquire texture information and motion information of the contact object.

[0036] The first acquisition sensor is composed of a texture recognition sensor and a pressure sensor. The texture information of the contact object acquired by the first sensor may be palm print information and fingerprint information, and the action information may be the number of times the first target part hits the first acquisition sensor. Exemplarily, the first control component may be a steering wheel, and the first acquisition sensor is configured on the steering hub of the steering wheel.

[0037] Specifically, the first texture information of the target contact object is collected by the first control component, and the corresponding preset texture information is matched from the preset texture information library according to the first texture information, and whether the target contact object is qualified to control the target vehicle is determined according to the matching result. The preset texture information library is a database composed of encrypted first texture information of different target contact objects collected in advance by the first control component.

[0038] Furthermore, before matching, the first control component transmits the encrypted first texture information to the ECU (Electronic Control Unit). After receiving the encrypted first texture information, the ECU decrypts the first texture information and decrypts the preset texture information.

[0039] For example, Figure 2As shown, the first control component monitors the first texture information in real time. When the first texture information is detected, a voice prompt is given to indicate whether the first texture information needs to be entered. If it does not need to be entered, the first texture information is encrypted and sent to the ECU. After the ECU receives the encrypted first texture information, it decrypts the first texture information, obtains the preset texture information from the preset texture information library, and decrypts the preset texture information. The first texture information is matched with the decrypted preset texture information. If the match is successful within the preset number of matches, the first control monitors the target action information; if the match is unsuccessful within the preset number of matches, the target vehicle is opened by a traditional car key or other means. If it needs to be entered, the first texture information obtained is used as the preset texture information, and the preset texture information is encrypted and stored in the preset texture information library.

[0040] Furthermore, after the first texture information is compared with the decrypted preset texture information, the decrypted preset texture information is encrypted and stored in a preset texture information library, and the first texture information is deleted.

[0041] In the above steps, the first texture information is used to verify the identity of the target contact object, which can ensure the property safety of the target contact object. The first texture information collects more information, and the information collection is relatively less affected by the location of the first target part and the contamination of the collection area. The recognition success rate is higher and the misjudgment rate is lower. At the same time, the target vehicle is also prevented from relying on third-party auxiliary equipment. Furthermore, the transmission and storage of the first texture information are encrypted to prevent the information from being stolen.

[0042] S120: If the first texture information is verified to be successful, the target action information is obtained through the first control component.

[0043] The target action information is information sent by the target contact object to instruct the operation of the vehicle, and the target action information includes the second texture information and the external trigger information.

[0044] The second texture information is texture information of a second target part of the target contact object, and the second target part is a part of the first target part. Exemplarily, the second texture information may be fingerprint information.

[0045] The external trigger information is used to represent the action initiated by the second target part. For example, the second target part may be a finger.

[0046] Specifically, after the first texture information is verified, the first control component monitors in real time whether the target contact object sends out target action information. If it is detected that it is sent out, the first control component obtains the target action information; if not detected, the monitoring continues.

[0047] In the above steps, real-time monitoring can ensure that the target action is detected in time when it is issued, so as to ensure that the control intention of the target contact object can be responded to in time.

[0048] S130 . Match target instruction information from candidate instruction information according to the target action information.

[0049] Among them, the candidate command information is the command information for automatically controlling the target vehicle, and the target command information includes: driving command information, parking command information and comprehensive command information. Driving command information is command information that can only take effect when the target vehicle is driving. For example, the driving command information can be acceleration and deceleration command information. Parking command information is command information that can only take effect when the target vehicle is parked. For example, the parking command information can be opening the trunk. Comprehensive command information is command information that can take effect when the vehicle is driving or parked. For example, the comprehensive command information can be turning on the wipers, the low beam or the high beam.

[0050] Furthermore, the candidate instruction information is instruction information determined in advance based on the driving habits of the target contact object.

[0051] For example, the command to turn on the wipers consists of the fingerprint information of the index finger and middle finger of the right hand and the external trigger information of tapping the middle finger and index finger at the same time; the command to turn on or off the high beams consists of the fingerprint information of the index finger and middle finger of the left hand and the external trigger information of tapping the index finger and middle finger of the left hand at the same time; the command to open the trunk consists of the fingerprint information of the index finger and middle finger of the right hand and the external trigger information of tapping the middle finger and index finger twice at the same time, etc.

[0052] Specifically, the corresponding reference instruction information is matched from the candidate instruction information according to the second texture information, and the reference instruction information is screened according to the external trigger information, so as to obtain the target instruction information.

[0053] Furthermore, the candidate instruction information is stored in an encrypted manner, and therefore needs to be decrypted before matching.

[0054] The above steps, the establishment of candidate instruction information, can better meet the driving habits of different target contact objects, make the control of the target vehicle more universal, and avoid the inconvenience caused by using a set of candidate instruction information.

[0055] S140: Control the target vehicle according to the target command information.

[0056] Specifically, the driving state of the target vehicle is judged according to the type of target command information obtained, and whether to execute the target command information is determined according to the driving state. If executed, the target command information is sent to the corresponding control unit through the ECU to control the target vehicle.

[0057] For example, Figure 3 As shown, after the first texture information is verified, the first control component monitors in real time whether there is target action information. If target action information is detected, the corresponding target instruction information is matched according to the target action information to determine the type of the target instruction information. If it is comprehensive instruction information, the target instruction information is directly sent to the corresponding control unit through the ECU, and the target vehicle is controlled to execute the target instruction through the control unit; if it is driving instruction information, it is determined whether the target vehicle is in a driving state. If it is in a driving state, the target instruction information is sent to the corresponding control unit through the ECU, and the target vehicle is controlled to execute the target instruction through the control unit; if it is parking instruction information, it is determined whether the target vehicle is in a driving state. If it is in a parking state, the target instruction information is sent to the corresponding control unit through the ECU, and the target vehicle is controlled to execute the target instruction through the control unit.

[0058] The above steps complete the authentication and control of the target vehicle by combining the first texture information with the target action information, which can get rid of the dependence on third-party auxiliary equipment, improve the safety of the vehicle, and avoid the safety problems caused by the target contact object leaving the first control component.

[0059] Optionally, before obtaining the first texture information through the first control component, steps A1-A3 are included:

[0060] Step A1: obtaining first texture information through a second control component, and verifying a target joint object according to the first texture information and preset texture information.

[0061] The second control component is used to control the opening of the vehicle door. The second control component is provided with a second acquisition sensor, which can acquire texture information of the contact object.

[0062] Specifically, the second control component monitors in real time whether the first texture information is collected. If collected, the first texture information is obtained, and the first texture information is encrypted and sent to the ECU. After the ECU receives the encrypted first texture information, it decrypts the first texture information, obtains the preset texture information from the preset texture information library, decrypts the preset texture information, and matches the first texture information with the decrypted preset texture information, and verifies the target joint object according to the matching result.

[0063] Step A2: If the verification is successful within a preset number of times, the door of the target vehicle is opened.

[0064] Specifically, if the verification succeeds within a preset number of times, the target contact object is considered to be the owner of the target vehicle, and the exit of the target vehicle is enabled.

[0065] Furthermore, the car door may be opened in an automatic opening mode; or the second control component may monitor pressure information caused by the action of the target contact object, and open the car door when the pressure information is detected.

[0066] Step A3: If the verification fails within the preset verification times, start early warning monitoring and determine whether the target contact object has malicious door-breaking behavior. If so, issue an alarm.

[0067] Specifically, if the verification fails within the preset number of verification times, the early warning monitoring is turned on. If malicious breaking of the door is detected by the target contact object, the alarm is directly processed; if no malicious breaking is detected, the first texture information continues to be collected for verification. If multiple verifications are passed, the permission information is also sent to the owner of the target vehicle. If the permission is passed, the verification continues. If the permission is not passed, the alarm is processed.

[0068] For example, Figure 4 As shown, the second control component monitors the first texture information in real time. When the first texture information is detected, a voice prompt is given to indicate whether the first texture information needs to be entered. If it does not need to be entered, the first texture information is encrypted and sent to the ECU. After the ECU receives the encrypted first texture information, it decrypts the first texture information, obtains the preset texture information from the preset texture information library, and decrypts the preset texture information. The first texture information is matched with the decrypted preset texture information. If the match is successful within the preset matching number, the second control component controls the target vehicle to open the door; if the match is unsuccessful within the preset number of times, the early warning monitoring is turned on to monitor whether there is malicious door-breaking behavior. If so, an alarm is issued; if not, the first texture information is continuously collected for verification. If it needs to be entered, the first texture information obtained is used as the preset texture information, and the preset texture information is encrypted and stored in the preset texture information library.

[0069] The above steps avoid the traditional use of car keys or mobile phones to establish a connection with the target vehicle through wireless communication technologies such as Bluetooth, network, NFC (NearField Communication), etc., so as to complete operations such as opening and locking the car, which are highly dependent on third-party devices. At the same time, it also avoids the security issues caused by the cracking of wireless communication links.

[0070] Optionally, if the first texture information is verified, the target action information is obtained through the first control component, including steps B1-B3:

[0071] Step B1: If the first texture information is verified, the first control component is used to monitor in real time whether the second texture information is collected.

[0072] Specifically, if the first texture information is verified, the first control component monitors in real time whether the second texture information of the second target part is detected, and if the second texture information is detected, the second texture information is collected.

[0073] Exemplarily, if the palm print verification is successful, the first control component monitors whether a finger touches the first control component, and if a finger touches the first control component, the fingerprint information at the time of contact is collected.

[0074] Step B2: If the second texture information is collected, determine the trigger action issued by the second target part within the first preset time to obtain external trigger information.

[0075] Step B2: if the second texture information is collected, determine the second target part at the first preset time

[0076] Specifically, after the second texture information is collected, it is determined whether the second target part continues to send out a trigger action within the first preset time. If there is contact, the number of trigger actions is determined, and the number of trigger actions obtained + 1 is used as the external trigger information. If there is no contact, the trigger action corresponding to the second texture information is used as the external trigger information, that is, one tap.

[0077] Exemplarily, after collecting the fingerprint information of the middle finger and index finger, the first control component determines the tapping action emitted by the second target part within the next 2 seconds. If there is no tapping action, it is considered that the middle finger and index finger tap once at the same time; if one tap is detected, it is considered that the middle finger and index finger tap twice at the same time.

[0078] Step B3: using the second texture information and the external trigger information as target action information.

[0079] Specifically, the second texture information and the external trigger information are matched to obtain the target action information.

[0080] Furthermore, in addition to obtaining the target action information in the above manner, the number of tapping times can be directly obtained when the continuous tapping action of the finger is felt. During the finger tapping process, a fingerprint information is collected, and the obtained number of tapping times and fingerprint information are used as the target action information.

[0081] In the above steps, the particularity and uniqueness of the second texture information determine that it can cover a large amount of target action information for controlling the vehicle through different arrangements and combinations and numbers of taps. Compared with the combination of gestures, fingerprints and buttons, it is more universal and can better meet the needs of different target contact objects.

[0082] Optionally, matching target instruction information from candidate instruction information according to target action information includes steps C1-C2:

[0083] Step C1: matching reference instruction information corresponding to the second texture information from candidate instruction information according to the second texture information.

[0084] Exemplarily, assuming that the second texture information is the fingerprint information of the index finger and middle finger of the right hand, the candidate command information is first decrypted, and then the command information such as turning on the wipers and opening the trunk corresponding to the fingerprint information of the index finger and middle finger of the right hand is matched from the candidate command information, and the command information such as turning on the wipers and opening the trunk is used as reference command information.

[0085] Step C2: Filter the reference instruction information through the external trigger information to obtain the target instruction information.

[0086] Specifically, the reference instruction information is filtered according to the number of tapping times included in the external trigger information, and the filtered instruction information is used as the target instruction information.

[0087] Exemplarily, assuming that the external trigger information is tapping the middle finger and index finger twice at the same time, the reference instruction information is filtered based on tapping the middle finger and index finger twice at the same time to obtain the trunk opening instruction, and the trunk opening instruction is used as the target instruction information.

[0088] The above steps, through double screening, can ensure the accuracy of the obtained target instruction information.

[0089] Optionally, controlling the target vehicle according to the target instruction information includes steps D1-D2:

[0090] Step D1: If the target instruction information is driving instruction information or parking instruction information, the current driving state of the target vehicle is determined, and the target vehicle is controlled according to the driving state of the target vehicle and the target instruction information.

[0091] Specifically, if the target instruction information is driving instruction information, it is determined whether the current driving state of the target vehicle is a driving state. If it is a driving state, the driving instruction information is sent to the corresponding ECU, and the target vehicle is controlled by the ECU; if it is not a driving state, the instruction is not executed, and a voice reminder is made. If the target instruction information is parking instruction information, it is determined whether the current driving state of the target vehicle is a parking state. If it is a parking state, the parking instruction information is sent to the corresponding ECU, and the target vehicle is controlled by the ECU; if it is not a parking state, the instruction is not executed, and a voice reminder is made.

[0092] For example, assuming that the target command information is to open the trunk, this is parking command information, so it is necessary to determine whether the target vehicle is currently in a parking state. If it is in a parking state, the command to open the trunk will be sent to the corresponding ECU, and the ECU will control the trunk to open; if it is not in a parking state, it will be prompted that opening the trunk is a dangerous behavior.

[0093] For example, assuming that the target instruction information is a deceleration instruction, this is driving instruction information, so it is necessary to determine whether the target vehicle is in a driving state. If it is in a driving state, the vehicle is controlled to decelerate; if not, it is prompted that the current vehicle is in a parking state and cannot decelerate.

[0094] Exemplarily, assuming that the target instruction information is a vehicle start instruction, it is determined whether the target vehicle is in a parked state, and if it is in a parked state, the target vehicle is started.

[0095] The above steps avoid the traditional way of starting the vehicle, that is, using a car key or a start button to control vehicle start and other operations, which has a strong dependence on third-party equipment.

[0096] Step D2: If the target command information is comprehensive command information, the target vehicle is directly controlled by the comprehensive command information.

[0097] Specifically, if the target instruction information is comprehensive instruction information, it means that the instruction information can be executed in a driving state or in a parking state, and the comprehensive instruction information is directly sent to the corresponding ECU to control the target vehicle.

[0098] Exemplarily, if the target instruction information is to turn on the wipers, the instruction to turn on the wipers is directly sent to the ECU that controls the wipers, thereby controlling the wipers to turn on.

[0099] The above steps can realize the control of the target vehicle through the type of target instruction information and the current driving status, and can also directly execute the instruction to cause safety problems to the target vehicle.

[0100] Optionally, the vehicle control method based on palm prints and gestures further includes steps E1-E2:

[0101] Step E1, obtaining the target size within a second preset time through the first control component.

[0102] The second preset time is greater than the first preset time.

[0103] Specifically, the first texture information of the target release object is collected in real time through the first control component, and the target size of all the first texture information within the second preset time is determined.

[0104] Step E2: determining the driving state of the target vehicle according to the target size.

[0105] The driving state of the target vehicle includes: normal driving state and dangerous driving state.

[0106] Specifically, the target size of the first texture information is compared with a preset size, and the driving state of the target vehicle is determined according to the comparison result.

[0107] Optionally, determining the driving state of the target vehicle according to the target size includes steps F1-F2:

[0108] Step F1: If the target size satisfies the preset size within the second preset time, the driving state of the target vehicle is a normal driving state.

[0109] Specifically, if the target size within the target duration is compared with a preset size, and if the target size always satisfies the preset size within a second preset time, it is considered that the driving state of the target vehicle is a normal driving state.

[0110] Furthermore, if the target size is smaller than the preset size, the time period during which the target size is smaller than the preset size is obtained, and it is determined whether the time period is smaller than the first preset time. If it is smaller, it is considered that the target contact object issues a target action, and the driving state of the target vehicle is a normal driving state.

[0111] For example, assuming that the first preset time is 5s, the second preset time is 10 minutes, and the first texture information is the palm print information of the left and right hands of the target contact object, then the palm print information of the left and right hands of the target contact object within 10 minutes is obtained. If the palm print size of the left and right hands is always equal to the preset palm print size within 10 minutes, it is considered that the driving state of the target vehicle is a normal driving state. If the palm print information of the left or right hand is smaller than the preset size within the time t1, the time t1 is used as the third preset time. If the third preset time is less than 5s, it is considered that the target contact object has made a target action to cause a short departure, and the driving state of the target vehicle is considered to be a normal driving state.

[0112] Step F2: If the target size does not meet the preset size, the driving state of the target vehicle is a dangerous driving state.

[0113] Specifically, if the target size of the first texture information within the second preset time is always smaller than the preset size, it is considered that the driving state of the target vehicle is a dangerous driving state.

[0114] Furthermore, if the target size is smaller than the preset size, a third preset time is obtained, and it is determined whether the third preset time is smaller than the first preset time. If it is greater, it is considered that the target contact object has left the first control component, and the driving state of the target vehicle is a dangerous driving state.

[0115] For example, assuming that the first preset time is 5s, the second preset time is 10 minutes, and the first texture information is the left and right palm print information of the target contact object, then the left and / or right palm print information of the target contact object within 10 minutes is obtained. If the size of the left and / or right palm print is always smaller than the preset palm print size within 10 minutes, it is considered that the driving state of the target vehicle is a dangerous driving state. If the palm print information of the left or right hand is smaller than the preset size within the time t1, the time t1 is used as the third preset time. If the third preset time is greater than 5s, it is considered that the target contact object has left the first control component, and the driving state of the target vehicle is considered to be a dangerous driving state.

[0116] Furthermore, if the driving state of the target vehicle is a dangerous driving state, the target vehicle is reminded of dangerous driving and dangerous driving information is generated. If it is resolved within the specified time, the first texture information continues to be detected; if it is not resolved within the specified time, it is reported to the rescue platform.

[0117] The dangerous driving information includes: a target size of the first texture information and a second preset time or a third preset time.

[0118] Furthermore, when uploading to the rescue platform, the location information of the target vehicle and the dangerous driving information of the target vehicle are sent to the rescue platform.

[0119] For example, Figure 5As shown, after the first texture information is verified and the target vehicle is turned on, the first texture information, i.e., the palm print information, is monitored in real time through the first control component to obtain the target size of the first texture information within the second preset time. According to the target size, it is determined whether the driver places both hands on the first control component. That is, if the target size is always equal to the preset size or the target size is less than the preset size within the first preset time, the driving state of the target vehicle is considered to be a normal driving state. Further, the driving behavior of the target vehicle within the second preset time is recorded, and the driving time of the target vehicle is determined according to the recorded second preset time. If the preset driving time is exceeded and the target vehicle is still driving, the driving behavior corresponding to the driving time is scored and the score is sent to the traffic control platform; if the target vehicle's subsequent driving time exceeds the preset driving time and the target vehicle stops, the driving behavior corresponding to this period is directly scored and the score is sent to the traffic control platform. If the preset driving time is not exceeded, the target vehicle reaches the destination and stops, the driving behavior corresponding to the driving time at this time is scored and the score is sent to the traffic control platform. If the target size is always not equal to the preset size or the target size is larger than the preset size within the first preset time, the driving state of the target vehicle is considered to be a dangerous driving state, and a dangerous driving reminder is given, and it is determined in real time whether there is contact with dangerous driving. If it is resolved within the specified time, the first texture information will continue to be detected; if it is not resolved within the specified time, it will be reported to the rescue platform.

[0120] For example, assume that the preset driving time is 30 minutes. If the total driving time is 40 minutes, then when the driving time is 30 minutes, the driving behavior of the target vehicle within 30 minutes is scored and sent to the traffic management platform; the driving behavior score of the last 10 minutes is sent to the traffic management platform after the target vehicle stops. If the total driving time is 20 minutes, then after the target vehicle stops, the driving behavior within 20 minutes is scored and sent to the traffic management platform.

[0121] The above steps can determine whether the target contact object leaves the first control component within the second preset time period based on the size of the first texture information within the second preset time period, thereby effectively determining whether the target vehicle has dangerous driving behavior and effectively avoiding the occurrence of accidents involving the target vehicle.

[0122] The technical solution of this embodiment is to obtain the first texture information through the first control component and verify the first texture information. The verification through the first texture information is because the first texture information contains more information about the target contact object and is unique, so the recognition success rate is higher than the information of other parts, and it also avoids the dependence of the traditional vehicle opening method on auxiliary devices such as car keys; if the first texture information is verified, the target action information is obtained through the first control component. After the verification is passed, the target action information is monitored to ensure timely acquisition of the control information of the target vehicle and timely response to the control intention of the target contact object; according to the target action information, the target instruction information is matched from the candidate instruction information, and the establishment of the candidate instruction information can meet the driving habits of different target contact objects, avoiding the inconvenience caused by using a set of candidate instruction information; according to the target instruction information, the target vehicle is controlled, and the target contact object can achieve control of the vehicle without leaving the first control component, thereby ensuring the safety of the vehicle. The method realizes the verification of the vehicle through the first texture information, avoids the dependence on third-party auxiliary identification, and avoids the possibility of third-party equipment being attacked during wireless communication, ensuring the property safety of the owner, and improving the safety of the vehicle during driving.

[0123] Figure 6 The structure diagram of a vehicle control device based on palm prints and gestures provided by an embodiment of the present invention. This embodiment is applicable to the situation where the vehicle is directly controlled without the support of auxiliary equipment. The vehicle control device based on palm prints and gestures can be implemented in the form of hardware and / or software. The vehicle control device based on palm prints and gestures can be configured in any electronic device with network communication function. Figure 6 As shown, the device includes: a verification module 210, a target action information determination module 220, a target instruction information determination module 230 and a control module 240, wherein:

[0124] Verification module 210: used to obtain first texture information through a first control component and verify the first texture information, the first texture information is texture information of a first target part of a target contact object, the first control component is a component for controlling a vehicle, and a first acquisition sensor is configured on the first control component, and the first acquisition sensor can acquire texture information and motion information of the contact object;

[0125] The target action information determination module 220 is used to obtain the target action information through the first control component if the first texture information is verified. The target action information is information sent by the target contact object to indicate the operation of the vehicle. The target action information includes second texture information and external trigger information. The second texture information is texture information of the second target part of the target contact object. The second target part is a part of the first target part. The external trigger information is used to characterize the action sent by the second target part.

[0126] The target instruction information determination module 230 is used to match the target instruction information from the candidate instruction information according to the target action information. The candidate instruction information is the instruction information for automatically controlling the target vehicle. The target instruction information includes: driving instruction information, parking instruction information and comprehensive instruction information. The driving instruction information is the instruction information that can only be effective when the target vehicle is driving. The parking instruction information is the instruction information that can only be effective when the target vehicle is in a parking state. The comprehensive instruction information is the instruction information that can be effective when the vehicle is driving or in a parking state.

[0127] Control module 240: used to control the target vehicle according to the target instruction information.

[0128] Optional palm print and gesture based vehicle controls including:

[0129] Door opening verification module: used to obtain the first texture information through the second control component, and verify the target contact object according to the first texture information and the preset texture information, the first control component is used to control the opening of the door, and the second control component is equipped with a second acquisition sensor, which can acquire the texture information of the contact object;

[0130] Door opening module: used to open the door of the target vehicle if the verification is successful within a preset number of times;

[0131] Early warning module: If the verification fails within the preset number of verification times, it will start early warning monitoring and determine whether the target contact object has malicious door-breaking behavior. If so, an alarm will be issued.

[0132] Optionally, the target action information determination module 220 includes:

[0133] The second texture information acquisition unit is used to monitor in real time whether the second texture information is acquired through the first control component if the first texture information is verified;

[0134] An external trigger information determination unit: used to determine the trigger action issued by the second target part within the first preset time to obtain external trigger information if the second texture information is collected;

[0135] The target action information determining unit is used to use the second texture information and the external trigger information as the target action information.

[0136] Optionally, the target instruction information determination module 230 includes:

[0137] a reference instruction information determining unit, configured to match reference instruction information corresponding to the second texture information from candidate instruction information according to the second texture information;

[0138] The target instruction information determining unit is used to filter the reference instruction information through external trigger information to obtain the target instruction information.

[0139] Optionally, the control module 240 includes:

[0140] If the target instruction information is driving instruction information or parking instruction information, the current driving state of the target vehicle is determined, and the target vehicle is controlled according to the driving state of the target vehicle and the target instruction information;

[0141] If the target command information is comprehensive command information, the target vehicle is directly controlled through the comprehensive command information.

[0142] Optional palm print and gesture based vehicle control device also includes:

[0143] A data acquisition module: used for acquiring a target size of the first texture information within a second preset time through the first control component, where the second preset time is greater than the first preset time;

[0144] Driving state determination module: used to determine the driving state of the target vehicle according to the target size. The driving state of the target vehicle includes: normal driving state and dangerous driving state.

[0145] Optionally, the driving state determination module includes:

[0146] A normal driving state determination unit: used for determining that the driving state of the target vehicle is a normal driving state if the target size satisfies a preset size within a second preset time;

[0147] Dangerous driving state determination unit: used to determine that the driving state of the target vehicle is a dangerous driving state if the target size does not meet a preset size.

[0148] The palm print and gesture-based vehicle control device provided in the embodiments of the present invention can execute the palm print and gesture-based vehicle control method provided in any of the above-mentioned embodiments of the present invention, and has the corresponding functions and beneficial effects of executing the palm print and gesture-based vehicle control method. For detailed processes, please refer to the relevant operations of the palm print and gesture-based vehicle control method in the above-mentioned embodiments.

[0149] Figure 7A schematic diagram of the structure of an electronic device for implementing a vehicle control method based on palm prints and gestures according to an embodiment of the present invention. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present invention described and / or required herein.

[0150] like Figure 7 As shown, the electronic device 10 includes at least one processor 11, and a memory connected to the at least one processor 11, such as a read-only memory (ROM) 12, a random access memory (RAM) 13, etc., wherein the memory stores a computer program that can be executed by at least one processor, and the processor 11 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 12 or the computer program loaded from the storage unit 18 to the random access memory (RAM) 13. In the RAM 13, various programs and data required for the operation of the electronic device 10 can also be stored. The processor 11, the ROM 12, and the RAM 13 are connected to each other through a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0151] A number of components in the electronic device 10 are connected to the I / O interface 15, including: an input unit 16, such as a keyboard, a mouse, etc.; an output unit 17, such as various types of displays, speakers, etc.; a storage unit 18, such as a disk, an optical disk, etc.; and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0152] The processor 11 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The processor 11 executes the various methods and processes described above, such as a vehicle control method based on palm prints and gestures.

[0153] In some embodiments, the vehicle control method based on palm prints and gestures may be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as a storage unit 18. In some embodiments, part or all of the computer program may be loaded and / or installed on the electronic device 10 via the ROM 12 and / or the communication unit 19. When the computer program is loaded into the RAM 13 and executed by the processor 11, one or more steps of the vehicle control method based on palm prints and gestures described above may be performed. Alternatively, in other embodiments, the processor 11 may be configured to execute the vehicle control method based on palm prints and gestures in any other appropriate manner (e.g., by means of firmware).

[0154] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0155] Computer programs for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that when the computer program is executed by the processor, the functions / operations specified in the flow chart and / or block diagram are implemented. The computer program may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0156] In the context of the present invention, a computer-readable storage medium may be a tangible medium that may contain or store a computer program for use by or in combination with an instruction execution system, device or equipment. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0157] To provide interaction with a user, the systems and techniques described herein may be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or trackball) through which the user can provide input to the electronic device. Other types of devices may also be used to provide interaction with the user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form (including acoustic input, voice input, or tactile input).

[0158] The systems and techniques described herein may be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0159] A computing system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The client and server relationship is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services.

[0160] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps described in the present invention can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solution of the present invention can be achieved, and this document does not limit this.

[0161] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A vehicle control method based on palm prints and gestures, characterized in that: include: Acquire first texture information through a first control component and verify the first texture information, wherein the first texture information is texture information of a first target part of a target contact object, the first control component is a component for controlling a vehicle, and a first acquisition sensor is configured on the first control component, and the first acquisition sensor can acquire texture information and motion information of the contact object; If the first texture information is verified, the target action information is obtained through the first control component, the target action information is information sent by the target contact object to indicate the operation of the vehicle, and the target action information includes second texture information and external trigger information, the second texture information is texture information of the second target part of the target contact object, the second target part is a part of the first target part, and the external trigger information is used to characterize the action sent by the second target part; Matching target instruction information from candidate instruction information according to the target action information, the candidate instruction information is instruction information for automatically controlling the target vehicle, the target instruction information includes: driving instruction information, parking instruction information and comprehensive instruction information, the driving instruction information is instruction information that can only take effect during the driving process of the target vehicle, the parking instruction information is instruction information that can only take effect when the target vehicle is in a parking state, and the comprehensive instruction information is instruction information that can take effect when the vehicle is in a driving or parking state; The target vehicle is controlled according to the target instruction information.

2. The method according to claim 1, characterized in that Before obtaining the first texture information through the first control component, the method includes: The first texture information is acquired through the second control component, and the target contact object is verified according to the first texture information and the preset texture information, the first control component is used to control the opening of the door, and the second control component is equipped with a second acquisition sensor, and the second acquisition sensor can acquire the texture information of the contact object; If the verification is successful within the preset number of times, the door of the target vehicle is opened; If the verification fails within the preset number of verification times, early warning monitoring will be activated to determine whether the target contact object has malicious door-breaking behavior. If so, an alarm will be issued.

3. The method according to claim 1, characterized in that If the first texture information is verified, obtaining target action information through the first control component includes: If the first texture information is verified, the first control component is used to monitor in real time whether the second texture information is collected; If the second texture information is collected, determining the trigger action issued by the second target part within the first preset time, and obtaining external trigger information; The second texture information and the external trigger information are used as target action information.

4. The method according to claim 1, characterized in that: The matching target instruction information from candidate instruction information according to the target action information includes: matching reference instruction information corresponding to the second texture information from the candidate instruction information according to the second texture information; The reference instruction information is filtered through external trigger information to obtain the target instruction information.

5. The method according to claim 1, characterized in that The controlling the target vehicle according to the target instruction information includes: If the target instruction information is driving instruction information or parking instruction information, the current driving state of the target vehicle is determined, and the target vehicle is controlled according to the driving state of the target vehicle and the target instruction information; If the target instruction information is comprehensive instruction information, the target vehicle is directly controlled by the comprehensive instruction information.

6. A vehicle control method based on palm prints and gestures, characterized in that: Also includes: Acquiring, by the first control component, a target size of the first texture information within a second preset time, wherein the second preset time is greater than the first preset time; The driving state of the target vehicle is determined according to the target size, and the driving state of the target vehicle includes: a normal driving state and a dangerous driving state.

7. The method according to claim 6, characterized in that Determining the driving state of the target vehicle according to the target size includes: If the target size satisfies the preset size within the second preset time, the driving state of the target vehicle is a normal driving state; If the target size does not meet the preset size, the driving state of the target vehicle is a dangerous driving state.

8. A vehicle control device based on palm prints and gestures, characterized in that: include: A verification module, used to obtain first texture information through a first control component and verify the first texture information, wherein the first texture information is texture information of a first target part of a target contact object, the first control component is a component for controlling a vehicle, and a first acquisition sensor is configured on the first control component, and the first acquisition sensor can acquire texture information and motion information of the contact object; a target action information determination module, configured to obtain target action information through the first control component if the first texture information is verified, wherein the target action information is information issued by the target contact object for indicating the operation of the vehicle, and the target action information includes second texture information and external trigger information, wherein the second texture information is texture information of a second target part of the target contact object, the second target part is a part of the first target part, and the external trigger information is used to characterize the action issued by the second target part; a target instruction information determination module, used for matching target instruction information from candidate instruction information according to the target action information, wherein the candidate instruction information is instruction information for automatically controlling the target vehicle, and the target instruction information includes: driving instruction information, parking instruction information and comprehensive instruction information, wherein the driving instruction information is instruction information that can only be effective during the driving process of the target vehicle, the parking instruction information is instruction information that can only be effective when the target vehicle is in a parking state, and the comprehensive instruction information is instruction information that can be effective when the vehicle is in a driving or parking state; A control module is used to control the target vehicle according to the target instruction information.

9. An electronic device, characterized in that: The electronic device comprises: at least one processor; and a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the vehicle control method based on palm prints and gestures according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the vehicle control method based on palm prints and gestures according to any one of claims 1 to 7 when executed.

Images