Vehicle door unlocking method and device, vehicle and storage medium

Abstract

The embodiment of the invention provides a vehicle door unlocking method and device, a vehicle and a storage medium. The method comprises the steps that under the condition that a user is detected through a vehicle sensing device, a voice recognition device is activated to collect a voice unlocking instruction of the user; judging whether the voice unlocking instruction is a valid instruction or not; when the voice unlocking instruction is a valid instruction, judging whether voiceprint information of the voice unlocking instruction is matched with preset voiceprint information or not; under the condition that the voiceprint information of the voice unlocking instruction is matched with preset voiceprint information, activating a facial recognition device to collect facial information of a user; judging whether the face information is matched with preset face information or not; and under the condition that the face information is matched with the preset face information, a voice unlocking instruction is executed to control the vehicle door to be unlocked. According to the method, the voiceprint and face dual verification is set, the vehicle door is unlocked under the condition that the voiceprint and face verification is passed, and the safety of vehicle control can be effectively improved.

Description

Technical Field

[0001] This application relates to the field of vehicle technologies, and particularly to a method and device for unlocking a vehicle door, a vehicle, and a storage medium. Background Art

[0002] With the development of social technology and economy, cars are chosen by more and more people as a daily means of transportation. The functions of a car directly affect the driving experience of users. For example, in terms of the most basic unlocking function, from mechanical keys (crank keys) to remote control keys (integrated keys) and then to digital keys (NFC), it all reflects the development concept of facilitating user operations and putting people first.

[0003] The digital key unlocking methods are relatively independent and usually only one of them is selected. For example, unlocking by voiceprint recognition, facial recognition, etc. Voiceprint unlocking mainly depends on the instructions sent by the user; facial recognition unlocking mainly verifies by collecting the position and posture of the user's face and the information of facial feature points. However, voiceprint recognition can be cracked through audio editing, voice synthesis, etc., and facial recognition can be cracked through static images, AI forgery, etc. These unlocking methods all have the risk of being cracked, which will threaten the driving safety of users to a certain extent. Summary of the Invention

[0004] The purpose of the embodiments of this application is to provide a method and device for unlocking a vehicle door, a vehicle, and a storage medium, so as to solve the technical defect that there are security risks in the existing single unlocking method.

[0005] To achieve the above purpose, in the first aspect of this application, a method for unlocking a vehicle door is provided, and the method includes:

[0006] When a user is detected by a vehicle sensing device, activate a voice recognition device to collect a voice unlocking instruction of the user;

[0007] Judge whether the voice unlocking instruction is a valid instruction;

[0008] When the voice unlocking instruction is a valid instruction, judge whether the voiceprint information of the voice unlocking instruction matches the preset voiceprint information;

[0009] When the voiceprint information of the voice unlocking instruction matches the preset voiceprint information, activate a facial recognition device to collect the facial information of the user;

[0010] Judge whether the facial information matches the preset facial information;

[0011] When the facial information matches the preset facial information, execute the voice unlocking instruction to control the unlocking of the vehicle door.

[0012] In an embodiment of the present application, the method further includes: when a user is detected by a vehicle sensing device, activating a face recognition device to collect the user's face information; determining whether the face information matches preset face information; when the face information matches the preset face information, activating a voice recognition device to collect the user's voice unlocking instruction; determining whether the voice unlocking instruction is a valid instruction; when the voice unlocking instruction is a valid instruction, determining whether the voiceprint information of the voice unlocking instruction matches preset voiceprint information; when the voiceprint information of the voice unlocking instruction matches the preset voiceprint information, executing the voice unlocking instruction to control the unlocking of the vehicle door.

[0013] In an embodiment of the present application, determining whether the voice unlocking instruction is a valid instruction includes: matching the voice unlocking instruction with all preset unlocking instructions included in an instruction library, where the instruction library includes multiple preset instructions; when the voice unlocking instruction matches the preset unlocking instruction, determining that the voice unlocking instruction is a valid instruction.

[0014] In an embodiment of the present application, the method further includes: when multiple users are detected by a vehicle sensing device, activating a voice recognition device to collect the voice unlocking instruction of a first user, where the multiple users include a first user and a second user; determining whether the voice unlocking instruction of the first user is a valid instruction; when the voice unlocking instruction is a valid instruction, determining whether the voiceprint information of the voice unlocking instruction matches preset voiceprint information; when the voiceprint information of the voice unlocking instruction matches the preset voiceprint information, activating a face recognition device to collect the face information of the second user; determining whether the face information of the second user matches the preset face information; when the face information matches the preset face information, executing the voice unlocking instruction to control the unlocking of the vehicle door.

[0015] In an embodiment of the present application, the method further includes: during the process of a user driving the vehicle, regularly collecting the user's face information and voiceprint information through an in-vehicle recording device; adding the voiceprint information to a voiceprint library to optimize the preset voiceprint information in the voiceprint library; adding the face information to a face information library to optimize the preset face information in the face information library.

[0016] In an embodiment of the present application, the method further includes: during the process of a user driving the vehicle, when a voice instruction of the user is not responded to, extracting the voiceprint information of the voice instruction through an in-vehicle recording device; adding the voiceprint information to a voiceprint library to optimize the preset voiceprint information in the voiceprint library.

[0017] In an embodiment of the present application, the method further includes: when the voiceprint information of the voice unlocking instruction fails to match the preset voiceprint information or the facial information fails to match the preset facial information, triggering an audible and visual alarm of the vehicle and pushing the alarm information to the vehicle owner; when any of the following conditions is met, triggering the central lock of the vehicle to lock: the number of times the voiceprint information of the voice unlocking instruction fails to match the preset voiceprint information reaches a preset number; the number of times the facial information fails to match the preset facial information reaches a preset number.

[0018] A second aspect of the present application provides a door unlocking device, including:

[0019] A memory configured to store instructions;

[0020] A processor configured to call the instructions from the memory and capable of implementing the above-mentioned door unlocking method when executing the instructions.

[0021] A third aspect of the present application provides a vehicle, which includes:

[0022] A vehicle sensing device for detecting a user;

[0023] A voice recognition device for collecting a voice unlocking instruction of the user; determining whether the voice unlocking instruction is a valid instruction; when the voice unlocking instruction is a valid instruction, determining whether the voiceprint information of the voice unlocking instruction matches the preset voiceprint information;

[0024] A face recognition device for collecting facial information of the user; determining whether the facial information matches the preset facial information;

[0025] The above-mentioned door unlocking device.

[0026] A fourth aspect of the present application provides a machine-readable storage medium, on which instructions are stored, and when the instructions are executed by a processor, the processor is configured to execute the above-mentioned door unlocking method.

[0027] In the above technical solution, when a user is detected by the vehicle sensing device, the voice recognition device is activated to collect the voice unlocking instruction of the user; it is determined whether the voice unlocking instruction is a valid instruction; when the voice unlocking instruction is a valid instruction, it is determined whether the voiceprint information of the voice unlocking instruction matches the preset voiceprint information; when the voiceprint information of the voice unlocking instruction matches the preset voiceprint information, the face recognition device is activated to collect the facial information of the user; it is determined whether the facial information matches the preset facial information; when the facial information matches the preset facial information, the voice unlocking instruction is executed to control the door to unlock. This method sets double verification of voiceprint combined with face. When both the voiceprint and the face are verified successfully, the door is unlocked, which can effectively improve the security of vehicle control.

[0028] Other features and advantages of the embodiments of the present application will be described in detail in the following specific implementation section. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] The drawings are used to provide a further understanding of the embodiments of the present application, and constitute a part of the specification. Together with the following specific implementation, they are used to explain the embodiments of the present application, but do not constitute a limitation to the embodiments of the present application. In the drawings:

[0030] Figure 1 Schematically shows a flowchart of a method for unlocking a vehicle door according to an embodiment of the present application;

[0031] Figure 2 Schematically shows a flowchart of another method for unlocking a vehicle door according to an embodiment of the present application;

[0032] Figure 3 Schematically shows a flowchart of yet another method for unlocking a vehicle door according to an embodiment of the present application;

[0033] Figure 4 Schematically shows a flowchart of a method for unlocking a vehicle door with multi-person collaboration according to an embodiment of the present application;

[0034] Figure 5 Schematically shows an internal structure diagram of a computer device according to an embodiment of the present application. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0035] To make the objectives, technical solutions, and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. It should be understood that the specific implementation described here is only used to illustrate and explain the embodiments of the present application, and is not used to limit the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts belong to the scope of protection of the present application.

[0036] It should be noted that if there are directional indications (such as up, down, left, right, front, back,...) involved in the embodiments of the present application, the directional indications are only used to explain the relative positional relationship and movement conditions between components in a specific posture (as shown in the drawings). If the specific posture changes, the directional indications will also change accordingly.

[0037] In addition, if the descriptions such as "first" and "second" are involved in the embodiments of the present application, the descriptions of "first", "second", etc. are only for descriptive purposes and cannot be construed as indicating or implying their relative importance or implicitly specifying the quantity of the indicated technical features. Thus, the features defined with "first" and "second" may explicitly or implicitly include at least one such feature. In addition, the technical solutions between various embodiments may be combined with each other, but it must be based on the fact that those skilled in the art can implement them. When the combination of technical solutions is contradictory or cannot be implemented, it should be considered that such a combination of technical solutions does not exist and is not within the scope of protection required by the present application.

[0038] Figure 1 Schematically shows a flowchart of a method for unlocking a vehicle door according to an embodiment of the present application. As Figure 1 shown, an embodiment of the present application provides a method for unlocking a vehicle door, and the method may include the following steps:

[0039] Step 101, when a user is detected by a vehicle sensing device, activate a voice recognition device to collect a voice unlocking instruction of the user.

[0040] In the embodiment of the present application, it should be noted that the vehicle sensing device may refer to a device installed on the vehicle for sensing changes in the environment around the vehicle or the internal state of the vehicle. These devices convert non-electrical signals into electrical signals and provide them to the vehicle's computer system (ECU) to achieve various functions and controls. In this technical solution, the vehicle sensing device can be used to sense whether a user appears within the vehicle area. When the vehicle sensing device senses that a user appears within the vehicle area, the processor can activate the vehicle's voice recognition device, and further collect the user's voice unlocking instruction through the voice recognition device. Among them, the sensing range of the vehicle sensing device can be set in combination with the recognition range of the voice recognition device to ensure that when the user appears within this sensing range, the issued voice unlocking instruction can be recognized by the voice recognition device. For example, it can be set to a range of 1-3 meters. When the vehicle sensing device senses that a user appears within the 1-3 meter area range of the vehicle, the processor can activate the vehicle's voice recognition device at this time. At this time, when the user issues a voice unlocking instruction, the issued voice unlocking instruction can be accurately collected by the voice recognition device. At the same time, in order to ensure the accuracy of the voice recognition of the voice recognition device, when the user issues a voice unlocking instruction, the sound decibel should not be lower than 40 decibels, that is, it can be issued with a voice not lower than normal speech, so that the recognition degree of the voice recognition device is more accurate.

[0041] Step 102, determine whether the voice unlocking instruction is a valid instruction.

[0042] In the embodiments of the present application, it should be noted that after the voice recognition device collects the user's voice unlocking instruction, it is necessary to further determine whether the voice unlocking instruction is a valid instruction. Among them, the valid instruction is set by the vehicle owner. For example, taking the valid instruction set as "unlock the door" as an example, when the vehicle is locked, the user needs to use the voice unlocking instruction to control the vehicle to unlock. If the voice unlocking instruction issued by the user is "unlock the door", it can be considered that the voice unlocking instruction issued by the user at this time is a valid instruction; if the voice unlocking instruction issued by the user is "unlock", "lower the window", etc., it can be considered that the voice unlocking instruction issued by the user at this time is an invalid instruction.

[0043] In the embodiments of the present application, determining whether the voice unlocking instruction is a valid instruction includes: matching the voice unlocking instruction with the preset unlocking instructions included in the instruction library, where the instruction library includes various preset instructions; in the case where the voice unlocking instruction matches the preset unlocking instruction, determining that the voice unlocking instruction is a valid instruction.

[0044] In this embodiment, it should be noted that the vehicle owner can set various instructions for controlling the vehicle according to needs, such as including but not limited to controlling the lowering and raising of the vehicle window, controlling the playing and closing of music, controlling the unlocking of the vehicle, etc. All the set instructions will be stored in the instruction library as preset instructions and can be classified according to the control type. When the vehicle owner issues any instruction, the issued instruction will be matched with the preset instructions stored in the instruction library. If the matching is successful, the processor will execute the instruction issued by the user. At the same time, for each control type of the vehicle, the vehicle owner can customize multiple instructions. For example, taking the control of vehicle unlocking as an example, the vehicle owner can set the voice instructions for vehicle unlocking as "vehicle unlocking", "unlock", and "open the door", etc., or a personalized "I'm back". Therefore, in this technical solution, after the voice unlocking instruction of the user is collected, the processor can match the voice unlocking instruction with the preset unlocking instructions stored in the instruction library. If the voice unlocking instruction matches the preset unlocking instruction, it can be considered that the voice unlocking instruction is a valid instruction. Otherwise, it is considered that the voice unlocking instruction is an invalid instruction.

[0045] Step 103, in the case where the voice unlocking instruction is a valid instruction, determine whether the voiceprint information of the voice unlocking instruction matches the preset voiceprint information.

[0046] In the embodiments of the present application, it should be noted that as Figure 2As shown, a flowchart of another door unlocking method is provided. In this technical solution, before setting a voice command, the vehicle owner needs to perform voiceprint enrollment. In this technical solution, the in-vehicle device can support enrolling 2 to 3 voiceprint information. To meet different needs of users, the first voiceprint enrollment can support two methods, including enrollment on the mobile phone side and enrollment inside the vehicle. If the user chooses to enroll voiceprint information on the mobile phone side, the mobile phone side needs to be connected to the in-vehicle device first. After the vehicle successfully recognizes the mobile phone side and obtains relevant permissions, the mobile phone side can enter the "information enrollment" function page to enroll voiceprint information according to specific words set by the in-vehicle device. The voiceprint information of the user extracted, such as voiceprint feature information including frequency, pitch, rhythm, etc., will be synchronously uploaded to the voiceprint library of the in-vehicle device as the preset voiceprint information for enrollment. Among them, it is recommended that the user complete it in a relatively quiet environment to ensure the accuracy of the voiceprint. If the user chooses to enroll inside the vehicle, they need to enter the vehicle, connect the vehicle to the network and log in, find "information enrollment" in the personalized settings, and enter information according to the enrollment instructions. The voiceprint information of the user extracted, such as voiceprint feature information including frequency, pitch, rhythm, etc., will also be synchronously uploaded to the voiceprint library as the preset voiceprint information for enrollment. At the same time, a voice receiver can be set at the position below the vehicle dashboard. The voice receiver can collect the vehicle owner's voice by receiving the voice command issued by the vehicle owner, and at the same time perform processing operations such as noise reduction, analysis, and training on the collected voice information, extract voiceprint features with individual differences such as frequency, pitch, rhythm, etc., and the extracted voiceprint features can be imported into the voiceprint library to optimize the preset voiceprint information in the voiceprint library. In this way, when the vehicle owner issues any command and the command is a valid command, the processor will extract the voiceprint feature information of the arbitrary command issued by the vehicle owner and match it with the preset voiceprint information stored in the voiceprint library.

[0047] Therefore, in this technical solution, after determining that the voice unlocking command issued by the user is a valid command, the processor will extract the voiceprint information of the voice unlocking command and match it with the preset voiceprint information stored in the voiceprint library to further determine whether the voiceprint information of the voice unlocking command passes the verification.

[0048] Step 104, when the voiceprint information of the voice unlocking command matches the preset voiceprint information, activate the facial recognition device to collect the facial information of the user.

[0049] In the embodiment of the present application, it should be noted that after determining that the voice unlocking instruction issued by the user is a valid instruction, the processor will extract the voiceprint information of the voice unlocking instruction and match it with the preset voiceprint information stored in the voiceprint library to further determine whether the voiceprint information of the voice unlocking instruction passes the verification. If the voiceprint information of the voice unlocking instruction matches the preset voiceprint information, it can be considered that the voiceprint information passes the verification. At the same time, it can be set that after passing the verification, a "beep" prompt sound will sound in the vehicle. At this time, after the voiceprint information passes the verification, the processor will activate the face recognition device to collect the user's face information for face authentication. Combining voiceprint with face can effectively improve the security of vehicle control and prevent the situation where a stranger outside the vehicle wakes up the in-vehicle voice assistant to execute relevant commands when the vehicle is not locked.

[0050] Step 105, determine whether the face information matches the preset face information.

[0051] In the embodiment of the present application, it should be noted that as Figure 3As shown in the figure, a flowchart of another method for unlocking a vehicle door is provided. In this technical solution, the in-vehicle terminal can support the entry of 2 to 3 facial information. To meet the different needs of users, the first facial information entry supports two methods, including entry on the mobile phone side and entry inside the vehicle. If the user chooses to enter facial information on the mobile phone side, the mobile phone side needs to be connected to the in-vehicle terminal first. After the vehicle successfully recognizes the mobile phone side and obtains relevant permissions, the mobile phone side can enter the "information entry" function page to complete the facial information entry according to the specific face collection steps set by the in-vehicle terminal. The shape and position of the facial information of the user extracted, such as the eyes, nose, mouth, etc., will be synchronized and uploaded to the facial information database of the in-vehicle terminal as the preset facial information for entry. Among them, it is recommended that the user complete it in an environment with sufficient light to ensure the accuracy of face recognition. If the user chooses to enter inside the vehicle, they need to enter the vehicle, connect the vehicle to the network and log in, find "information entry" in the personalized settings, and enter the information according to the entry instructions. The shape and position of the facial information of the user extracted, such as the eyes, nose, mouth, etc., will be synchronized and uploaded to the facial information database of the in-vehicle terminal as the preset facial information for entry. At the same time, an in-vehicle camera can be installed at a position above the dashboard inside the vehicle near the rearview mirror. The in-vehicle camera can regularly collect the facial information of the vehicle owner and perform processing operations such as noise reduction, analysis, and training on the collected facial information, and extract individual facial features such as the shape and position of the eyes, nose, mouth, etc. The extracted facial features can be imported into the facial information database to optimize the preset facial information in the facial information database. In this way, when the vehicle owner performs face recognition, the processor will match the uploaded facial information with the preset facial information stored in the facial information database to effectively prevent strangers from unlocking the vehicle. Therefore, in this technical solution, after the processor determines that the voice unlock command issued by the user is a valid command and the voiceprint information of the voice unlock command passes the verification, the processor will further match the collected facial information of the user with the preset facial information stored in the facial information database to determine whether the facial information of this user passes the verification.

[0052] Step 106, when the facial information matches the preset facial information, execute the voice unlock command to control the unlocking of the vehicle door.

[0053] In the embodiment of the present application, it should be noted that if the facial information matches the preset facial information, it can be considered that the facial information of the user passes the verification. At the same time, it can be set that a "beep" prompt sound will sound in the vehicle after passing the verification. At this time, after the facial information passes the verification, the processor can consider that the user meets the unlocking conditions, and then execute the voice unlock command to control the unlocking of the vehicle door. Otherwise, if the facial information does not match the preset facial information, it can be considered that the facial information of the user does not pass the verification, and unlocking will not be performed.

[0054] In the above technical solution, when the vehicle sensing device detects the user, the voice recognition device is activated to collect the user's voice unlocking instruction; it is determined whether the voice unlocking instruction is a valid instruction; when the voice unlocking instruction is a valid instruction, it is determined whether the voiceprint information of the voice unlocking instruction matches the preset voiceprint information; when the voiceprint information of the voice unlocking instruction matches the preset voiceprint information, the face recognition device is activated to collect the user's face information; it is determined whether the face information matches the preset face information; when the face information matches the preset face information, the voice unlocking instruction is executed to control the unlocking of the vehicle door. This method sets double verification of voiceprint combined with face. When both the voiceprint and the face are verified successfully, the vehicle door is unlocked, which can effectively improve the security of vehicle control.

[0055] In the embodiment of the present application, the method further includes: when the vehicle sensing device detects the user, the face recognition device is activated to collect the user's face information; it is determined whether the face information matches the preset face information; when the face information matches the preset face information, the voice recognition device is activated to collect the user's voice unlocking instruction; it is determined whether the voice unlocking instruction is a valid instruction; when the voice unlocking instruction is a valid instruction, it is determined whether the voiceprint information of the voice unlocking instruction matches the preset voiceprint information; when the voiceprint information of the voice unlocking instruction matches the preset voiceprint information, the voice unlocking instruction is executed to control the unlocking of the vehicle door.

[0056] In this embodiment, it should be noted that the sensing range of the vehicle sensing device can be set in combination with the recognition range of the face recognition device to ensure that when the user appears within the sensing range, the user's face can be recognized by the face recognition device. For example, it can be set to the area range of 1 - 3 meters. When the vehicle sensing device senses that a user appears within the 1 - 3 - meter area range of the vehicle, the processor can activate the face recognition device of the vehicle at this time, and at this time, the user's face can be accurately collected by the face recognition device. At the same time, the face recognition device has an infrared function, which can ensure normal recognition of the user's face information even in low - light conditions. Therefore, when the vehicle sensing device senses that a user appears within the vehicle area range, the processor can activate the face recognition device of the vehicle to further collect the user's face information through the face recognition device. After collecting the user's face information, the processor will further match the collected user's face information with the preset face information stored in the face information database to determine whether the user's face information passes the verification. If the face information matches the preset face information, it can be considered that the user's face information passes the verification. At the same time, it can be set that a "beep" prompt sound is made by the vehicle after passing the verification.

[0057] Further, after the facial information passes the verification, the processor activates the voice recognition device of the vehicle and further collects the user's voice unlocking instruction through the voice recognition device. After collecting the user's voice unlocking instruction, the processor can match the voice unlocking instruction with the preset unlocking instructions stored in the instruction library. If the voice unlocking instruction matches any one of all the preset unlocking instructions, it can be considered that the voice unlocking instruction is a valid instruction. Otherwise, it is considered that the voice unlocking instruction is an invalid instruction.

[0058] Further, after determining that the voice unlocking instruction issued by the user is a valid instruction, the processor extracts the voiceprint information of the voice unlocking instruction and matches it with the preset voiceprint information stored in the voiceprint library to further determine whether the voiceprint information of the voice unlocking instruction passes the verification. If the voiceprint information of the voice unlocking instruction matches the preset voiceprint information, it can be considered that the voiceprint information passes the verification. At the same time, it can be set that a "beep" prompt sound is emitted by the vehicle after passing the verification. At this time, after the voiceprint information passes the verification, the processor can consider that the user meets the unlocking conditions and execute the voice unlocking instruction to control the door to unlock.

[0059] In the embodiment of the present application, the method further includes: when the vehicle sensing device detects multiple users, activating the voice recognition device to collect the voice unlocking instruction of the first user, where the multiple users include the first user and the second user; determining whether the voice unlocking instruction of the first user is a valid instruction; when the voice unlocking instruction is a valid instruction, determining whether the voiceprint information of the voice unlocking instruction matches the preset voiceprint information; when the voiceprint information of the voice unlocking instruction matches the preset voiceprint information, activating the facial recognition device to collect the facial information of the second user; determining whether the facial information of the second user matches the preset facial information; when the facial information matches the preset facial information, executing the voice unlocking instruction to control the door to unlock.

[0060] In this embodiment, it should be noted that, as Figure 4As shown, a flow diagram of a multi-person collaborative door unlocking method is provided. In this technical solution, multi-person unlocking is also supported. One user conducts voiceprint information verification, while another user conducts facial information verification. Among them, the order of information verification is not sequential. According to the actual needs of the user, one can choose to first conduct voiceprint information verification or facial information verification by one user. If the verification is passed, then another user conducts facial information verification or voiceprint information verification. At the same time, multiple users can conduct information verification at both ends of the vehicle respectively, or at the same end of the vehicle. Specifically, taking the first user and the second user who are respectively at both ends of the vehicle and conduct voiceprint information verification and facial information verification successively as an example, when the vehicle sensing device senses that the first user and the second user appear in the area range at both ends of the vehicle respectively, the processor can activate the voice recognition device of the vehicle, and further collect the voice unlocking instruction of the first user through the voice recognition device. After collecting the voice unlocking instruction of the first user, the processor will further match the collected voice unlocking instruction with the preset unlocking instructions stored in the instruction library. If the voice unlocking instruction matches any one of all the preset unlocking instructions, it can be considered that the voice unlocking instruction is a valid instruction. Otherwise, it is considered that the voice unlocking instruction is an invalid instruction.

[0061] Further, after determining that the voice unlocking instruction issued by the first user is a valid instruction, the processor will extract the voiceprint information of the voice unlocking instruction and match it with the preset voiceprint information stored in the voiceprint library to further determine whether the voiceprint information of the voice unlocking instruction passes the verification. If the voiceprint information of the voice unlocking instruction matches the preset voiceprint information, it can be considered that the voiceprint information passes the verification. At the same time, it can be set that a "beep" prompt sound sounds in the vehicle after passing the verification.

[0062] Further, after the voiceprint information of the first user passes the verification, the processor can activate the facial recognition device of the vehicle, and further collect the facial information of the second user through the facial recognition device. After collecting the facial information of the second user, the processor will further match the collected facial information of the second user with the preset facial information stored in the facial information library to determine whether the facial information of the second user passes the verification. If the facial information matches the preset facial information, it can be considered that the facial information of the second user passes the verification. At the same time, it can be set that a "beep" prompt sound sounds in the vehicle after passing the verification. At this time, after the facial information passes the verification, the processor can consider that the first user and the second user meet the unlocking conditions, and then execute the voice unlocking instruction to control the door to unlock. This multi-person unlocking method can enhance the user's riding experience and interaction.

[0063] In an embodiment of the present application, the method further includes: when the voiceprint information of the voice unlocking instruction fails to match the preset voiceprint information or the facial information fails to match the preset facial information, triggering an audible and visual alarm of the vehicle and pushing the alarm information to the vehicle owner; when any of the following conditions is met, triggering the central lock of the vehicle to lock: the number of times the voiceprint information of the voice unlocking instruction fails to match the preset voiceprint information reaches a preset number of times; the number of times the facial information fails to match the preset facial information reaches a preset number of times.

[0064] In this embodiment, it should be noted that when the voiceprint information verification fails or the facial information verification fails, an audible and visual alarm of the vehicle will be triggered. Among them, the duration of the audible and visual alarm can be set by the vehicle owner according to needs, for example, it can be set to 10s, including but not limited to this. At the same time, each time the verification fails, the alarm information will be synchronously pushed to the vehicle owner's mobile phone. If the vehicle alarm is triggered by the vehicle owner himself / herself, the vehicle owner can control the audible and visual alarm to turn off on the mobile phone. To further improve the safety of the vehicle, the voiceprint data and facial information of each verification failure will be stored in the draft box, and the vehicle owner can enter the draft box to view them.

[0065] It should be noted that the preset number of times can be set to 5 times, including but not limited to this. Specifically, the voice recognition device and the facial recognition device can both be installed on the B-pillar of the vehicle, and the unlocking times of both functions can be set to 5 times. When the number of times the voiceprint information verification fails reaches 5 times or the number of times the facial information verification fails reaches 5 times, while triggering the audible and visual alarm of the vehicle, the central lock of the vehicle will automatically lock and the engine will be disabled from starting. With the authorization of the vehicle owner, the in-vehicle terminal can directly call the nearest police station to report the alarm. At the same time, when the unlocking fails for the 4th time, the audible and visual alarm prompt time can be extended to 20s to prompt the user that there is only 1 remaining failure time.

[0066] In an embodiment of the present application, the method further includes: during the process of the user driving the vehicle, regularly collecting the user's facial information and voiceprint information through the in-vehicle recording device; adding the voiceprint information to the voiceprint library to optimize the preset voiceprint information in the voiceprint library; adding the facial information to the facial information library to optimize the preset facial information in the facial information library.

[0067] In this embodiment, it should be noted that since the vehicle owner issues commands at different times and in different moods, etc., there may be slight fluctuations in the voiceprint. At the same time, there may be slight changes in the facial information of the vehicle owner in different periods, different moods, different makeup, etc. Therefore, a timed acquisition task can be set for the vehicle-mounted recording device, and with the permission of the vehicle owner, the facial information and voiceprint information of the user are acquired at regular intervals. The voiceprint information is added to the voiceprint library to optimize the preset voiceprint information in the voiceprint library, and at the same time, the facial information is added to the facial information library to optimize the preset facial information in the facial information library.

[0068] In an embodiment of the present application, the method further includes: during the process of the user driving the vehicle, when the voice command of the user is not responded to, the voiceprint information of the voice command is extracted through the vehicle-mounted recording device; the voiceprint information is added to the voiceprint library to optimize the preset voiceprint information in the voiceprint library.

[0069] In this embodiment, it should be noted that in some cases, during the process of the user driving the vehicle, the voice command issued by the user is not responded to by the vehicle. At this time, with the permission of the vehicle owner, the unresponded voice command can be recorded through the vehicle-mounted recording device, and the voiceprint information of the voice command is extracted. The extracted voiceprint information is added to the voiceprint library and compared with the preset voiceprint information in the existing voiceprint library (ignoring duplicate information), corrected and optimized (training and fusing similar voiceprint information obtained), and added (for information not in the voiceprint library) to ensure the user experience.

[0070] An embodiment of the present application provides a door unlocking device, including:

[0071] A memory configured to store instructions;

[0072] A processor configured to call the instructions from the memory and capable of implementing the above-mentioned door unlocking method when executing the instructions.

[0073] An embodiment of the present application provides a machine-readable storage medium, on which instructions are stored, and when the instructions are executed by a processor, the processor is configured to execute the above-mentioned door unlocking method.

[0074] In one embodiment, a computer device is provided. The computer device may be a server, and its internal structure diagram may be as Figure 5As shown. The computer device includes a processor A01, a network interface A02, a memory (not shown in the figure), and a database (not shown in the figure) connected via a system bus. Among them, the processor A01 of the computer device is used to provide computing and control capabilities. The memory of the computer device includes an internal memory A03 and a non-volatile storage medium A04. The non-volatile storage medium A04 stores an operating system B01, a computer program B02, and a database (not shown in the figure). The internal memory A03 provides an environment for the operation of the operating system B01 and the computer program B02 in the non-volatile storage medium A04. The database of the computer device is used to store data of the door unlocking method. The network interface A02 of the computer device is used to communicate with an external terminal via a network connection. When the computer program B02 is executed by the processor A01, it realizes a door unlocking method.

[0075] Those skilled in the art can understand that Figure 5 the structure shown in is only a block diagram of some structures related to the solution of this application, and does not constitute a limitation on the computer device to which the solution of this application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine some components, or have different component arrangements.

[0076] An embodiment of this application provides a device, which includes a processor, a memory, and a program stored on the memory and executable on the processor. When the processor executes the program, the following steps are implemented: when a user is detected through a vehicle sensing device, activate a voice recognition device to collect a voice unlocking instruction of the user; determine whether the voice unlocking instruction is a valid instruction; when the voice unlocking instruction is a valid instruction, determine whether the voiceprint information of the voice unlocking instruction matches preset voiceprint information; when the voiceprint information of the voice unlocking instruction matches the preset voiceprint information, activate a face recognition device to collect face information of the user; determine whether the face information matches preset face information; when the face information matches the preset face information, execute the voice unlocking instruction to control the door to unlock.

[0077] In one embodiment, the method further includes: when a user is detected through a vehicle sensing device, activate a face recognition device to collect face information of the user; determine whether the face information matches preset face information; when the face information matches the preset face information, activate a voice recognition device to collect a voice unlocking instruction of the user; determine whether the voice unlocking instruction is a valid instruction; when the voice unlocking instruction is a valid instruction, determine whether the voiceprint information of the voice unlocking instruction matches preset voiceprint information; when the voiceprint information of the voice unlocking instruction matches the preset voiceprint information, execute the voice unlocking instruction to control the door to unlock.

[0078] In one embodiment, determining whether a voice unlocking instruction is a valid instruction includes: matching the voice unlocking instruction with preset unlocking instructions included in an instruction library, where the instruction library includes multiple preset instructions; and determining that the voice unlocking instruction is a valid instruction when the voice unlocking instruction matches the preset unlocking instruction.

[0079] In one embodiment, the method further includes: when a vehicle sensing device detects multiple users, activating a voice recognition device to collect a voice unlocking instruction of a first user, where the multiple users include a first user and a second user; determining whether the voice unlocking instruction of the first user is a valid instruction; when the voice unlocking instruction is a valid instruction, determining whether the voiceprint information of the voice unlocking instruction matches preset voiceprint information; when the voiceprint information of the voice unlocking instruction matches the preset voiceprint information, activating a face recognition device to collect face information of the second user; determining whether the face information of the second user matches preset face information; and when the face information matches the preset face information, executing the voice unlocking instruction to control the vehicle door to unlock.

[0080] In one embodiment, the method further includes: during the process of a user driving a vehicle, regularly collecting the face information and voiceprint information of the user through an in-vehicle recording device; adding the voiceprint information to a voiceprint library to optimize the preset voiceprint information in the voiceprint library; and adding the face information to a face information library to optimize the preset face information in the face information library.

[0081] In one embodiment, the method further includes: during the process of a user driving a vehicle, when a voice instruction of the user is not responded to, extracting the voiceprint information of the voice instruction through an in-vehicle recording device; and adding the voiceprint information to a voiceprint library to optimize the preset voiceprint information in the voiceprint library.

[0082] In one embodiment, the method further includes: when the voiceprint information of the voice unlocking instruction fails to match the preset voiceprint information or the face information fails to match the preset face information, triggering an audible and visual alarm of the vehicle and pushing the alarm information to the vehicle owner; and triggering the vehicle central lock to lock under any of the following conditions: the number of times that the voiceprint information of the voice unlocking instruction fails to match the preset voiceprint information reaches a preset number of times; the number of times that the face information fails to match the preset face information reaches a preset number of times.

[0083] The present application also provides a computer program product which, when executed on a data processing device, is adapted to execute a program initialized with the following method steps: when a user is detected by a vehicle sensing device, activate a voice recognition device to collect the user's voice unlocking instruction; determine whether the voice unlocking instruction is a valid instruction; when the voice unlocking instruction is a valid instruction, determine whether the voiceprint information of the voice unlocking instruction matches preset voiceprint information; when the voiceprint information of the voice unlocking instruction matches the preset voiceprint information, activate a face recognition device to collect the user's face information; determine whether the face information matches preset face information; when the face information matches the preset face information, execute the voice unlocking instruction to control the unlocking of the vehicle door.

[0084] In one embodiment, the method further includes: when a user is detected by a vehicle sensing device, activate a face recognition device to collect the user's face information; determine whether the face information matches preset face information; when the face information matches the preset face information, activate a voice recognition device to collect the user's voice unlocking instruction; determine whether the voice unlocking instruction is a valid instruction; when the voice unlocking instruction is a valid instruction, determine whether the voiceprint information of the voice unlocking instruction matches preset voiceprint information; when the voiceprint information of the voice unlocking instruction matches the preset voiceprint information, execute the voice unlocking instruction to control the unlocking of the vehicle door.

[0085] In one embodiment, determining whether the voice unlocking instruction is a valid instruction includes: matching the voice unlocking instruction with preset unlocking instructions included in an instruction library, where the instruction library includes multiple preset instructions; when the voice unlocking instruction matches the preset unlocking instruction, determine that the voice unlocking instruction is a valid instruction.

[0086] In one embodiment, the method further includes: when multiple users are detected by a vehicle sensing device, activate a voice recognition device to collect the voice unlocking instruction of a first user, where the multiple users include the first user and a second user; determine whether the voice unlocking instruction of the first user is a valid instruction; when the voice unlocking instruction is a valid instruction, determine whether the voiceprint information of the voice unlocking instruction matches preset voiceprint information; when the voiceprint information of the voice unlocking instruction matches the preset voiceprint information, activate a face recognition device to collect the face information of the second user; determine whether the face information of the second user matches preset face information; when the face information matches the preset face information, execute the voice unlocking instruction to control the unlocking of the vehicle door.

[0087] In one embodiment, the method further includes: during the process of a user driving a vehicle, regularly collecting the user's facial information and voiceprint information through an in-vehicle recording device; adding the voiceprint information to a voiceprint library to optimize the preset voiceprint information in the voiceprint library; adding the facial information to a facial information library to optimize the preset facial information in the facial information library.

[0088] In one embodiment, the method further includes: during the process of a user driving a vehicle, when a voice command of the user is not responded to, extracting the voiceprint information of the voice command through an in-vehicle recording device; adding the voiceprint information to a voiceprint library to optimize the preset voiceprint information in the voiceprint library.

[0089] In one embodiment, the method further includes: when the voiceprint information of a voice unlocking command fails to match the preset voiceprint information or the facial information fails to match the preset facial information, triggering an audible and visual alarm of the vehicle and pushing the alarm information to the vehicle owner; triggering the central lock of the vehicle to lock under any of the following conditions: the number of times that the voiceprint information of the voice unlocking command fails to match the preset voiceprint information reaches a preset number; the number of times that the facial information fails to match the preset facial information reaches a preset number.

[0090] Those skilled in the art should understand that the embodiments of the present application can be provided as a method, a system, or a computer program product. Therefore, the present application can take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present application can take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code.

[0091] The present application is described with reference to the flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each flow and / or block in the flowcharts and / or block diagrams can be implemented by computer program instructions, and the combination of flows and / or blocks in the flowcharts and / or block diagrams can also be implemented by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing devices to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing devices generate a device for realizing the functions specified in one Figure 1 one flow or multiple flows and / or blocks Figure 1 one block or multiple blocks.

[0092] These computer program instructions can also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to work in a specific manner, such that the instructions stored in the computer-readable memory produce a manufacture including an instruction device that implements the functions specified in one process Figure 1 one process or multiple processes and / or blocks Figure 1 in the block or multiple blocks.

[0093] These computer program instructions can also be loaded onto a computer or other programmable data processing device, so that a series of operation steps are performed on the computer or other programmable device to produce a computer-implemented process, and thus the instructions executed on the computer or other programmable device provide steps for implementing the functions specified in one process Figure 1 one process or multiple processes and / or blocks Figure 1 in the block or multiple blocks.

[0094] In a typical configuration, a computing device includes one or more processors (CPUs), an input / output interface, a network interface, and memory.

[0095] The memory may include non-permanent memory in the computer-readable medium, in the form of random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash memory (flashRAM). The memory is an example of a computer-readable medium.

[0096] Computer-readable media includes permanent and non-permanent, removable and non-removable media that can store information by any method or technology. The information can be computer-readable instructions, data structures, program modules, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassette tapes, magnetic disk storage or other magnetic storage devices, or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer-readable media does not include transitory computer-readable media, such as modulated data signals and carrier waves.

[0097] It should also be noted that the term "comprising", "including" or any other variant thereof is intended to cover non-exclusive inclusion, such that a process, method, commodity or device comprising a series of elements not only includes those elements but also includes other elements not expressly listed, or further includes elements inherent to such process, method, commodity or device. Without further limitation, an element defined by the statement "comprising an..." does not exclude the presence of additional identical elements in the process, method, commodity or device comprising the element.

[0098] The above are only embodiments of the present application and are not used to limit the present application. For those skilled in the art, various changes and modifications can be made to the present application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included within the scope of the claims of the present application.

Claims

1. A method for unlocking a vehicle door, characterized in that, The method includes: When a user is detected by a vehicle sensing device, activating a voice recognition device to collect the user's voice unlocking instruction; Determining whether the voice unlocking instruction is a valid instruction; When the voice unlocking instruction is a valid instruction, determining whether the voiceprint information of the voice unlocking instruction matches preset voiceprint information; When the voiceprint information of the voice unlocking instruction matches the preset voiceprint information, activating a face recognition device to collect the user's face information; Determining whether the face information matches preset face information; When the face information matches the preset face information, executing the voice unlocking instruction to control the unlocking of the vehicle door.

2. The door unlocking method according to claim 1, wherein, The method further includes: When a user is detected by the vehicle sensing device, activating a face recognition device to collect the user's face information; Determining whether the face information matches preset face information; When the face information matches the preset face information, activating a voice recognition device to collect the user's voice unlocking instruction; Determining whether the voice unlocking instruction is a valid instruction; When the voice unlocking instruction is a valid instruction, determining whether the voiceprint information of the voice unlocking instruction matches preset voiceprint information; When the voiceprint information of the voice unlocking instruction matches the preset voiceprint information, executing the voice unlocking instruction to control the unlocking of the vehicle door.

3. The door unlocking method according to claim 1, characterized in that The determining whether the voice unlocking instruction is a valid instruction includes: Matching the voice unlocking instruction with preset unlocking instructions included in an instruction library, where the instruction library includes multiple preset instructions; When the voice unlocking instruction matches the preset unlocking instruction, determining that the voice unlocking instruction is a valid instruction.

4. The door unlocking method according to claim 1, wherein The method further includes: When multiple users are detected by the vehicle sensing device, activating a voice recognition device to collect the voice unlocking instruction of a first user, where the multiple users include the first user and a second user; Determining whether the voice unlocking instruction of the first user is a valid instruction; When the voice unlocking instruction is a valid instruction, determining whether the voiceprint information of the voice unlocking instruction matches preset voiceprint information; When the voiceprint information of the voice unlocking instruction matches the preset voiceprint information, activating a face recognition device to collect the face information of the second user; Determining whether the face information of the second user matches preset face information; When the face information matches the preset face information, executing the voice unlocking instruction to control the unlocking of the vehicle door.

5. The door unlocking method according to claim 1, wherein The method further includes: During the process of a user driving the vehicle, regularly collecting the user's face information and voiceprint information through an in-vehicle recording device; Adding the voiceprint information to a voiceprint library to optimize the preset voiceprint information in the voiceprint library; Adding the face information to a face information library to optimize the preset face information in the face information library.

6. The door unlocking method according to claim 1, characterized in that, The method further includes: During the process of a user driving a vehicle, in the case where the voice command of the user is not responded to, the voiceprint information of the voice command is extracted through an in-vehicle recording device; The voiceprint information is added to a voiceprint library to optimize the preset voiceprint information in the voiceprint library.

7. The door unlocking method according to claim 1, wherein The method further includes: In the case where the voiceprint information of the voice unlocking command does not match the preset voiceprint information or the facial information does not match the preset facial information, a vehicle sound and light alarm is triggered, and the alarm information is pushed to the vehicle owner; In the case where any one of the following conditions is met, the central lock of the vehicle is triggered to lock: The number of times that the voiceprint information of the voice unlocking command does not match the preset voiceprint information reaches a preset number of times; The number of times that the facial information does not match the preset facial information reaches the preset number of times.

8. A door unlocking device, characterized in that, It includes: A memory configured to store instructions; A processor configured to call the instructions from the memory and capable of implementing the vehicle door unlocking method according to any one of claims 1 to 7 when executing the instructions.

9. A vehicle, characterized in that, It includes: A vehicle sensing device for detecting a user; A voice recognition device for collecting the voice unlocking command of the user; Determine whether the voice unlocking command is a valid command; In the case where the voice unlocking command is a valid command, determine whether the voiceprint information of the voice unlocking command matches the preset voiceprint information; A facial recognition device for collecting the facial information of the user; determine whether the facial information matches the preset facial information; The vehicle door unlocking device according to claim 8.

10. A machine-readable storage medium having instructions stored thereon, characterized in that, When the instruction is executed by the processor, the processor is configured to execute the vehicle door unlocking method according to any one of claims 1 to 7.

Images