Vehicle unlocking method based on EAR living body recognition and cosine similarity and vehicle

Abstract

The invention discloses a vehicle unlocking method based on EAR living body recognition and cosine similarity and a vehicle, and belongs to the technical field of machine vision, and the method comprises the steps that when a sensor in a BRC camera detects that a person approaches, a face image is started and sent to a vehicle door controller, and a control unit judges whether the person is a living body or not according to the face image; if yes, the control unit sends a living body state instruction to a display screen, whether the recognition personnel are registered or not is confirmed through database comparison, and if yes, a vehicle unlocking instruction is sent to a vehicle door controller. According to the invention, the user does not need to spend time in finding a key or worry about key loss, and can easily unlock and start the vehicle only by facing the vehicle, so that the whole driving process is smoother and more pleasant.

Description

Technical Field

[0001] The invention discloses a vehicle unlocking method based on EAR living body recognition and cosine similarity and a vehicle, belonging to the technical field of machine vision. Background Art

[0002] In traditional car unlocking methods, people usually rely on physical keys or remote electronic keys to control the unlocking of car doors. However, these methods often encounter some problems, such as the key may become invalid, lost, stolen or forgotten somewhere, which not only brings inconvenience to the car owner, but also may affect the safety of the vehicle. Summary of the invention

[0003] In view of the defects of the prior art, the present invention proposes a vehicle unlocking method and vehicle based on EAR liveness recognition and cosine similarity. Through the EAR liveness recognition technology, the facial features of the car owner can be accurately identified to ensure that the unlocking request is issued by the real car owner, which not only improves security but also greatly enhances the user experience, so that the car owner does not need to carry any physical keys or remote controls, but can easily unlock the car door through facial recognition.

[0004] The technical solution of the present invention is as follows:

[0005] According to a first aspect of an embodiment of the present invention, a vehicle unlocking method based on EAR liveness recognition and cosine similarity is provided, which is applied to a vehicle unlocking system based on EAR liveness recognition and cosine similarity, and comprises a BRC camera, a door controller and a display screen electrically connected to a control unit respectively, wherein the display screen is connected to a remote control key network, and comprises:

[0006] When the internal sensor of the BRC camera detects that someone is approaching, it starts to obtain a facial image and sends it to the door controller, and the control unit determines whether the person is alive based on the facial image;

[0007] If so, the control unit sends a live status instruction to the display screen, and confirms whether the identified person has been registered through database comparison. If so, it sends a vehicle unlocking instruction to the door controller.

[0008] Preferably, before the BRC camera internal sensor detects that a person is approaching, the facial image acquisition strategy is started and sent to the door controller, the method further includes:

[0009] The remote control key obtains a start command and sends the start command to the display screen;

[0010] After receiving the start-up instruction, the display screen obtains the facial features of the registrant and sends them to execute the BRCID registration strategy.

[0011] Preferably, the executing the BRCID registration policy includes:

[0012] Obtain facial features of the registered person, obtain a grayscale image and a facial area according to the facial features of the registered person, obtain a number of feature points according to the grayscale image and the facial area, convert the number of feature points into corresponding two-dimensional arrays and add them to the landmarklist list;

[0013] Determine whether the extracted facial features are usable based on the corresponding two-dimensional array analysis and comparison:

[0014] Yes, the registration is successful and a registration success instruction is sent to the display screen, and the display screen will receive the registration success instruction and display it;

[0015] No, the registration is unsuccessful and a registration failure instruction is sent to the display screen, and the display screen will receive the registration failure instruction and display it.

[0016] Preferably, the control unit determines whether the face image is alive or not, including:

[0017] The pre-trained deep learning model is read through the dnn module in the OpenCV library. The deep learning model converts the face image into a grayscale image and uses a face detection classifier to detect the face.

[0018] Use the dnn module in the OpenCV library to create a blob and resize the face image video frame to x pixels;

[0019] Each pixel value is mean subtracted, using a specific mean array (104.0, 177.0, 123.0) to subtract the mean of each color channel, and the created blob is passed as input data to the deep learning model, which calculates the depth information of the face based on the input blob;

[0020] Get the depth information by calling the model's forward method, get the required depth value by indexing [0][0], and determine whether the depth value is less than the threshold:

[0021] Yes, it is alive, proceed to the next step;

[0022] No, it is not alive. Please re-judge.

[0023] According to a second aspect of an embodiment of the present invention, there is provided a vehicle, comprising:

[0024] one or more processors;

[0025] a memory for storing the one or more processor-executable instructions;

[0026] Wherein, the one or more processors are configured to:

[0027] Execute the method described in the first aspect of the embodiment of the present invention.

[0028] According to a third aspect of an embodiment of the present invention, a non-transitory computer-readable storage medium is provided. When instructions in the storage medium are executed by a processor of a terminal, the terminal is enabled to execute the method described in the first aspect of the embodiment of the present invention.

[0029] According to a fourth aspect of an embodiment of the present invention, an application product is provided. When the application product is running on a terminal, the terminal executes the method described in the first aspect of the embodiment of the present invention.

[0030] The beneficial effects of the present invention are:

[0031] The present invention provides a vehicle unlocking method and a vehicle based on EAR liveness recognition and cosine similarity, which adopts EAR liveness recognition technology and cosine similarity algorithm for face recognition. This method not only saves the trouble of carrying physical keys or remote control electronic keys, but also greatly reduces the risk of key theft or loss, making the entire unlocking process more convenient and safer. The adopted face recognition technology has the characteristics of fast speed and high accuracy, and can quickly identify the identity of the owner, thereby greatly improving the user's driving experience. Users no longer need to spend time looking for keys or worry about losing keys. They can easily unlock and start the vehicle by facing the vehicle, making the entire driving process smoother and more enjoyable.

[0032] It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] Figure 1 The present invention is a flow chart of a vehicle unlocking method based on EAR liveness recognition and cosine similarity according to an exemplary embodiment.

[0034] Figure 2 The present invention is a schematic block diagram of a vehicle structure according to an exemplary embodiment. DETAILED DESCRIPTION

[0035] The technical solution of the present invention will be described clearly and completely below in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0036] In the description of the present invention, it should be noted that the terms "center", "up", "down", "left", "right", "vertical", "horizontal", "inside", "outside", etc. indicate directions or positional relationships based on the directions or positional relationships shown in the accompanying drawings. They are only for the convenience of describing the present invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific direction, be constructed and operated in a specific direction. Therefore, they cannot be understood as limitations on the present invention.

[0037] In the description of the present invention, it should be noted that, unless otherwise clearly specified and limited, the terms "installed", "connected", and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal communication of two components. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0038] An embodiment of the present invention provides a vehicle unlocking method based on EAR liveness recognition and cosine similarity, which is applied to a vehicle unlocking system based on EAR liveness recognition and cosine similarity, and includes a BRC camera, a door controller and a display screen which are electrically connected to a control unit respectively, and the display screen is connected to a remote control key network.

[0039] Embodiment 1:

[0040] Figure 1 A vehicle unlocking method based on EAR liveness recognition and cosine similarity is shown according to an exemplary embodiment, including:

[0041] Step 101, when the internal sensor of the BRC camera detects that a person is approaching, it starts to obtain a face image and sends it to the door controller. The control unit determines whether the person is alive based on the face image. The specific steps are as follows:

[0042] When the internal sensor of the BRC camera detects that someone is approaching, before starting the strategy of acquiring the face image and sending it to the door controller, it also includes:

[0043] The remote control key obtains the start command and sends it to the display screen. After receiving the start command, the display screen obtains the facial features of the registered person and sends them to the BRC execution ID Registration policy.

[0044] The above execution BRC ID Registration strategy, the specific steps are as follows:

[0045] Obtain the facial features of the registered person, obtain a grayscale image and a facial area based on the facial features of the registered person, obtain several feature points based on the grayscale image and the facial area, convert the several feature points into corresponding two-dimensional arrays and add them to the landmark list List;

[0046] Determine whether the extracted facial features are usable based on the corresponding two-dimensional array analysis and comparison:

[0047] Yes, the registration is successful and a registration success instruction is sent to the display screen, and the display screen will receive the registration success instruction and display it;

[0048] No, the registration is unsuccessful and a registration failure instruction is sent to the display screen, and the display screen will receive the registration failure instruction and display it.

[0049] The control unit determines whether the face is alive based on the face image. The specific process is as follows:

[0050] The pre-trained deep learning model is read through the dnn module in the OpenCV library. The deep learning model converts the face image into a grayscale image and uses a face detection classifier to detect the face.

[0051] Use the dnn module in the OpenCV library to create a blob and resize the face image video frame to x pixels;

[0052] Each pixel value is mean subtracted, using a specific mean array (104.0, 177.0, 123.0) to subtract the mean of each color channel, and the created blob is passed as input data to the deep learning model, which calculates the depth information of the face based on the input blob;

[0053] Get the depth information by calling the model's forward method, get the required depth value by indexing [0][0], and determine whether the depth value is less than the threshold:

[0054] Yes, it is alive, proceed to the next step;

[0055] No, it is not alive. Please re-judge.

[0056] Step 102, the control unit sends a live status instruction to the display screen, and confirms whether the identified person has been registered through database comparison. If so, it sends a vehicle unlocking instruction to the door controller.

[0057] Embodiment 2:

[0058] Figure 2is a block diagram of a vehicle provided in an embodiment of the present application. For example, the vehicle may be a hybrid vehicle, a non-hybrid vehicle, an electric vehicle, a fuel cell vehicle, or other types of vehicles. The vehicle may be an autonomous vehicle, a semi-autonomous vehicle, or a non-autonomous vehicle. The vehicle may also be equipped with a brake-by-wire system.

[0059] Reference Figure 2 The vehicle may include various subsystems, such as an infotainment system, a perception system, a decision control system, a drive system, and a computing platform. The vehicle may also include more or fewer subsystems, and each subsystem may include multiple components. In addition, each subsystem and each component of the vehicle may be interconnected by wire or wireless means.

[0060] In some embodiments, the infotainment system may include a communication system, an entertainment system, and a navigation system, among others.

[0061] The perception system may include several sensors for sensing information about the environment around the vehicle. For example, the perception system may include a global positioning system (the global positioning system may be a GPS system, a BeiDou system, or other positioning systems), an inertial measurement unit (IMU), a laser radar, a millimeter wave radar, an ultrasonic radar, and a camera.

[0062] The decision control system may include a computing system, a vehicle controller, a steering system, a throttle, and a braking system.

[0063] The drive system may include components that provide powered motion for the vehicle. In one embodiment, the drive system may include an engine, an energy source, a transmission system, and wheels. The engine may be one or a combination of an internal combustion engine, an electric motor, and an air compression engine. The engine is capable of converting energy provided by the energy source into mechanical energy.

[0064] Some or all functions of the vehicle are controlled by the computing platform. The computing platform may include at least one processor and a memory, and the processor may execute instructions stored in the memory.

[0065] The processor may be any conventional processor, such as a commercially available CPU. The processor may also include a graphics processor (Graphic Process Unit, GPU), a field programmable gate array (Field Programmable Gate Array, FPGA), a system on chip (System on Chip, SOC), an application specific integrated circuit (Application Specific Integrated Circuit, ASIC) or a combination thereof.

[0066] The memory can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk or optical disk.

[0067] In addition to instructions, the memory may also store data, such as road maps, route information, vehicle location, direction, speed, etc. The data stored in the memory 352 may be used by the computing platform.

[0068] In an embodiment of the present disclosure, the processor can execute instructions to complete all or part of the steps of the above-mentioned vehicle unlocking method based on EAR liveness recognition and cosine similarity.

[0069] Embodiment three:

[0070] In an exemplary embodiment, a computer-readable storage medium is also provided, on which a computer program is stored. When the program is executed by a processor, a vehicle unlocking method based on EAR liveness recognition and cosine similarity as provided in all the inventive embodiments of the present application is implemented.

[0071] Any combination of one or more computer-readable media may be used. A computer-readable medium may be a computer-readable signal medium or a computer-readable storage medium. A computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination thereof. More specific examples (a non-exhaustive list) of computer-readable storage media include: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In this document, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in conjunction with an instruction execution system, device, or device.

[0072] Computer-readable signal media may include a data signal propagated in baseband or as part of a carrier wave, which carries a computer-readable program code. Such propagated data signals may take a variety of forms, including, but not limited to, electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable medium other than a computer-readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device.

[0073] Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

[0074] Computer program code for performing the operations of the present invention may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0075] Embodiment 4:

[0076] In an exemplary embodiment, an application product is also provided, including one or more instructions, which can be executed by the processor 351 of the above-mentioned device to complete the above-mentioned vehicle unlocking method based on EAR liveness recognition and cosine similarity.

[0077] Although the embodiments of the present invention have been disclosed above, they are not limited to the applications listed in the specification and the embodiments. It can be fully applied to various fields suitable for the present invention. For those familiar with the art, additional modifications can be easily realized. Therefore, without departing from the general concept defined by the claims and equivalent scope, the present invention is not limited to the specific details and the illustrations shown and described here.

Claims

1. A vehicle unlocking method based on EAR liveness recognition and cosine similarity, applied to a vehicle unlocking system based on EAR liveness recognition and cosine similarity, comprising a BRC camera, a door controller and a display screen electrically connected to a control unit respectively, wherein the display screen is connected to a remote control key network, characterized in that: include: When the internal sensor of the BRC camera detects that someone is approaching, it starts to obtain a facial image and sends it to the door controller, and the control unit determines whether the person is alive based on the facial image; If so, the control unit sends a live status instruction to the display screen, and confirms whether the identified person has been registered through database comparison. If so, it sends a vehicle unlocking instruction to the door controller.

2. According to claim 1, a vehicle unlocking method based on EAR liveness recognition and cosine similarity is characterized in that: Before the strategy of acquiring the face image and sending it to the door controller is started when the internal sensor of the BRC camera detects that someone is approaching, the method further includes: The remote control key obtains a start command and sends the start command to the display screen; After receiving the start-up instruction, the display screen obtains the facial features of the registrant and sends them to execute the BRCID registration strategy.

3. According to claim 2, a vehicle unlocking method based on EAR liveness recognition and cosine similarity is characterized in that: The executing BRCID registration strategy includes: Obtain facial features of the registered person, obtain a grayscale image and a facial area according to the facial features of the registered person, obtain a number of feature points according to the grayscale image and the facial area, convert the number of feature points into corresponding two-dimensional arrays and add them to the landmarklist list; Determine whether the extracted facial features are usable based on the corresponding two-dimensional array analysis and comparison: Yes, the registration is successful and a registration success instruction is sent to the display screen, and the display screen will receive the registration success instruction and display it; No, the registration is unsuccessful and a registration failure instruction is sent to the display screen, and the display screen will receive the registration failure instruction and display it.

4. According to claim 1, a vehicle unlocking method based on EAR liveness recognition and cosine similarity is characterized in that: The control unit determines whether the face image is alive or not, including: The pre-trained deep learning model is read through the dnn module in the OpenCV library. The deep learning model converts the face image into a grayscale image and uses a face detection classifier to detect the face. Use the dnn module in the OpenCV library to create a blob and resize the face image video frame to x pixels; Each pixel value is mean subtracted, using a specific mean array (104.0, 177.0, 123.0) to subtract the mean of each color channel, and the created blob is passed as input data to the deep learning model, which calculates the depth information of the face based on the input blob; Get the depth information by calling the model's forward method, get the required depth value by indexing [0][0], and determine whether the depth value is less than the threshold: Yes, it is alive, proceed to the next step; No, it is not alive. Please re-judge.

5. A vehicle, characterized in that: include: processor; a memory for storing processor-executable instructions; Wherein, the processor is configured to execute the steps of the vehicle unlocking method based on EAR liveness recognition and cosine similarity as described in any one of claims 1 to 4.

6. A computer-readable storage medium having computer program instructions stored thereon, characterized in that: When the program instructions are executed by a processor, the steps of the vehicle unlocking method based on EAR liveness recognition and cosine similarity as described in any one of claims 1 to 4 are implemented.

Images