Face recognition method, device and equipment and storage medium

Abstract

The application discloses a face recognition method and device, equipment and a storage medium, and belongs to the computer technical field. The method comprises the following steps: acquiring image information of a vehicle interior region, wherein the image information is collected by a camera device installed in the vehicle interior; if the number of faces in the image information is greater than a threshold value, acquiring a voice instruction issued by an object requiring face recognition, wherein the voice instruction is collected by a sound collecting device installed in the vehicle interior; positioning the object issuing the voice instruction according to the sound collecting device to obtain first position information of the object in the vehicle; determining face information of the object in the image information according to the first position information; and performing face recognition on the object according to the face information of the object in the image information. When the number of faces in the image information is greater than the threshold value, the object issuing the voice instruction is positioned, the face information of the object in the image information can be determined, and the efficiency and accuracy of face recognition are improved.

Description

Technical Field

[0001] This application relates to the field of computer technology, and in particular to a face recognition method, apparatus, device, and storage medium. Background Technology

[0002] With the continuous development of computer technology, facial recognition technology is being used more and more widely in people's lives. For example, in vehicle driving scenarios, users can use facial recognition technology to log in to the vehicle system or make payments, which is convenient and fast.

[0003] In related technologies, after the camera equipment installed inside the vehicle collects image information of the interior area of ​​the vehicle, the terminal recognizes the facial information in the image information. Once the recognition is successful, the recognized facial information can be used for operations such as login and payment.

[0004] In this method, when the image information contains multiple facial information, the terminal may mistakenly use the wrong facial information for operations such as login and payment, which reduces the efficiency and accuracy of facial recognition. Summary of the Invention

[0005] This application provides a face recognition method, apparatus, device, and storage medium, which can be used to solve problems existing in related technologies. The technical solution is as follows:

[0006] On one hand, embodiments of this application provide a face recognition method, the method comprising:

[0007] Acquire image information of the interior area of ​​the vehicle, the image information being acquired by a camera device installed inside the vehicle;

[0008] If the number of faces in the image information is greater than a threshold, the voice command issued by the object that needs to be face recognition is obtained, and the voice command is collected by a sound acquisition device installed inside the vehicle.

[0009] The sound acquisition device locates the object that issues the voice command, thereby obtaining the object's first location information within the vehicle;

[0010] The facial information of the object in the image information is determined based on the first location information;

[0011] Face recognition is performed on the object based on the facial information of the object in the image information.

[0012] In one possible implementation, before locating the object issuing the voice command based on the sound acquisition device to obtain the object's first location information within the vehicle, the method further includes:

[0013] The voice command is matched with a voice prompt, which is broadcast by the vehicle's voice system and serves to indicate the content of the voice command.

[0014] In one possible implementation, before matching the voice command with the voice prompt information, the method further includes:

[0015] If the number of faces is greater than the threshold, the voice prompt information broadcast by the vehicle's voice system is obtained.

[0016] In one possible implementation, determining the facial information of the object in the image information based on the first location information includes:

[0017] Based on the first location information, determine the second location information of the object in the image information;

[0018] The facial information corresponding to the second location information is taken as the facial information of the object in the image information.

[0019] In one possible implementation, determining the second location information of the object in the image information based on the first location information includes:

[0020] The first location information is mapped onto the image information to obtain a mapping result;

[0021] Based on the mapping result, it is indicated that there is location information in the image information that corresponds to the first location information, and the location information is used as the second location information of the object in the image information.

[0022] In one possible implementation, the voice prompt information includes either login prompt information or payment prompt information.

[0023] In one possible implementation, the voice command includes either a login command or a payment command, wherein the payment command is used to instruct the user to make a payment for a mobile payment bill by performing facial recognition on the object.

[0024] On the other hand, a facial recognition device is provided, the device comprising:

[0025] An acquisition module is used to acquire image information of the interior area of ​​the vehicle, the image information being collected by a camera device installed inside the vehicle;

[0026] The acquisition module is further configured to acquire, if the number of faces in the image information is greater than a threshold, a voice command issued by the object to be face recognition, wherein the voice command is acquired by a sound acquisition device installed inside the vehicle.

[0027] The determining module is used to locate the object that issues the voice command based on the sound acquisition device, and obtain the first location information of the object in the vehicle;

[0028] The determining module is further configured to determine the facial information of the object in the image information based on the first location information;

[0029] The recognition module is used to perform face recognition on the object based on the face information of the object in the image information.

[0030] In one possible implementation, the device further includes:

[0031] The matching module is used to match the voice command with voice prompt information, which is broadcast by the vehicle's voice system and is used to prompt the content of the voice command.

[0032] In one possible implementation, the acquisition module is further configured to acquire the voice prompt information broadcast by the vehicle's voice system if the number of faces is greater than the threshold.

[0033] In one possible implementation, the determining module is configured to determine a second location information of the object in the image information based on the first location information;

[0034] The facial information corresponding to the second location information is taken as the facial information of the object in the image information.

[0035] In one possible implementation, the determining module is used to map the first location information to the image information to obtain a mapping result;

[0036] Based on the mapping result, it is indicated that there is location information in the image information that corresponds to the first location information, and the location information is used as the second location information of the object in the image information.

[0037] In one possible implementation, the voice prompt information includes either login prompt information or payment prompt information.

[0038] In one possible implementation, the voice command includes either a login command or a payment command, wherein the payment command is used to instruct the user to make a payment for a mobile payment bill by performing facial recognition on the object.

[0039] On the other hand, a computer device is provided, the computer device including a processor and a memory, the memory storing at least one computer program, the at least one computer program being loaded and executed by the processor to enable the computer device to implement any of the above-described face recognition methods.

[0040] On the other hand, a computer-readable storage medium is also provided, wherein at least one computer program is stored in the computer-readable storage medium, the at least one computer program being loaded and executed by a processor to enable a computer to implement any of the above-described face recognition methods.

[0041] On the other hand, a computer program product or computer program is also provided, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform any of the face recognition methods described above.

[0042] The technical solution provided in this application has at least the following beneficial effects:

[0043] In this embodiment, when the number of faces in the image information exceeds a threshold, the first location information of the object issuing the voice command is obtained by locating the object, thereby determining the object's facial information in the image information, and performing face recognition based on this facial information. Compared to methods that can only recognize a unique face in the image information, this method can obtain the face information of the object in the image information by locating the object issuing the voice command when there are multiple faces in the image information, thus improving the efficiency and accuracy of face recognition. Attached Figure Description

[0044] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0045] Figure 1 This is a schematic diagram of an implementation environment provided in an embodiment of this application;

[0046] Figure 2 This is a flowchart of a face recognition method provided in an embodiment of this application;

[0047] Figure 3 This is a schematic diagram of the background control of a face recognition method provided in an embodiment of this application;

[0048] Figure 4 This is a logic judgment diagram of a face recognition method provided in an embodiment of this application;

[0049] Figure 5 This is a schematic diagram of the structure of a face recognition device provided in an embodiment of this application;

[0050] Figure 6 This is a schematic diagram of the structure of a server provided in an embodiment of this application;

[0051] Figure 7 This is a schematic diagram of the structure of a terminal provided in an embodiment of this application. Detailed Implementation

[0052] To make the objectives, technical solutions, and advantages of this application clearer, the embodiments of this application will be described in further detail below with reference to the accompanying drawings.

[0053] This application provides a face recognition method. Please refer to the following embodiments. Figure 1 The diagram illustrates the implementation environment of the method provided in this embodiment. Taking the application of this method in a vehicle driving scenario as an example, the implementation environment may include: terminal 11 and server 12.

[0054] The terminal 11 is equipped with an application or webpage capable of facial recognition. When the application or webpage requires facial recognition, the method provided in this embodiment can be used for recognition. The server 12 can store the facial information that needs to be recognized, and the terminal 11 can obtain the facial information that needs to be recognized from the server 12. Of course, the terminal 11 can also store the obtained facial information.

[0055] Optionally, terminal 11 can be an intelligent device such as an in-vehicle terminal or a smart vehicle system. Server 12 can be a single server, a server cluster consisting of multiple servers, or a cloud computing service center. Terminal 11 and server 12 establish a communication connection via wired or wireless network.

[0056] Those skilled in the art should understand that the above-described terminal 11 and server 12 are merely examples. Other existing or future terminals or servers that are applicable to this application should also be included within the scope of protection of this application, and are hereby incorporated by reference.

[0057] This application provides a face recognition method, which can be applied to the above-mentioned... Figure 1 The implementation environment is shown. Figure 2 As shown, taking the application of this method to a terminal as an example, the method includes steps 201-205.

[0058] In step 201, image information of the interior area of ​​the vehicle is acquired by a camera device installed inside the vehicle.

[0059] This application does not limit the type of camera device, as long as it can capture images of people seated inside the vehicle. For example, the camera device can be a camera with an Occupant Monitoring System (OMS). The vehicle terminal sends a shooting command to the camera device inside the vehicle. After receiving the shooting command, the camera device captures images of the area inside the vehicle, obtaining image information of the vehicle's interior area, and then uploads this image information to the terminal, allowing the terminal to obtain the image information of the area inside the vehicle.

[0060] In step 202, if the number of faces in the image information is greater than the threshold, the voice command issued by the object to be face recognition is obtained. The voice command is obtained by the sound acquisition device installed inside the vehicle.

[0061] After acquiring image information from inside the vehicle, the terminal detects the number of faces in the image. If the terminal detects that the number of faces in the image is greater than a threshold, it sends a voice acquisition command to the vehicle's internal sound acquisition device. This command instructs the device to acquire the voice commands issued by the objects requiring face recognition. Upon receiving the voice acquisition command, the sound acquisition device acquires the voice commands and then uploads them to the terminal. This embodiment does not limit the threshold value; for example, the threshold can be 1, meaning that when the number of faces in the image is greater than 1, the terminal acquires the voice commands issued by the objects requiring face recognition. This embodiment also does not limit the type of sound acquisition device, as long as it can acquire voice from inside the vehicle. For example, the sound acquisition device can be a microphone array. This application does not limit the type of microphone array; for example, linear arrays, planar arrays, and stereo arrays can be used.

[0062] Furthermore, the embodiments of this application can be applied to login scenarios and payment scenarios, etc. Therefore, in one possible implementation, the voice command includes either a login command or a payment command. This application does not limit the function of the login command. For example, the login command can be used to instruct the user to log in to the vehicle system by performing facial recognition on an object that requires facial recognition, or to log in to mobile applications, etc., through facial recognition. Similarly, the payment command can be used to instruct the user to perform facial recognition on an object that requires facial recognition, thereby enabling the user to pay bills on a mobile device.

[0063] In this embodiment, after the terminal determines that the number of faces in the image information is greater than a threshold, it needs to first obtain the voice prompt information broadcast by the vehicle's voice system. Exemplarily, the voice prompt information is used to prompt the content of the voice command. This embodiment does not limit the content of the voice prompt information, as long as it prompts the occupants of the vehicle to speak the corresponding voice command. Therefore, in one possible implementation, the voice prompt information includes login prompt information and payment prompt information. Taking the login scenario in this embodiment as an example, the content of the voice prompt information could be "Multiple occupants detected; please say 'login' if you need to log in."

[0064] In one possible implementation, after the terminal obtains the voice prompt information broadcast by the vehicle's voice system, it needs to match the voice command with the voice prompt information.

[0065] For example, if the voice prompt message is "Multiple people have been detected in the vehicle. Please say 'login' if you need to log in," then when the terminal receives the voice command "login," it will convert the voice command into text and compare the converted text with the voice prompt message. If the two contents match, it can be determined that the voice command and the voice prompt message have matched successfully.

[0066] In step 203, the object issuing the voice command is located by the sound acquisition device to obtain the object's first location information inside the vehicle.

[0067] According to step 202, the sound acquisition device can not only acquire voice commands issued by the object requiring facial recognition, but also locate the object issuing the voice commands. This application embodiment does not limit the location method. For example, time difference of arrival, beamforming, and acoustic holography can be used to determine the object's position within the vehicle, and this position can be used as the first position information of the object issuing the voice commands within the vehicle. For example, the first position information can be the passenger seat, the driver's seat, etc.

[0068] In step 204, the facial information of the object in the image information is determined based on the first location information.

[0069] After the terminal obtains the first location information of the object issuing the voice command within the vehicle, to determine the object's facial information in the image information, it must first determine the object's second location information in the image information based on the first location information. In one possible implementation, determining the object's second location information in the image information based on the first location information includes: mapping the first location information to the image information to obtain a mapping result; indicating, based on the mapping result, that there is location information in the image information corresponding to the first location information, and using the location information as the object's second location information in the image information.

[0070] This application does not limit the mapping method. Taking the first location information of the object in the vehicle as the passenger seat as an example, after the terminal obtains that the object's location in the vehicle is the passenger seat, it detects the image information and identifies regions in the image information that match the characteristics of the passenger seat location. This application also does not limit the terminal's detection method. For example, the terminal can be trained through machine learning to detect various regions inside the vehicle. If the terminal detects the location information corresponding to the passenger seat in the image information, it can use that location information as the object's second location information in the image information. In one possible implementation, the facial information corresponding to the second location information is used as the object's facial information in the image information.

[0071] After obtaining the second location information of the object to be recognized in the image information, the terminal uses the facial information corresponding to that information as the object's facial information in the image information, which is the facial information that the terminal needs to recognize for login or payment operations.

[0072] In step 205, face recognition is performed on the object based on the face information of the object in the image information.

[0073] In this embodiment, if the terminal detects only one face in the image information, meaning there is only one face in the image information, the terminal can directly recognize that single face. If the terminal detects multiple faces in the image information, it needs to determine the face information of the object requiring face recognition in the image information according to steps 202 to 204 described above. After determining the face information of the object in the image information, the terminal can perform face recognition on that face information to facilitate further operations such as login or payment.

[0074] Figure 3 This is a schematic diagram of the backend control of a facial recognition method. The hardware includes camera equipment and sound acquisition equipment. Figure 3 In this system, the camera is used for image capture, and the microphone array is used for sound acquisition. The image information captured by the camera inside the vehicle can be used for multi-face detection, and the voice commands captured by the microphone array can be used to locate the object issuing the voice command. The image information corresponds to... Figure 3 Image data and corresponding voice commands Figure 3 The system uses audio data. Through multi-face detection and voice localization, the facial information of the person to be identified can be determined. Furthermore, the multi-face detection, voice localization, and face identification processes are all completed within the facial security authentication system.

[0075] Figure 4 This is a logic diagram of a face recognition method. Figure 4In step 401, the terminal enters the facial recognition login or payment page. After entering the facial recognition login or payment page, the terminal needs to control the camera device located inside the vehicle to collect image information inside the vehicle. This image information can also be called image data, and the process of collecting image data is step 402. After the terminal obtains the image information, it executes step 403, which is to detect whether there are multiple facial images in the image information. If there are no multiple facial images in the image information, that is, if there is only one facial image in the image information, it executes step 404, and the terminal directly performs facial authentication on that single facial image. If there are multiple facial images in the image information, it executes step 405, and the terminal controls the vehicle's voice system to broadcast voice prompts. Figure 4 The voice prompt message is: "Multiple occupants detected. Those who need to log in, please say 'Log in' or 'Pay'." After receiving the voice prompt, the person inside the vehicle requiring facial recognition will issue a voice command, which can be either "Log in" or "Pay." This process corresponds to... Figure 4 Step 406. Subsequently, the terminal controls the sound acquisition device installed in the vehicle to receive voice commands from the object requiring facial recognition within the vehicle, and performs keyword matching. This step corresponds to... Figure 4 In step 407, the microphone array is the sound acquisition device, the sound data is the voice command, and keyword matching is matching the voice command with the voice prompt information. After successful keyword matching, step 408 is executed, whereby the terminal controls the sound acquisition device to locate the object providing the sound data, obtain the object's location information inside the vehicle, and then determine the object's facial information in the image information. Specifically, locating the object providing the sound data is equivalent to locating the object that issued the voice command and requires facial recognition.

[0076] In this embodiment, when the number of faces in the image information exceeds a threshold, the first location information of the object issuing the voice command is obtained by locating the object, thereby determining the object's facial information in the image information, and performing face recognition based on this facial information. Compared to methods that can only recognize a unique face in the image information, this method can obtain the face information of the object in the image information by locating the object issuing the voice command when there are multiple faces in the image information, thus improving the efficiency and accuracy of face recognition.

[0077] See Figure 5 This application provides a face recognition device, which includes:

[0078] The acquisition module 501 is used to acquire image information of the interior area of ​​the vehicle. The image information is acquired by a camera device installed inside the vehicle.

[0079] The acquisition module 501 is also used to acquire the voice command issued by the object to be face recognition if the number of faces in the image information is greater than the threshold. The voice command is acquired by the sound acquisition device installed inside the vehicle.

[0080] The determination module 502 is used to locate the object that issues the voice command based on the sound acquisition device, and obtain the first location information of the object inside the vehicle;

[0081] The determining module 502 is further configured to determine the face information of the object in the image information based on the first location information;

[0082] The recognition module 503 is used to perform face recognition on an object based on the object's facial information in the image information.

[0083] In one possible implementation, the device further includes:

[0084] The matching module is used to match voice commands with voice prompts, which are broadcast by the vehicle's voice system and are used to indicate the content of the voice commands.

[0085] In one possible implementation, the acquisition module 501 is further configured to acquire the voice prompt information broadcast by the vehicle's voice system if the number of faces exceeds a threshold.

[0086] In one possible implementation, the determining module 502 is used to determine the second position information of the object in the image information based on the first position information;

[0087] The facial information corresponding to the second location information is used as the facial information of the object in the image information.

[0088] In one possible implementation, the determining module 502 is used to map the first position information to the image information to obtain the mapping result;

[0089] Based on the mapping result indicating that there is position information in the image information corresponding to the first position information, the position information is used as the second position information of the object in the image information.

[0090] In one possible implementation, the voice prompts may include either login prompts or payment prompts.

[0091] In one possible implementation, the voice command includes either a login command or a payment command. The payment command is used to instruct the user to make a payment on a mobile payment bill by performing facial recognition on the object.

[0092] In this embodiment, when the number of faces in the image information exceeds a threshold, the first location information of the object issuing the voice command is obtained by locating the object, thereby determining the object's facial information in the image information, and performing face recognition based on this facial information. Compared to devices that can only recognize a unique face in the image information, this device can obtain the face information of the object issuing the voice command in the image information when there are multiple faces in the image information, thus improving the efficiency and accuracy of face recognition.

[0093] It should be noted that the apparatus provided in the above embodiments is only illustrated by the division of the above functional modules. In practical applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. In addition, the apparatus and method embodiments provided in the above embodiments belong to the same concept, and their specific implementation process can be found in the method embodiments, which will not be repeated here.

[0094] Figure 6 This is a schematic diagram of a server structure provided in an embodiment of this application. The server can vary significantly due to differences in configuration or performance. It may include one or more processors 601 and one or more memories 602. The processor 601 may be a Central Processing Unit (CPU). The one or more memories 602 store at least one computer program, which is loaded and executed by the one or more processors 601 to enable the server to implement the face recognition methods provided in the various method embodiments described above. Of course, the server may also have wired or wireless network interfaces, a keyboard, and input / output interfaces for input and output. The server may also include other components for implementing device functions, which will not be elaborated here.

[0095] Figure 7 This is a schematic diagram of the structure of a terminal provided in an embodiment of this application. The terminal can be a smartphone, tablet computer, laptop computer, or desktop computer. The terminal may also be referred to as user equipment, portable terminal, laptop terminal, desktop terminal, or other names.

[0096] Typically, a terminal includes a processor 1501 and a memory 1502.

[0097] Processor 1501 may include one or more processing cores, such as a quad-core processor, an octa-core processor, etc. Processor 1501 may be implemented using at least one hardware form selected from DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). Processor 1501 may also include a main processor and a coprocessor. The main processor, also known as a CPU (Central Processing Unit), is used to process data in the wake-up state; the coprocessor is a low-power processor used to process data in the standby state. In some embodiments, processor 1501 may integrate a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content required to be displayed on the screen. In some embodiments, processor 1501 may also include an AI (Artificial Intelligence) processor, which is used to handle computational operations related to machine learning.

[0098] The memory 1502 may include one or more computer-readable storage media, which may be non-transitory. The memory 1502 may also include high-speed random access memory and non-volatile memory, such as one or more disk storage devices or flash memory devices. In some embodiments, the non-transitory computer-readable storage media in the memory 1502 are used to store at least one instruction, which is executed by the processor 1501 to cause the terminal to implement the face recognition method provided in the method embodiments of this application.

[0099] In some embodiments, the terminal may also optionally include: a peripheral device interface 1503 and at least one peripheral device. The processor 1501, memory 1502, and peripheral device interface 1503 can be connected via a bus or signal line. Each peripheral device can be connected to the peripheral device interface 1503 via a bus, signal line, or circuit board. Specifically, the peripheral device includes at least one of: a radio frequency circuit 1504, a display screen 1505, a camera assembly 1506, an audio circuit 1507, a positioning assembly 1508, and a power supply 1509.

[0100] Peripheral interface 1503 can be used to connect at least one I / O (Input / Output) related peripheral device to processor 1501 and memory 1502. In some embodiments, processor 1501, memory 1502 and peripheral interface 1503 are integrated on the same chip or circuit board; in some other embodiments, any one or two of processor 1501, memory 1502 and peripheral interface 1503 can be implemented on separate chips or circuit boards, which is not limited in this embodiment.

[0101] The radio frequency (RF) circuit 1504 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The RF circuit 1504 communicates with communication networks and other communication devices via electromagnetic signals. The RF circuit 1504 converts electrical signals into electromagnetic signals for transmission, or converts received electromagnetic signals back into electrical signals. Optionally, the RF circuit 1504 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, etc. The RF circuit 1504 can communicate with other terminals through at least one wireless communication protocol. This wireless communication protocol includes, but is not limited to: metropolitan area networks (MANs), various generations of mobile communication networks (2G, 3G, 4G, and 5G), wireless local area networks (WLANs), and / or WiFi (Wireless Fidelity) networks. In some embodiments, the RF circuit 1504 may also include circuitry related to NFC (Near Field Communication), which is not limited in this application.

[0102] Display screen 1505 is used to display a UI (User Interface). This UI may include graphics, text, icons, videos, and any combination thereof. When display screen 1505 is a touch display screen, it also has the ability to collect touch signals on or above its surface. These touch signals can be input as control signals to processor 1501 for processing. In this case, display screen 1505 can also be used to provide virtual buttons and / or a virtual keyboard, also known as soft buttons and / or a soft keyboard. In some embodiments, display screen 1505 can be a single screen, located on the front panel of the terminal; in other embodiments, display screen 1505 can be at least two screens, respectively located on different surfaces of the terminal or in a folded design; in other embodiments, display screen 1505 can be a flexible display screen, located on a curved or folded surface of the terminal. Furthermore, display screen 1505 can be configured as a non-rectangular, irregular shape, i.e., a non-rectangular screen. Display screen 1505 can be made of materials such as LCD (Liquid Crystal Display) or OLED (Organic Light-Emitting Diode).

[0103] The camera assembly 1506 is used to acquire images or videos. Optionally, the camera assembly 1506 includes a front-facing camera and a rear-facing camera. Typically, the front-facing camera is located on the front panel of the terminal, and the rear-facing camera is located on the back of the terminal. In some embodiments, there are at least two rear-facing cameras, which are any one of a main camera, a depth-sensing camera, a wide-angle camera, and a telephoto camera, to achieve background blurring by fusion of the main camera and the depth-sensing camera, panoramic shooting by fusion of the main camera and the wide-angle camera, VR (Virtual Reality) shooting, or other fusion shooting functions. In some embodiments, the camera assembly 1506 may also include a flash. The flash can be a single-color temperature flash or a dual-color temperature flash. A dual-color temperature flash refers to a combination of a warm-light flash and a cool-light flash, which can be used for light compensation at different color temperatures.

[0104] The audio circuit 1507 may include a microphone and a speaker. The microphone is used to collect sound waves from the user and the environment, converting the sound waves into electrical signals that are input to the processor 1501 for processing, or input to the radio frequency circuit 1504 for voice communication. For stereo sound acquisition or noise reduction purposes, multiple microphones may be used, each positioned at a different location on the terminal. The microphone may also be an array microphone or an omnidirectional microphone. The speaker is used to convert electrical signals from the processor 1501 or the radio frequency circuit 1504 into sound waves. The speaker may be a conventional diaphragm speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can convert electrical signals not only into audible sound waves but also into inaudible sound waves for purposes such as distance measurement. In some embodiments, the audio circuit 1507 may also include a headphone jack.

[0105] The positioning component 1508 is used to locate the current geographical location of the terminal in order to enable navigation or LBS (Location Based Service).

[0106] Power supply 1509 is used to power the various components in the terminal. Power supply 1509 can be AC ​​power, DC power, a disposable battery, or a rechargeable battery. When power supply 1509 includes a rechargeable battery, the rechargeable battery can support wired or wireless charging. The rechargeable battery can also be used to support fast charging technology.

[0107] In some embodiments, the terminal further includes one or more sensors 1510. The one or more sensors 1510 include, but are not limited to: an accelerometer 1511, a gyroscope 1512, a pressure sensor 1513, a fingerprint sensor 1514, an optical sensor 1515, and a proximity sensor 1516.

[0108] Accelerometer 1511 can detect the magnitude of acceleration along the three coordinate axes of a coordinate system established by the terminal. For example, accelerometer 1511 can be used to detect the components of gravitational acceleration along the three coordinate axes. Processor 1501 can control display screen 1505 to display the user interface in either a landscape or portrait view based on the gravitational acceleration signal acquired by accelerometer 1511. Accelerometer 1511 can also be used for games or for acquiring user motion data.

[0109] The gyroscope sensor 1512 can detect the terminal's orientation and rotation angle. The gyroscope sensor 1512, in conjunction with the accelerometer sensor 1511, can collect the user's 3D movements on the terminal. Based on the data collected by the gyroscope sensor 1512, the processor 1501 can perform the following functions: motion sensing (e.g., changing the UI based on the user's tilt), image stabilization during shooting, game control, and inertial navigation.

[0110] The pressure sensor 1513 can be disposed on the side bezel of the terminal and / or the lower layer of the display screen 1505. When the pressure sensor 1513 is disposed on the side bezel of the terminal, it can detect the user's grip signal on the terminal, and the processor 1501 can perform left / right hand recognition or quick operation based on the grip signal collected by the pressure sensor 1513. When the pressure sensor 1513 is disposed on the lower layer of the display screen 1505, the processor 1501 can control the operable controls on the UI interface based on the user's pressure operation on the display screen 1505. The operable controls include at least one of button controls, scroll bar controls, icon controls, and menu controls.

[0111] The fingerprint sensor 1514 is used to collect a user's fingerprint. The processor 1501 identifies the user based on the fingerprint collected by the fingerprint sensor 1514, or vice versa. When the user's identity is identified as trusted, the processor 1501 authorizes the user to perform relevant sensitive operations, including unlocking the screen, viewing encrypted information, downloading software, making payments, and changing settings. The fingerprint sensor 1514 can be located on the front, back, or side of the terminal. When the terminal has physical buttons or a manufacturer's logo, the fingerprint sensor 1514 can be integrated with the physical buttons or the manufacturer's logo.

[0112] Optical sensor 1515 is used to collect ambient light intensity. In one embodiment, processor 1501 can control the display brightness of display screen 1505 based on the ambient light intensity collected by optical sensor 1515. Specifically, when the ambient light intensity is high, the display brightness of display screen 1505 is increased; when the ambient light intensity is low, the display brightness of display screen 1505 is decreased. In another embodiment, processor 1501 can also dynamically adjust the shooting parameters of camera assembly 1506 based on the ambient light intensity collected by optical sensor 1515.

[0113] The proximity sensor 1516, also known as a distance sensor, is typically installed on the front panel of the terminal. The proximity sensor 1516 is used to detect the distance between the user and the front of the terminal. In one embodiment, when the proximity sensor 1516 detects that the distance between the user and the front of the terminal is gradually decreasing, the processor 1501 controls the display screen 1505 to switch from a screen-on state to a screen-off state; when the proximity sensor 1516 detects that the distance between the user and the front of the terminal is gradually increasing, the processor 1501 controls the display screen 1505 to switch from a screen-off state to a screen-on state.

[0114] Those skilled in the art will understand that Figure 7 The structure shown does not constitute a limitation on the terminal and may include more or fewer components than shown, or combine certain components, or use different component arrangements.

[0115] In an exemplary embodiment, a computer device is also provided, comprising a processor and a memory, wherein at least one computer program is stored in the memory. The at least one computer program is loaded and executed by one or more processors to enable the computer device to implement any of the aforementioned face recognition methods.

[0116] In an exemplary embodiment, a computer-readable storage medium is also provided, which stores at least one computer program that is loaded and executed by a processor of a computer device to enable the computer to implement any of the above-described face recognition methods.

[0117] In one possible implementation, the aforementioned computer-readable storage medium may be a read-only memory (ROM), a random access memory (RAM), a compact disc read-only memory (CD-ROM), magnetic tape, floppy disk, and optical data storage device, etc.

[0118] In an exemplary embodiment, a computer program product or computer program is also provided, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform any of the aforementioned face recognition methods.

[0119] It should be noted that all information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, stored data, displayed data, etc.), and signals involved in this application have been authorized by the user or fully authorized by all parties, and the collection, use, and processing of related data must comply with the relevant laws, regulations, and standards of the relevant countries and regions. For example, the image information of the vehicle's interior area involved in this application was obtained with full authorization.

[0120] It should be understood that "multiple" as used in this article refers to two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone. The character " / " generally indicates that the preceding and following related objects have an "or" relationship.

[0121] It should be noted that the terms "first," "second," etc. (if applicable) in the specification and claims of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented in orders other than those illustrated or described herein. The embodiments described in the above exemplary embodiments do not represent all embodiments consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this application as detailed in the appended claims.

[0122] The above description is merely an exemplary embodiment of this application and is not intended to limit this application. Any modifications, equivalent substitutions, improvements, etc., made within the principles of this application should be included within the protection scope of this application.

Claims

1. A face recognition method, characterized in that, The method includes: Acquire image information of the interior area of ​​the vehicle, the image information being acquired by a camera device installed inside the vehicle; If the number of faces in the image information is greater than a threshold, the voice command issued by the object that needs to be face recognition is obtained, and the voice command is collected by a sound acquisition device installed inside the vehicle. The voice command is matched with the voice prompt information, which is broadcast by the vehicle's voice system and is used to prompt the content of the voice command. The sound acquisition device locates the object that issues the voice command, thereby obtaining the object's first location information within the vehicle; The image information is detected to identify regions in the image information that match the features of the first location information, and a mapping result is obtained. Based on the mapping result, it is indicated that there is location information in the image information that corresponds to the first location information, and the location information is used as the second location information of the object in the image information; The facial information corresponding to the second location information is taken as the facial information of the object in the image information; Face recognition is performed on the object based on the facial information of the object in the image information.

2. The method according to claim 1, characterized in that, Before matching the voice command with the voice prompt information, the method further includes: If the number of faces is greater than the threshold, the voice prompt information broadcast by the vehicle's voice system is obtained.

3. The method according to claim 1, characterized in that, The voice prompts include either login prompts or payment prompts.

4. The method according to any one of claims 1-3, characterized in that, The voice command includes either a login command or a payment command. The payment command is used to instruct the user to make a payment on a mobile payment bill by performing facial recognition on the object.

5. A face recognition device, characterized in that, The device includes: An acquisition module is used to acquire image information of the interior area of ​​the vehicle, the image information being collected by a camera device installed inside the vehicle; The acquisition module is further configured to acquire, if the number of faces in the image information is greater than a threshold, a voice command issued by the object to be face recognition, wherein the voice command is acquired by a sound acquisition device installed inside the vehicle. A matching module is used to match the voice command with voice prompt information, which is broadcast by the vehicle's voice system and is used to prompt the content of the voice command. The determining module is used to locate the object that issues the voice command based on the sound acquisition device, and obtain the first location information of the object in the vehicle; The determining module is further configured to detect the image information, detect regions in the image information that conform to the features of the first location information, and obtain a mapping result; based on the mapping result, indicate that there is location information in the image information corresponding to the first location information, and use the location information as the second location information of the object in the image information; use the face information corresponding to the second location information as the face information of the object in the image information; The recognition module is used to perform face recognition on the object based on the face information of the object in the image information.

6. A computer device, characterized in that, The computer device includes a processor and a memory, the memory storing at least one computer program, the at least one computer program being loaded and executed by the processor to enable the computer device to implement the face recognition method as described in any one of claims 1 to 4.

7. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores at least one computer program, which is loaded and executed by a processor to enable the computer to implement the face recognition method as described in any one of claims 1 to 4.

Images