Identity recognition method and electronic equipment

Abstract

The embodiment of the invention is suitable for the field of data processing, provides an identity recognition method and electronic equipment, can enable the electronic equipment to carry out continuous identity recognition in various complex scenes, and improves the convenience of using the electronic equipment, and comprises the following steps: in a first scene, obtaining first biological characteristic information to carry out continuous identity recognition, the method comprises the steps of obtaining a first recognition result, sending out an ultrasonic signal when the electronic equipment is switched from a first scene to a second scene, obtaining an echo signal corresponding to the ultrasonic signal, and then determining a second recognition result based on the echo signal and the first recognition result, the second scene including a scene in which biological feature information cannot be obtained.

Description

Technical Field

[0001] The present application relates to the field of data processing, and more specifically, to an identity recognition method and an electronic device. Background Art

[0002] In the process of using electronic devices, users have gradually shown the need to better protect their personal privacy based on the improvement of convenience. In order to meet the needs of users, some electronic devices provide the function of continuous identity recognition.

[0003] The function of continuous identity recognition may mean that the electronic device periodically collects the user's facial information according to a preset period, and determines whether the user has the authority to use the electronic device based on the facial information. If the user has the authority to use the electronic device, the information that can be viewed within the authority is displayed to the user. If the user does not have the authority to use the electronic device, the relevant information is not displayed to the user. However, when the user is using the electronic device, there may be a situation where the user's facial information cannot be collected due to environmental changes. In this case, the electronic device cannot realize the function of continuous identity recognition, which affects the convenience of the user in using the electronic device.

[0004] Based on this, how to achieve continuous identity recognition in a complex environment to improve the convenience of users using electronic devices has become an urgent problem to be solved. Summary of the invention

[0005] The present application provides an identity recognition method that can realize continuous identity recognition function in a complex environment, thereby improving the convenience of users in using electronic devices.

[0006] In a first aspect, an identity recognition method is provided, the method being applied in an electronic device, the method comprising: In the first scenario, first biometric information is obtained for continuous identity recognition to obtain a first recognition result; If the electronic device switches from the first scene to the second scene, emits an ultrasonic signal, and obtains an echo signal corresponding to the ultrasonic signal, the second scene includes a scene in which the biometric information cannot be obtained; A second recognition result is determined based on the echo signal and the first recognition result.

[0007] The first biometric information includes the facial image, eye pattern image, and other feature information that can identify the user's body, which is not limited in the present embodiment. The first user may refer to a user who is using an electronic device, for example, the first user refers to a user who is holding the electronic device.

[0008] The first device result may refer to the result of identity recognition performed by the electronic device. For example, the first recognition result may mean that the user holding the electronic device has the authority to use the electronic device, or the first recognition result may mean that the user holding the electronic device does not have the authority to use the electronic device.

[0009] The first scenario may refer to a scenario in which the user's biometric information (ie, the first biometric information) can be collected, and the second scenario may refer to a scenario in which the user's biometric information cannot be collected.

[0010] The identity recognition method provided in the embodiment of the present application is applied to an electronic device. In a first scenario, first biometric information is obtained for continuous identity recognition to obtain a first recognition result. When the electronic device switches from the first scenario to the second scenario, an ultrasonic signal is emitted, and an echo signal corresponding to the ultrasonic signal is acquired. Then, a second recognition result is determined based on the echo signal and the first recognition result. The second scenario includes a scenario in which the biometric information cannot be obtained. This is equivalent to the electronic device being able to emit an ultrasonic signal in a scenario in which the biometric information cannot be obtained, and based on the echo signal corresponding to the ultrasonic signal and the first recognition result determined in a scenario in which the biometric information can be obtained, continuously identifying the user's identity information, i.e., the second recognition result, so that the electronic device can perform continuous identity recognition in a variety of complex scenarios, thereby improving the convenience of using the electronic device.

[0011] In combination with the first aspect, in certain embodiments of the first aspect, determining the second recognition result based on the echo signal and the first recognition result includes: determining whether the first user in the first scene is away from the electronic device based on the echo signal; if the first user is not away from the electronic device, determining the second recognition result based on the first recognition result.

[0012] It is understandable that if the first user does not move away from the electronic device, it means that the user using the electronic device has not changed. Therefore, the electronic device can maintain the first recognition result in the first scene as the second recognition result in the second scene.

[0013] In some possible cases, the first user is not far away from the electronic device, but other users are close to the electronic device. In this case, the electronic device continues to determine whether other users are close to the electronic device. If no other users are close to the electronic device, the electronic device can maintain the first recognition result of the first scene as the second recognition result in the second scene; if other users are close to the electronic device, since the biometric information of other users cannot be collected in the second scene, the identity of other users close to the electronic device cannot be identified. Therefore, the electronic device can not allow the user to use the electronic device when other users are close to the electronic device, thereby improving the safety of using the electronic device.

[0014] In combination with the first aspect, in certain embodiments of the first aspect, if the first user is not far away from the electronic device, determining the second identification result based on the first identification result includes: if the first user is not far away from the electronic device, determining whether a third user is close to the electronic device based on the echo signal; if there is no third user close to the electronic device, using the first identification result as the second identification result.

[0015] The identity recognition method provided in the embodiment of the present application maintains the first recognition result in the first scene as the second recognition result in the second scene when it is determined in the second scene that the first user is not far away from the electronic device and there is no third user close to the electronic device, so that the electronic device can perform continuous identity recognition in a variety of complex scenarios, thereby improving the convenience of using the electronic device.

[0016] In combination with the first aspect, in certain embodiments of the first aspect, if there is a third user close to the electronic device, when the second scene switches to the first scene, second biometric information is obtained; and a third recognition result is determined based on the second biometric information.

[0017] The identity recognition method provided in the embodiment of the present application, when it is determined that there is a third user close to the electronic device in the second scenario, when the second scenario switches to the first scene, the second biometric information is re-acquired, and then the third recognition result is determined based on the second biometric information. In this way, in the second scenario where the user's biometric information cannot be collected, if there is a third user close to the electronic device, only after the second biometric information of the third user is re-acquired, it is determined based on the second biometric information whether the third user is allowed to use the electronic device, thereby improving the security of using the electronic device.

[0018] In combination with the first aspect, in certain embodiments of the first aspect, if the first user is away from the electronic device, when the second scene switches to the first scene, second biometric information is obtained; and a third recognition result is determined based on the second biometric information.

[0019] It is understandable that in the second scenario, if the first user is away from the electronic device, it indicates that the user using the electronic device has changed. In this case, the electronic device can re-acquire the second biometric information when the second scenario switches to the first scenario, and then determine the third recognition result based on the second biometric information. In this way, in the second scenario where the user's biometric information cannot be collected, if the first user is away from the electronic device, that is, the user using the electronic device has changed, only after re-acquiring the second biometric information, will it be determined based on the second biometric information whether to allow the user to continue to use the electronic device, thereby improving the security of using the electronic device.

[0020] It should be understood that the electronic device may also obtain the second biometric information when the second scene is switched to the third scene. The third scene may be a scene that is different from the first scene but can normally obtain the user's biometric information.

[0021] In combination with the first aspect, in certain embodiments of the first aspect, determining the second recognition result based on the echo signal and the first recognition result includes: inputting the echo signal and the first recognition result into an identity recognition model to obtain the second recognition result, and the identity recognition model is a neural network model.

[0022] The identity recognition method provided in the embodiment of the present application can input the echo signal and the first recognition result into the identity recognition model to obtain a second recognition result, wherein the identity recognition model is a neural network model. This is equivalent to being able to directly obtain the second recognition result through the neural network model, thereby improving the convenience of obtaining the second recognition result.

[0023] In combination with the first aspect, in certain embodiments of the first aspect, determining whether the first user in the first scene is far away from the electronic device based on the echo signal includes: processing the echo signal using an ultrasonic ranging algorithm to determine whether the first user in the first scene is far away from the electronic device.

[0024] Among them, the ultrasonic ranging algorithm usually calculates the distance to the obstacle based on the time difference between the ultrasonic signal and the echo signal.

[0025] The identity recognition method provided in the embodiment of the present application can use an ultrasonic ranging algorithm to process the echo signal to determine whether the first user in the first scene is far away from the electronic device. Since the ultrasonic ranging algorithm simply determines the distance information between the electronic device and the first user based on the time difference between the echo signal and the ultrasonic signal, it can improve the convenience of obtaining the distance information between the electronic device and the first user, thereby improving the convenience of determining whether the first user is far away from the electronic device based on the change in the distance between the electronic device and the first user.

[0026] In combination with the first aspect, in certain embodiments of the first aspect, the above-mentioned determining whether a third user is close to the electronic device based on the echo signal includes: inputting the echo signal into a multi-person scene recognition model, and outputting whether a third user is close to the electronic device, and the multi-person scene recognition model is a neural network model.

[0027] The identity recognition method provided in the embodiment of the present application can input the echo signal into a multi-person scene recognition model, and output whether a third user is close to the electronic device through the multi-person scene recognition model, wherein the multi-person scene recognition model is a neural network model. This is equivalent to being able to directly determine whether a third user is close to the electronic device through the neural network model, thereby improving the convenience of determining whether a third user is close to the electronic device.

[0028] In combination with the first aspect, in some embodiments of the first aspect, the first biometric information is a facial image.

[0029] In combination with the first aspect, in some embodiments of the first aspect, the second scene is a scene in which the light intensity is less than a preset light intensity threshold.

[0030] Exemplarily, the second scenario may be as follows Figure 3 The scene at moment T3.

[0031] In combination with the first aspect, in some embodiments of the first aspect, the second scene is a scene in which the user's face is not within the acquisition range of the camera device of the electronic device.

[0032] Exemplarily, the second scenario may be as follows Figure 2 The scene at moment T1.

[0033] In combination with the first aspect, in some embodiments of the first aspect, the electronic device does not have an infrared camera device.

[0034] In the embodiment of the present application, the electronic device does not have an infrared camera device. Therefore, in the case of a scene where the light intensity is less than the light intensity threshold, the electronic device cannot collect the user's facial image, and thus cannot confirm the user's identity information through the facial image. In this case, the electronic device can send out an ultrasonic signal and receive an echo signal corresponding to the ultrasonic signal, and then determine the second recognition result in the scene where the light intensity is less than the light intensity threshold based on the echo signal and the first recognition result in the first scene, thereby improving the adaptability of the electronic device without an infrared camera device to perform continuous identity recognition.

[0035] In combination with the first aspect, in some embodiments of the first aspect, a speaker of the electronic device sends an ultrasonic signal, and a microphone of the electronic device receives an echo signal corresponding to the ultrasonic signal.

[0036] The identity recognition method provided in the embodiment of the present application can send an ultrasonic signal through a speaker in the electronic device, and receive an echo signal corresponding to the ultrasonic signal through a microphone in the electronic device. In this way, the electronic device does not need to add additional ultrasonic signal sending and receiving devices, and can determine the second recognition result in the second scene through the echo signal of the ultrasonic signal, thereby effectively reducing the cost of the electronic device.

[0037] In a second aspect, an identity recognition device is provided, comprising a unit for executing any one of the methods in the first aspect. The device may be a server, a terminal device, or a chip in a terminal device. The device may include an input unit and a processing unit.

[0038] When the device is a terminal device, the processing unit may be a processor, and the input unit may be a communication interface; the terminal device may also include a memory, which is used to store computer program code. When the processor executes the computer program code stored in the memory, the terminal device executes any one of the methods in the first aspect.

[0039] When the device is a chip in a terminal device, the processing unit may be a processing unit inside the chip, and the input unit may be an output interface, a pin or a circuit, etc.; the chip may also include a memory, which may be a memory inside the chip (for example, a register, a cache, etc.) or a memory located outside the chip (for example, a read-only memory, a random access memory, etc.); the memory is used to store computer program code, and when the processor executes the computer program code stored in the memory, the chip executes any one of the methods in the first aspect.

[0040] In one possible implementation, a memory is used to store computer program code; a processor executes the computer program code stored in the memory, and when the computer program code stored in the memory is executed, the processor is used to perform: in a first scenario, obtaining first biometric information for continuous identity recognition, and obtaining a first recognition result; if the electronic device switches from the first scenario to a second scenario, an ultrasonic signal is emitted, and an echo signal corresponding to the ultrasonic signal is obtained, and the second scenario includes a scenario in which the biometric information cannot be obtained; and a second recognition result is determined based on the echo signal and the first recognition result.

[0041] According to a third aspect, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores a computer program code. When the computer program code is executed by an identity recognition device, the identity recognition device executes any one of the identity recognition methods according to the first aspect.

[0042] In a fourth aspect, a computer program product is provided, the computer program product comprising: a computer program code, when the computer program code is executed by an identity recognition device, the identity recognition device executes any one of the identity recognition methods in the first aspect.

[0043] The identity recognition method provided in the embodiment of the present application is applied to an electronic device. In a first scenario, first biometric information is obtained for continuous identity recognition to obtain a first recognition result. When the electronic device switches from the first scenario to the second scenario, an ultrasonic signal is emitted, and an echo signal corresponding to the ultrasonic signal is acquired. Then, a second recognition result is determined based on the echo signal and the first recognition result. The second scenario includes a scenario in which the biometric information cannot be obtained. This is equivalent to the electronic device being able to emit an ultrasonic signal in a scenario in which the biometric information cannot be obtained, and based on the echo signal corresponding to the ultrasonic signal and the first recognition result determined in a scenario in which the biometric information can be obtained, continuously identifying the user's identity information, i.e., the second recognition result, so that the electronic device can perform continuous identity recognition in a variety of complex scenarios, thereby improving the convenience of using the electronic device. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] Figure 1 A schematic diagram of a display interface for continuous identity recognition of an electronic device; Figure 2 is a schematic diagram of an electronic device switching from a first scene to a second scene; Figure 3 is a schematic diagram of an electronic device switching from a first scene to a second scene; Figure 4 is a schematic diagram of an electronic device switching from a first scene to a second scene; Figure 5 is a schematic diagram of a hardware system of an electronic device applicable to the present application; Figure 6 It is a flowchart of the identity recognition method provided in the embodiment of the present application; Figure 7 is a schematic diagram of a microphone and a speaker in an electronic device provided in an embodiment of the present application; Figure 8 is a schematic diagram of a detection range formed by an ultrasonic signal and an echo signal provided in an embodiment of the present application; Fig. 9 It is a flowchart of the identity recognition method provided in the embodiment of the present application; Fig.10 is a schematic diagram of processing an echo signal provided in an embodiment of the present application; Fig.11 is a schematic diagram of processing an echo signal through a neural network model provided by an embodiment of the present application; Fig.12 is a schematic diagram of preprocessing an echo signal provided in an embodiment of the present application; Fig.13 is a schematic diagram of an identity recognition device provided by the present application; Fig.14 It is a schematic diagram of an electronic device for identity recognition provided by the present application. DETAILED DESCRIPTION

[0045] The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.

[0046] In the following, the terms "first", "second", and "third" are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first", "second", and "third" may explicitly or implicitly include one or more of the features.

[0047] When using electronic devices, users need to better protect their personal privacy in addition to improving the convenience of use. In order to meet the needs of users, some electronic devices provide the function of continuous identity recognition.

[0048] The function of continuous identity recognition may mean that the electronic device periodically collects the user's facial information according to a preset period, and determines whether the user has the authority to use the electronic device based on the facial information. If the user has the authority to use the electronic device, the information that can be viewed within the authority is displayed to the user; if the user does not have the authority to use the electronic device, the relevant information is not displayed to the user.

[0049] For example, if the mobile phone determines that the user has permission to use the mobile phone, the entire message is displayed in the notification bar. Figure 1 As shown in (a), the notification bar 1011 displays "Headhunter A", "What did you think of the last position?" If the mobile phone determines that the user does not have permission to use the mobile phone, only the prompt information is displayed in the notification bar. Figure 1 As shown in (b) in FIG. 1 , the notification bar 1012 displays “information” and “one notification”.

[0050] However, when a user is using an electronic device, there may be a situation where the user's facial information cannot be collected due to environmental changes.

[0051] For example, Figure 2As shown in the figure, the user holds the phone at time T0, and the front camera of the phone can periodically collect the user's facial information so that the phone can determine whether the user has permission to use the phone based on the facial information. If at time T1, the user places the phone flat on the table, the user's face is not within the field of view (FOV) of the front camera of the phone, so the phone cannot collect the user's facial information, and thus cannot achieve the function of continuous identity recognition.

[0052] For example, Figure 3 As shown, at time T2, the user holds the phone in a bright environment, and the front camera of the phone periodically collects the user's facial information so that the phone determines whether the user has permission to use the phone based on the facial information. If at time T3, the user holds the phone from a bright environment into a dark environment, and the front camera on the phone is not an infrared camera, the front camera of the phone cannot collect the user's facial information in a dark environment, and thus cannot achieve the function of continuous identity recognition.

[0053] For example, Figure 4 As shown, at time T4, when the user is riding in a moving vehicle, the front camera of the mobile phone periodically collects the user's facial information so that the mobile phone determines whether the user has permission to use the mobile phone based on the facial information. If at time T5, the vehicle starts to bump, making the facial information collected by the mobile phone blurred, the mobile phone cannot recognize the user's identity based on the blurred facial information, and thus cannot achieve the function of continuous identity recognition. The above-mentioned vehicles include but are not limited to cars, ships, trains, airplanes, and electric bicycles.

[0054] In view of this, an embodiment of the present application provides an identity recognition method, which is applied to an electronic device. In a first scenario, first biometric information is obtained for continuous identity recognition to obtain a first recognition result. When the electronic device switches from the first scenario to the second scenario, an ultrasonic signal is emitted, and an echo signal corresponding to the ultrasonic signal is obtained. Then, a second recognition result is determined based on the echo signal and the first recognition result. The second scenario includes a scenario in which the biometric information cannot be obtained. This is equivalent to the electronic device being able to emit an ultrasonic signal in a scenario in which the biometric information cannot be obtained, and based on the echo signal corresponding to the ultrasonic signal and the first recognition result determined in the scenario in which the biometric information can be obtained, continuously identifying the user's identity information, that is, the second recognition result, so that the electronic device can perform continuous identity recognition in a variety of complex scenarios, thereby improving the convenience of using the electronic device.

[0055] The identity recognition method provided in the embodiment of the present application can be applied to electronic devices. Optionally, the electronic device includes a terminal device, which can also be called a terminal, a user equipment (UE), a mobile station (MS), a mobile terminal (MT), etc. The terminal device can be a mobile phone, a smart TV, a wearable device, a tablet computer (Pad), a computer with wireless transceiver function, a virtual reality (VR) terminal device, an augmented reality (AR) terminal device, a wireless terminal in industrial control, a wireless terminal in self-driving, a wireless terminal in remote medical surgery, a wireless terminal in smart grid, a wireless terminal in transportation safety, a wireless terminal in smart city, a wireless terminal in smart home, etc. The embodiment of the present application does not limit the specific technology and specific device form adopted by the terminal device.

[0056] For example, Figure 5 The structure diagram of the electronic device 100 is shown. The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0057] It is to be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0058] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0059] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0060] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0061] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0062] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present application is only a schematic illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0063] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0064] The electronic device 100 can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor.

[0065] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then passes the electrical signal to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0066] It is understandable that the camera 193 of the electronic device 100 may include a front camera, and the user's facial information is collected through the front camera. In the embodiment of the present application, the camera 193 of the electronic device 100 may not be an infrared camera.

[0067] The electronic device 100 can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0068] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be arranged in the processor 110, or some functional modules of the audio module 170 can be arranged in the processor 110.

[0069] The speaker 170A, also called a "speaker", is used to convert an audio electrical signal into a sound signal. The electronic device 100 can listen to music or listen to a hands-free call through the speaker 170A.

[0070] The receiver 170B, also called a "earpiece", is used to convert audio electrical signals into sound signals. When the electronic device 100 receives a call or voice message, the voice can be received by placing the receiver 170B close to the human ear.

[0071] Microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to microphone 170C to input the sound signal into microphone 170C. The electronic device 100 can be provided with at least one microphone 170C. In other embodiments, the electronic device 100 can be provided with two microphones 170C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the electronic device 100 can also be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify the sound source, realize directional recording function, etc.

[0072] It is understood that the frequency of sound waves audible to human hearing is 20Hz to 20kHz, and sound waves exceeding this upper frequency limit are called ultrasonic waves, which cannot be perceived by human hearing. In addition to emitting sound waves of 20Hz to 20kHz that can be perceived by humans, the speaker 170A of the electronic device 100 is usually also capable of emitting 20kHz-24kHz ultrasonic waves, so the speaker 170A can also be used as an ultrasonic transmitter.

[0073] In addition, the sampling frequency of the microphone 170C of the electronic device 100 can generally cover all frequency bands emitted by the above-mentioned speaker 170A, such as the above-mentioned 20kHz-24kH sound waves, so the microphone 170C can also receive the ultrasonic waves emitted by the speaker 170A, as a receiver of ultrasonic waves. Thus, the electronic device 100 can transmit and receive ultrasonic waves through the speaker 170A and the microphone 170C, so that the electronic device 100 can use ultrasonic waves to measure distance or position.

[0074] The gyro sensor 180B can be used to determine the motion posture of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 around three axes (i.e., the x-axis, the y-axis, and the z-axis) can be determined by the gyro sensor 180B. The gyro sensor 180B can be used for anti-shake shooting. For example, when the shutter is pressed, the gyro sensor 180B detects the angle of the shaking of the electronic device 100, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to offset the shaking of the electronic device 100 through reverse movement to achieve anti-shake. In some possible cases, the electronic device 100 can also determine that the electronic device 100 is in a bumpy state based on the data collected by the gyro sensor 180B, for example, Figure 4 shown.

[0075] The acceleration sensor 180E can detect the magnitude of the acceleration of the electronic device 100 in various directions (generally three axes). When the electronic device 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of the electronic device and applied to applications such as horizontal and vertical screen switching and pedometers. For example, based on the data collected by the acceleration sensor 180E, the electronic device 100 can determine whether the electronic device 100 is converted from a holding state to a placing state, such as Figure 2 shown.

[0076] The distance sensor 180F is used to measure the distance. The electronic device 100 can measure the distance by infrared or laser. In some embodiments, when shooting a scene, the electronic device 100 can use the distance sensor 180F to measure the distance to achieve fast focus. In some possible cases, the electronic device 100 can also determine whether there is a person approaching or moving away from the electronic device 100 through the distance sensor 180F.

[0077] The ambient light sensor 180L is used to sense the ambient light brightness. The electronic device 100 can adaptively adjust the brightness of the display screen 194 according to the perceived ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the electronic device 100 is in a pocket to prevent accidental touches. In some possible cases, the electronic device 100 can determine whether the electronic device 100 has entered a dim environment from a bright environment based on the data collected by the ambient light sensor 180L, such as Figure 3 shown.

[0078] It should be noted that any electronic device mentioned in the embodiments of the present application may include more or fewer modules in the electronic device 100.

[0079] The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture.

[0080] The application scenarios provided by the embodiments of the present application are described below with reference to the accompanying drawings.

[0081] The identity recognition method provided in the embodiment of the present application can be applied in a scenario where continuous identity recognition is performed through a camera, and in the process of continuous identity recognition through a camera, the environment of the electronic device changes, making it impossible for the electronic device to continue continuous identity recognition through the camera. The following description takes the electronic device as a mobile phone. For example, the identity recognition method provided in the embodiment of the present application can be applied in a scenario where continuous identity recognition is performed through a camera, and the environment of the electronic device changes, making it impossible for the electronic device to continue continuous identity recognition through the camera. Figures 2 to 4 In the application scenario shown.

[0082] Application scenario one.

[0083] like Figure 2 As shown, at time T0, the user holds the mobile phone, and the camera in the mobile phone (such as the front camera) can periodically collect the user's facial information, so that the mobile phone can determine whether the user has the authority to use the mobile phone based on the collected facial information, and continue to authenticate the identity until time T1. If at time T1, the user places the mobile phone flat on the table, the user's face is not within the field of view (FOV) of the front camera of the mobile phone. Therefore, the mobile phone cannot collect the user's facial information, and thus cannot perform continuous identity recognition by collecting the user's facial information. In this case, the mobile phone can send an ultrasonic signal through a speaker, and receive the echo signal reflected by the obstacle through a microphone, and then determine whether the user is away from the mobile phone based on the echo signal. If the user is not away from the mobile phone, it is determined that the user still has the authority to use the mobile phone; if the user is away from the mobile phone, the display of the private information in the mobile phone stops.

[0084] Application scenario two.

[0085] like Figure 3 As shown, at time T2, the user holds the mobile phone in a bright environment, and the camera in the mobile phone periodically collects the user's facial information, so that the mobile phone can determine whether the user holding the mobile phone has the authority to use the mobile phone based on the facial information collected by the camera. If at time T3, the user holds the mobile phone from a bright environment to a dark environment, and the camera on the mobile phone is not an infrared camera, the camera of the mobile phone cannot collect the user's facial information in a dark environment, and thus cannot achieve the function of continuous identity recognition. In this case, the mobile phone can also send an ultrasonic signal through a speaker, and receive an echo signal reflected by an obstacle through a microphone, and then determine whether the user is away from the mobile phone based on the echo signal. If the user is not away from the mobile phone, it is determined that the user still has the authority to use the mobile phone; if the user is away from the mobile phone, the display of the privacy information in the mobile phone stops.

[0086] Application scenario three.

[0087] like Figure 4 As shown, at time T4, when the user is riding in a moving vehicle, the camera in the mobile phone periodically collects the user's facial information, so that the mobile phone determines whether the user has the right to use the mobile phone based on the collected facial information. If at time T5, the vehicle starts to bump, so that the facial information collected by the mobile phone becomes blurred, the mobile phone cannot recognize the user's identity based on the blurred facial information, and thus cannot achieve the function of continuous identity recognition. Among them, the above-mentioned vehicles include but are not limited to cars, ships, trains, airplanes, and electric bicycles. In this case, the mobile phone can also send an ultrasonic signal through a speaker, and receive an echo signal reflected by an obstacle through a microphone, and then determine whether the user is away from the mobile phone based on the echo signal. If the user is not away from the mobile phone, it is determined that the user still has the right to use the mobile phone; if the user is away from the mobile phone, the display of the private information in the mobile phone stops.

[0088] It should be understood that the above is an example of an application scenario and does not limit the application scenario of the present application.

[0089] Combine the following Figures 6 to 12 The identity recognition method provided in the embodiment of the present application is described in detail.

[0090] Figure 6 A flowchart of an identity recognition method provided in an embodiment of the present application is shown in FIG. Figure 6 As shown, the method includes: S101. In a first scenario, biometric information is obtained for continuous identity recognition to obtain a first recognition result.

[0091] The biometric information may refer to the facial image, eye pattern image, and other feature information of the first user that can identify the user's body, and the present application embodiment does not limit this. The first user may refer to a user who is using the electronic device, for example, the first user refers to a user who is holding the electronic device.

[0092] Exemplarily, the electronic device may collect facial information of a first user holding the electronic device through a front camera, and perform image recognition on the collected facial information to determine whether the facial information of the first user is the facial information of a user with permission to use the electronic device pre-stored in the electronic device. If the facial information of the first user matches the facial information of a user with permission to use the electronic device pre-stored in the electronic device, the electronic device determines that the first user has permission to use the electronic device. If the facial information of the first user does not match the facial information of a user with permission to use the electronic device pre-stored in the electronic device, the electronic device determines that the first user does not have permission to use the electronic device.

[0093] Among them, the permission to use the electronic device includes but is not limited to viewing information in the electronic device, modifying the configuration of the electronic device, sending information through the electronic device, and receiving information through the electronic device.

[0094] The electronic device continuously authenticates the biometric information by means of the electronic device periodically acquiring the biometric information of the first user according to a preset period, and periodically verifying whether the biometric information of the first user matches a user with usage authority pre-stored in the electronic device.

[0095] If the biometric information of the first user is verified to match the biometric information of the user with the use permission each time, the electronic device continues to allow the first user to use the electronic device. When the acquired biometric information of the first user does not match the biometric information of the user with the use permission, the electronic device does not allow the first user to use the electronic device.

[0096] If the biometric information collected last time matches the biometric information of the user with permission to use, but the biometric information collected at the current moment does not match the biometric information of the user with permission to use, it means that the first user has changed from a user with permission to use the electronic device to a user without permission to use the electronic device.

[0097] For example, Xiao Wang has the right to use the electronic device, and the biometric information of the first user collected by the electronic device before the first moment matches Xiao Wang's biometric information, so the electronic device allows the first user to use the electronic device before the first moment. Xiao Wang transfers the electronic device to another person, such as Xiao Li, at the first moment, and the biometric information collected by the electronic device at the first moment does not match Xiao Wang's biometric information, so the electronic device does not allow the first user to use the electronic device from the first moment on.

[0098] The first recognition result may indicate the result of the identity recognition performed by the electronic device at the first moment. For example, the first recognition result may mean that at the first moment, the user holding the electronic device has the authority to use the electronic device, or the first recognition result may mean that at the first moment, the user holding the electronic device does not have the authority to use the electronic device.

[0099] The first scene may refer to a scene in which biometric information can be obtained. For example, the first scene may refer to a scene with bright light. The first scene may also refer to a scene in which a user holds an electronic device and the user's face is within the coverage range of the electronic device for collecting biometrics. The first scene may also refer to a stable and non-bumpy environment, so that the electronic device can collect clear biometric information. The embodiments of the present application do not limit this.

[0100] S102: If the electronic device switches from the first scene to the second scene, an ultrasonic signal is emitted, and an echo signal corresponding to the ultrasonic signal is acquired.

[0101] The second scenario may refer to a scenario where biometric information cannot be collected normally.

[0102] For example, the second scenario may refer to a scenario where the collection range of the electronic device of the electronic device collecting biometric information cannot cover the user. For example, the electronic device collects the user's facial image through a camera, and the second scenario may refer to a scenario where the user's face is not within the shooting range of the camera.

[0103] For example, the second scene may refer to a scene with low light intensity. In the second scene, due to the low light intensity, the electronic device cannot normally capture the user's facial image.

[0104] For example, the second scenario may refer to a scenario where the electronic device is bumpy, resulting in inaccurate biometric information being collected. Exemplarily, the second scenario may refer to a scenario where the electronic device is in a bumpy vehicle and cannot collect a clear facial image in the bumpy vehicle, and therefore cannot perform identity recognition through the collected facial image.

[0105] The electronic device switching from the first scene to the second scene may mean that when the user holds the electronic device to collect the user's facial image, the user places the electronic device flat on the table, and the camera of the electronic device can no longer collect the user's facial image, such as Figure 2 shown.

[0106] The electronic device switching from the first scene to the second scene may also refer to the user carrying the electronic device from a bright environment into a dim environment. The electronic device cannot collect the user's biometric information, such as a facial image, in the dim environment, so the electronic device cannot continue to perform identity recognition through the biometric information, such as Figure 3 shown.

[0107] The electronic device switching from the first scene to the second scene may also refer to a vehicle driving smoothly onto a bumpy road, causing the vehicle to shake, thereby causing the electronic device on the vehicle to be unable to capture a clear user's facial image, such as Figure 4 shown.

[0108] When the electronic device switches from the first scene to the second scene, the electronic device may send out an ultrasonic signal through a speaker, and then receive an echo signal obtained by reflecting the ultrasonic signal from an obstacle through a microphone.

[0109] Among them, the electronic device may have only one microphone and one speaker, or may have multiple microphones and multiple speakers, which is not limited in the embodiments of the present application. In some possible cases, the electronic device may also include one microphone and multiple speakers; in some possible cases, the electronic device may include multiple microphones and one speaker.

[0110] For example, Figure 7 As shown, the electronic device may include two microphones and two speakers, wherein the two microphones are microphone 11 and microphone 12, and the two speakers are speaker 21 and speaker 22. The microphone 11 and the speaker 21 are arranged on the top of the electronic device, such as Figure 7 The microphone 12 and the speaker 22 are arranged at the bottom of the electronic device. Figure 7 shown.

[0111] It is understandable that ultrasonic signals are usually directional. When there is only one set of ultrasonic paths consisting of a speaker and a microphone in an electronic device, the range that can detect the user's location is limited. When the electronic device includes multiple sets of ultrasonic paths consisting of a speaker and a microphone, the ultrasonic paths formed are more abundant, so the range of the electronic device to detect the user's location will also be larger.

[0112] For example, Figure 8As shown, there are two microphones and one speaker on the mobile phone, the two microphones are microphone 13 and microphone 14, and the one speaker can be called speaker 23. Among them, the speaker 23 and the microphone 13 can be set at the bottom of the mobile phone, such as Figure 8 As shown; the microphone 14 can be set at the top of the mobile phone, such as Figure 8 The ultrasonic path formed between the speaker 23 and the microphone 13 can detect the position information of the user within the first range, wherein the first range can be as shown in FIG. Figure 8 The ultrasonic path formed between the speaker 23 and the microphone 14 can detect whether the user is away from the phone within the second range, wherein the second range is as shown in FIG. Figure 8 That is to say, the user range that the electronic device can detect is a larger range interval consisting of the first range and the second range.

[0113] It should be noted that the ultrasonic signal is reflected by obstacles within the range corresponding to the ultrasonic path formed by the speaker and the microphone, and the resulting echo signals are relatively large. The electronic device can directly process these echo signals to determine the location information of the obstacles.

[0114] In some possible cases, the ultrasonic signal is reflected by an obstacle outside the range of the ultrasonic path formed by the speaker and the microphone, and the resulting echo signal is usually small. The electronic device is usually unable to directly process these echo signals to determine the location information of the obstacle. However, the electronic device can process these echo signals to increase the difference between the echo signal formed by the obstacle and the noise signal in the echo signal, so that the electronic device can process the echo signal and determine the location information of the obstacle. For example, the electronic device can input the weaker echo signal into the neural network model, and process the echo signal through the neural network model to determine the location information of the obstacle.

[0115] S103: Determine a second recognition result based on the echo signal and the first recognition result.

[0116] As described in S102, the electronic device can determine the position information of the obstacle in the ultrasonic path formed by the speaker and the microphone based on the echo signal. Based on this, the electronic device can further determine whether the obstacle is a user using the electronic device in the first scenario based on the position information of the obstacle. Then, based on whether the obstacle is the user using the electronic device in the first scenario and the first recognition result, the second recognition result is determined.

[0117] The second recognition result may indicate the result of the identity recognition performed by the electronic device after the electronic device switches from the first scene to the second scene. For example, the second recognition result may indicate that the user has the authority to use the electronic device after switching from the first scene to the second scene, or the second recognition result may indicate that the user does not have the authority to use the electronic device after switching from the first scene to the second scene.

[0118] For ease of description, a user using an electronic device in a first scenario may be referred to as a first user, and a user in a second scenario may be referred to as a second user.

[0119] For example, the electronic device can determine whether the second user is farther away from the electronic device than the first user based on the echo signal. If the second user is not farther away from the electronic device, the second user is the first user, and the second identification result is the same as the first identification result. If the second user is farther away from the electronic device than the first user, the second user is not the first user and needs to be re-identified through biometric information.

[0120] For another example, the electronic device can determine whether the number of second users is greater than the number of first users based on the echo signal, thereby determining whether other people are close to the electronic device. For example, if the number of second users is greater than the number of first users, it is determined that other users are close to the electronic device and identity recognition needs to be performed again through biometric information.

[0121] The identity recognition method provided in the embodiment of the present application is applied to an electronic device. In a first scenario, first biometric information is obtained for continuous identity recognition to obtain a first recognition result. When the electronic device switches from the first scenario to the second scenario, an ultrasonic signal is emitted, and an echo signal corresponding to the ultrasonic signal is acquired. Then, a second recognition result is determined based on the echo signal and the first recognition result. The second scenario includes a scenario in which the biometric information cannot be obtained. This is equivalent to the electronic device being able to emit an ultrasonic signal in a scenario in which the biometric information cannot be obtained, and based on the echo signal corresponding to the ultrasonic signal and the first recognition result determined in a scenario in which the biometric information can be obtained, continuously identifying the user's identity information, i.e., the second recognition result, so that the electronic device can perform continuous identity recognition in a variety of complex scenarios, thereby improving the convenience of using the electronic device.

[0122] Exemplarily, taking the biometric information being a user's facial image as an example, it is explained how an electronic device can perform continuous identity recognition through ultrasonic signals.

[0123] like Fig. 9 As shown, one possible approach to continuous identification includes: S201. Acquire a first facial image in a first scene, and determine a first recognition result according to the first facial image.

[0124] The first recognition result indicates whether the first user has permission to use the electronic device. The first facial image may refer to a facial image captured by the electronic device in the first scene, such as a facial image of the first user holding the electronic device. The electronic device may perform image recognition on the facial image of the first user to determine whether the first user has permission to use the electronic device, which is the first recognition result.

[0125] S202: If the first scene is switched to the second scene, an ultrasonic signal is emitted, and an echo signal corresponding to the ultrasonic signal is acquired.

[0126] The process of switching from the first scene to the second scene, emitting an ultrasonic signal and obtaining an echo signal corresponding to the ultrasonic signal can be referred to the description of S102 above, which will not be repeated here.

[0127] S203: Determine whether the first user is away from the electronic device based on the echo signal.

[0128] The electronic device may use an ultrasonic ranging algorithm on the echo signal to determine a second distance between the second user and the electronic device. If the difference between the second distance and the first distance is less than a preset difference threshold, the second user in the second scene is the first user in the first scene, which is equivalent to the first user not being far away from the electronic device.

[0129] The first distance may refer to the distance between the first user and the electronic device in the first scenario. In the first scenario, the electronic device captures a first facial image of the first user, and the electronic device may perform image distance measurement based on the first facial image of the first user to determine the first distance, that is, the distance between the first user and the electronic device.

[0130] In some possible cases, when the electronic device switches from the first scene to the second scene, the first distance between the first user and the electronic device is usually the distance between the second user and the electronic device. The electronic device can measure the second distance between the electronic device and the second user based on the ultrasonic signal and use the second distance as the first distance.

[0131] Among them, the ultrasonic ranging algorithm may refer to an algorithm that calculates the distance based on the propagation speed of ultrasonic waves in the air and the time difference between the emitted ultrasonic signal and the echo signal. The principle of ultrasonic ranging is similar to that of radar ranging, both of which calculate the distance by measuring the time difference between signal transmission and reception. The specific process includes: 1. The speaker emits ultrasonic waves, and the timer starts timing at the same time.

[0132] 2. Ultrasonic waves propagate in the air and are immediately reflected back when they encounter an obstacle (such as the second user) on the way.

[0133] 3. When the microphone receives the echo signal, the timer stops counting immediately.

[0134] 4. Based on the time t (seconds) recorded by the timer and the propagation speed v of ultrasound in the air (usually 340m / s), the distance s from the emission point to the obstacle can be calculated, that is, s=vt / 2.

[0135] In the process of measuring distance through ultrasonic signals, the ultrasonic signal may refer to a frequency modulated continuous wave (FMCW) or a channel impulse response (CIR), which is not limited in the embodiments of the present application.

[0136] The electronic device may also process the echo signal using an ultrasonic distance detection algorithm to determine whether the first user is away from the electronic device.

[0137] Among them, the ultrasonic away detection algorithm can refer to a neural network model algorithm, which takes the echo signal as the input of the ultrasonic away detection algorithm, and outputs the information that the first user is away from the electronic device, or outputs the information that the first user is not away from the electronic device through the ultrasonic away detection algorithm.

[0138] The identity recognition method provided in the embodiment of the present application can input the echo signal and the first recognition result into the identity recognition model to obtain a second recognition result, wherein the identity recognition model is a neural network model. This is equivalent to being able to directly obtain the second recognition result through the neural network model, thereby improving the convenience of obtaining the second recognition result.

[0139] The ultrasonic signal is FMCW. The process of determining whether the first user is away from the electronic device by using the ultrasonic distance detection algorithm can be seen in Fig.10 shown.

[0140] The ultrasonic signal emitted by the electronic device is FWCW, and the echo signal reflected back to the electronic device by the obstacle and received by the microphone of the electronic device is also FWCW.

[0141] For example, Fig.10As shown, the received echo signal is demodulated, that is, the frequency band signal is restored to the baseband signal to obtain a demodulated signal; then the demodulated signal is Fourier transformed (FFT) to convert the demodulated signal from a time domain signal to a frequency domain signal to obtain a converted signal; then the converted signal is phase analyzed, and finally the signal after the phase analysis is input into the ultrasonic distance detection model to output the distance change information between the first user and the electronic device. For example, the information that the first user is far away from the electronic device, or the information that the first user is not far away from the electronic device is output.

[0142] If the first user is away from the electronic device, a second facial image is acquired, and a third recognition result is determined according to the second facial image, that is, S204 is executed.

[0143] If the first user is not far away from the electronic device, it is determined whether a third user is close to the electronic device, that is, S205 is executed.

[0144] S204: Determine a third recognition result according to the second facial image.

[0145] The second facial image may refer to a facial image captured by the electronic device after the electronic device recovers from the second scene to the first scene. That is to say, when the electronic device switches from the first scene to the second scene, if the first user is away from the electronic device, the electronic device cannot continue to perform continuous identity recognition and can only capture the second facial image again for identity recognition when it recovers to the scene where facial images can be captured (such as the first scene) to obtain a third recognition result.

[0146] S205: Determine that a third user is close to the electronic device.

[0147] It is understandable that the echo signal includes a reflective signal with an amplitude lower than a preset amplitude threshold and a reflection signal with a long reflection distance. These two reflection signals are more likely to be reflection signals obtained by reflection from a third user close to the electronic device. Therefore, the electronic device can extract time domain multimodal features of the two reflection signals. For example, the electronic device can extract a multi-frame CIR phase image or a multi-frame original time domain image from the two reflection signals as a time domain multimodal feature. The electronic device can then input the time domain multimodal feature into a multi-person scene recognition model, and determine whether there are multiple people around the electronic device through the multi-person scene recognition model. Among them, the multi-person scene recognition model can be a neural network model for determining whether the current scene is a multi-person scene based on the time domain multimodal features generated by the echo signal.

[0148] For example, Fig.11As shown, after the time domain multimodal features are input into the neural network model, they pass through the input layer, the first convolution layer, the first pooling layer, the second convolution layer, the second pooling layer and the output layer in sequence, and output information about whether there are multiple people around the electronic device, that is, whether the current scene is a multi-person scene.

[0149] If there are multiple people around the electronic device, that is, there are other users besides the first user approaching the electronic device, for example, a third user approaching the electronic device.

[0150] If there are not many people around the electronic device, that is, there are no other users close to the electronic device except the first user, the user around the electronic device is still the first user, so the electronic device can keep the first recognition result as the recognition result of continuous identity recognition.

[0151] If a third user approaches the electronic device, a second facial image is acquired, and a third recognition result is determined according to the second facial image, that is, S204 is executed.

[0152] The identity recognition method provided in the embodiment of the present application, when it is determined that there is a third user close to the electronic device in the second scenario, when the second scenario switches to the first scene, the second biometric information is re-acquired, and then the third recognition result is determined based on the second biometric information. In this way, in the second scenario where the user's biometric information cannot be collected, if there is a third user close to the electronic device, only after the second biometric information of the third user is re-acquired, it is determined based on the second biometric information whether the third user is allowed to use the electronic device, thereby improving the security of using the electronic device.

[0153] If there is no third user near the electronic device, the first recognition result is used as the second recognition result, that is, S206 is executed.

[0154] The identity recognition method provided in the embodiment of the present application maintains the first recognition result in the first scene as the second recognition result in the second scene when it is determined in the second scene that the first user is not far away from the electronic device and there is no third user close to the electronic device, so that the electronic device can perform continuous identity recognition in a variety of complex scenarios, thereby improving the convenience of using the electronic device.

[0155] In some possible cases, the second scene is more complex, including multiple people and some interfering reflective objects, such as a desktop, objects on the desktop, a user's palm, etc. In this case, the electronic device can first filter the echo signal to remove the interfering objects in the echo signal, and then determine whether there are multiple people in the second scene based on the filtered echo signal.

[0156] For example, the interference signal caused by the environment can be as follows: Fig.12As shown in the figure, the horizontal axis represents time and the vertical axis represents normalized amplitude. That is to say, the vertical axis of 0 represents the echo signal caused by the reflective object in the environment, the vertical axis of 1 (not shown in the figure) represents the maximum echo signal that the sensor (such as a microphone) can receive, and the interference signal of 0.2 is 0.2 times the maximum signal that the sensor can receive, so it has no unit. Fig.12 The signal shown may refer to the echo signal formed when the mobile phone is placed flat on the table, which includes the interference signal caused by the environment. Fig.12 The interference signal in the middle ellipse represents the interference signal caused by other structures in the mobile phone. The peak with higher amplitude is the disturbing signal formed by the reflection of the interference object on the nearby surface, for example Fig.12 As shown in the figure, the peak with a higher amplitude is the interference signal caused by the desktop. The electronic device can clip the peak in the echo signal to remove the signal formed by the reflection of the interference object.

[0157] In some possible cases, the electronic device may also directly input the first recognition result and the echo signal into the identity recognition model, and directly determine the second recognition result through the identity recognition model, wherein the identity recognition model may refer to a neural network model, which is used to determine the second recognition result based on the echo signal and the first recognition result.

[0158] The identity recognition method provided in the embodiment of the present application can input the echo signal and the first recognition result into the identity recognition model to obtain a second recognition result, wherein the identity recognition model is a neural network model. This is equivalent to being able to directly obtain the second recognition result through the neural network model, thereby improving the convenience of obtaining the second recognition result.

[0159] S206: Use the first recognition result as the second recognition result.

[0160] It should be understood that, although each step in the flow chart in the above-described embodiment is shown in sequence according to the indication of the arrow, these steps are not necessarily performed in sequence according to the order indicated by the arrow. Unless there is clear explanation in this article, the execution of these steps does not have strict order restriction, and these steps can be performed in other orders. Moreover, at least a portion of the steps in the flow chart may include a plurality of sub-steps or a plurality of stages, and these sub-steps or stages are not necessarily performed at the same time, but can be performed at different times, and the execution order of these sub-steps or stages is not necessarily performed in sequence, but can be performed in turn or alternately with at least a portion of other steps or sub-steps or stages of other steps.

[0161] It is understandable that in order to implement the above functions, the electronic device includes hardware and / or software modules corresponding to the execution of each function. In combination with the algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in combination with the embodiments, but such implementation should not be considered to be beyond the scope of the present application.

[0162] The embodiment of the present application can divide the functional modules of the electronic device according to the above method example. For example, each functional module can be divided according to each function, or two or more functions can be integrated into one module. It should be noted that the division of modules in the embodiment of the present application is schematic and is only a logical function division. There may be other division methods in actual implementation. It should be noted that the names of the modules in the embodiment of the present application are schematic and are not limited to the names of the modules in actual implementation.

[0163] Fig.13 A schematic diagram of the structure of an identity recognition device provided in an embodiment of the present application.

[0164] It should be understood that the identity recognition device 600 can perform Figures 6 to 12 The identity recognition method shown; the identity recognition device 600 includes: an acquisition unit 610 and a processing unit 620.

[0165] The processing unit 620 is used to obtain the first biometric information for continuous identity recognition in the first scenario, obtain a first recognition result, and when the electronic device switches from the first scenario to the second scenario, emit an ultrasonic signal and obtain an echo signal corresponding to the ultrasonic signal, and then determine a second recognition result based on the echo signal and the first recognition result.

[0166] The identity recognition device provided in this embodiment is used to execute the identity recognition method of the above embodiment. The technical principle and technical effect are similar and will not be repeated here.

[0167] It should be noted that the above-mentioned identity recognition device 600 is embodied in the form of a functional unit. The term "unit" here can be implemented in the form of software and / or hardware, and is not specifically limited to this.

[0168] For example, a "unit" may be a software program, a hardware circuit, or a combination of the two that implements the above functions. The hardware circuit may include an application specific integrated circuit (ASIC), an electronic circuit, a processor (such as a shared processor, a dedicated processor, or a group processor, etc.) and a memory for executing one or more software or firmware programs, a combined logic circuit, and / or other suitable components that support the described functions.

[0169] Therefore, the units of each example described in the embodiments of the present application can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present application.

[0170] Fig.14 A structural schematic diagram of an electronic device provided by the present application is shown. Fig.14 The dotted line in the figure indicates that the unit or the module is optional. The electronic device 700 can be used to implement the identity recognition method described in the above method embodiment.

[0171] The electronic device 700 includes one or more processors 701, which can support the electronic device 700 to implement the identity recognition method in the method embodiment. The processor 701 can be a general-purpose processor or a special-purpose processor. For example, the processor 701 can be a central processing unit (CPU), a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, such as discrete gates, transistor logic devices or discrete hardware components.

[0172] The processor 701 may be used to control the electronic device 700, execute software programs, and process data of the software programs. The electronic device 700 may also include a communication unit 705 to implement input (reception) and output (transmission) of signals.

[0173] For example, the electronic device 700 may be a chip, the communication unit 705 may be an input and / or output circuit of the chip, or the communication unit 705 may be a communication interface of the chip, and the chip may be a component of a terminal device or other electronic devices.

[0174] For another example, the electronic device 700 may be a terminal device, and the communication unit 705 may be a transceiver of the terminal device, or the communication unit 705 may be a transceiver circuit of the terminal device.

[0175] The electronic device 700 may include one or more memories 702 on which a program 704 is stored. The program 704 can be executed by the processor 701 to generate instructions 703, so that the processor 701 executes the impedance matching method described in the above method embodiment according to the instructions 703.

[0176] Optionally, data may be stored in the memory 702. Optionally, the processor 701 may read data stored in the memory 702. The data may be stored at the same storage address as the program 704, or may be stored at a different storage address than the program 704.

[0177] The processor 701 and the memory 702 may be provided separately or integrated together; for example, integrated on a system on chip (SOC) of a terminal device.

[0178] Exemplarily, the memory 702 can be used to store the related program 704 of the identity recognition method provided in the embodiment of the present application, and the processor 701 can be used to call the related program 704 of the identity recognition method stored in the memory 702 when performing identity recognition, and execute the identity recognition method of the embodiment of the present application; including: in a first scenario, obtaining first biometric information for continuous identity recognition, obtaining a first recognition result, and when the electronic device switches from the first scenario to the second scenario, emitting an ultrasonic signal, and obtaining an echo signal corresponding to the ultrasonic signal, and then determining the second recognition result based on the echo signal and the first recognition result.

[0179] The present application also provides a computer program product, which, when executed by the processor 701, implements the identity recognition method described in any method embodiment of the present application.

[0180] The computer program product may be stored in the memory 702 , for example, a program 704 , which is converted into an executable target file that can be executed by the processor 701 after preprocessing, compiling, assembling, and linking.

[0181] The present application also provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a computer, the identity recognition method described in any method embodiment of the present application is implemented. The computer program can be a high-level language program or an executable target program.

[0182] The computer-readable storage medium is, for example, a memory 702. The memory 702 may be a volatile memory or a nonvolatile memory, or the memory 702 may include both a volatile memory and a nonvolatile memory. Among them, the nonvolatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), and direct rambus RAM (DR RAM).

[0183] In this application, "at least one" means one or more, and "plurality" means two or more. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single items or plural items. For example, at least one of a, b, or c can mean: a, b, c, ab, ac, bc, or abc, where a, b, and c can be single or multiple.

[0184] It should be understood that in the various embodiments of the present application, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0185] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0186] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0187] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic; for example, the division of the units is only a logical function division, and there may be other division methods in actual implementation; for example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0188] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0189] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0190] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. An identity recognition method, characterized in that: The method is applied in an electronic device, and the method comprises: In the first scenario, first biometric information is obtained for continuous identity recognition to obtain a first recognition result; If the electronic device switches from the first scene to a second scene, emits an ultrasonic signal, and obtains an echo signal corresponding to the ultrasonic signal, the second scene includes a scene in which biometric information cannot be obtained; A second recognition result is determined based on the echo signal and the first recognition result.

2. The method according to claim 1, characterized in that The determining a second recognition result based on the echo signal and the first recognition result comprises: determining whether a first user in the first scene is away from the electronic device based on the echo signal; If the first user is not far away from the electronic device, the second recognition result is determined based on the first recognition result.

3. The method according to claim 2, characterized in that If the first user is not away from the electronic device, determining the second recognition result based on the first recognition result includes: If the first user is not far away from the electronic device, determining whether a third user is close to the electronic device based on the echo signal; If there is no third user near the electronic device, the first recognition result is used as the second recognition result.

4. The method according to claim 3, characterized in that The method further comprises: If there is a third user close to the electronic device, when the second scene switches to the first scene, obtaining second biometric information; A third recognition result is determined based on the second biometric information.

5. The method according to claim 2, characterized in that: The method further comprises: If the first user is away from the electronic device, when the second scene switches to the first scene, obtaining second biometric information; A third recognition result is determined based on the second biometric information.

6. The method according to any one of claims 1 to 5, characterized in that: The determining a second recognition result based on the echo signal and the first recognition result comprises: The echo signal and the first recognition result are input into an identity recognition model to obtain the second recognition result, and the identity recognition model is a neural network model.

7. The method according to any one of claims 2 to 5, characterized in that: The determining, based on the echo signal, whether the first user in the first scene is away from the electronic device comprises: The echo signal is processed by using an ultrasonic ranging algorithm to determine whether the first user in the first scene is far away from the electronic device.

8. The method according to any one of claims 3 to 5, characterized in that: The determining whether a third user is close to the electronic device based on the echo signal comprises: The echo signal is input into a multi-person scene recognition model to output whether a third user is close to the electronic device, and the multi-person scene recognition model is a neural network model.

9. The method according to any one of claims 1 to 5, characterized in that: The first biometric information is a facial image.

10. The method according to claim 9, characterized in that The second scene is a scene where the light intensity is less than a preset light intensity threshold.

11. The method according to claim 9, characterized in that The second scene is a scene in which the user's face is not within the acquisition range of the camera device of the electronic device.

12. The method according to any one of claims 1 to 5, characterized in that: The electronic device has no infrared camera device.

13. The method according to any one of claims 1 to 5, characterized in that: The sending out of the ultrasonic signal and obtaining the echo signal corresponding to the ultrasonic signal includes: The speaker of the electronic device sends out the ultrasonic signal, and the microphone of the electronic device receives an echo signal corresponding to the ultrasonic signal.

14. An electronic device, characterized in that: The electronic device comprises means for performing the method according to any one of claims 1 to 13.

15. An electronic device, characterized in that: include: one or more processors; Memory; and one or more computer programs, wherein the one or more computer programs are stored in the memory, and when the computer programs are executed by the one or more processors, the electronic device performs the method according to any one of claims 1 to 13.

16. A chip system, characterized in that: The chip system includes a processor for calling and running a computer program from a memory, so that an electronic device equipped with the chip system executes the method according to any one of claims 1 to 13.

17. A computer-readable storage medium comprising a computer program, characterized in that: When the computer program is executed on an electronic device, the electronic device is caused to execute the method according to any one of claims 1 to 13.

Images