Press detection method and device, ultrasonic fingerprint chip, equipment and storage medium

Abstract

The invention relates to the technical field of signal detection, and particularly discloses a press detection method and device, an ultrasonic fingerprint chip, equipment and a computer storage medium, which are used for improving the press detection effectiveness of a wading scene. The method comprises the steps that in response to the fact that the ultrasonic fingerprint chip enters a wading pressing detection mode, continuous multiple frames of ultrasonic echo images are collected, and the ultrasonic echo images are corresponding ultrasonic echo images after the ultrasonic fingerprint chip transmits ultrasonic signals to a detection area; the ultrasonic echo image is generated when the ultrasonic cover plate corresponding to the detection area wades into water; and determining a pressing event result according to the feature matching values of the multiple frames of ultrasonic echo images.

Description

Technical Field

[0001] The present application relates to the technical field of signal detection, and particularly relates to a pressing detection method, device, ultrasonic fingerprint chip, device, and computer storage medium. Background Art

[0002] With the rapid development of the electronic device industry, sensing devices mainly based on sound, light, and electricity have constituted the underlying implementation basis of "intelligent life". The diversification of application scenarios determines application solutions based on different sensing principles. With the extensive derivation of modern life touch application scenarios, for example, in fields such as smart phones, interactive experimental devices, and automotive control systems, pressing actions (such as finger pressing) are key interaction information.

[0003] Mature pressing detection methods generally achieve pressing detection through changes in capacitance voltage signals in the touch area. Typically, this includes the capacitive touch screen operation of mobile phones. However, in underwater scenarios or scenarios with water on the surface, due to the existence of water flow noise, the signal images obtained by the fingerprint chip or module in the water flow state are highly similar to fingerprint images. That is, in the water flow scenario, the water flow will cause noise images similar to fingerprint presses to appear in the image when there is no press. Therefore, the traditional pressing detection scheme based on capacitance detection will fail. Summary of the Invention

[0004] The present application provides a solution to the technical problem that the traditional pressing detection scheme based on capacitance detection will fail.

[0005] Based on the above technical problems, the following solutions are provided: In a first aspect of the present application, a pressing detection method for an ultrasonic fingerprint chip of an electronic device is provided. The method includes: In response to the ultrasonic fingerprint chip entering the wading pressing detection mode, collect a continuous plurality of frames of ultrasonic echo images. The ultrasonic echo images are the ultrasonic echo images corresponding to the ultrasonic signal emitted by the ultrasonic fingerprint chip to the detection area, and are the ultrasonic echo images generated when the ultrasonic cover plate corresponding to the detection area wades through water; Determine the pressing event result according to the feature matching values of the plurality of frames of ultrasonic echo images.

[0006] Optionally, the determining the pressing event result according to the feature matching values of the plurality of frames of ultrasonic echo images includes: Input the plurality of frames of ultrasonic echo images into a pre-trained neural network model, so that the neural network model calculates the feature matching values of the plurality of frames of ultrasonic echo images and outputs the pressing event result; The neural network model is trained based on sample training data, where the sample training data includes ultrasonic fingerprint sample images and abnormal ultrasonic sample images. The abnormal ultrasonic sample images are ultrasonic echo images corresponding to the ultrasonic cover plate in the detection area when there is water on it.

[0007] Optionally, the continuous multiple frames of ultrasonic echo images include two consecutive frames of the ultrasonic echo images.

[0008] Optionally, before collecting the continuous multiple frames of ultrasonic echo images, the method further includes: Determining whether the electronic device is in a wading scenario based on sensing data. When it is determined that the electronic device is in a wading scenario, it is determined that the ultrasonic fingerprint chip has entered the wading press detection mode. The sensing data is detected by the sensors of the electronic device; Or; Obtaining a mode indication signal sent by the processing unit of the electronic device, and determining that the ultrasonic fingerprint chip has entered the wading press detection mode in response to the mode indication signal; The mode indication signal is an indication signal input by the user, or the mode indication signal is determined by the processing unit based on the sensing data detected by the sensors of the electronic device.

[0009] Optionally, when it is determined that the electronic device is in a wading scenario and it is determined that the ultrasonic fingerprint chip has entered the wading press detection mode, it includes: When it is determined that the electronic device is in a wading scenario, when the wading scenario type indicates that the electronic device is in a full-coverage water scenario, it is determined whether the trigger condition is met according to the water flow characteristic features; When the trigger condition is met, it is determined that the ultrasonic fingerprint chip has entered the wading press detection mode.

[0010] Optionally, the method further includes: When it is determined that the electronic device is in a wading scenario and the wading scenario type is that the electronic device is in a non-full-coverage water scenario, it is determined whether the trigger condition is met according to the water coverage area of the ultrasonic cover plate corresponding to the detection area.

[0011] Optionally, when determining the result of the press event according to the feature matching values of the multiple frames of ultrasonic echo images, the method further includes: Sending the result of the press event to the processing unit of the electronic device so that the processing unit responds to the result of the press event.

[0012] A second aspect of the present application provides a press detection method for the processing unit of an electronic device. The method includes: Obtain a series of consecutive ultrasonic echo images sent by the ultrasonic fingerprint chip after entering the water-contact pressing detection mode. The ultrasonic echo images are the corresponding ultrasonic echo images after the ultrasonic fingerprint chip emits ultrasonic signals to the detection area, and are the ultrasonic echo images generated when the ultrasonic cover plate corresponding to the detection area is in contact with water. Determine the result of the pressing event according to the feature matching values of the series of ultrasonic echo images.

[0013] Optionally, the determining the result of the pressing event according to the feature matching values of the series of ultrasonic echo images includes: Input the series of ultrasonic echo images into a pre-trained neural network model, so that the neural network model calculates the feature matching values of the series of ultrasonic echo images and outputs the result of the pressing event. The neural network model is trained based on sample training data, and the sample training data includes ultrasonic fingerprint sample images and abnormal ultrasonic sample images. The abnormal ultrasonic sample images are the corresponding ultrasonic echo images when there is water on the detection area.

[0014] Optionally, the series of consecutive ultrasonic echo images includes two consecutive ultrasonic echo images.

[0015] Optionally, before obtaining the series of consecutive ultrasonic echo images sent by the ultrasonic fingerprint chip, the method further includes: Determine whether the electronic device is in a water-contact scenario based on sensing data. In response to the electronic device being in a water-contact scenario, send a mode indication signal to the ultrasonic fingerprint chip to make the ultrasonic fingerprint chip enter the water-contact pressing detection mode. The sensing data is detected by the sensors of the electronic device. Or; In response to an indication signal that the user sets the electronic device to be in a water-contact scenario, send the mode indication signal to the ultrasonic fingerprint chip to make the ultrasonic fingerprint chip enter the water-contact pressing detection mode.

[0016] Optionally, the sending the mode indication signal to the ultrasonic fingerprint chip in response to the electronic device being in a water-contact scenario includes: When it is determined that the electronic device is in a water-contact scenario, when the water-contact scenario type indicates that the electronic device is in a full-coverage water scenario, determine whether the trigger condition is met according to the characteristics of the water flow. When the trigger condition is met, send the mode indication signal to the ultrasonic fingerprint chip.

[0017] Optionally, the method further includes: When it is determined that the electronic device is in a wading scenario, when the wading scenario type is that the electronic device is in a non-full-coverage water scenario, it is determined whether the trigger condition is met according to the water coverage area of the ultrasonic cover plate corresponding to the detection area.

[0018] In a third aspect of the present application, a pressing detection device is provided, and the device includes: An acquisition module, configured to acquire a continuous plurality of frames of ultrasonic echo images in response to the ultrasonic fingerprint chip entering the wading pressing detection mode, where the ultrasonic echo images are the ultrasonic echo images corresponding to the ultrasonic fingerprint chip emitting ultrasonic signals to the detection area, and are the ultrasonic echo images generated when the ultrasonic cover plate corresponding to the detection area is wading; A first processing module, configured to determine the result of the pressing event according to the feature matching values of the plurality of frames of ultrasonic echo images.

[0019] In a third aspect of the present application, a pressing detection device is provided, and the device includes: An acquisition module, configured to acquire a continuous plurality of frames of ultrasonic echo images sent after the ultrasonic fingerprint chip enters the wading pressing detection mode, where the ultrasonic echo images are the ultrasonic echo images corresponding to the ultrasonic fingerprint chip emitting ultrasonic signals to the detection area, and are the ultrasonic echo images generated when the ultrasonic cover plate corresponding to the detection area is wading; A second processing module, configured to determine the result of the pressing event according to the feature matching values of the plurality of frames of ultrasonic echo images.

[0020] In a fifth aspect of the present application, an ultrasonic fingerprint chip is provided for an electronic device, and the ultrasonic fingerprint chip includes an ultrasonic array, a control unit, a digital-to-analog converter, and a processing unit, where: The ultrasonic array is configured to respond to the control unit to emit ultrasonic signals; The digital-to-analog converter is configured to perform digital-to-analog conversion on the ultrasonic echo signal; The processing unit is configured to implement the pressing detection method according to any one of the foregoing first aspects based on the ultrasonic echo signal.

[0021] In a sixth aspect of the present application, an electronic device is provided, including: a processor, a communication interface, a memory, and a communication bus, and the processor, the communication interface, and the memory complete communication with each other through the communication bus; The memory is configured to store a computer program; The processor is configured to execute the steps of the method according to any one of the foregoing by running the computer program stored on the memory.

[0022] In a seventh aspect of the present application, a readable storage medium is provided. The readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the method described in any one of the foregoing are implemented.

[0023] In one of the implemented solutions described above, the ultrasonic fingerprint chip is set to a wading press detection mode. When the ultrasonic fingerprint chip has entered the wading press detection mode, in response to the ultrasonic fingerprint chip having entered the wading press detection mode, a plurality of consecutive frames of ultrasonic echo images are collected. Since the corresponding ultrasonic echo noise images underwater are constantly changing, even if they are in the form of water pattern images, it is highly unlikely that a plurality of consecutive frames of ultrasonic echo images collected will show a high degree of similarity; while the ultrasonic echo images collected when a finger or other pressing object presses will show a high degree of similarity. Therefore, by performing a press determination based on the feature matching values of a plurality of consecutive frames of ultrasonic echo images collected in the wading press detection mode, the effectiveness of the press event output in the wading scenario can be accurately determined. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following will briefly introduce the drawings required for use in the description of the embodiments of the present application. Obviously, the following drawings are only some embodiments of the present application, and those of ordinary skill in the art can obtain other drawings based on these drawings without creative efforts.

[0025] Figure 1 It is a schematic diagram of an ultrasonic echo image obtained by the ultrasonic fingerprint chip in the water flow state; Figure 2 It is a signal schematic diagram of the average value of the signal generated by the press; Figure 3 It is a frame schematic diagram of an electronic device in different directions in an embodiment of the present application; Figure 4 It is a device structure schematic diagram of an ultrasonic fingerprint chip in an embodiment of the present application; Figure 5 It is a flowchart of a press detection method provided in the first aspect in an embodiment of the present application; Figure 6 It is a flowchart of using a neural network model to output the press event result in an embodiment of the present application; Figure 7 It is another flowchart of a press detection method provided in the first aspect in an embodiment of the present application; Figure 8 It is a structure schematic diagram of a press detection device in an embodiment of the present application; Figure 9It is another structural schematic diagram of a pressing detection device in an embodiment of the present application; Figure 10 It is a structural schematic diagram of an electronic device in an embodiment of the present application. Detailed implementation manners

[0026] Next, the technical solutions in the embodiments of the present application will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.

[0027] To thoroughly understand the present application, detailed structures and steps will be presented in the following description to explain the technical solutions proposed in the present application. The preferred embodiments of the present application are described in detail below. However, in addition to these detailed descriptions, the present application may have other implementation manners.

[0028] Please first refer to Figure 1 as shown in Figure 1 It shows the ultrasonic echo image obtained by processing the signals acquired by the ultrasonic fingerprint chip in the water flow state through an algorithm. It can be seen that in underwater scenarios, when the hands are wet or there is water in the touch area and other water-related scenarios, due to the existence of water flow noise, the signal images acquired by the ultrasonic fingerprint chip in the water flow state have a high similarity to the fingerprint images. That is, in the water flow scenario, the water flow will cause the image without pressing to appear as a noise image similar to a fingerprint press. Therefore, the traditional capacitance-based scheme for judging whether a finger is pressed by an image is invalid. In addition, the traditional scheme can also detect the difference between the signals with and without pressing to perform pressing detection. However, in some water-related scenarios, such as Figure 2 as shown in Figure 2 It represents a schematic diagram of the average value of the signals generated by pressing. The signal fluctuations introduced by the noise image have exceeded the signal difference generated by the pressing itself. Therefore, it cannot be used for pressing detection in water-related scenarios. To solve the above technical problem of the failure of pressing detection in water-related scenarios, the embodiments of the present application provide a pressing detection scheme to solve the problem of the failure of pressing detection in water-related scenarios of electronic devices.

[0029] In the embodiments of the present application, the electronic device can be any type of electronic device. For example, it can be a mobile terminal such as a mobile phone, a tablet computer, a computer, a server, etc., or some interactive test devices, automotive control devices, or door lock control and other electronic devices with touch requirements, and no specific limitation is made. To facilitate the understanding of the embodiments of the present application, first, an introduction to the system framework of an electronic device adopted in the embodiments of the present application is made, as Figure 3 shown in Figure 3Shows a schematic diagram of a frame of an electronic device in the present application. Figure 3 The left figure and the right figure respectively show schematic diagrams of the structure of the electronic device in different directions. It can be seen that the electronic device includes an ultrasonic fingerprint chip, an ultrasonic cover plate, and a chip interface. The ultrasonic fingerprint chip is located under the ultrasonic cover plate. The optional materials of the ultrasonic cover plate include glass, ceramics, etc., and no specific determination is made here. The ultrasonic fingerprint chip communicates with external devices through the chip interface. For example, it communicates with the processing unit of the electronic device.

[0030] As Figure 4 shown, Figure 4 This is a schematic diagram of the device structure of an ultrasonic fingerprint chip in the present application. The ultrasonic fingerprint chip includes an ultrasonic array, a control unit (Controller), an analog-to-digital converter (ADC converter), and a Serial Peripheral Interface (SPI). Exemplarily, the ultrasonic array includes structures such as a coupling layer. The ultrasonic array can be a PVDF (polyvinylidene fluoride) array, and no specific limitation is made here. The control unit is used to control the sending and receiving timing of ultrasonic signals. The received ultrasonic echo signal is converted into an electrical signal, and then converted into a digital signal through the analog-to-digital converter, and data communication is carried out with the processing unit of the upper-layer electronic device through the SPI interface.

[0031] Figure 4 This is only an example and no specific limitation is made. In other embodiments, the ultrasonic fingerprint chip includes an ultrasonic array, a control unit, an analog-to-digital converter, and a processing unit. Exemplarily, the ultrasonic array includes structures such as a coupling layer. The ultrasonic array can be a PVDF (polyvinylidene fluoride) array, and no specific limitation is made here. The control unit is used to control the sending and receiving timing of ultrasonic signals. The received ultrasonic echo signal is converted into an electrical signal, and then converted into a digital signal through the analog-to-digital converter, and data communication is carried out with the processing unit inside the ultrasonic fingerprint chip.

[0032] Regarding the specific structure of the ultrasonic fingerprint chip, no limitation is made in the embodiments of the present application as long as the requirements can be met. The foregoing examples only show an exemplary framework. Optionally, the ultrasonic fingerprint chip in the present application may include multiple ultrasonic sub-units. Each ultrasonic sub-unit can emit and receive ultrasonic signals. The multiple ultrasonic sub-units can form an array of M columns and N rows. Each ultrasonic sub-unit can be equivalent to an ultrasonic pixel.

[0033] Optionally, the ultrasonic sub-unit may include a piezoelectric material layer, which can transmit and receive ultrasonic signals based on the piezoelectric effect. For example, taking the scenario of a finger pressing on an ultrasonic fingerprint chip as an example, the finger can be pressed on the corresponding detection area of the ultrasonic cover plate. The ultrasonic array of the ultrasonic fingerprint chip can transmit ultrasonic signals to the detection area. Starting from the emission of the ultrasonic signals, the signals will pass through the chip layer by layer, then penetrate into the ultrasonic cover plate. Subsequently, the finger above the detection area of the ultrasonic fingerprint chip can reflect at least part of the ultrasonic signals to form ultrasonic echo signals. The ultrasonic echo signals received by the array can be processed into a form of signal data that can be processed. The processing unit of the ultrasonic fingerprint chip can implement the pressing detection method of the embodiments of the present application based on the ultrasonic echo signals; alternatively, it can also be implemented by the processing unit of an electronic device electrically connected to the ultrasonic fingerprint chip to implement the pressing detection method provided by the embodiments of the present application. It should be understood that the description here is only an example for easy understanding and is not any limitation to the present application.

[0034] Optionally, the types of ultrasonic fingerprint chips in the present application may include ultrasonic fingerprint chips for the side, for the back, and under the screen, etc. Through the above types of ultrasonic fingerprint chips, pressing scenarios such as side pressing detection, back pressing detection, or under-screen pressing detection can be realized to meet various usage requirements of electronic devices, and specific details are not limited.

[0035] Combined with the above system framework, as Figure 5 shown, in one embodiment, the first aspect of the embodiments of the present application provides a pressing detection method for an ultrasonic fingerprint chip of an electronic device, including the following steps: S10: In response to the ultrasonic fingerprint chip having entered the wading pressing detection mode, collect a continuous multi-frame ultrasonic echo image, where the ultrasonic echo image is an echo image corresponding to the ultrasonic signals emitted by the ultrasonic fingerprint chip to the detection area and is an ultrasonic echo image generated when the ultrasonic cover plate corresponding to the detection area is wading.

[0036] S20: Determine the pressing event result according to the feature matching values of the multi-frame ultrasonic echo images.

[0037] It should be understood that an ultrasonic fingerprint chip is a fingerprint chip that realizes functions through ultrasonic signals. Optionally, a pressing detection method provided in the first aspect of the present application can be executed by an ultrasonic fingerprint chip. Exemplarily, it can be executed by a processing unit inside the ultrasonic fingerprint chip, such as any central processing unit MCU or microcontroller, etc., and specific details are not limited. The electronic device can be any type of electronic device. For example, it can be a mobile terminal such as a mobile phone, a tablet computer, a computer, a server, etc., or some interactive test devices, vehicle control devices, or door lock control electronic devices, etc., and specific details are not limited.

[0038] The ultrasonic fingerprint signal in this application can include multiple chip operating modes. In order for a general ultrasonic fingerprint chip to implement the function of detecting water-touch pressing, it is necessary to design a water-touch pressing detection mode for the ultrasonic fingerprint chip in the implementation of this application. That is, this chip operating mode includes the water-touch pressing detection mode. It should be noted that there can be various triggering forms or conditions for whether the ultrasonic fingerprint chip enters the water-touch pressing detection mode, and no specific limitation is made.

[0039] When the ultrasonic fingerprint chip has entered the water-touch pressing detection mode, the ultrasonic fingerprint chip will respond to the operating state of having entered the water-touch pressing detection mode. The ultrasonic array emits ultrasonic signals to the detection area. Starting from the emission of the ultrasonic signals, they will pass through the chip layer by layer, then penetrate to the ultrasonic cover plate. After that, at least part of the ultrasonic signals will be reflected based on the pressing situation above the detection area of the ultrasonic fingerprint chip to form an ultrasonic echo signal. The array receives the ultrasonic echo signal to form an ultrasonic echo image. The ultrasonic fingerprint chip will respond to having entered the water-touch pressing detection mode and collect multiple consecutive frames of ultrasonic echo images. The ultrasonic echo image is the ultrasonic echo image corresponding to the ultrasonic fingerprint chip emitting ultrasonic signals to the detection area, and is the ultrasonic echo image generated when the ultrasonic cover plate corresponding to the detection area is in water.

[0040] It is worth noting that in order to ensure the accuracy of pressing detection and a good user experience, the time for the ultrasonic fingerprint chip to obtain an ultrasonic echo image once cannot be too long, and too short an image acquisition duration cannot ensure image clarity. Therefore, in the embodiments of this application, the single-image acquisition duration will be controlled within the duration obtained through calibration or testing. By way of example, as an example, the single-image acquisition duration can be within 10 ms, and no specific limitation is made.

[0041] After the ultrasonic fingerprint chip collects multiple consecutive frames of ultrasonic echo images, it determines the result of the pressing event according to the feature matching values of the multiple frames of ultrasonic echo images. The result of the pressing event includes a pressing event or no pressing event.

[0042] It can be seen that in this embodiment, the ultrasonic fingerprint chip is set with a water-involved pressing detection mode. When the ultrasonic fingerprint chip has entered the water-involved pressing detection mode, in response to the ultrasonic fingerprint chip having entered the water-involved pressing detection mode, a plurality of consecutive frames of ultrasonic echo images are collected. Since the corresponding ultrasonic echo noise images underwater are constantly changing, even if they are in the form of water pattern images, it is highly unlikely that the plurality of consecutive frames of ultrasonic echo images collected will show a high degree of similarity; while the ultrasonic echo images collected when a finger or other pressing object presses will show a high degree of similarity. Therefore, in the water-involved pressing detection mode, by using the feature matching values of a plurality of consecutive frames of ultrasonic echo images collected, the pressing is judged, and the influence of water pattern lines or signal deviation in the water-involved scenario can be solved, and the effectiveness of the pressing event output in the water-involved scenario can be accurately judged.

[0043] In addition, it is worth noting that based on the ultrasonic fingerprint chip, the embodiment of the present application can add the function of finger pressing detection without increasing the hardware cost, can enrich the use of the ultrasonic fingerprint chip in the application scenario, and can complete the finger pressing detection relying on the ultrasonic fingerprint chip itself, and can provide a click function for an electronic device integrated with ultrasonic fingerprint recognition but without a touch control chip.

[0044] In one embodiment, the above-mentioned pressing event results include no pressing event and a pressing event. Exemplarily, the pressing event includes, but is not limited to, pressing events such as single click, long press, and double click, etc., to meet various pressing detection requirements and improve detection diversity, and no specific limitation is made.

[0045] In one embodiment, as Figure 6 shown, in step S20, that is, determining the pressing event result according to the feature matching values of the plurality of frames of ultrasonic echo images includes: The ultrasonic fingerprint chip inputs the plurality of frames of ultrasonic echo images into a pre-trained neural network model, so that the neural network model calculates the feature matching values of the plurality of frames of ultrasonic echo images and outputs the pressing event result.

[0046] In this embodiment, in order to ensure the accuracy of pressing detection and a good user experience, an embodiment of the present application pre-trains a neural network model. The neural network model is trained based on sample training data, and the sample training data includes ultrasonic fingerprint sample images and abnormal ultrasonic sample images. The abnormal ultrasonic sample image is the ultrasonic echo image corresponding to the ultrasonic cover plate of the detection area when there is water on it. In the embodiment of the present application, a large amount of sample training data is used to train the neural network model to calculate the feature matching values of multiple input frames of ultrasonic echo images and output the pressing event result. During the training process, the training data used may include pressing event labels, and the pressing event labels include no pressing event labels and pressing event labels, so that supervised learning training can be performed to obtain a neural network model that can output the pressing event result based on multiple consecutive frames of ultrasonic echo images. Of course, as another example, during training, the sample training data may also only include multiple consecutive frames of ultrasonic fingerprint sample images and their calibration labels for training, without including the above abnormal ultrasonic sample images for training, and the specific details are not limited.

[0047] In addition, by way of example, the neural network model includes, but is not limited to, a convolutional neural network model CNN, a recurrent neural network RNN, or other neural network models. The specific network structure is not limited in the present application.

[0048] The trained neural network model can be solidified inside the ultrasonic fingerprint chip. The ultrasonic fingerprint chip inputs multiple frames of the ultrasonic echo images into the pre-trained neural network model, so that the neural network model calculates the feature matching values of multiple frames of the ultrasonic echo images and outputs the pressing event result. The pressing event result may include a pressing event and no pressing event.

[0049] As an example, an embodiment of the present application collects a large amount of data for the training and verification of the neural network. By way of example, the actual measurement results are shown in Table 1 below: Among them, click_touch represents a single click, i1~i5 respectively represent different database data, click_long_touch represents a long press, and double_click_touch represents a double click. It can be seen that based on this embodiment of the present application, the accuracy rate of detecting the pressing event reaches more than 98%, and the accuracy rates of double click and long press are greater than 95%.

[0050] It can be seen that in this embodiment, a method for determining the result of a pressing event according to the feature matching values of multiple frames of the ultrasonic echo images is provided. Specifically, the trained neural network model is used to process multiple consecutive frames of ultrasonic echo images collected in the wading pressing detection mode to output the result of the pressing event. Since the abnormal fixed images generated when there is water on the ultrasonic cover plate are also used as sample training data for calculation, these wading abnormal features will also be recorded or learned in the neural network model to effectively exclude the false detection results brought by the fixed images when there are foreign objects on the ultrasonic cover plate, improving the accuracy and speed of the output of the final pressing event result.

[0051] In other embodiments, in step S20, that is, when determining the result of the pressing event according to the feature matching values of multiple frames of the ultrasonic echo images, the neural network model may not be used. Instead, the ultrasonic fingerprint chip directly calculates the feature matching values of multiple frames of the ultrasonic echo images in other ways, and then determines the result of the pressing event according to the feature matching values. The specific method is not limited.

[0052] In one embodiment, the multiple consecutive frames of ultrasonic echo images specifically include two consecutive frames of the ultrasonic echo images. That is to say, when performing pressing detection, it is only necessary to take two consecutive frames of ultrasonic echo images, which can not only ensure the accurate implementation of pressing detection, but also greatly reduce the amount of image data processing and improve the data processing efficiency.

[0053] Based on this embodiment, two consecutive frames of ultrasonic echo images can be collected, and the feature matching values of the two consecutive frames of ultrasonic echo images can be directly calculated; or, two consecutive frames of ultrasonic echo images are collected and input into the pre-trained neural network model, so that the neural network model outputs the result of the pressing event. The neural network model will respectively extract the feature maps of the two consecutive frames of ultrasonic echo images, and then determine the output result of the pressing event based on the feature matching values of the feature maps of the two consecutive frames of ultrasonic echo images.

[0054] For ease of understanding, as Figure 7 shown, here, taking the processing of two consecutive frames of ultrasonic echo images as an example, in combination with Figure 7The flowchart shown below provides a more detailed introduction to the processing flow. In this embodiment, the ultrasonic fingerprint chip responds to the state of entering the wading press detection mode, obtains the Nth frame of ultrasonic echo image, and processes the Nth frame of ultrasonic echo image to obtain the Nth frame of feature map; obtains the (N + 1)th frame of ultrasonic echo image, and processes the (N + 1)th frame of ultrasonic echo image to obtain the (N + 1)th frame of feature map; calculates the feature matching value between the Nth frame of feature map and the (N + 1)th frame of feature map; determines whether the feature matching value is less than a preset threshold; when the determination is no (N), that is, the calculated feature matching value is greater than or equal to the preset threshold, it is determined that the press event result is no press event, and when the determination is yes (Y), that is, if the calculated feature matching value is less than the preset threshold, it is determined that the press event result is a press event. Subsequently, the (N + 1)th frame is set as the new Nth frame and referred to in the calculation process of the next cycle. Repeating multiple cycles can determine the situation of single press, multiple presses, or long press. The preset threshold is an empirical value or a calibrated value, which can be set according to the press detection requirements and is not specifically limited.

[0055] The calculation method of the feature matching degree between consecutive ultrasonic echo images can be calculated using a similarity calculation method, which is not specifically limited.

[0056] The above is described by taking the case of two consecutive frames as an example, which is not specifically limited. When the collected consecutive multiple frames of ultrasonic echo images include more than two frames (three frames or more), there are multiple implementation methods to determine the feature matching value of the multiple frames of ultrasonic echo images. For example, it can be calculated pairwise to calculate the feature matching value of each group of consecutive images respectively, and then select the largest group of feature matching values calculated from multiple groups to compare with the preset threshold; or, in each cycle, image screening is performed on the consecutive multiple frames of ultrasonic echo images to select two consecutive frames of ultrasonic echo images to participate in the calculation of the feature matching value; or calculate pairwise to calculate the feature matching value of each group of consecutive features respectively, and then obtain the average feature matching value. It is not specifically limited.

[0057] It should be noted that the ultrasonic fingerprint chip in this application can include multiple chip working modes. To improve the detection effectiveness, this application needs to design a wading press detection mode for the ultrasonic fingerprint chip, that is, the chip working mode includes the wading press detection mode. Only when the ultrasonic fingerprint chip enters this wading press detection mode can the signal acquisition and output of the press event result in this embodiment of the application be triggered. Moreover, the ultrasonic fingerprint chip can also include other chip working modes besides the non-wading press detection mode. Through the multiple working modes of the above ultrasonic fingerprint sensor, it is convenient to meet different press detection requirements of electronic devices including but not limited to underwater use or other situations with water, so as to improve the use effects of the ultrasonic fingerprint chip and the electronic device.

[0058] Optionally, the ultrasonic fingerprint chip in the present application may include multiple working modes. For example, in some alternative embodiments, the working modes of the ultrasonic fingerprint chip further include: a non-wading press detection mode, a fingerprint recognition mode, and a movement detection mode, etc. It should be understood that the non-wading press detection mode refers to a working mode of detecting whether the detection area of the ultrasonic fingerprint chip is pressed when not in the wading press detection mode; the fingerprint recognition mode refers to a working mode of performing fingerprint recognition based on an ultrasonic fingerprint image; and the movement detection mode refers to a mode in which the electronic device completes corresponding tasks by detecting finger movement in the detection area. Additionally, as an alternative solution, the working mode of the ultrasonic fingerprint chip may further include a reset mode, which can be used for system reset of the ultrasonic fingerprint sensor and is beneficial for working mode switching. In the reset mode, the ultrasonic fingerprint chip is turned on but does not transmit or receive ultrasonic signals.

[0059] There are various triggering forms or conditions for whether the ultrasonic fingerprint chip enters the wading press detection mode, and specific details are not limited. Several situations for entering the wading press detection mode are provided in this embodiment, enriching the triggering scenarios for press detection. They are described separately below: In one embodiment, before step S10, that is, before collecting a series of consecutive ultrasonic echo images, the method further includes: The ultrasonic fingerprint chip determines whether the electronic device is in a wading scenario based on sensing data. When it is determined that the electronic device is in a wading scenario, it is determined that the ultrasonic fingerprint chip has entered the wading press detection mode, and the sensing data is detected by a sensor of the electronic device; Or; the ultrasonic fingerprint chip obtains a mode indication signal sent by the processing unit of the electronic device, and determines that the ultrasonic fingerprint chip has entered the wading press detection mode in response to the mode indication signal; the mode indication signal is an indication signal input by the user, or the mode indication signal is determined by the processing unit based on the sensing data detected by the sensor of the electronic device.

[0060] It can be seen that in one embodiment, the electronic device in the embodiments of the present application may be pre-set with relevant sensors to facilitate detecting whether the electronic device is in a wading scenario. For example, detecting whether the electronic device is underwater or there is water in the detection area. If so, it indicates that the electronic device is in a wading scenario. The above wading scenarios are often encountered in daily life. For example, swimming in a pool, taking a bath, or in rainy or humid weather. In this embodiment, the relevant sensors of the electronic device may send the sensing data to the ultrasonic fingerprint chip for processing, so that the ultrasonic fingerprint chip can automatically determine whether the electronic device is in a wading scenario based on the sensing data.

[0061] In addition, the types of sensors used in this application are not specifically limited. For example, in some embodiments, the sensor may be a certain touch sensor of an electronic device. Exemplarily, the sensing data is touch sensing data detected by the touch sensor of the electronic device, and the touch sensing data may include capacitance data detected by the touch sensor. Since the capacitance data detected by the touch sensor will change before and after the electronic device enters the water, the ultrasonic fingerprint chip can determine that the electronic device is in a wading scenario through the change amount of the above capacitance data. Based on this, in the embodiments of this application, it is possible to accurately determine whether the electronic device is in a wading scenario through the touch sensing data, so as to facilitate the subsequent implementation of image acquisition and processing in the embodiments of this application, and improve the user's experience of using the ultrasonic fingerprint chip and the electronic device's wading press underwater. Of course, other touch sensing data can also be used to detect whether the electronic device is in a wading scenario, and the specific embodiments of this application do not make any limitations.

[0062] It should be noted that since the ultrasonic fingerprint chip itself is also a type of sensor of the electronic device, in some alternative embodiments, the function of the ultrasonic fingerprint chip can also be used to determine whether the electronic device is in a wading scenario. Especially in the scenario where the entire electronic device is in the water, due to the flowing nature of the water, the ultrasonic echo signals corresponding to the detection area of the ultrasonic fingerprint chip also have corresponding flowing characteristics. Therefore, based on this flowing characteristic, it can be determined whether the electronic device is in a wading scenario. Based on this, in the embodiments of this application, it is possible to accurately determine whether the electronic device is in a wading scenario through the water flow characteristics characterized by the ultrasonic echo signals, so as to facilitate the subsequent implementation of image acquisition and processing in the embodiments of this application, and improve the user's experience of using the ultrasonic fingerprint chip and the electronic device underwater. Of course, there are other ways for the ultrasonic fingerprint chip to determine whether the electronic device is in a wading scenario, and no specific limitations are made. For example, since there will be differences in the ultrasonic echo signals before and after the electronic device enters the water, and the transmission medium of the ultrasonic signal also changes, the determination of whether the electronic device is in a wading scenario can also be achieved through the above differences or changes, and the specific embodiments of this application do not make any limitations.

[0063] In one embodiment, when it is determined that the electronic device is in a wading scenario, determining that the ultrasonic fingerprint chip has entered the wading press detection mode includes: Judging the type of wading scenario; When the type of wading scenario indicates that the electronic device is in a full-coverage water scenario, judge whether the trigger condition is met according to the water flow characteristic features; When the type of wading scenario is that the electronic device is in a non-full-coverage water scenario, judge whether the trigger condition is met according to the water coverage area of the ultrasonic cover plate corresponding to the detection area; When the trigger condition is satisfied, it is determined that the ultrasonic fingerprint chip has entered the water-contact pressing detection mode.

[0064] In this embodiment, when determining whether the electronic device is in a water-contact scenario based on the sensing data, the type of the water-contact scenario will be further determined. When the type of the water-contact scenario indicates that the electronic device is in a full-coverage water scenario, it will be further combined with the characteristics of the water flow to determine whether the trigger condition is satisfied. Only when the characteristics of the water flow also satisfy the trigger condition, it will be finally determined that the ultrasonic fingerprint chip has entered the water-contact pressing detection mode to perform subsequent processing in response to the water-contact pressing detection mode. Due to the influence of the characteristics of the water flow, the ultrasonic echo signals generated by some special water flow characteristics may obviously not be similar to human fingerprints. If such characteristics are satisfied, there is no need to trigger the detection. On the contrary, subsequent processing will be triggered. Based on this method, the detection effectiveness can be further improved, and the processing of invalid data in some special scenarios can be excluded, improving the pertinence of scenario processing.

[0065] In addition, in an embodiment, when the type of the water-contact scenario is that the electronic device is in a non-full-coverage water scenario, it can be determined whether the trigger condition is satisfied according to the water coverage area of the ultrasonic cover plate corresponding to the detection area. Since the influence of water contact may be weak when the electronic device is in a non-full-coverage water scenario, it will be finally determined that the ultrasonic fingerprint chip has entered the water-contact pressing detection mode only when the area reaches the required condition to perform subsequent processing in response to the water-contact pressing detection mode. Based on this method, the detection effectiveness can also be further improved, and the processing of invalid data in some special scenarios can be excluded, improving the pertinence of scenario processing.

[0066] It should be noted that the specific method for the type of the water-contact scenario is not limited in the embodiments of the present application. For example, it can be directly based on the capacitance data detected by the touch sensor of the electronic device to jointly determine whether to enter the water-contact scenario and the type of the water-contact scenario, which is not specifically limited. In other embodiments, it can actually also be jointly determined whether to enter the water-contact scenario and the type of the water-contact scenario based on the situation of the detection area of the ultrasonic fingerprint chip, which are not specifically limited.

[0067] Another way is that it can also be switched manually by the user. For example, in one implementation, it can be set through the setting interface of the electronic device to set the ultrasonic fingerprint chip to be in the water-contact pressing detection mode. In this way, by actively setting the user to the water-contact pressing detection mode, it can be accurately determined that the electronic device is already in a water-contact scenario. In addition, it can better meet the personalized setting needs of the user to use the ultrasonic fingerprint chip and the electronic device underwater, further improving the touch experience of the electronic device.

[0068] For example, as an illustrative application scenario, assume that when a user wishes to implement a screen click function in a wet or underwater environment, the user can trigger an indication signal (i.e., the indication signal input by the user) in advance through a button (virtual button or physical button) of the electronic device, causing the ultrasonic fingerprint chip to switch from other operating modes to the wading press detection mode to prepare for wading press detection in advance; for the electronic device, before entering the water, based on the indication signal input by the user, the electronic device issues a mode indication signal to make the ultrasonic fingerprint chip enter the wading press detection mode, so that the ultrasonic fingerprint chip operates in response to this wading press detection mode, that is, continuously detects whether there is a press. In one embodiment, the electronic device can continue to keep the ultrasonic fingerprint chip in the wading press detection mode as needed, or exit the wading press detection mode in the same way as indicated by the user input, without specific limitation.

[0069] Another way is that the mode indication signal can also be determined by the processing unit of the electronic device based on the sensing data detected by the sensors of the electronic device; when the electronic device is in a wading scenario, the processing unit of the electronic device sends a mode indication signal to the ultrasonic fingerprint chip, so that the ultrasonic fingerprint chip responds to this mode indication signal to confirm that it has entered the wading press detection mode, and can accurately determine that the electronic device is in a wading scenario, so as to facilitate subsequent control of the operation of the ultrasonic fingerprint chip. Further, in one embodiment, the mode indication signal can also be jointly determined by the processing unit of the electronic device based on whether the electronic device is in a wading scenario and the type of the wading scenario, without specific limitation. The processing method of the processing unit of the electronic device based on the sensing data detected by the sensors to determine whether the electronic device is in a wading scenario and the processing method related to the type of the wading scenario can refer to the processing method of the ultrasonic fingerprint chip based on the sensing data detected by the sensors to determine whether the electronic device is in a wading scenario and the processing method of the type of the wading scenario in the foregoing embodiments, without specific limitation and not elaborated one by one. It should be noted that since it is the processing unit of the electronic device that processes the sensing data, it is also beneficial to reduce the data processing volume of the ultrasonic fingerprint chip, reduce the excessive occupation of the computing resources of the ultrasonic fingerprint chip, and improve the chip processing speed.

[0070] In one embodiment, after step S20, that is, after determining the result of the press event according to the feature matching values of multiple frames of the ultrasonic echo images, the method further includes: The ultrasonic fingerprint chip sends the result of the press event to the processing unit of the electronic device, so that the processing unit responds to the result of the press event to implement the upper-layer functions corresponding to the result of the press event. For example, the functions corresponding to a single click, a double click, etc.

[0071] In one embodiment, the ultrasonic fingerprint chip transmits the ultrasonic signal at a fixed transmission frequency, and multiple frames of the ultrasonic echo images are the ultrasonic echo images of the ultrasonic signal transmitted at the fixed transmission frequency.

[0072] In this embodiment, the ultrasonic fingerprint chip transmits the ultrasonic signal at a fixed transmission frequency to accurately obtain the ultrasonic echo images in a water-related scenario, ensuring accurate acquisition of all required image data.

[0073] It should be understood that the above exemplary description of the pressing detection method provided in the first aspect of the embodiments of the present application does not impose any limitation on the embodiments of the present application.

[0074] In one embodiment, the second aspect of the embodiments of the present application further provides a pressing detection method for a processing unit of an electronic device. The method includes the following steps: S101: Obtain multiple consecutive frames of ultrasonic echo images sent after the ultrasonic fingerprint chip enters the water-related pressing detection mode. The ultrasonic echo images are the ultrasonic echo images corresponding to the ultrasonic signal transmitted by the ultrasonic fingerprint chip to the detection area, and are the ultrasonic echo images generated when the ultrasonic cover plate corresponding to the detection area is in water. S102: Determine the result of the pressing event according to the feature matching values of multiple frames of the ultrasonic echo images.

[0075] It should be understood that the ultrasonic fingerprint chip can be a fingerprint chip that realizes functions through ultrasonic signals. The ultrasonic fingerprint chip is electrically connected to the processing unit of the electronic device. A pressing detection method provided in the second aspect of the present application can be executed by the processing unit of the electronic device, and specific details are not limited. The electronic device can be any type of electronic device. For example, it can be a mobile terminal such as a mobile phone, a tablet computer, a computer, a server, etc., or some interactive test devices, vehicle control devices, or door lock control electronic devices, etc., and specific details are not limited.

[0076] The ultrasonic fingerprint signals in the present application can include multiple chip working modes. In order to enable an ordinary ultrasonic fingerprint chip to realize the water-related pressing detection function, the present application needs to design a water-related pressing detection mode for the ultrasonic fingerprint chip. That is, the chip working mode includes the water-related pressing detection mode. It should be noted that there can be various triggering forms or conditions for whether the ultrasonic fingerprint chip enters the water-related pressing detection mode, and specific details are not limited.

[0077] When the ultrasonic fingerprint chip has entered the water-touch detection mode, the ultrasonic fingerprint chip will respond to the working state of having entered the water-touch detection mode. The ultrasonic array emits ultrasonic signals to the detection area. Starting from the emission of the ultrasonic signals, they will pass through the chip layer by layer, then penetrate to the ultrasonic cover plate. After that, at least part of the ultrasonic signals will be reflected based on the pressing situation above the detection area of the ultrasonic fingerprint chip, forming an ultrasonic echo signal. The array receives the ultrasonic echo signal to form an ultrasonic echo image, and continuously acquires multiple frames of ultrasonic echo images. The processing unit of the electronic device will obtain the multiple frames of the ultrasonic echo images collected by the above ultrasonic fingerprint chip, and then determine the pressing event result according to the feature matching values of the multiple frames of the ultrasonic echo images. The pressing event result includes a pressing event or no pressing event.

[0078] It should be noted that, in order to ensure the accuracy of pressing detection and a good user experience, the time for the processing unit of the electronic device to acquire an ultrasonic echo image once cannot be too long, and too short an image acquisition duration cannot guarantee image clarity. Therefore, in the embodiments of the present application, the single-image acquisition duration will be controlled within the duration obtained through calibration or testing. For example, as an example, the single-image acquisition duration can be within 10 ms, and no specific limitation is made.

[0079] It can be seen that in this embodiment, the ultrasonic fingerprint chip is provided with a water-touch detection mode. When the ultrasonic fingerprint chip has entered the water-touch detection mode, it will respond to the fact that the ultrasonic fingerprint chip has entered the water-touch detection mode and acquire multiple consecutive frames of ultrasonic echo images. Since the corresponding ultrasonic echo noise images underwater are constantly changing, even if they are in the form of water pattern images, it is highly unlikely that multiple consecutive frames of ultrasonic echo images collected will show a high degree of similarity; while the ultrasonic echo images collected when a finger or other pressing object presses will show a high degree of similarity. Therefore, in the water-touch detection mode, by performing pressing judgment based on the feature matching values of multiple consecutive frames of ultrasonic echo images collected, the effectiveness of the pressing event output in the water-touch scenario can be accurately judged.

[0080] It should be noted that the pressing detection method provided in the second aspect of the present application is executed by the processing unit of the electronic device. For the introduction of the ultrasonic fingerprint chip, the electronic device and other related contents, reference can be made to the relevant contents of the pressing detection method embodiment in the first aspect above, and the subsequent relevant contents can also be understood by referring to the above, and will not be elaborated here.

[0081] In an embodiment, the determining the pressing event result according to the feature matching values of the multiple frames of the ultrasonic echo images includes: The processing unit of the electronic device inputs multiple frames of the ultrasonic echo images into a pre-trained neural network model, enabling the neural network model to calculate the feature matching values of the multiple frames of the ultrasonic echo images and output the result of the pressing event; The neural network model is trained based on sample training data, and the sample training data includes ultrasonic fingerprint sample images and abnormal ultrasonic sample images. The abnormal ultrasonic sample images are the ultrasonic echo images corresponding to when there is water on the detection area.

[0082] The trained neural network model can be solidified inside the processing unit of the electronic device. The processing unit of the electronic device inputs multiple frames of the ultrasonic echo images into the pre-trained neural network model, enabling the neural network model to calculate the feature matching values of the multiple frames of the ultrasonic echo images and output the result of the pressing event. The result of the pressing event may include a pressing event and no pressing event.

[0083] In one embodiment, the consecutive multiple frames of ultrasonic echo images include two consecutive frames of the ultrasonic echo images.

[0084] In one embodiment, before obtaining the consecutive multiple frames of ultrasonic echo images sent by the ultrasonic fingerprint chip, The processing unit of the electronic device determines whether the electronic device is in a wading scenario based on sensing data. In response to the electronic device being in a wading scenario, a mode indication signal is sent to the ultrasonic fingerprint chip to enable the ultrasonic fingerprint chip to enter the wading press detection mode. The sensing data is detected by the sensors of the electronic device; Or; The processing unit of the electronic device sends the mode indication signal to the ultrasonic fingerprint chip in response to an indication signal from the user setting the electronic device to be in a wading scenario, so that the ultrasonic fingerprint chip enters the wading press detection mode.

[0085] In one embodiment, the sending the mode indication signal to the ultrasonic fingerprint chip in response to the electronic device being in a wading scenario includes: When the processing unit of the electronic device determines that the electronic device is in a wading scenario, and when the wading scenario type indicates that the electronic device is in a full-coverage water scenario, it determines whether the trigger condition is met according to the water flow characteristic features; When the trigger condition is met, the mode indication signal is sent to the ultrasonic fingerprint chip.

[0086] In one embodiment, the method further includes: When the processing unit of the electronic device determines that the electronic device is in a wading scenario, and when the wading scenario type is that the electronic device is in a non-full-coverage water scenario, it determines whether the trigger condition is met according to the water coverage area of the ultrasonic cover plate corresponding to the detection area.

[0087] It should be noted that in any optional embodiment of the pressing detection method in the second aspect, the processing unit of the electronic device undertakes most of the processing work, which can effectively reduce the computing resources occupied by the ultrasonic fingerprint chip to a certain extent and ensure the function of the ultrasonic fingerprint chip.

[0088] The above mainly describes some content of the method provided by the embodiments of the present application. Later, the embodiments of the relevant devices, media, and equipment provided by the embodiments of the present application will be described.

[0089] In one embodiment, a pressing detection device for an ultrasonic fingerprint chip is provided. The functions of the pressing detection device correspond one-to-one to those of the ultrasonic fingerprint chip in the pressing detection method in the above embodiment. As Figure 8 shown, the pressing detection device includes an acquisition module 101 and a first processing module 102. The detailed description of each functional module is as follows: The acquisition module 101 is configured to collect a continuous multi-frame ultrasonic echo image in response to the ultrasonic fingerprint chip entering the wading pressing detection mode. The ultrasonic echo image is the ultrasonic echo image corresponding to the ultrasonic fingerprint chip emitting an ultrasonic signal to the detection area, and is the ultrasonic echo image generated when the ultrasonic cover plate corresponding to the detection area is wading. The first processing module 102 is configured to determine the pressing event result according to the feature matching values of the multi-frame ultrasonic echo images.

[0090] It should be noted that the pressing detection device and its optional embodiments in the embodiments of the present application can be correspondingly referred to the relevant content in the method embodiments of the first aspect described above. Therefore, the relevant content and beneficial effects can be referred to the content of the above method embodiments and will not be elaborated here.

[0091] In one embodiment, a pressing detection device for the processing unit of an electronic device is provided. The functions of the pressing detection device correspond one-to-one to those of the processing unit of the electronic device in the pressing detection method in the above embodiment. As Figure 9 shown, the pressing detection device includes an acquisition module 201 and a second processing module 202. The detailed description of each functional module is as follows: An acquisition module 201, configured to acquire a plurality of consecutive ultrasonic echo images sent after an ultrasonic fingerprint chip enters a water-contact pressing detection mode, where the ultrasonic echo images are ultrasonic echo images corresponding to the ultrasonic fingerprint chip emitting ultrasonic signals to a detection area, and are ultrasonic echo images generated when an ultrasonic cover plate corresponding to the detection area is in contact with water; A second processing module 202, configured to determine a pressing event result according to the feature matching values of the plurality of ultrasonic echo images.

[0092] It should be noted that for the pressing detection device and its optional embodiments in the embodiments of the present application, reference may be made to the relevant content in the foregoing method embodiments. Therefore, the relevant content and beneficial effects thereof may refer to the content of each embodiment of the foregoing method, and will not be elaborated herein.

[0093] In one embodiment, an ultrasonic fingerprint chip for an electronic device is provided. The ultrasonic fingerprint chip includes an ultrasonic array, a control unit, a digital-to-analog converter, and a processing unit, where: The ultrasonic array is configured to respond to the control unit to emit ultrasonic signals; The digital-to-analog converter is configured to perform digital-to-analog conversion on ultrasonic echo signals; The processing unit is configured to implement the steps or functions on the ultrasonic fingerprint chip side in the pressing detection method described in any one of the foregoing first aspects based on the ultrasonic echo signals.

[0094] It should be noted that for the ultrasonic fingerprint chip and its optional embodiments in the embodiments of the present application, reference may be made to the relevant content in the foregoing method embodiments. Therefore, the relevant content and beneficial effects thereof may refer to the content of each embodiment of the foregoing method, and will not be elaborated herein.

[0095] In one embodiment, as Figure 10 shown, an electronic device is further provided, including: a processor, a communication interface, a memory, and a communication bus. The processor, the communication interface, and the memory complete communication with each other through the communication bus; The memory is configured to store a computer program; The processor is configured to execute the steps or functions on the electronic device side in the pressing detection method described in any one of the foregoing by running the computer program stored on the memory.

[0096] Specifically, the computer program may include program code, which includes computer operation instructions. The processor may be a CPU, or a GPU (Graphic Processing Unit), or an application specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present application. One or more processors included in the intelligent device may be of the same type of processor, such as one or more CPUs; or may be of different types of processors, such as one or more CPUs and one or more ASICs. The memory is used to store the computer program. The memory may include high-speed RAM memory and may also include non-volatile memory, such as at least one disk memory. The computer program may be used to cause the processor to execute the pressing detection method in the foregoing embodiments.

[0097] In addition, for the specific implementation of each step in the computer program, reference may be made to the corresponding steps and descriptions in the corresponding units in any of the method embodiments in the foregoing first aspect or second aspect, which will not be elaborated herein. Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described devices and modules may refer to the corresponding process descriptions in the foregoing method embodiments, which will not be elaborated herein. The electronic device in the embodiments of the present application has been described in detail in the foregoing pressing detection method embodiments. Therefore, the relevant content and beneficial effects thereof may be understood with reference to the foregoing method embodiments and will not be elaborated herein.

[0098] In one embodiment, a readable storage medium is provided. The readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of any one of the pressing detection methods in the foregoing method embodiments are implemented. The computer storage medium includes, but is not limited to, a compact disc read-only memory (CD-ROM), a random access memory (RAM), a floppy disk, a hard disk, or a magneto-optical disk, etc.

[0099] In one embodiment, a computer program product is provided, including a computer program, and when the computer program is executed by a processor, the steps of any one of the pressing detection methods in the foregoing method embodiments are implemented.

[0100] The device, equipment, computer storage medium, and computer program product embodiments in the embodiments of the present application have been described in detail in the foregoing pressing detection method embodiments. Therefore, the relevant content and beneficial effects thereof may be understood with reference to the foregoing method embodiments and will not be elaborated herein.

[0101] Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be completed by instructing relevant hardware through a computer program. The computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above methods. Any reference to a memory, storage, database, or other medium used in the embodiments provided in the present application can include non-volatile and / or volatile memories.

[0102] The methods according to the embodiments of the present application described above can be implemented in hardware, firmware, or be implemented as software or computer code that can be stored in a recording medium (such as a CD-ROM, RAM, floppy disk, hard disk, or magneto-optical disk), or be implemented as computer code originally stored in a remote recording medium or a non-transitory machine-readable medium and downloaded through a network and will be stored in a local recording medium. Thus, the methods described herein can be stored on such a recording medium for software processing using a general-purpose computer, a dedicated processor, or programmable or dedicated hardware (such as an Application Specific Integrated Circuit (ASIC) or a Field Programmable Gate Array (FPGA)). It can be understood that a computer, a processor, a microprocessor controller, or programmable hardware includes a storage component (such as a Random Access Memory (RAM), a Read-Only Memory (ROM), a flash memory, etc.) that can store or receive software or computer code. When the software or computer code is accessed and executed by the computer, the processor, or the hardware, the methods described herein are implemented. In addition, when a general-purpose computer accesses the code for implementing the methods shown herein, the execution of the code converts the general-purpose computer into a dedicated computer for executing the methods shown herein.

[0103] Those skilled in the art can clearly understand that, for the convenience and conciseness of description, only the above division of each functional unit and module is used as an example. In actual applications, the above functions can be allocated to different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above.

[0104] The above-described embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements for some technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the various embodiments of the present application, and should all be included in the protection scope of the present application.

Claims

1. A pressing detection method for an ultrasonic fingerprint chip of an electronic device, the method comprising: In response to the ultrasonic fingerprint chip entering the wading pressing detection mode, collecting a continuous plurality of frames of ultrasonic echo images, where the ultrasonic echo images are the ultrasonic echo images corresponding to the ultrasonic fingerprint chip emitting ultrasonic signals to the detection area, and are the ultrasonic echo images generated when the ultrasonic cover plate corresponding to the detection area is wading; Determining the pressing event result according to the feature matching values of the plurality of frames of ultrasonic echo images.

2. The pressing detection method according to claim 1, wherein The determining the pressing event result according to the feature matching values of the plurality of frames of ultrasonic echo images includes: Inputting the plurality of frames of ultrasonic echo images into a pre-trained neural network model, enabling the neural network model to calculate the feature matching values of the plurality of frames of ultrasonic echo images, and outputting the pressing event result; The neural network model is trained based on sample training data, where the sample training data includes ultrasonic fingerprint sample images and abnormal ultrasonic sample images, and the abnormal ultrasonic sample images are the ultrasonic echo images corresponding to when there is water on the ultrasonic cover plate corresponding to the detection area.

3. The pressing detection method according to claim 1, wherein Before collecting the continuous plurality of frames of ultrasonic echo images, the method further includes: Determining whether the electronic device is in a wading scenario based on sensing data, and when it is determined that the electronic device is in a wading scenario, determining that the ultrasonic fingerprint chip has entered the wading pressing detection mode, where the sensing data is detected by the sensors of the electronic device; Or; Obtaining a mode indication signal sent by the processing unit of the electronic device, and determining that the ultrasonic fingerprint chip has entered the wading pressing detection mode in response to the mode indication signal; The mode indication signal is an indication signal input by the user, or the mode indication signal is determined by the processing unit based on the sensing data detected by the sensors of the electronic device.

4. The pressing detection method according to claim 3, wherein The determining that the ultrasonic fingerprint chip has entered the wading pressing detection mode when it is determined that the electronic device is in a wading scenario includes: When it is determined that the electronic device is in a wading scenario, when the wading scenario type indicates that the electronic device is in a full-coverage water scenario, determining whether the trigger condition is satisfied according to the water flow characteristic features; When the trigger condition is satisfied, determining that the ultrasonic fingerprint chip has entered the wading pressing detection mode.

5. The pressing detection method according to claim 4, wherein The method further includes: When it is determined that the electronic device is in a wading scenario and the wading scenario type is that the electronic device is in a non-full-coverage water scenario, determining whether the trigger condition is satisfied according to the water coverage area of the ultrasonic cover plate corresponding to the detection area.

6. A pressing detection method for a processing unit of an electronic device, characterized in that, The method includes: Obtaining a continuous plurality of frames of ultrasonic echo images sent after the ultrasonic fingerprint chip enters the wading pressing detection mode, where the ultrasonic echo images are the ultrasonic echo images corresponding to the ultrasonic fingerprint chip emitting ultrasonic signals to the detection area, and are the ultrasonic echo images generated when the ultrasonic cover plate corresponding to the detection area is wading; Determining the pressing event result according to the feature matching values of the plurality of frames of ultrasonic echo images.

7. The pressing detection method according to claim 6, wherein, Determining a pressing event result according to the feature matching values of multiple frames of the ultrasonic echo images includes: Inputting multiple frames of the ultrasonic echo images into a pre-trained neural network model, enabling the neural network model to calculate the feature matching values of multiple frames of the ultrasonic echo images, and outputting the pressing event result; The neural network model is trained based on sample training data, and the sample training data includes ultrasonic fingerprint sample images and abnormal ultrasonic sample images, and the abnormal ultrasonic sample images are ultrasonic echo images corresponding to when there is water on the detection area.

8. The pressing detection method according to any one of claims 6-7, characterized in that, Before acquiring multiple consecutive frames of ultrasonic echo images sent by the ultrasonic fingerprint chip, the method further includes: Determining whether the electronic device is in a wading scenario based on sensing data, and in response to the electronic device being in a wading scenario, sending a mode indication signal to the ultrasonic fingerprint chip to enable the ultrasonic fingerprint chip to enter the wading pressing detection mode, where the sensing data is detected by a sensor of the electronic device; Or; In response to an indication signal that the user sets the electronic device to be in a wading scenario, sending the mode indication signal to the ultrasonic fingerprint chip to enable the ultrasonic fingerprint chip to enter the wading pressing detection mode.

9. The pressing detection method according to claim 8, wherein, The responding to the electronic device being in a wading scenario and sending a mode indication signal to the ultrasonic fingerprint chip includes: When it is determined that the electronic device is in a wading scenario, when the wading scenario type indicates that the electronic device is in a full-coverage water scenario, determining whether a trigger condition is met according to the water flow characteristic features; When the trigger condition is met, sending the mode indication signal to the ultrasonic fingerprint chip.

10. The pressing detection method according to claim 9, wherein The method further includes: When it is determined that the electronic device is in a wading scenario and the wading scenario type is that the electronic device is in a non-full-coverage water scenario, determining whether the trigger condition is met according to the water coverage area of the ultrasonic cover plate corresponding to the detection area.

11. A pressing detection device, characterized in that, The device includes: An acquisition module, configured to acquire multiple consecutive frames of ultrasonic echo images in response to the ultrasonic fingerprint chip entering the wading pressing detection mode, where the ultrasonic echo images are ultrasonic echo images corresponding to the ultrasonic fingerprint chip emitting ultrasonic signals to the detection area, and are ultrasonic echo images generated when the ultrasonic cover plate corresponding to the detection area is wading; A first processing module, configured to determine a pressing event result according to the feature matching values of multiple frames of the ultrasonic echo images.

12. A pressing detection device, characterized in that, The device includes: An acquisition module, configured to acquire multiple consecutive frames of ultrasonic echo images sent after the ultrasonic fingerprint chip enters the wading pressing detection mode, where the ultrasonic echo images are ultrasonic echo images corresponding to the ultrasonic fingerprint chip emitting ultrasonic signals to the detection area, and are ultrasonic echo images generated when the ultrasonic cover plate corresponding to the detection area is wading; A second processing module, configured to determine a pressing event result according to the feature matching values of multiple frames of the ultrasonic echo images.

13. An ultrasonic fingerprint chip for an electronic device, the ultrasonic fingerprint chip comprising an ultrasonic array, a control unit, a digital-to-analog converter, and a processing unit, wherein: The ultrasonic array is configured to respond to the control unit to transmit ultrasonic signals; The digital-to-analog converter is configured to perform digital-to-analog conversion on the ultrasonic echo signals; The processing unit is configured to implement the pressing detection method according to any one of claims 1-5 based on the ultrasonic echo signals.

Images