Control method and apparatus, electronic device, storage medium and computer program product

Abstract

Embodiments of the present application provide a control method and apparatus, an electronic device, a storage medium and a computer program product. The control method is used for an ultrasonic fingerprint sensor of a terminal device. The control method comprises: determining whether the terminal device has entered an underwater working mode; and in response to the terminal device having entered the underwater working mode, determining a target working mode of the ultrasonic fingerprint sensor, and controlling the ultrasonic fingerprint sensor to operate in the target working mode.

Description

Control method and device, electronic device, storage medium and computer program product TECHNICAL FIELD

[0001] Embodiments of the present application relate to the technical field of fingerprint sensor, and in particular to a control method and device, electronic device, storage medium and computer program product. BACKGROUND

[0002] The waterproof performance of terminal devices such as mobile phones is continuously improving at the present stage, and users also have the demand to use terminal devices such as mobile phones underwater in some scenarios. For example, if a user accidentally brings a mobile phone into water while swimming, the user still hopes that the mobile phone will not malfunction due to water immersion, and even hopes to be able to normally use the mobile phone underwater. Some terminal devices rely on fingerprint sensors to realize unlocking, transaction and other functions, but most of the current fingerprint technology solutions cannot well meet the demand to work underwater, resulting in poor underwater use effect of the terminal devices. Therefore, a new technical solution is needed to improve this problem.

[0003] SUMMARY

[0004] In view of this, embodiments of the present application provide a control solution.

[0005] According to a first aspect of embodiments of the present application, a control method is provided for an ultrasonic fingerprint sensor of a terminal device, the method comprising: determining whether the terminal device has entered an underwater working mode; in response to the terminal device having entered the underwater working mode, determining a target working mode of the ultrasonic fingerprint sensor, and controlling the ultrasonic fingerprint sensor to enter the target working mode and run.

[0006] According to a second aspect of embodiments of the present application, a control method is provided, comprising: a control unit for a terminal device, the method comprising: determining whether the terminal device has entered an underwater working mode, and in response to determining that the terminal device has entered the underwater working mode, generating an indication signal; sending the indication signal to the ultrasonic fingerprint sensor, so that the ultrasonic fingerprint sensor determines a target working mode of the ultrasonic fingerprint sensor in response to the indication signal, and enters the target working mode and runs.

[0007] According to a third aspect of embodiments of the present application, a control device is provided for an ultrasonic fingerprint sensor of a terminal device, the control device comprising: a first determination module configured to determine whether the terminal device has entered an underwater working mode; and a first control module configured to, in response to the terminal device having entered the underwater working mode, determine a target working mode of the ultrasonic fingerprint sensor, and control the ultrasonic fingerprint sensor to enter the target working mode and run.

[0008] According to a fourth aspect of the embodiments of the present application, a control device is provided, comprising: a control unit for a terminal device, the control device comprising: a second determination module configured to determine whether the terminal device has entered an underwater working mode, and generate an indication signal in response to determining that the terminal device has entered the underwater working mode; and a second control module configured to send the indication signal to the ultrasonic fingerprint sensor, so that the ultrasonic fingerprint sensor determines a target working mode of the ultrasonic fingerprint sensor in response to the indication signal, and operates in the target working mode.

[0009] According to a fifth aspect of the embodiments of the present application, an electronic device is provided, comprising: a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory complete communication with each other through the communication bus; the memory is configured to store a computer program; and the processor is configured to execute the method of the first aspect or the second aspect by running the computer program stored on the memory.

[0010] According to a sixth aspect of the embodiments of the present application, a computer storage medium is provided, having a computer program stored thereon, the computer program being executed by a processor to implement the method of the first aspect or the second aspect.

[0011] According to a seventh aspect of the embodiments of the present application, a computer program product is provided, comprising a computer program, the computer program being executed by a processor to implement the method of the first aspect or the second aspect.

[0012] According to the control scheme provided by the embodiments of the present application, on the one hand, the terminal device uses an ultrasonic fingerprint sensor to implement a fingerprint function. Since the ultrasonic fingerprint sensor implements the fingerprint function through ultrasonic signals, and the ultrasonic signals are less affected underwater, compared with other types of fingerprint sensors, the use of the ultrasonic fingerprint sensor can better maintain the use effect of the fingerprint function of the terminal device when the terminal device is used underwater. On the other hand, since the terminal device has a special underwater working mode in the control scheme of the present application, the needs of underwater use of the terminal device can be better met, thereby improving the user experience. On the other hand, since the target working mode of the ultrasonic fingerprint sensor can be determined when the terminal device has entered the underwater working mode, and the ultrasonic fingerprint sensor is controlled to enter the target working mode and operate, the ultrasonic fingerprint sensor can enter the appropriate target working mode and operate on the basis of being enabled and working in the underwater working mode, thereby better meeting the needs of users to use the ultrasonic fingerprint sensor and the terminal device underwater, and further improving the underwater use experience of the terminal device. BRIEF DESCRIPTION OF DRAWINGS

[0013] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings needed to be used in the embodiments or prior art description. Obviously, the drawings described below are only some of the embodiments of the present application, and for those of ordinary skill in the art, other drawings can also be obtained from these drawings.

[0014] FIG. 1 is a step flow chart of a control method according to a first aspect of the present application.

[0015] FIG. 2 is an optional flow chart of determining navigation control information according to an embodiment of the present application.

[0016] FIG. 3A is a schematic diagram of the position arrangement of a plurality of sub-ultrasonic units of an ultrasonic fingerprint sensor according to some embodiments of the present application.

[0017] FIG. 3B is an optional schematic diagram of an echo intensity distribution corresponding to the plurality of sub-ultrasonic units of FIG. 3A.

[0018] FIG. 4 is an echo intensity distribution corresponding to two different time instants in one example.

[0019] FIG. 5 is a schematic diagram of the change of the position of the center point of the finger pressing at two different time instants corresponding to FIG. 4.

[0020] FIG. 6 is a step flow chart of a control method according to a second aspect of the present application.

[0021] FIG. 7 is an implementation flow chart of an optional scenario of determining navigation control information by the control unit when the ultrasonic fingerprint sensor is running in the navigation working mode according to an embodiment of the present application.

[0022] FIG. 8 is a schematic diagram of a control device according to a third aspect of the present application.

[0023] FIG. 9 is a schematic diagram of a control device according to a fourth aspect of the present application.

[0024] FIG. 10 is a structural schematic diagram of an electronic device according to a fifth aspect of the present application. DETAILED DESCRIPTION

[0025] In order to make the person skilled in the art better understand the technical solutions in the embodiments of the present application, the technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, and not all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art should belong to the scope of protection of the present application.

[0026] The embodiments of the present application are further illustrated below with reference to the accompanying drawings.

[0027] FIG. 1 is a flow chart of steps of a control method according to a first aspect of the embodiments of the present application. According to the first aspect of the embodiments of the present application, a control method is provided for an ultrasonic fingerprint sensor of a terminal device. Referring to FIG. 1, the control method includes steps S102 and S104, specifically:

[0028] S102: Determine whether the terminal device has entered an underwater working mode.

[0029] The ultrasonic fingerprint sensor can be a fingerprint sensor that realizes functions through ultrasonic signals. Alternatively, the control method provided by the first aspect of the present application can be executed by the ultrasonic fingerprint sensor, for example, specifically by a processing unit (which can include any processor such as a CPU, MCU, etc.) inside the ultrasonic fingerprint sensor.

[0030] In the embodiments of the present application, the terminal device can be any type of electronic device. For example, it can be a mobile terminal such as a mobile phone, a tablet computer, a computer, a server, etc. Hereinafter, the terminal device can be exemplified and understood as a mobile phone.

[0031] Alternatively, the type of ultrasonic fingerprint sensor in the present application can include at least one of a side ultrasonic fingerprint sensor, a back ultrasonic fingerprint sensor, and an under-screen ultrasonic fingerprint sensor. Through the above types of ultrasonic fingerprint sensors, side fingerprint recognition, back fingerprint recognition, or under-screen fingerprint recognition can be realized to meet the use requirements of the terminal device.

[0032] It should be understood that the specific structure of the ultrasonic fingerprint sensor is not limited in the embodiments of the present application, as long as it can meet the requirements. Alternatively, the ultrasonic fingerprint sensor in the present application can include a plurality of ultrasonic sub-units, each of which can emit and receive ultrasonic signals, and the plurality of ultrasonic sub-units can form an M-column N-row array. Each ultrasonic sub-unit can be equivalent to a "pixel".

[0033] Optionally, the ultrasonic sub-unit can include a piezoelectric material layer, and can emit and receive ultrasonic signals based on a piezoelectric effect. For example, in the scenario of fingerprint collection by an ultrasonic fingerprint sensor, a finger can be pressed above the detection area of the ultrasonic fingerprint sensor, and the ultrasonic fingerprint sensor can emit ultrasonic signals to the finger. From the start of the emission of the ultrasonic signals, the ultrasonic signals can pass through the chip layer by layer, and then penetrate the cover plate. Subsequently, the finger above the detection area of the ultrasonic fingerprint sensor can reflect at least part of the ultrasonic signals to form ultrasonic echo signals carrying fingerprint information. The ultrasonic sub-units can receive the ultrasonic echo signals respectively, and the ultrasonic echo signals received by each ultrasonic sub-unit can be processed into ultrasonic echo data that can be processed by a computer. The ultrasonic fingerprint sensor can generate an ultrasonic fingerprint image based on the ultrasonic echo data, or a control unit (which can be a control unit of a terminal device and can include any processor such as a CPU, an MCU, etc.) electrically connected to the ultrasonic fingerprint sensor can generate an ultrasonic fingerprint image based on the ultrasonic echo data. Further, the function of fingerprint recognition can be implemented through the ultrasonic fingerprint image. It should be understood that the above description is only an example for understanding and is not a limitation on the present application.

[0034] Optionally, the ultrasonic fingerprint sensor in the present application can include multiple working modes. For example, in some optional embodiments, the working modes of the ultrasonic fingerprint sensor include at least one of a fingerprint recognition working mode, a press detection working mode, and a navigation working mode. On this basis, the control method of the first aspect further includes:

[0035] When the ultrasonic fingerprint sensor operates in the fingerprint recognition working mode, the ultrasonic fingerprint sensor is controlled to collect a finger to obtain ultrasonic echo data, and fingerprint recognition is performed based on the ultrasonic echo data; and / or,

[0036] When the ultrasonic fingerprint sensor operates in the press detection working mode, the ultrasonic fingerprint sensor is controlled to collect a finger to obtain ultrasonic echo data, and press detection is performed based on the ultrasonic echo data; and / or,

[0037] When the ultrasonic fingerprint sensor operates in the navigation working mode, the ultrasonic fingerprint sensor is controlled to collect a finger to obtain ultrasonic echo data, and navigation control information for navigation control of a terminal device is determined based on the ultrasonic echo data.

[0038] Based on this, the multiple working modes of the ultrasonic fingerprint sensor in the embodiments of the present application are used to meet different requirements of a terminal device including but not limited to underwater use, so as to improve the underwater use effect of the ultrasonic fingerprint sensor and the terminal device.

[0039] It should be understood that the fingerprint recognition can refer to generating an ultrasonic fingerprint image and performing fingerprint recognition based on the ultrasonic fingerprint image; the press detection can refer to detecting whether the detection area of the ultrasonic fingerprint sensor is pressed; and the navigation control can refer to controlling the terminal device to complete a predetermined task according to the detected finger movement.

[0040] It should be noted that in the embodiment of the first aspect, the above fingerprint recognition, press detection, and determination of navigation control information can be implemented by the ultrasonic fingerprint sensor (may be implemented by the processing unit of the ultrasonic fingerprint sensor). In the following control method embodiment of the second aspect, the control unit of the terminal device can be used to implement fingerprint recognition, press detection, and determination of navigation control information, which will not be described here.

[0041] Optionally, the working modes of the ultrasonic fingerprint sensor can further include a reset mode, which can be used for system reset of the ultrasonic fingerprint sensor and is conducive to switching between working modes. In the reset mode, the ultrasonic fingerprint sensor is turned on but does not transmit or receive ultrasonic signals (which can be simply understood as that the ultrasonic fingerprint sensor is idle in the reset mode).

[0042] Optionally, for the case where the ultrasonic fingerprint sensor includes M*N ultrasonic subunits, in the fingerprint recognition working mode, the M*N ultrasonic subunits can all be in the working state of transmitting and receiving ultrasonic signals. Optionally, in the press detection working mode, part of the M*N ultrasonic subunits can be in the working state of transmitting and receiving ultrasonic signals, and the other part can not be in such a working state, which has the advantage of reducing power consumption; optionally, different parts of the ultrasonic subunits can be made to enter the working state of transmitting and receiving ultrasonic signals at uniform time intervals to balance the time consumption and spatial uniformity. In the navigation working mode, either all of the M*N ultrasonic subunits can be in the working state of transmitting and receiving ultrasonic signals, or part of the ultrasonic subunits can be in the working state of transmitting and receiving ultrasonic signals.

[0043] Optionally, when the ultrasonic fingerprint sensor is in the navigation working mode, if the navigation control information is obtained, the control unit of the terminal device can further perform navigation control of the terminal device based on the navigation control information.

[0044] Optionally, in combination with actual application scenarios, the ultrasonic fingerprint sensor in the present application can have a detection frequency of more than 10 Hz in the fingerprint recognition working mode, the press detection working mode, and the navigation working mode, that is, at least 10 times of signal acquisition per second to obtain at least 10 ultrasonic echo data, so as to ensure the use effect of the ultrasonic fingerprint sensor and the terminal device.

[0045] Optionally, the terminal device in the present application can be pre-set with an underwater working mode to facilitate the underwater use of the terminal device. After the terminal device enters the underwater working mode, some functions unsuitable for underwater use can be turned off. For example, it can include but is not limited to power output function, power output function, etc. Corresponding to the underwater working mode, the terminal device can also be set with a normal working mode (or referred to as air working mode) to facilitate daily use. In the normal working mode, some functions unsuitable for underwater use can be turned on. When needed, the normal working mode of the terminal device can be switched to the underwater working mode for operation, which can be automatically switched by the terminal device after meeting certain conditions (for example, detecting that the terminal device has entered water, then automatically switching to the underwater working mode), or manually switched by the user (for example, in an implementation, the underwater working mode can be set through the setting interface of the terminal device, so as to switch the terminal device from the normal working mode to the underwater working mode).

[0046] In the above step S102, whether the terminal device has entered the underwater working mode can be determined in any suitable manner. In some optional embodiments, the terminal device can automatically switch to the underwater working mode after determining that it has entered water. In some optional embodiments, step S102 can include obtaining sensing data detected by a sensor of the terminal device, and determining whether the terminal device has entered the underwater working mode based on the sensing data.

[0047] It should be understood that in this optional embodiment, the sensor can send the sensing data to the processing unit of the ultrasonic fingerprint sensor for processing. Specifically, a suitable sensor can be provided on the terminal device, and the sensing data detected by the sensor can be used to determine whether the terminal device has entered water. Since the terminal device can automatically enter the underwater working mode after entering water, it can also be accurately determined whether the terminal device has entered the underwater working mode based on the sensing data. In order to control the ultrasonic fingerprint sensor to run subsequently, and improve the user's experience of using the ultrasonic fingerprint sensor and the terminal device underwater.

[0048] Alternatively, in some other optional embodiments, step S102 can include obtaining a first indication signal sent by a control unit of the terminal device, and determining that the terminal device has entered the underwater working mode according to the first indication signal, wherein the first indication signal is determined by the control unit based on sensing data detected by a sensor of the terminal device.

[0049] It should be understood that in this another optional embodiment, the sensor can send the sensing data to the control unit of the terminal device. If the control unit determines that the terminal device has entered the water based on the sensing data, since the terminal device can automatically enter the underwater working mode after entering the water, the control unit can generate a first indication signal for indicating that the terminal device has entered the underwater working mode, and then the control unit sends the first indication signal to the processing unit of the ultrasonic fingerprint sensor, so that the processing unit of the ultrasonic fingerprint sensor can accurately determine that the terminal device has entered the underwater working mode based on the first indication signal. So as to facilitate subsequent control of the ultrasonic fingerprint sensor, and improve the underwater use experience of the user using the ultrasonic fingerprint sensor and the terminal device. It should be understood that processing the sensing data through the control unit of the terminal device is also conducive to reducing the data processing amount of the ultrasonic fingerprint sensor, avoiding excessive occupation of the operation resources of the ultrasonic fingerprint sensor, and improving the processing speed.

[0050] The type of the sensor used in the present application is not specifically limited. For example, in some optional embodiments, the sensor can be a touch sensor. Alternatively, the sensing data includes touch sensing data detected by the touch sensor of the terminal device, wherein the touch sensing data includes at least one of the capacitance data or the touch area data detected by the touch sensor, and the touch area data is used to indicate the pressing area in the detection area of the touch sensor when the terminal device is touched by the touch sensor. The above-mentioned "determining whether the terminal device has entered the underwater working mode based on the sensing data" can include: in response to the variation amount of the capacitance data within the first preset time satisfying the first preset condition, and / or the touch area data indicating that the pressing area reaches the second preset condition, determining that the terminal device has entered the underwater working mode.

[0051] Based on this, in the embodiments of the present application, the touch sensing data and the preset condition can be used to accurately determine whether the terminal device has entered the underwater working mode, so as to facilitate subsequent control of the ultrasonic fingerprint sensor, and improve the underwater use experience of the user using the ultrasonic fingerprint sensor and the terminal device.

[0052] The sensing data detected by the touch sensor includes capacitance data, that is, the touch sensor can be a capacitive touch sensor. Since the capacitance data detected by the capacitive touch sensor will change before and after the terminal device enters the water, the first preset time and the first preset condition can be preset, and if it is determined that the variation amount of the capacitance data within the first preset time satisfies the first preset condition, it can be considered that the terminal device has entered the water. Since the terminal device can automatically enter the underwater working mode after entering the water, the above-mentioned method can be used to accurately determine that the terminal device has entered the underwater working mode based on this.

[0053] Optionally, the first preset time can be set as needed, for example, set to 1-2 seconds. Optionally, the first preset condition can be set as needed, for example, can be a threshold condition. For example, if it is determined that the change amount of the capacitance data in the first preset time exceeds a certain preset threshold, it can be determined that the terminal device has entered the water, thereby accurately determining that the terminal device has entered the underwater working mode.

[0054] The reason why the touch area data detected by the touch sensor can be used to determine whether the terminal device has entered the underwater working mode is that after the terminal device enters the water, the water will press the detection area of the touch sensor in a large area, and the pressing area can even reach 100% of the area of the detection area, so that the pressing area indicated by the touch area data will change greatly compared to before the terminal device enters the water. Therefore, a second preset condition can be preset, and if it is determined that the touch area data meets the second preset condition, it can be considered that the terminal device has entered the water. Since the terminal device can automatically enter the underwater working mode after entering the water, the terminal device can be accurately determined to have entered the underwater working mode based on the above-mentioned method.

[0055] Optionally, the second preset condition can be set as needed, for example, can be a threshold condition. For example, if it is determined that the touch area data indicates that the pressing area exceeds 90% of the area of the detection area of the touch sensor (only an example, the threshold can be set as needed), it is considered that the terminal device has entered the water, thereby determining that the terminal device has entered the underwater working mode. Optionally, as an embodiment, the second preset condition can also be set to the pressing area reaching 100% of the area of the detection area of the touch sensor, and if it is determined that the touch area data indicates that the pressing area reaches 100% of the area of the detection area of the touch sensor, it is considered that the terminal device has entered the water, thereby accurately determining that the terminal device has entered the underwater working mode.

[0056] It should be understood that the above-mentioned capacitance data and touch area data can be combined or optionally one of them to realize the judgment of whether the terminal device has entered the underwater working mode, which is not limited in the present application.

[0057] It should be understood that since the ultrasonic fingerprint sensor is also one of the sensors of the terminal device, in some optional embodiments, the function of the ultrasonic fingerprint sensor can also be used to realize the judgment of whether the terminal device has entered the underwater working mode. Optionally, the sensing data includes ultrasonic echo data collected by the ultrasonic fingerprint sensor, and the above-mentioned "determining whether the terminal device has entered the underwater working mode based on the sensing data" includes: in response to the change amount of the ultrasonic echo data within the second preset time meeting a third preset condition, and / or the acoustic impedance data determined based on the ultrasonic echo data meeting a fourth preset condition, determining that the terminal device has entered the underwater working mode.

[0058] Based on this, in the embodiments of the present application, whether the terminal device has entered the underwater working mode can be accurately determined through the ultrasonic echo data and the preset condition, so as to facilitate subsequent control of the ultrasonic fingerprint sensor to run, and improve the underwater use experience of the user using the ultrasonic fingerprint sensor and the terminal device underwater.

[0059] Optionally, when the ultrasonic echo data collected by the ultrasonic fingerprint sensor is used to determine whether the terminal device has entered the underwater working mode, the ultrasonic fingerprint sensor can run in the press detection mode, which has lower power consumption and can effectively achieve the purpose.

[0060] Since the ultrasonic echo data detected by the ultrasonic fingerprint sensor will change before and after the terminal device enters the water, a second preset time and a third preset condition can be preset. If it is determined that the change amount of the ultrasonic echo data within the second preset time meets the third preset condition, it can be considered that the terminal device has entered the water. Since the terminal device can automatically enter the underwater working mode after entering the water, the terminal device can be accurately determined to have entered the underwater working mode based on the above method.

[0061] Optionally, the second preset time can be set as needed, for example, set to 1-2 seconds. Optionally, the third preset condition can be set as needed, for example, can be a threshold condition. For example, if it is determined that the change amount of the ultrasonic echo data within the third preset time exceeds a certain preset threshold, it can be determined that the terminal device has entered the water, thereby accurately determining that the terminal device has entered the underwater working mode.

[0062] Since the propagation medium of the ultrasonic signal changes from air to water before and after the terminal device enters the water, and there is a difference between the acoustic impedance of air and water (the acoustic impedance of water is larger than that of air), the acoustic impedance data can be calculated based on the ultrasonic echo data, and a fourth preset condition can be preset. If the acoustic impedance data meets the fourth preset condition, it can be considered that the terminal device has entered the water. Since the terminal device can automatically enter the underwater working mode after entering the water, the terminal device can be accurately determined to have entered the underwater working mode based on the above method.

[0063] Optionally, the fourth preset condition can be set as needed. For example, the fourth preset condition can be set as a range condition. For example, the range condition may, for example, be a range of the acoustic impedance of water. If the acoustic impedance data determined based on the ultrasonic echo data falls within the range of the acoustic impedance of water, it can be determined that the terminal device has entered the water, thereby accurately determining that the terminal device has entered the underwater working mode. Alternatively, the fourth preset condition can also use a threshold condition. If the acoustic impedance data determined based on the ultrasonic echo data exceeds a certain preset threshold, it can be determined that the terminal device has entered the water, thereby accurately determining that the terminal device has entered the underwater working mode. It should be understood that this is only for ease of understanding and does not limit the present application.

[0064] It should be understood that the above change amount of ultrasonic signal data and acoustic impedance data can be combined or optionally one of them to determine whether the terminal device has entered the underwater working mode, which is not limited in the present application.

[0065] In still other optional embodiments, the manner of determining whether the terminal device has entered the underwater working mode in step S102 can include: in response to the terminal device being set by the user to the underwater working mode, determining that the terminal device has entered the underwater working mode.

[0066] Based on this, according to the terminal device being set by the user to the underwater working mode, it can be accurately determined that the terminal device has entered the underwater working mode, so as to facilitate subsequent control of the ultrasonic fingerprint sensor to run and improve the user's experience of using the ultrasonic fingerprint sensor and the terminal device underwater.

[0067] For example, if the user wants to use the terminal device underwater, the user can set the terminal device to the underwater working mode in advance as needed to make preparations in advance. For example, in an implementation, the terminal device can be set through a setting interface of the terminal device to open the underwater working mode, so as to set the terminal device to the underwater working mode.

[0068] Optionally, the control unit of the terminal device can generate a second indication signal for indicating that the terminal device has entered the underwater mode after the user sets the terminal device to the underwater working mode, and send the second indication signal to the ultrasonic fingerprint sensor, and the processing unit of the ultrasonic fingerprint sensor can determine that the terminal device has entered the underwater working mode based on the second indication signal.

[0069] S104: In response to the terminal device having entered the underwater working mode, determining a target working mode of the ultrasonic fingerprint sensor, and controlling the ultrasonic fingerprint sensor to enter the target working mode and run.

[0070] Based on this, in the optional implementation of steps S102-S104 in the embodiments of the present application, on the one hand, the terminal device adopts the ultrasonic fingerprint sensor to realize the fingerprint function. Since the ultrasonic fingerprint sensor realizes the fingerprint function through ultrasonic signals, the influence of the ultrasonic signals is small under water, and therefore, compared with other types of fingerprint sensors, the ultrasonic fingerprint sensor can better maintain the use effect of the fingerprint function of the terminal device when the terminal device is used under water. On the other hand, since the terminal device has a special underwater working mode in the control scheme of the present application, the needs of underwater use of the terminal device can be better met, thereby improving the user experience. On the other hand, since the target working mode of the ultrasonic fingerprint sensor can be determined when it is determined that the terminal device has entered the underwater working mode, and the ultrasonic fingerprint sensor is controlled to enter the target working mode and run, the ultrasonic fingerprint sensor can be ensured to be started and work in the underwater working mode, and can also enter the appropriate target working mode and run, thereby better meeting the needs of the user to use the ultrasonic fingerprint sensor and the terminal device under water, and further improving the underwater use experience of the terminal device.

[0071] Optionally, the target working mode of the ultrasonic fingerprint sensor determined in the present application can be one of the above-mentioned fingerprint recognition working mode, the pressing detection working mode, the navigation working mode, and the reset mode.

[0072] Optionally, the current working mode of the ultrasonic fingerprint sensor can be the same as the target working mode. If the current working mode is the same as the target working mode, the ultrasonic fingerprint sensor can be controlled to remain in the current working mode, thereby achieving the purpose of controlling the ultrasonic fingerprint sensor to enter the target working mode and run.

[0073] Optionally, if the current working mode of the ultrasonic fingerprint sensor is different from the target working mode, during the process of switching the current working mode to the target working mode, if the target working mode is not the reset mode, the ultrasonic fingerprint sensor can be first controlled to enter the reset mode from the current working mode (in the reset mode, the ultrasonic fingerprint sensor is started but does not emit or receive ultrasonic signals), and then controlled to switch from the reset mode to the target working mode and run. By first entering the reset state and then completing the switching of the target working mode of the ultrasonic fingerprint sensor, the stability and reliability of the switching are improved. In addition, if the target working mode is the reset mode, the ultrasonic fingerprint sensor can be directly controlled to enter the reset mode from the current working mode.

[0074] Optionally, in other embodiments, if the current working mode and the target working mode are different, and neither of them is the reset mode, the ultrasonic fingerprint sensor can also be directly switched from the current working mode to the target working mode and run without passing through the reset mode, as long as the needs can be met.

[0075] The specific manner of determining the target working mode of the ultrasonic fingerprint sensor is not specifically limited in this application. For example, the control unit of the terminal device can send a mode start signal to the processing unit of the ultrasonic fingerprint sensor, the processing unit of the ultrasonic fingerprint sensor can receive the mode start signal of the control unit of the terminal device to determine the target working mode that the ultrasonic fingerprint sensor needs to enter according to the mode start signal. Then, the ultrasonic fingerprint sensor can be controlled to run in the target working mode. For example, taking the navigation working mode as an example, after determining that the terminal device has entered the working mode, the control unit of the terminal device can send a mode start signal for starting the navigation working mode to the processing unit of the ultrasonic fingerprint sensor, so that the processing unit determines that the target working mode is the navigation working mode, and controls the ultrasonic fingerprint sensor to run in the navigation working mode.

[0076] Alternatively, the processing unit of the ultrasonic fingerprint sensor can also determine the target working mode according to the preset rules by itself. For example, it can be preset that the ultrasonic fingerprint sensor needs to run in the press detection mode / fingerprint identification mode / navigation working mode when the terminal device enters the underwater working mode, so the target working mode can be directly determined as the press detection mode / fingerprint identification mode / navigation working mode, and then the ultrasonic fingerprint sensor can be controlled to run in the target working mode.

[0077] In the embodiment of the present application, when the ultrasonic fingerprint sensor runs in the navigation working mode, in some optional embodiments, the manner of "determining the navigation control information for navigation control of the terminal device based on the ultrasonic echo data" can include the following steps S202, S204 and S206 with reference to the flowchart shown in FIG. 2, specifically:

[0078] S202: Obtain a plurality of ultrasonic echo data obtained by respectively collecting the finger at a plurality of different times by the ultrasonic fingerprint sensor.

[0079] For example, taking the case that the ultrasonic fingerprint sensor collects the finger at n different times to obtain n ultrasonic echo data as an example. For example, the n different times can be n times of continuously collecting the finger. n≥2, and n=2 will be taken as an example in the following.

[0080] Optionally, for the ultrasonic fingerprint sensor including a plurality of ultrasonic sub-units, each ultrasonic sub-unit is configured to collect the finger to obtain sub-ultrasonic echo data, and the ultrasonic echo data at any time includes a plurality of sub-ultrasonic echo data collected by the plurality of ultrasonic sub-units at the time.

[0081] As an example for easy understanding, at any time of n times, if the ultrasonic fingerprint sensor has M*N ultrasonic subunits, assuming that the M*N ultrasonic subunits are all in the working state of transmitting and receiving ultrasonic signals, then at the time, M*N ultrasonic subunits can respectively collect M*N sub-ultrasonic echo data from the finger, and the ultrasonic fingerprint sensor obtains ultrasonic data at the time, that is, the M*N sub-ultrasonic echo data.

[0082] S204: According to the plurality of ultrasonic echo data, determine a plurality of pressing position information of the finger in the detection area of the ultrasonic fingerprint sensor at a plurality of different times.

[0083] For example, taking n=2 as an example, n=2 ultrasonic echo data can obtain 2 pressing position information of the finger in the detection area of the ultrasonic fingerprint sensor at 2 different times.

[0084] In some optional embodiments, step S204 can include: for each ultrasonic echo data in the plurality of ultrasonic echo data: according to the ultrasonic echo signal intensity indicated by the plurality of sub-ultrasonic echo data in the ultrasonic echo data, determine the echo intensity distribution information corresponding to the time when the ultrasonic echo data is collected, and according to the echo intensity distribution information, determine the pressing center point position coordinates corresponding to the time when the ultrasonic echo data is collected, wherein the echo intensity information is used to indicate the intensity distribution of the sub-ultrasonic echo data received by the ultrasonic subunit at different positions; the obtained plurality of pressing center point position coordinates are determined as the plurality of pressing position information.

[0085] Ultrasonic wave is a mechanical wave, and the propagation of ultrasonic wave depends on the propagation medium. Ultrasonic signals propagate at a fixed speed in the same homogeneous propagation medium without changing direction. Ultrasonic waves will be reflected and transmitted at the interface of different propagation media, and the reflectivity and transmissivity depend on the acoustic impedance of different media and the incident angle. Therefore, when the finger is pressed on the detection area of the ultrasonic fingerprint sensor, the ultrasonic signal enters the skin tissue of the finger and is reflected to form an ultrasonic echo signal. Due to the different contact degrees of the finger with each point in the detection area, the intensity of the ultrasonic echo signal received by the ultrasonic subunit at different positions of the ultrasonic fingerprint sensor has differences. Generally, the intensity of the ultrasonic echo signal received by the ultrasonic subunit at the pressing center point position of the finger is the largest, and the intensity of the ultrasonic echo signal received by the peripheral ultrasonic subunit gradually decreases with the increasing distance from the pressing center point position.

[0086] Therefore, in the present application, for each of the plurality of ultrasonic echo data, the echo intensity distribution information indicating the intensity distribution of the ultrasonic echo signals received by the ultrasonic subunits at different positions is determined according to the ultrasonic echo signal intensity indicated by the plurality of sub-ultrasonic echo data of the ultrasonic echo data, so as to accurately determine the pressing center point position coordinates corresponding to the time when the ultrasonic echo data is collected according to the echo intensity distribution information. After obtaining a plurality of pressing center point position coordinates at a plurality of times, each pressing center point position coordinate can represent the pressing center point position of the finger on the detection area of the ultrasonic fingerprint sensor at the corresponding time, and therefore these pressing center point position coordinates can be determined as the pressing position information, so that the subsequent step determines the navigation control information for navigating and controlling the terminal device based on the obtained pressing position information, and then when the terminal device is used underwater, the function of guiding navigation and control by hand can be better realized by the ultrasonic fingerprint sensor, and the use effect of the user using the terminal device underwater is improved.

[0087] The echo intensity distribution information can be implemented in any suitable form, for example, it can be in the form of an image, a table, a function, etc., and can be selected as needed. In some optional embodiments, the echo intensity distribution information is an echo intensity distribution graph in the form of an image, the echo intensity distribution graph includes a plurality of image regions corresponding one-to-one to the plurality of ultrasonic subunits, and the positional arrangement relationship between the plurality of image regions is determined based on the positional arrangement relationship between the plurality of ultrasonic subunits.

[0088] It should be understood that the echo intensity distribution graph in the form of an image is more convenient for calculating the pressing center point position coordinates. For example, in one implementation manner below, an image coordinate system can be preset, and the pressing center point position coordinates are determined according to the coordinates of the selected image region in the echo intensity distribution graph, which will be described in detail below, and will not be described here.

[0089] For example, referring to FIG. 3A, a position arrangement manner of a plurality of ultrasonic subunits is shown (it should be understood that the examples shown in the drawings of the present application are not necessarily in actual proportion, and are only used to facilitate understanding of the technical solutions of the present application, and are not limited to the present application). Among them, the plurality of ultrasonic subunits are arranged in matrix form as M columns and N rows, and several example ultrasonic subunits p1, p2, p3, p4, p5, p6 are respectively located in the second row, the second column, the first row, the second column, the third row, the second column, the second row, the first column, the second row, the third column, and the last second row. For example, referring to FIG. 3B, an example of an echo intensity distribution diagram corresponding to the plurality of sub-ultrasonic units of FIG. 3A is shown. Among them, a plurality of image regions are also arranged in matrix form as M columns and N rows, a plurality of image regions correspond one-to-one to a plurality of ultrasonic subunits, and the position arrangement relationship between a plurality of image regions is determined based on the position arrangement relationship between a plurality of ultrasonic subunits. For example, several example image regions q1, q2, q3, q4, q5, q6 in FIG. 3B correspond one-to-one to ultrasonic subunits p1, p2, p3, p4, p5, p6 in FIG. 3A, and image regions q1, q2, q3, q4, q5, q6 are also correspondingly located in the second row, the second column, the first row, the second column, the third row, the second column, the second row, the first column, the second row, the third column, and the last second row. Other image regions can also be analogized according to the above example description. Therefore, after finding a certain image region from the echo intensity distribution diagram, it can be correspondingly determined which ultrasonic subunit to determine the pressing center point position and its coordinates of the finger at a certain moment, so as to generate navigation control information for navigation control of the terminal device.

[0090] In some optional embodiments, the above-mentioned "determining echo intensity distribution information corresponding to the time when the ultrasonic echo data is collected according to the ultrasonic echo signal intensity indicated by the plurality of sub-ultrasonic echo data in the ultrasonic echo data" can include: for each sub-ultrasonic echo data of the ultrasonic echo data, obtaining a to-be-processed echo intensity distribution diagram, and assigning an image feature value to an image region corresponding to a target ultrasonic subunit in the to-be-processed echo intensity diagram according to the ultrasonic echo signal intensity indicated by the sub-ultrasonic echo data. After each image region of the to-be-processed echo intensity diagram is assigned an image feature value, the echo intensity distribution diagram corresponding to the time when the ultrasonic echo data is collected is obtained. Wherein, the target ultrasonic subunit is the ultrasonic subunit for collecting the sub-ultrasonic echo data, and the to-be-processed echo intensity distribution diagram is a blank echo intensity distribution diagram or a historical echo intensity distribution diagram.

[0091] Based on this, in the present application, the echo intensity distribution graph corresponding to the time of collecting the ultrasonic echo data can be obtained according to the ultrasonic echo signal intensity indicated by the plurality of sub-ultrasonic echo data in the ultrasonic echo data in the above manner, so that the subsequent determination of the pressing center point position coordinates corresponding to the time of collecting the ultrasonic echo data according to the echo intensity distribution graph (i.e. echo intensity distribution information) is more convenient and accurate, so that the obtained pressing center point position coordinates can be determined as the pressing position information, so that the subsequent step of determining the navigation control information for navigation control of the terminal device based on the obtained pressing position information, and then when the terminal device is used underwater, the function of hand navigation control can be better realized by the ultrasonic fingerprint sensor, and the use effect of the user using the terminal device underwater is improved.

[0092] Optionally, the image feature value can adopt any feature value of the image. For example, saturation, pixel value, etc. can be adopted.

[0093] Optionally, the blank echo intensity distribution graph can be an echo intensity distribution graph without being assigned an image feature value according to the ultrasonic echo signal intensity. In use, the image feature value can be directly assigned to the corresponding image region. Optionally, the historical echo intensity distribution graph can be an echo intensity distribution graph corresponding to the time of collecting the ultrasonic echo data before. The historical echo intensity distribution graph can have been assigned an image feature value, and the image feature value can be reassigned according to the ultrasonic echo signal intensity.

[0094] In some optional embodiments, the above-mentioned "determining the pressing center point position coordinates corresponding to the time of collecting the ultrasonic echo data according to the echo intensity distribution information" can include: determining the pressing center point position coordinates corresponding to the time of collecting the ultrasonic echo data according to the coordinates of the image region with the maximum or minimum image feature value in the preset image coordinate system in the echo intensity distribution graph.

[0095] Referring to the foregoing, generally speaking, the intensity of the ultrasonic echo signal received by the ultrasonic subunit at the pressing center point position of the finger is the largest, and the intensity of the ultrasonic echo signal received by the ultrasonic subunit around the pressing center point position gradually decreases, so the image region to which the image feature value assigned in the echo intensity distribution map is the largest or the smallest is more likely to correspond to the ultrasonic subunit at the pressing center point position of the finger. Therefore, through such an optional mode, the pressing center point position coordinates corresponding to the time when the ultrasonic echo data is collected can be more accurately determined according to the echo intensity distribution map, so that the obtained pressing center point position coordinates can be determined as the pressing position information, so that the navigation control information for navigating and controlling the terminal device can be determined based on the obtained pressing position information in the subsequent step, and then when the terminal device is used underwater, the function of hand navigation control can be better realized by the ultrasonic fingerprint sensor, and the use effect of the user using the terminal device underwater is improved.

[0096] It should be understood that the plurality of echo intensity distribution maps obtained from the plurality of ultrasonic echo data can use the same rule to determine the pressing center point position coordinates corresponding to the time when the ultrasonic echo data is collected. That is, one optional implementation is that, for each echo intensity distribution map of the obtained plurality of echo intensity distribution maps, the pressing center point position coordinates corresponding to the time when the ultrasonic echo data is collected are determined according to the coordinates of the image region with the largest image feature value in the preset image coordinate system. Alternatively, another optional implementation is that, for each echo intensity distribution map of the obtained plurality of echo intensity distribution maps, the pressing center point position coordinates corresponding to the time when the ultrasonic echo data is collected are determined according to the coordinates of the image region with the smallest image feature value in the preset image coordinate system.

[0097] The preset image coordinate system can be set as needed. For example, one vertex of the echo intensity distribution map can be taken as the origin (for example, the top left vertex of the image), the first direction F1 of the echo intensity distribution map and the second direction F2 perpendicular to the first direction F1 (for example, the first direction F1 can be the length direction of the echo intensity distribution map, and the second direction F2 can be the width direction of the echo intensity distribution map, of course, the two can also be interchanged, that is, the first direction F1 is the width direction, and the second direction F2 is the length direction) can be taken as the two coordinate axis directions, and an x-y rectangular coordinate system can be established in advance, and the x-y rectangular coordinate system is determined as the preset image coordinate system.

[0098] Optionally, the coordinates of the plurality of image regions in the echo intensity distribution map can be pre-stored for use. Optionally, one or more pixels can be included in the image region of the echo intensity distribution map, and the coordinates of the pixel at the center position of the image region with the maximum or minimum image feature value can be determined as the pressing center point position coordinates. Alternatively, the coordinates of any pixel in the image region can be determined as the pressing center point position coordinates. Alternatively, in another optional embodiment, coordinates can be assigned to each image region according to the position arrangement manner. For example, as shown in FIG. 3B, the image region q1 in the second row and the second column can be assigned the coordinates (2, 2), the image region q2 in the first row and the second column can be assigned the coordinates (2, 1), the image region q3 in the third row and the second column can be assigned the coordinates (2, 3), the image region q4 in the second row and the first column can be assigned the coordinates (1, 2), and the image region q5 in the second row and the third column can be assigned the coordinates (3, 2). The same method can be used for other image regions. When needed, the coordinates of the selected image region can be determined as the pressing center point position coordinates. It should be understood that the specific implementation manner can be selected as needed, and the present application does not make specific limitations here.

[0099] Optionally, when the image feature value is assigned to the image region according to the ultrasonic wave echo signal strength indicated by the sub-ultrasonic wave echo data, the image feature value can be proportional to the ultrasonic wave echo signal strength, or can be inversely proportional to the ultrasonic wave echo signal strength. When the proportional relationship is adopted, the larger the ultrasonic wave echo signal strength, the larger the image feature value, and the coordinates of the image region with the maximum image feature value in the echo intensity distribution map can be used to determine the pressing center point position coordinates corresponding to the time when the ultrasonic wave echo data is collected. When the inverse relationship is adopted, the larger the ultrasonic wave echo signal strength, the smaller the image feature value, and the coordinates of the image region with the minimum image feature value in the echo intensity distribution map can be used to determine the pressing center point position coordinates corresponding to the time when the ultrasonic wave echo data is collected.

[0100] The following describes an example process of determining the echo intensity distribution map and calculating the pressing center point position coordinates in combination with FIG. 3A, FIG. 3B, and FIG. 4. For example, the first of the two ultrasonic echo data collected by the ultrasonic fingerprint sensor at n = 2 time points is taken as an example, assuming that the ultrasonic fingerprint sensor includes M*N ultrasonic subunits (for example, refer to FIG. 3A), and each receives an ultrasonic echo signal of a finger, then the first ultrasonic echo data includes M*N sub-ultrasonic echo data collected by M*N ultrasonic subunits. A to-be-processed echo intensity distribution map can be obtained, for example, taking the echo intensity distribution map in FIG. 3B as an example (here, it can be understood as an example of a blank echo intensity distribution map), then according to the ultrasonic echo signal strength indicated by the sub-ultrasonic echo data collected by the ultrasonic subunit p1, the image feature value of the image region q1 in the to-be-processed echo distribution map is assigned, according to the ultrasonic echo signal strength indicated by the sub-ultrasonic echo data collected by the ultrasonic subunit p2, the image feature value of the image region q2 in the to-be-processed echo distribution map is assigned, according to the ultrasonic echo signal strength indicated by the sub-ultrasonic echo data collected by the ultrasonic subunit p3, the image feature value of the image region q3 in the to-be-processed echo distribution map is assigned, and so on. The image feature values of the other image regions in the to-be-processed echo distribution map are respectively assigned, so that the echo intensity distribution map corresponding to the time when the first ultrasonic echo data is collected can be obtained. Taking the image feature value as an example of saturation, assuming that the ultrasonic echo signal strength indicated by the sub-ultrasonic echo data collected by the ultrasonic subunit p1 is the maximum, then the image feature value assigned to the image region q1 is also the maximum. Referring to the echo intensity distribution map corresponding to the first time shown in FIG. 4, along the first direction F1, the image feature values assigned to the image region q5 and other image regions will gradually decrease (when the ultrasonic echo signal strength is too low, the image feature values of multiple image regions can also be set to 0 based on the ultrasonic echo signal strength), and similarly, along the second direction F2, along the opposite direction of the first direction F1, along the opposite direction of the second direction F2, the image feature values assigned to other image regions will also gradually decrease. In this way, the echo intensity distribution map corresponding to the first time is processed, and the coordinates of the image region q1 with the maximum image feature value in the preset image coordinate system can be determined according to the image feature value of each image region, and the pressing center point position coordinates (x1, y1) corresponding to the first time when the first ultrasonic echo data is collected are determined.

[0101] For example, the second ultrasonic echo data in the two ultrasonic echo data collected by the ultrasonic fingerprint sensor at n=2 time points is taken as an example, the blank echo intensity distribution diagram or the echo intensity distribution diagram at the first time point can be taken as the echo intensity distribution diagram to be processed. Assuming that the echo intensity distribution diagram at the first time point is taken as the echo intensity distribution diagram to be processed, the image feature values of the image regions in the echo intensity distribution diagram to be processed are re-assigned according to the ultrasonic echo signal strengths indicated by the sub-ultrasonic echo data collected by each ultrasonic sub-unit (for details, refer to the foregoing description, which will not be repeated here), so that the echo intensity distribution diagram corresponding to the time point at which the second ultrasonic echo data is collected can be obtained. Taking the image feature value as an example, assuming that the sub-ultrasonic echo data collected by the ultrasonic sub-unit p6 corresponding to the image region q6 indicates the maximum ultrasonic echo signal, the image feature value assigned to the image region q1 is also the maximum. Referring to the echo intensity distribution diagram corresponding to the second time point shown in FIG. 4, the image feature values assigned to the image regions q10, q9, q8, q7 and other image regions gradually decrease along the first direction F1, the second direction F2, the opposite direction of the first direction F1, the opposite direction of the second direction F2. Thus, the echo intensity distribution diagram corresponding to the second time point is processed again, and the coordinates of the image region q6 with the maximum image feature value in the preset image coordinate system can be determined according to the image feature values of the image regions, and the position coordinates (x2, y2) of the pressing center point corresponding to the second time point at which the second ultrasonic echo data is collected can be determined.

[0102] Then, the obtained two pressing center point position coordinates (x1, y1) and (x2, y2) can be determined as the plurality of pressing position information, which is used for calculating the navigation control information in the subsequent step. The above example illustrates that the pressing center point position of the finger on the detection region of the ultrasonic fingerprint sensor moves from the position of the ultrasonic sub-unit p1 corresponding to the image region q1 to the position of the ultrasonic sub-unit p6 corresponding to the image region q6 at two time points (refer to FIG. 5). It can be understood that in another case, if the obtained two pressing center point position coordinates are the same, it can be explained that the finger does not move from the first time point to the second time point. It should be understood that the above example is not intended to limit the embodiments of the present application.

[0103] S206: Determine the navigation control information for navigating and controlling the terminal device according to the obtained pressing position information.

[0104] Based on this, in the optional implementation of the above steps S202-S206 in this application, by acquiring a plurality of ultrasonic echo data respectively obtained by the ultrasonic fingerprint sensor collecting the finger at a plurality of different times, and then determining a plurality of pressing position information of the finger in the detection area of the ultrasonic fingerprint sensor at a plurality of different times according to the plurality of ultrasonic echo data, the obtained pressing position information can be used to accurately and effectively determine the navigation control information for navigation control of the terminal device, and then when the terminal device is used underwater, the function of hand navigation control can be better realized by the ultrasonic fingerprint sensor, and the use effect of the user using the terminal device underwater is improved.

[0105] It should be understood that the movement of the finger can be represented by determining the change of the pressing position information, and therefore the navigation control information calculated based on the obtained pressing position information can facilitate the realization of hand navigation.

[0106] In some optional embodiments, step S206 can include determining movement information of the finger in the detection area of the ultrasonic fingerprint sensor according to the plurality of pressing center point position coordinates, wherein the movement information includes at least one of a moving direction, a moving distance, and a moving speed; and determining navigation control information for navigation control of the terminal device according to the movement information.

[0107] Alternatively, taking the pressing center point position coordinates (x1, y1) and (x2, y2) as an example, it can be detected that the finger moves from the position corresponding to the ultrasonic subunit p1 to the position corresponding to the ultrasonic subunit p6 in the detection area of the ultrasonic fingerprint sensor from the first time to the second time, and then the moving direction of the finger in the detection area of the ultrasonic fingerprint sensor can be determined by the coordinates (x1, y1) and (x2, y2); in combination with the coordinates (x1, y1) and (x2, y2) and the physical size data of the ultrasonic subunits of the ultrasonic fingerprint sensor, the moving distance of the finger in the detection area of the ultrasonic fingerprint sensor can be calculated; in combination with the moving distance and the time interval from the first time to the second time, the moving speed of the finger in the detection area of the ultrasonic fingerprint sensor can also be calculated; and then the obtained results can be used as the movement information. Further, the navigation control information for navigation control of the terminal device can be determined according to the movement information.

[0108] Alternatively, the navigation control information can include, but is not limited to, at least one of a navigation control signal, a navigation control parameter, etc. Some navigation control information corresponding to different styles of movement information can be preset. After the movement information is determined, the navigation control information corresponding to the movement information can be determined, and the control unit of the terminal device can perform corresponding navigation control on the terminal device based on the navigation control information, so that the terminal device completes the predetermined task.

[0109] Based on this, in the present application, the movement information of the finger in the detection area of the ultrasonic fingerprint sensor is determined through multiple pressing center point position coordinates, the navigation control information for navigation control of the terminal device can be accurately and effectively determined, and then when the terminal device is used underwater, the function of hand navigation control can be better realized through the ultrasonic fingerprint sensor, and the use effect of the user using the terminal device underwater is improved.

[0110] It should be understood that the exemplary description of the control method provided in the first aspect of the embodiments of the present application is not as any limitation of the embodiments of the present application.

[0111] FIG. 6 is a step flow chart of a control method according to the second aspect of the embodiments of the present application. According to the second aspect of the embodiments of the present application, a control method is provided for a control unit of a terminal device. Referring to FIG. 1, the control method includes steps S602 and S604, specifically:

[0112] S602: determining whether the terminal device has entered an underwater working mode, and generating an indication signal in response to determining that the terminal device has entered the underwater working mode.

[0113] S604: sending the indication signal to the ultrasonic fingerprint sensor, so that the ultrasonic fingerprint sensor determines a target working mode of the ultrasonic fingerprint sensor in response to the indication signal and runs in the target working mode.

[0114] Based on this, in the optional implementation of the above steps S602-S604 in the present application, on the one hand, the terminal device uses the ultrasonic fingerprint sensor to realize the fingerprint function. Since the ultrasonic fingerprint sensor realizes the fingerprint function through ultrasonic signals, and the ultrasonic signals are less affected underwater, compared with other types of fingerprint sensors, the use effect of the fingerprint function of the terminal device can be better maintained when the terminal device is used underwater using the ultrasonic fingerprint sensor. On the other hand, since the terminal device has a special underwater working mode in the control scheme of the present application, the needs of the terminal device used underwater can be better met, thereby improving the user experience. On the other hand, since the indication signal can be generated when it is determined that the terminal device has entered the underwater working mode, and the indication signal is sent to the ultrasonic fingerprint sensor, the ultrasonic fingerprint sensor can determine that the terminal device has entered the underwater working mode according to the indication signal, and determine the target working mode of the ultrasonic fingerprint sensor in response to the indication signal and run in the target working mode. Therefore, on the basis of ensuring that the ultrasonic fingerprint sensor can be started and worked in the underwater working mode, it can also enter the appropriate target working mode for running, so as to better meet the needs of the user using the ultrasonic fingerprint sensor and the terminal device underwater, and further improve the underwater use experience of the terminal device.

[0115] It should be understood that the control method provided in the second aspect of the present application can be executed by the control unit of the terminal device. The related content of the ultrasonic fingerprint sensor, the terminal device, the underwater working mode, the target working mode, and the like can be understood with reference to the related content of the control method embodiments of the first aspect of the present application, and other related content can also be understood with reference to the foregoing, which will not be described here again.

[0116] In some optional embodiments, the type of the ultrasonic fingerprint sensor in the present application can include at least one of a side ultrasonic fingerprint sensor, a back ultrasonic fingerprint sensor, and an under-screen ultrasonic fingerprint sensor. Through the above types of ultrasonic fingerprint sensors, side fingerprint recognition, back fingerprint recognition, or under-screen fingerprint recognition can be achieved to meet the use requirements of the terminal device.

[0117] In some optional embodiments, the working mode of the ultrasonic fingerprint sensor includes at least one of a fingerprint recognition working mode, a press detection working mode, and a navigation working mode. On this basis, the control method of the second aspect further includes: when the ultrasonic fingerprint sensor operates in the fingerprint recognition working mode, acquiring ultrasonic echo data obtained by the ultrasonic fingerprint sensor collecting a finger, and performing fingerprint recognition based on the ultrasonic echo data; and / or, when the ultrasonic fingerprint sensor operates in the press detection working mode, acquiring ultrasonic echo data obtained by the ultrasonic fingerprint sensor collecting a finger, and performing press detection based on the ultrasonic echo data; and / or, when the ultrasonic fingerprint sensor operates in the navigation working mode, acquiring ultrasonic echo data obtained by the ultrasonic fingerprint sensor collecting a finger, and determining navigation control information for navigation control of the terminal device based on the ultrasonic echo data.

[0118] Based on this, in the embodiments of the present application, the above-mentioned various working modes of the ultrasonic fingerprint sensor are used to meet different requirements of the terminal device including but not limited to underwater use, so as to improve the underwater use effect of the ultrasonic fingerprint sensor and the terminal device. It should be understood that the above-mentioned optional embodiments have been described in detail in the control method embodiments of the first aspect, and the difference is that the control unit of the terminal device needs to acquire ultrasonic echo data from the ultrasonic fingerprint sensor, and the control unit implements the above-mentioned fingerprint recognition, press detection, and determination of navigation control information. Specific understanding can be made with reference to the control method embodiments of the first aspect, which will not be described here again.

[0119] In some optional embodiments, the indication signal comprises a first indication signal; step S604 can comprise: obtaining sensing data detected by the sensor of the terminal device, determining whether the terminal device has entered the underwater working mode based on the sensing data, and in response to determining that the terminal device has entered the underwater working mode, generating the first indication signal. Further, in step S604, the first indication signal can be sent to the ultrasonic fingerprint sensor, so that the ultrasonic fingerprint sensor determines that the terminal device has entered the underwater mode in response to the first indication signal, determines the target working mode of the ultrasonic fingerprint sensor, and runs in the target working mode.

[0120] It should be understood that the above-mentioned optional embodiments of "obtaining sensing data detected by the sensor of the terminal device, and determining whether the terminal device has entered the underwater working mode based on the sensing data" can be understood with reference to the related content of the control method embodiments of the first aspect described above. The difference between the above-mentioned embodiments and the embodiments described above is that the sensing data is sent to the control unit of the terminal device for processing in the above-mentioned embodiments, while in the embodiments of the first aspect, the sensing data is sent to the processing unit of the ultrasonic fingerprint sensor for processing. The specific implementation details and principles are similar, and therefore will not be described again.

[0121] In addition, the first indication signal is also described in the embodiments of the first aspect described above, and can be understood in combination. Specifically, in the above-mentioned optional embodiments, if the control unit determines that the terminal device has entered the water based on the sensing data, since the terminal device can automatically enter the underwater working mode after entering the water, the control unit can generate a first indication signal indicating that the terminal device has entered the underwater working mode, and then send the first indication signal to the processing unit of the ultrasonic fingerprint sensor, so that the processing unit of the ultrasonic fingerprint sensor can accurately determine that the terminal device has entered the underwater working mode based on the first indication signal. In order to facilitate subsequent control of the ultrasonic fingerprint sensor, and improve the user experience of using the ultrasonic fingerprint sensor and the terminal device underwater. It should be understood that processing the sensing data by the control unit of the terminal device also helps to reduce the data processing amount of the ultrasonic fingerprint sensor, avoid excessive occupation of the computing resources of the ultrasonic fingerprint sensor, and improve the processing speed.

[0122] In some optional embodiments, the sensor can be a touch sensor. Optionally, the sensing data comprises touch sensing data detected by a touch sensor of the terminal device, wherein the touch sensing data comprises at least one of capacitance data detected by the touch sensor or touch area data, the touch area data being used to indicate a pressing area within a detection area of the touch sensor when the terminal device is touched by the touch sensor; and the determining whether the terminal device has entered the underwater working mode based on the sensing data comprises: in response to a variation of the capacitance data within a first preset time satisfying a first preset condition and / or the touch area data indicating that the pressing area reaches a second preset condition, determining that the terminal device has entered the underwater working mode.

[0123] Based on this, in the embodiments of the present application, the touch sensing data and the preset conditions can be used to accurately determine whether the terminal device has entered the underwater working mode, so as to facilitate subsequent control of the ultrasonic fingerprint sensor to run, and improve the user experience of using the ultrasonic fingerprint sensor and the terminal device underwater. It should be understood that the above optional embodiments can be understood with reference to the related content of the control method embodiments of the first aspect described above, and the difference between the above embodiments and the embodiments of the first aspect is that the processing is performed by the control unit of the terminal device, while the processing of the embodiments of the first aspect is performed by the processing unit of the ultrasonic fingerprint sensor, and the specific implementation details and principles are similar, and thus will not be described again.

[0124] In some optional embodiments, the sensing data comprises ultrasonic echo data collected by the ultrasonic fingerprint sensor; and the determining whether the terminal device has entered the underwater working mode based on the sensing data comprises: in response to a variation of the ultrasonic echo data within a second preset time satisfying a third preset condition and / or acoustic impedance data determined based on the ultrasonic echo data satisfying a fourth preset condition, determining that the terminal device has entered the underwater working mode.

[0125] Based on this, in the embodiments of the present application, the ultrasonic echo data and the preset conditions can be used to accurately determine whether the terminal device has entered the underwater working mode, so as to facilitate subsequent control of the ultrasonic fingerprint sensor to run, and improve the user experience of using the ultrasonic fingerprint sensor and the terminal device underwater. It should be understood that the above optional embodiments can be understood with reference to the related content of the control method embodiments of the first aspect described above, and the difference between the above embodiments and the embodiments of the first aspect is that the processing is performed by the control unit of the terminal device, while the processing of the embodiments of the first aspect is performed by the processing unit of the ultrasonic fingerprint sensor, and the specific implementation details and principles are similar, and thus will not be described again.

[0126] In some optional embodiments, the indication signal comprises a second indication signal; step S602 can comprise: determining whether the terminal device has been set to the underwater working mode by the user, in response to the second indication signal indicating that the user has set the terminal device to the underwater working mode, determining that the terminal device has entered the underwater working mode, and generating the second indication signal. Further, in step S604, the second indication signal can be sent to the ultrasonic fingerprint sensor, so that the ultrasonic fingerprint sensor determines that the terminal device has entered the underwater mode in response to the second indication signal, determines the target working mode of the ultrasonic fingerprint sensor, and runs in the target working mode.

[0127] Based on this, according to the terminal device having been set to the underwater working mode by the user, it can be accurately determined that the terminal device has entered the underwater working mode, so as to facilitate subsequent control of the ultrasonic fingerprint sensor to run, and improve the user's experience of using the ultrasonic fingerprint sensor and the terminal device underwater.

[0128] For example, if the user wants to use the terminal device underwater, the user can set the terminal device to the underwater working mode in advance as needed to make preparations in advance. For example, in an implementation, the terminal device can be set through a setting interface of the terminal device to turn on the underwater working mode, so as to set the terminal device to the underwater working mode.

[0129] In addition, the second indication signal is also described in the foregoing first aspect embodiment. Alternatively, the control unit of the terminal device can generate the second indication signal indicating that the terminal device has entered the underwater mode after the user sets the terminal device to the underwater working mode, and send the second indication signal to the ultrasonic fingerprint sensor, and the processing unit of the ultrasonic fingerprint sensor can determine that the terminal device has entered the underwater working mode based on the second indication signal.

[0130] In some optional embodiments, the above-mentioned "determining navigation control information for navigation control of the terminal device based on the ultrasonic echo data" comprises: obtaining a plurality of ultrasonic echo data respectively obtained by the ultrasonic fingerprint sensor collecting the finger at a plurality of different times; determining a plurality of pressing position information of the finger in the detection area of the ultrasonic fingerprint sensor at a plurality of different times according to the plurality of ultrasonic echo data; and determining the navigation control information for navigation control of the terminal device according to the obtained pressing position information.

[0131] Based on this, in the present application, through the above-mentioned optional implementation, by acquiring a plurality of ultrasonic echo data respectively obtained by the ultrasonic fingerprint sensor collecting the finger at a plurality of different times, and then determining a plurality of pressing position information of the finger in the detection area of the ultrasonic fingerprint sensor at a plurality of different times according to the plurality of ultrasonic echo data, the obtained pressing position information can be used to accurately and effectively determine the navigation control information for navigation control of the terminal device. Therefore, when the terminal device is used underwater, the function of hand navigation control can be better realized by the ultrasonic fingerprint sensor, and the use effect of the user using the terminal device underwater is improved. It should be understood that the above-mentioned optional embodiment can be understood with reference to the related content of "steps S202-S206" of the control method embodiment of the first aspect. The difference between the above-mentioned embodiment and the previous embodiment is that the processing is performed by the control unit of the terminal device, while the "steps S202-S206" embodiment of the first aspect is processed by the processing unit of the ultrasonic fingerprint sensor. The specific implementation details and principles are similar, and therefore will not be repeated here.

[0132] In some optional embodiments, the ultrasonic fingerprint sensor includes a plurality of ultrasonic sub-units, each of which is used to collect sub-ultrasonic echo data of the finger, and the ultrasonic echo data at any time includes a plurality of sub-ultrasonic echo data collected by the plurality of ultrasonic sub-units at that time. The above-mentioned "determining a plurality of pressing position information of the finger in the detection area of the ultrasonic fingerprint sensor at a plurality of different times according to the plurality of ultrasonic echo data" includes: for each ultrasonic echo data in the plurality of ultrasonic echo data: determining echo intensity distribution information corresponding to the time when the ultrasonic echo data is collected according to the ultrasonic echo signal intensity indicated by the plurality of sub-ultrasonic echo data in the ultrasonic echo data, and determining the pressing center point position coordinates corresponding to the time when the ultrasonic echo data is collected according to the echo intensity distribution information, wherein the echo intensity information is used to indicate the intensity distribution of the ultrasonic echo signal received by the ultrasonic sub-unit at different positions; and determining the obtained plurality of pressing center point position coordinates as the plurality of pressing position information.

[0133] Based on this, in the present application, for each of the plurality of ultrasonic echo data, the echo intensity distribution information indicating the intensity distribution of the ultrasonic echo signals received by the ultrasonic subunits at different positions is determined according to the ultrasonic echo signal intensity indicated by the plurality of sub-ultrasonic echo data of the ultrasonic echo data, so as to accurately determine the pressing center point position coordinates corresponding to the time when the ultrasonic echo data is collected according to the echo intensity distribution information. After obtaining a plurality of pressing center point position coordinates at a plurality of times, each pressing center point position coordinate can represent the pressing center point position of the finger on the detection area of the ultrasonic fingerprint sensor at the corresponding time, so these pressing center point position coordinates can be determined as the pressing position information, so that the subsequent step determines the navigation control information for navigating and controlling the terminal device based on the obtained pressing position information, and then when the terminal device is used underwater, the function of guiding and controlling the hand can be better realized by the ultrasonic fingerprint sensor, and the use effect of the user using the terminal device underwater is improved. It should be understood that the above-mentioned optional embodiments can be understood with reference to the related contents under "step S204" of the control method embodiment of the first aspect, and the difference between the above-mentioned optional embodiments and the previous embodiments is that the processing is performed by the control unit of the terminal device, while the embodiment of the first aspect is processed by the processing unit of the ultrasonic fingerprint sensor, and the specific implementation details and principles are similar, so they will not be repeated here.

[0134] In some optional embodiments, the echo intensity distribution information is an echo intensity distribution graph in the form of an image, the echo intensity distribution graph includes a plurality of image regions corresponding to the plurality of ultrasonic subunits one by one, and the position arrangement relationship between the plurality of image regions is determined based on the position arrangement relationship between the plurality of ultrasonic subunits; the above-mentioned "determining the echo intensity distribution information corresponding to the time when the ultrasonic echo data is collected according to the ultrasonic echo signal intensity indicated by the plurality of sub-ultrasonic echo data in the ultrasonic echo data" includes: for each sub-ultrasonic echo data of the ultrasonic echo data, obtaining a to-be-processed echo intensity distribution graph, and assigning an image feature value to the image region corresponding to the target ultrasonic subunit in the to-be-processed echo intensity graph according to the ultrasonic echo signal intensity indicated by the sub-ultrasonic echo data, after each image region of the to-be-processed echo intensity graph is assigned an image feature value, obtaining the echo intensity distribution graph corresponding to the time when the ultrasonic echo data is collected; wherein the target ultrasonic subunit is the ultrasonic subunit collecting the sub-ultrasonic echo data, and the to-be-processed echo intensity distribution graph is a blank echo intensity distribution graph or a historical echo intensity distribution graph.

[0135] Based on this, in the present application, the echo intensity distribution graph corresponding to the time when the ultrasonic echo data is collected can be obtained according to the ultrasonic echo signal intensity indicated by the plurality of sub-ultrasonic echo data in the ultrasonic echo data in the above manner, so that the subsequent press center point position coordinates corresponding to the time when the ultrasonic echo data is collected can be more conveniently and accurately determined according to the echo intensity distribution graph (i.e. echo intensity distribution information), so that the obtained press center point position coordinates can be determined as the press position information, so that the navigation control information for navigating and controlling the terminal device can be determined based on the obtained press position information in the subsequent step, and then when the terminal device is used underwater, the function of hand navigation control can be better realized by the ultrasonic fingerprint sensor, and the use effect of the user using the terminal device underwater is improved. It should be understood that the above optional embodiment can be understood with reference to the related content under "step S204" of the control method embodiment of the first aspect, and the difference between the above embodiment and the previous embodiment is that the processing is performed by the control unit of the terminal device, while the embodiment of the first aspect is processed by the processing unit of the ultrasonic fingerprint sensor. The specific implementation details and principles are similar, and therefore will not be repeated.

[0136] In some optional embodiments, the "determining the press center point position coordinates corresponding to the time when the ultrasonic echo data is collected according to the echo intensity distribution information" comprises: determining the press center point position coordinates corresponding to the time when the ultrasonic echo data is collected according to the coordinates of the image region with the maximum or minimum image feature value in the preset image coordinate system in the echo intensity distribution graph.

[0137] Based on this, by such an optional way, the press center point position coordinates corresponding to the time when the ultrasonic echo data is collected can be more accurately determined according to the echo intensity distribution graph, so that the obtained press center point position coordinates can be determined as the press position information, so that the navigation control information for navigating and controlling the terminal device can be determined based on the obtained press position information in the subsequent step, and then when the terminal device is used underwater, the function of hand navigation control can be better realized by the ultrasonic fingerprint sensor, and the use effect of the user using the terminal device underwater is improved. It should be understood that the above optional embodiment can be understood with reference to the related content under "step S204" of the control method embodiment of the first aspect, and the difference between the above embodiment and the previous embodiment is that the processing is performed by the control unit of the terminal device, while the embodiment of the first aspect is processed by the processing unit of the ultrasonic fingerprint sensor. The specific implementation details and principles are similar, and therefore will not be repeated.

[0138] In some optional embodiments, the determining, according to the obtained pressing position information, of navigation control information for navigation control of the terminal device comprises: determining, according to the plurality of pressing center point position coordinates, movement information of the finger in the detection area of the ultrasonic fingerprint sensor, wherein the movement information comprises at least one of a movement direction, a movement distance, and a movement speed; and determining, according to the movement information, the navigation control information for navigation control of the terminal device.

[0139] Based on this, in the present application, the movement information of the finger in the detection area of the ultrasonic fingerprint sensor is determined through the plurality of pressing center point position coordinates, which can accurately and effectively determine the navigation control information for navigation control of the terminal device, and thus when the terminal device is used underwater, the function of hand navigation control can be better realized through the ultrasonic fingerprint sensor, and the use effect of the user using the terminal device underwater is improved. It should be understood that the above optional embodiments can be understood with reference to the related content below "step S206" of the control method embodiment of the first aspect, and the difference between the above embodiments and the previous embodiments is that the processing is performed by the control unit of the terminal device here, while the processing is performed by the processing unit of the ultrasonic fingerprint sensor in the embodiments of the first aspect, and the specific implementation details and principles are similar, and thus will not be described again.

[0140] In the present application, the specific way of determining the target working mode of the ultrasonic fingerprint sensor is not specifically limited. For example, the processing unit of the ultrasonic fingerprint sensor can receive a mode opening signal of the control unit of the terminal device to determine the target working mode that the ultrasonic fingerprint sensor needs to enter according to the mode opening signal. Then, the ultrasonic fingerprint sensor can be controlled to enter the target working mode for operation. For example, taking the navigation working mode as an example, after determining that the terminal device has entered the working mode, the control unit of the terminal device can send a mode opening signal for opening the navigation working mode to the processing unit of the ultrasonic fingerprint sensor, so that the processing unit determines that the target working mode is the navigation working mode, and controls the ultrasonic fingerprint sensor to enter the navigation working mode for operation.

[0141] Alternatively, the processing unit of the ultrasonic fingerprint sensor can also determine the target working mode according to a preset rule by itself, for example, the ultrasonic fingerprint sensor needs to run in the pressing detection mode / fingerprint identification mode / navigation working mode when the terminal device enters the underwater working mode, and thus the target working mode can be directly determined as the pressing detection mode / fingerprint identification mode / navigation working mode, and the ultrasonic fingerprint sensor can be controlled to enter the target working mode for operation.

[0142] Optionally, the working modes of the ultrasonic fingerprint sensor further include a reset mode, which can be used for system reset of the ultrasonic fingerprint sensor, and is conducive to switching between working modes. In the reset mode, the ultrasonic fingerprint sensor is turned on but does not transmit or receive ultrasonic signals (which can be simply understood as that the ultrasonic fingerprint sensor is idle in the reset mode).

[0143] Optionally, the target working mode of the ultrasonic fingerprint sensor determined in the present application can be one of the fingerprint identification working mode, the press detection working mode, the navigation working mode, and the reset mode.

[0144] Optionally, the current working mode of the ultrasonic fingerprint sensor can be the same as the target working mode. If the current working mode is the same as the target working mode, the ultrasonic fingerprint sensor can be controlled to remain in the current working mode, thereby achieving the purpose of controlling the ultrasonic fingerprint sensor to enter the target working mode.

[0145] Optionally, if the current working mode of the ultrasonic fingerprint sensor is different from the target working mode, in the process of switching the current working mode to the target working mode, if the target working mode is not the reset mode, the ultrasonic fingerprint sensor can be first controlled to enter the reset mode from the current working mode (in the reset mode, the ultrasonic fingerprint sensor is turned on but does not transmit or receive ultrasonic signals), and then controlled to switch from the reset mode to the target working mode. By first entering the reset state and then switching the target working mode of the ultrasonic fingerprint sensor, the stability and reliability of the switching are improved. In addition, if the target working mode is the reset mode, the ultrasonic fingerprint sensor can be directly controlled to enter the reset mode from the current working mode.

[0146] Optionally, in other embodiments, if the current working mode and the target working mode are different, and neither of them is the reset mode, the ultrasonic fingerprint sensor can also be directly switched from the current working mode to the target working mode without passing through the reset mode, as long as the demand can be met.

[0147] Regarding the step S604 of "determining the target working mode of the ultrasonic fingerprint sensor", the related content of the first aspect of the embodiments has been described in detail, and can be understood with reference to the foregoing, which will not be repeated here.

[0148] Optionally, in the control method embodiment of the third aspect, if the ultrasonic fingerprint sensor has been turned off, the control unit can further control the ultrasonic fingerprint sensor to be turned on in response to determining that the terminal device has entered the underwater working mode, so as to enable the ultrasonic fingerprint sensor to determine the target working mode of the ultrasonic fingerprint sensor in response to the instruction signal and enter the target working mode.

[0149] It should be understood that the control method of the third aspect in any optional embodiment, the control unit of the terminal device undertakes most of the processing work, which can avoid excessive occupation of the operation resources of the ultrasonic fingerprint sensor to a certain extent.

[0150] Next, in combination with the flowchart shown in FIG. 7, the implementation process of an example scenario in which the control unit determines the navigation control information when the ultrasonic fingerprint sensor operates in the navigation working mode in the embodiment of the present application is described. As shown in FIG. 7, first, the control unit of the terminal device can send a mode start instruction for entering the navigation working mode to the ultrasonic fingerprint sensor, and the processing unit of the ultrasonic fingerprint sensor can determine that the target working mode is the navigation working mode according to the mode start instruction, and control the ultrasonic fingerprint sensor to enter the navigation working mode. Then, the ultrasonic fingerprint sensor collects the ultrasonic echo signal reflected by the finger in real time to obtain ultrasonic echo data, and puts the ultrasonic echo data into the cache. The control unit obtains the ultrasonic echo data from the ultrasonic fingerprint sensor. Then, the control unit calculates the navigation control information based on the ultrasonic echo data (the optional mode can be understood with reference to the related content of the foregoing embodiment, that is, the position coordinates of the pressing center point are determined, and then the navigation control information is determined, which will not be described here again). The control unit determines whether to end the navigation detection in real time. If not, the control unit reads the data cyclically, and continues to obtain the ultrasonic echo data from the ultrasonic fingerprint sensor for processing, so as to continue to calculate the navigation control information. If yes, the control unit sends a mode exit instruction for exiting the navigation working mode to the ultrasonic fingerprint sensor, and the processing unit of the ultrasonic fingerprint sensor controls the ultrasonic fingerprint sensor to exit the navigation working mode, and the process ends. It should be understood that the example description of FIG. 7 above is not any limitation on the embodiments of the present application.

[0151] Referring to FIG. 8, according to the third aspect of the embodiments of the present application, a control device 800 for an ultrasonic fingerprint sensor of a terminal device is provided, which comprises:

[0152] The first determination module 802 is configured to determine whether the terminal device has entered the underwater working mode.

[0153] The first control module 804 is configured to determine the target working mode of the ultrasonic fingerprint sensor and control the ultrasonic fingerprint sensor to enter the target working mode for operation in response to the terminal device having entered the underwater working mode.

[0154] The control device 1000 of the third aspect and the optional embodiments thereof in the embodiments of the present application have been described in detail in the foregoing control method embodiments of the first aspect, and therefore the related content and beneficial effects thereof can be understood with reference to the content of the foregoing optional embodiments of the method, which will not be described here again.

[0155] Referring to FIG. 9, according to a fourth aspect of the embodiments of the present application, a control device 900 is provided for a control unit of a terminal device, the control device 900 comprises:

[0156] A second determination module 902 is configured to determine whether the terminal device has entered an underwater working mode, and generate an indication signal in response to determining that the terminal device has entered the underwater working mode.

[0157] A second control module 904 is configured to send the indication signal to the ultrasonic fingerprint sensor, so that the ultrasonic fingerprint sensor determines a target working mode of the ultrasonic fingerprint sensor and operates in the target working mode in response to the indication signal.

[0158] The control device 900 of the fourth aspect and the optional embodiments thereof in the embodiments of the present application have been described in detail in the foregoing control method embodiments, and thus the related content and beneficial effects can be understood with reference to the content of the foregoing optional embodiments of the method, and will not be described here again.

[0159] According to a fifth aspect of the embodiments of the present application, an electronic device is provided, comprising: a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory complete communication with each other through the communication bus; the memory is configured to store a computer program; and the processor is configured to execute the control method of the first aspect or the second aspect by running the computer program stored on the memory.

[0160] FIG. 10 shows a structural block diagram of an optional electronic device in the embodiments of the present application. The embodiments of the present application do not limit the specific implementation of the electronic device 1000, and as an exemplary, referring to FIG. 10, the electronic device 1000 provided by the embodiments of the present application comprises: a processor 1002, a communication interface 1004, a memory 1006, and a communication bus 1008. Wherein:

[0161] The processor 1002, the communication interface 1004, and the memory 1006 complete communication with each other through the communication bus 1008.

[0162] The communication interface 1004 is configured to communicate with other electronic devices or servers.

[0163] The processor 1002 is configured to execute the computer program 1010, and specifically can execute the related steps in any of the foregoing control method embodiments.

[0164] Specifically, the computer program 1010 can include program code, and the program code includes computer operation instructions.

[0165] The processor 1002 can be a CPU, or a GPU (Graphic Processing Unit), or an ASIC (Application Specific Integrated Circuit), or one or more integrated circuits configured to implement one or more embodiments of the present application. The one or more processors included in the smart device can be the same type of processor, such as one or more CPUs; or can be different types of processors, such as one or more CPUs and one or more ASICs.

[0166] The memory 1006 is configured to store the computer program 1010. The memory 1006 can include a high-speed RAM memory, and can further include a non-volatile memory, such as at least one disk memory.

[0167] The computer program 1010 can be configured to cause the processor 1002 to perform the control method in any of the foregoing first aspect or second aspect embodiments.

[0168] The specific implementation of each step in the computer program 1010 can refer to the corresponding description in the corresponding step and unit in any of the control method embodiments of the foregoing first aspect or second aspect, and will not be described herein. It can be clearly understood by those skilled in the art that, for the convenience and brevity of description, the specific working process of the device and the module described above can refer to the corresponding process description in the foregoing method embodiments, and will not be described herein.

[0169] The electronic device 1000 in the embodiments of the present application has been described in detail in the foregoing control method embodiments, and therefore its related content and beneficial effects can be understood with reference to the foregoing method embodiments, and will not be described herein.

[0170] According to a fourth aspect of the embodiments of the present application, the embodiments of the present application further provide a computer storage medium having a computer program stored thereon, the computer program being executed by a processor to implement the control method described in any of the foregoing first aspect or second aspect method embodiments. The computer storage medium includes but is not limited to: a CD-ROM (Compact Disc Read-Only Memory), a RAM (Random Access Memory), a floppy disk, a hard disk, or a magneto-optical disk, etc.

[0171] According to a fifth aspect of the embodiments of the present application, the embodiments of the present application further provide a computer program product including a computer program, the computer program being executed by a processor to implement the control method described in any of the foregoing first aspect or second aspect embodiments.

[0172] The control device 800 / control device 900 / electronic device 1000 / computer storage medium / computer program product embodiments in the present application have been described in detail in the foregoing control method embodiments, and thus the related content and beneficial effects can be understood with reference to the foregoing method embodiments, which will not be described here again.

[0173] It should be understood that the various drawings of the embodiments are for the convenience of showing the structure, and the size ratio of each structure is not necessarily drawn according to the actual ratio.

[0174] In addition, it should be noted that the information related to the user (including but not limited to user equipment information, user personal information, etc.) and data (including but not limited to sample data for training the model, data for analysis, stored data, displayed data, etc.) involved in the embodiments of the present application are all information and data authorized by the user or authorized by all parties, and the collection, use and processing of the related data need to comply with the relevant laws, regulations and standards of the relevant countries and regions, and provide corresponding operation entrances for the user to choose authorization or refusal.

[0175] It should be noted that according to the needs of implementation, each component / step described in the embodiments can be split into more components / steps, or two or more components / steps or part of the operation of the components / steps can be combined into a new component / step to achieve the purpose of the embodiments of the present application.

[0176] The methods according to the embodiments of the present application described above can be implemented in hardware, firmware, or software, or a combination thereof, and can be stored in a recording medium such as a CD-ROM, RAM, floppy disk, hard disk, or magneto-optical disk, or be downloaded by a network from a remote recording medium or non-transitory machine-readable medium originally stored in a local recording medium and then stored in a local recording medium, so that the methods described herein can be stored in a recording medium on which such software processing using a general-purpose computer, a special-purpose processor, or programmable or special-purpose hardware such as an Application Specific Integrated Circuit (ASIC) or a Field Programmable Gate Array (FPGA) is performed. It can be understood that the computer, processor, microprocessor controller, or programmable hardware includes a storage component (for example, Random Access Memory (RAM), Read-Only Memory (ROM), flash memory, etc.) that can store or receive software or computer code, which, when accessed and executed by the computer, processor, or hardware, implements the methods described herein. Furthermore, when a general-purpose computer accesses code for implementing the methods shown herein, the execution of the code converts the general-purpose computer into a special-purpose computer for executing the methods shown herein.

[0177] Those skilled in the art can appreciate that the units and method steps of the examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether the functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. A skilled person can use different methods to implement the described functions for a specific application, but such implementation should not be considered beyond the scope of the embodiments of the present application.

[0178] The above embodiments are only used to illustrate but not limit the embodiments of the present application, and a person of ordinary skill in the art can make various changes and modifications without departing from the spirit and scope of the embodiments of the present application, therefore all equivalent technical solutions belong to the scope of the embodiments of the present application, and the patent protection scope of the embodiments of the present application should be defined by the claims.

Claims

A control method for an ultrasonic fingerprint sensor of a terminal device, the method comprising: determining whether the terminal device has entered an underwater working mode; in response to the terminal device having entered the underwater working mode, determining a target working mode of the ultrasonic fingerprint sensor, and controlling the ultrasonic fingerprint sensor to operate in the target working mode. The method of claim 1, wherein, The determination of whether the terminal device has entered the underwater working mode comprises: obtaining sensing data detected by a sensor of the terminal device, and determining whether the terminal device has entered the underwater working mode based on the sensing data; or, obtaining a first indication signal sent by a control unit of the terminal device, and determining that the terminal device has entered the underwater working mode according to the first indication signal, wherein the first indication signal is determined by the control unit based on sensing data detected by a sensor of the terminal device. The method of claim 2, wherein, The sensing data comprises touch sensing data detected by a touch sensor of the terminal device, wherein the touch sensing data comprises at least one of capacitance data detected by the touch sensor or touch area data used to indicate a pressing area within a detection area of the touch sensor when the terminal device is touched by the touch sensor; The determination of whether the terminal device has entered the underwater working mode based on the sensing data comprises: in response to a variation amount of the capacitance data within a first preset time satisfying a first preset condition, and / or the touch area data indicating that the pressing area reaches a second preset condition, determining that the terminal device has entered the underwater working mode. The method of claim 2, wherein, The sensing data comprises ultrasonic echo data collected by the ultrasonic fingerprint sensor; The determination of whether the terminal device has entered the underwater working mode based on the sensing data comprises: in response to a variation amount of the ultrasonic echo data within a second preset time satisfying a third preset condition, and / or acoustic impedance data determined based on the ultrasonic echo data satisfying a fourth preset condition, determining that the terminal device has entered the underwater working mode. The method of claim 1, wherein, The determination of whether the terminal device has entered the underwater working mode comprises: in response to the terminal device having been set to the underwater working mode by a user, determining that the terminal device has entered the underwater working mode. The method of any one of claims 1-5, wherein, The working modes of the ultrasonic fingerprint sensor comprise at least one of a fingerprint recognition working mode, a pressing detection working mode, and a navigation working mode; The method further comprises: when the ultrasonic fingerprint sensor operates in the fingerprint recognition working mode, controlling the ultrasonic fingerprint sensor to collect ultrasonic echo data from a finger, and performing fingerprint recognition based on the ultrasonic echo data; and / or when the ultrasonic fingerprint sensor operates in the pressing detection working mode, controlling the ultrasonic fingerprint sensor to collect ultrasonic echo data from a finger, and performing pressing detection based on the ultrasonic echo data; and / or when the ultrasonic fingerprint sensor operates in the navigation working mode, controlling the ultrasonic fingerprint sensor to collect ultrasonic echo data from a finger, and performing navigation based on the ultrasonic echo data. When the ultrasonic fingerprint sensor operates in the navigation mode, the ultrasonic fingerprint sensor is controlled to collect ultrasonic echo data of a finger, and navigation control information for navigation control of the terminal device is determined based on the ultrasonic echo data. The method of claim 6, wherein The determination of the navigation control information for navigation control of the terminal device based on the ultrasonic echo data comprises: acquiring a plurality of ultrasonic echo data respectively collected by the ultrasonic fingerprint sensor at a plurality of different time instants; determining, according to the plurality of ultrasonic echo data, a plurality of pressing position information of the finger in the detection region of the ultrasonic fingerprint sensor at the plurality of different time instants; determining, according to the obtained pressing position information, the navigation control information for navigation control of the terminal device. The method of claim 7, wherein, The ultrasonic fingerprint sensor comprises a plurality of ultrasonic subunits, each of which is configured to collect sub-ultrasonic echo data of a finger, and the ultrasonic echo data at any time instant comprises a plurality of sub-ultrasonic echo data collected by the plurality of ultrasonic subunits at the time instant; The determination of the plurality of pressing position information of the finger in the detection region of the ultrasonic fingerprint sensor at the plurality of different time instants according to the plurality of ultrasonic echo data comprises: For each of the plurality of ultrasonic echo data, the echo intensity distribution information corresponding to the time instant at which the ultrasonic echo data is collected is determined according to the ultrasonic echo signal intensity indicated by the plurality of sub-ultrasonic echo data in the ultrasonic echo data, and the pressing center point position coordinates corresponding to the time instant at which the ultrasonic echo data is collected are determined according to the echo intensity distribution information, wherein the echo intensity distribution information is used to indicate the intensity distribution of the ultrasonic echo signal received by the ultrasonic subunit at different positions; The plurality of pressing center point position coordinates obtained are determined as the plurality of pressing position information. The method of claim 8, wherein, The echo intensity distribution information is an echo intensity distribution map in the form of an image, the echo intensity distribution map comprises a plurality of image regions corresponding one-to-one to the plurality of ultrasonic subunits, and the position arrangement relationship between the plurality of image regions is determined based on the position arrangement relationship between the plurality of ultrasonic subunits; The determination of the echo intensity distribution information corresponding to the time instant at which the ultrasonic echo data is collected according to the ultrasonic echo signal intensity indicated by the plurality of sub-ultrasonic echo data in the ultrasonic echo data comprises: For each sub-ultrasonic echo data of the ultrasonic echo data, a to-be-processed echo intensity distribution map is acquired, and an image feature value is assigned to the image region corresponding to the target ultrasonic subunit in the to-be-processed echo intensity map according to the ultrasonic echo signal intensity indicated by the sub-ultrasonic echo data, and after each image region in the to-be-processed echo intensity map is assigned an image feature value, the echo intensity distribution map corresponding to the time instant at which the ultrasonic echo data is collected is obtained. The target ultrasonic subunit is an ultrasonic subunit that collects the sub-ultrasonic echo data, and the echo intensity distribution to be processed is a blank echo intensity distribution or a historical echo intensity distribution. The method of claim 9, wherein, The method comprises: According to the maximum or minimum image feature value of the echo intensity distribution, the coordinates of the pressing center point corresponding to the time when the ultrasonic echo data is collected are determined. The method of claim 8, wherein, According to the obtained pressing position information, navigation control information for navigation control of the terminal device is determined. According to the multiple pressing center point coordinates, movement information of the finger in the detection area of the ultrasonic fingerprint sensor is determined, wherein the movement information includes at least one of the moving direction, the moving distance, and the moving speed. According to the movement information, navigation control information for navigation control of the terminal device is determined. The method of any one of claims 1-5, wherein The ultrasonic fingerprint sensor includes at least one of a side ultrasonic fingerprint sensor, a back ultrasonic fingerprint sensor, and an under-screen ultrasonic fingerprint sensor. A control method for a control unit of a terminal device, the method comprising: Determining whether the terminal device has entered an underwater working mode, and in response to determining that the terminal device has entered the underwater working mode, generating an indication signal; Sending the indication signal to the ultrasonic fingerprint sensor, so that the ultrasonic fingerprint sensor determines a target working mode of the ultrasonic fingerprint sensor in response to the indication signal and runs in the target working mode. The method of claim 13, wherein, The indication signal includes a first indication signal. The determination of whether the terminal device has entered the underwater working mode, the generation of the indication signal in response to the determination that the terminal device has entered the underwater working mode, comprises: Obtaining sensing data detected by a sensor of the terminal device, determining whether the terminal device has entered the underwater working mode based on the sensing data, and generating the first indication signal in response to the determination that the terminal device has entered the underwater working mode. The method of claim 14, wherein, The sensing data includes touch sensing data detected by a touch sensor of the terminal device, wherein the touch sensing data includes at least one of capacitance data or touch area data detected by the touch sensor, and the touch area data is used to indicate a pressing area in a detection area of the touch sensor when the terminal device is touched by the touch sensor. The determination of whether the terminal device has entered the underwater working mode based on the sensing data comprises: In response to the fact that the change amount of the capacitance data within a first preset time meets a first preset condition and / or the fact that the touch area data indicates that the pressing area meets a second preset condition, it is determined that the terminal device has entered the underwater working mode. The method of claim 14, wherein, The sensing data includes ultrasonic echo data collected by the ultrasonic fingerprint sensor. The determination of whether the terminal device has entered the underwater working mode based on the sensing data comprises: ​ In response to the change amount of the ultrasonic echo data within a second preset time satisfying a third preset condition, and / or the acoustic impedance data determined based on the ultrasonic echo data satisfying a fourth preset condition, it is determined that the terminal device has entered an underwater working mode. The method of claim 13, wherein, The indication signal includes a second indication signal. The determination of whether the terminal device has entered an underwater working mode, in response to determining that the terminal device has entered an underwater working mode, generating an indication signal, includes: Determining whether the terminal device has been set to an underwater working mode by a user, in response to determining that the user has set the terminal device to an underwater working mode, determining that the terminal device has entered an underwater working mode, and generating the second indication signal. The method of any one of claims 13-17, wherein, The working mode of the ultrasonic fingerprint sensor includes at least one of a fingerprint recognition working mode, a press detection working mode, and a navigation working mode. The method further includes: When the ultrasonic fingerprint sensor operates in the fingerprint recognition working mode, obtaining ultrasonic echo data obtained by the ultrasonic fingerprint sensor collecting a finger, and performing fingerprint recognition based on the ultrasonic echo data; and / or, When the ultrasonic fingerprint sensor operates in the press detection working mode, obtaining ultrasonic echo data obtained by the ultrasonic fingerprint sensor collecting a finger, and performing press detection based on the ultrasonic echo data; and / or, When the ultrasonic fingerprint sensor operates in the navigation working mode, obtaining ultrasonic echo data obtained by the ultrasonic fingerprint sensor collecting a finger, and determining navigation control information for navigation control of the terminal device based on the ultrasonic echo data. The method of claim 18, wherein, The determination of navigation control information for navigation control of the terminal device based on the ultrasonic echo data includes: Obtaining a plurality of ultrasonic echo data obtained by the ultrasonic fingerprint sensor collecting a finger at a plurality of different times; Determining a plurality of press position information of the finger in the detection area of the ultrasonic fingerprint sensor at the plurality of different times according to the plurality of ultrasonic echo data; Determining navigation control information for navigation control of the terminal device according to the obtained press position information. The method of claim 19, wherein, The ultrasonic fingerprint sensor includes a plurality of ultrasonic subunits, each of which is used to collect sub-ultrasonic echo data obtained by a finger, and the ultrasonic echo data at any time includes a plurality of sub-ultrasonic echo data collected by the plurality of ultrasonic subunits at that time; The determination of a plurality of press position information of the finger in the detection area of the ultrasonic fingerprint sensor at the plurality of different times according to the plurality of ultrasonic echo data includes: For each of the plurality of ultrasonic echo data: according to the ultrasonic echo signal intensity indicated by the plurality of sub-ultrasonic echo data in the ultrasonic echo data, determine the echo intensity distribution information corresponding to the time when the ultrasonic echo data is collected, and according to the echo intensity distribution information, determine the pressing center point position coordinates corresponding to the time when the ultrasonic echo data is collected, wherein the echo intensity information is used to indicate the intensity distribution of the ultrasonic echo signal received by the ultrasonic subunit at different positions; Determine the plurality of pressing center point position coordinates obtained as the plurality of pressing position information. The method of claim 20, wherein, The echo intensity distribution information is an echo intensity distribution graph in the form of an image, the echo intensity distribution graph includes a plurality of image regions corresponding to the plurality of ultrasonic subunits, and the position arrangement relationship between the plurality of image regions is determined based on the position arrangement relationship between the plurality of ultrasonic subunits; According to the ultrasonic echo signal intensity indicated by the plurality of sub-ultrasonic echo data in the ultrasonic echo data, the echo intensity distribution information corresponding to the time when the ultrasonic echo data is collected is determined, including: For each sub-ultrasonic echo data of the ultrasonic echo data, obtain a to-be-processed echo intensity distribution graph, and assign an image feature value to the image region corresponding to the target ultrasonic subunit in the to-be-processed echo intensity graph according to the ultrasonic echo signal intensity indicated by the sub-ultrasonic echo data. After each image region of the to-be-processed echo intensity graph is assigned an image feature value, an echo intensity distribution graph corresponding to the time when the ultrasonic echo data is collected is obtained. Wherein, the target ultrasonic subunit is the ultrasonic subunit for collecting the sub-ultrasonic echo data, and the to-be-processed echo intensity distribution graph is a blank echo intensity distribution graph or a historical echo intensity distribution graph. The method of claim 21, wherein, According to the echo intensity distribution information, the pressing center point position coordinates corresponding to the time when the ultrasonic echo data is collected are determined, including: According to the coordinates of the image region with the maximum or minimum image feature value in the preset image coordinate system, the pressing center point position coordinates corresponding to the time when the ultrasonic echo data is collected are determined. According to the obtained pressing position information, the navigation control information for navigation control of the terminal device is determined, including: The method of claim 20, wherein, According to the plurality of pressing center point position coordinates, determine the movement information of the finger in the detection area of the ultrasonic fingerprint sensor, wherein the movement information includes at least one of the moving direction, the moving distance, and the moving speed; According to the movement information, determine the navigation control information for navigation control of the terminal device. The ultrasonic fingerprint sensor includes at least one of a side ultrasonic fingerprint sensor, a back ultrasonic fingerprint sensor, and an under-screen ultrasonic fingerprint sensor. The method of any one of claims 13-17, wherein, A control device for an ultrasonic fingerprint sensor of a terminal device, the control device comprising: A first determination module for determining whether the terminal device has entered an underwater working mode; ​ The first control module is configured to determine a target working mode of the ultrasonic fingerprint sensor in response to the terminal device entering the underwater working mode, and control the ultrasonic fingerprint sensor to run in the target working mode. A control device for a control unit of a terminal device, the control device comprising: The second determination module is configured to determine whether the terminal device has entered the underwater working mode, and generate an indication signal in response to determining that the terminal device has entered the underwater working mode; The second control module is configured to send the indication signal to the ultrasonic fingerprint sensor, so that the ultrasonic fingerprint sensor determines a target working mode of the ultrasonic fingerprint sensor in response to the indication signal, and runs in the target working mode. An electronic device, comprising: A processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory complete communication with each other through the communication bus; The memory is configured to store a computer program; The processor is configured to execute the method in any one of claims 1-24 by running the computer program stored on the memory. A computer storage medium having a computer program stored thereon, the computer program being executed by a processor to implement the method in any one of claims 1-24. A computer program product comprising a computer program, the computer program being executed by a processor to implement the method in any one of claims 1-24.

Images