Control methods, devices, electronic equipment, storage media and computer program products

Abstract

This application provides a control method, apparatus, electronic device, storage medium, and computer program product. The control method is used for an ultrasonic fingerprint sensor in a terminal device. The control method includes: determining whether the terminal device has entered an underwater operating mode; in response to the terminal device entering the underwater operating mode, determining a target operating mode for the ultrasonic fingerprint sensor, and controlling the ultrasonic fingerprint sensor to operate in the target operating mode.

Description

Technical Field

[0001] This application relates to the field of fingerprint sensor technology, and more particularly to a control method, device, electronic device, storage medium, and computer program product. Background Technology

[0002] The waterproof performance of mobile phones and other terminal devices is constantly improving, and users also have needs for underwater use in certain scenarios. For example, if a user accidentally takes their phone into the water while swimming, they still want the phone to remain functional despite water immersion. Some terminal devices rely on fingerprint sensors for unlocking and transactions, but most current fingerprint technologies do not adequately meet the needs of underwater operation, resulting in poor underwater performance. Therefore, a new technological solution is needed to improve this situation. Summary of the Invention

[0003] In view of this, embodiments of this application provide a control scheme.

[0004] According to a first aspect of the embodiments of this application, a control method is provided for an ultrasonic fingerprint sensor of a terminal device, the method comprising: determining whether the terminal device has entered an underwater working mode; in response to the terminal device having entered an underwater working mode, determining a target working mode of the ultrasonic fingerprint sensor, and controlling the ultrasonic fingerprint sensor to enter the target working mode for operation.

[0005] According to a second aspect of the embodiments of this application, a control method is provided, comprising: a control unit for a terminal device, the method comprising: determining whether the terminal device has entered an underwater operating mode, and generating an indication signal in response to determining that the terminal device has entered an underwater operating mode; sending the indication signal to an ultrasonic fingerprint sensor, such that the ultrasonic fingerprint sensor, in response to the indication signal, determines a target operating mode of the ultrasonic fingerprint sensor and enters the target operating mode for operation.

[0006] According to a third aspect of the embodiments of this application, a control device is provided for an ultrasonic fingerprint sensor of a terminal device. The control device includes: a first determining module for determining whether the terminal device has entered an underwater working mode; and a first controlling module for determining a target working mode of the ultrasonic fingerprint sensor in response to the terminal device entering the underwater working mode, and controlling the ultrasonic fingerprint sensor to enter the target working mode for operation.

[0007] According to a fourth aspect of the embodiments of this application, a control device is provided, comprising: a control unit for a terminal device, the control device comprising: a second determining module, configured to determine whether the terminal device has entered an underwater operating mode, and in response to determining that the terminal device has entered an underwater operating mode, generating an indication signal; and a second control module, configured to send the indication signal to the ultrasonic fingerprint sensor, so that the ultrasonic fingerprint sensor, in response to the indication signal, determines the target operating mode of the ultrasonic fingerprint sensor and enters the target operating mode for operation.

[0008] According to a fifth aspect of the present application, an electronic device is provided, comprising: a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other via the communication bus; the memory is used to store a computer program; and the processor is used to execute the method described in the first or second aspect by running the computer program stored in the memory.

[0009] According to a sixth aspect of the embodiments of this application, a computer storage medium is provided that stores a computer program thereon, which, when executed by a processor, implements the method described in the first or second aspect.

[0010] According to a seventh aspect of the embodiments of this application, a computer program product is provided, including a computer program that, when executed by a processor, implements the method as described in the first or second aspect.

[0011] According to the control scheme provided in the embodiments of this application, on the one hand, the terminal device uses an ultrasonic fingerprint sensor to realize the fingerprint function. Since the ultrasonic fingerprint sensor realizes the fingerprint function through ultrasonic signals, and the ultrasonic signals are less affected underwater, compared with other types of fingerprint sensors, the use of an ultrasonic fingerprint sensor can better maintain the fingerprint function of the terminal device when it is used underwater. On the other hand, since the terminal device in the control scheme of this application has a dedicated underwater working mode, it can better meet the needs of the terminal device when used underwater, thereby improving the user experience. Furthermore, since the target working mode of the ultrasonic fingerprint sensor can be determined when the terminal device has entered the underwater working mode, and the ultrasonic fingerprint sensor can be controlled to enter the target working mode, it can enter the appropriate target working mode to operate while ensuring that the ultrasonic fingerprint sensor can be turned on and working in the underwater working mode. This can better meet the user's needs for using the ultrasonic fingerprint sensor and the terminal device underwater, further improving the underwater user experience of the terminal device. Attached Figure Description

[0012] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in the embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings.

[0013] Figure 1 This is a flowchart illustrating the steps of a control method provided in the first aspect of an embodiment of this application.

[0014] Figure 2 This is an optional flowchart for determining navigation control information according to an embodiment of this application.

[0015] Figure 3A This is a schematic diagram illustrating the positional arrangement of multiple sub-ultrasonic units of an ultrasonic fingerprint sensor, which is an example of some embodiments of this application.

[0016] Figure 3B To and Figure 3A An optional schematic diagram showing the echo intensity distribution corresponding to multiple sub-ultrasonic units.

[0017] Figure 4 This is an example showing the echo intensity distribution at two different times.

[0018] Figure 5 To and Figure 4 The diagram shows the change in the position of the center point of finger pressure at two different times.

[0019] Figure 6 A flowchart illustrating the steps of a control method provided in the second aspect of an embodiment of this application.

[0020] Figure 7 This is a flowchart illustrating an optional scenario in which the control unit determines navigation control information when the ultrasonic fingerprint sensor is operating in navigation mode, according to an embodiment of this application.

[0021] Figure 8 This is a schematic diagram of a control device provided as a third aspect of the embodiments of this application.

[0022] Figure 9 This is a schematic diagram of a control device provided for a fourth aspect of the embodiments of this application.

[0023] Figure 10 This is a schematic diagram of the structure of an electronic device provided as a fifth aspect of the embodiments of this application. Detailed Implementation

[0024] To enable those skilled in the art to better understand the technical solutions in the embodiments of this application, the technical solutions in the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art should fall within the protection scope of the embodiments of this application.

[0025] The specific implementation of the embodiments of this application will be further described below with reference to the accompanying drawings.

[0026] Figure 1 This is a flowchart illustrating the steps of a control method provided according to a first aspect of an embodiment of this application. According to the first aspect of an embodiment of this application, a control method is provided for an ultrasonic fingerprint sensor in a terminal device, referring to… Figure 1 As shown, the control method includes steps S102 and S104, specifically:

[0027] S102: Determine whether the terminal equipment has entered underwater working mode.

[0028] An ultrasonic fingerprint sensor can be a fingerprint sensor that functions through ultrasonic signals. Optionally, the control method provided in the first aspect of this application can be executed by the ultrasonic fingerprint sensor, for example, by the processing unit inside the ultrasonic fingerprint sensor (which may include any processor, such as a CPU, MCU, etc.).

[0029] In this embodiment, the terminal device can be any type of electronic device. For example, it can be a mobile terminal such as a mobile phone, a tablet computer, a computer, a server, etc. In the following text, a mobile phone will be used as an example for illustration and understanding.

[0030] Optionally, the ultrasonic fingerprint sensor in this application may include at least one of a side-mounted ultrasonic fingerprint sensor, a rear-mounted ultrasonic fingerprint sensor, and an under-display ultrasonic fingerprint sensor. Using these types of ultrasonic fingerprint sensors, side-mounted fingerprint recognition, rear-mounted fingerprint recognition, or under-display fingerprint recognition can be achieved to meet the usage requirements of terminal devices.

[0031] It should be understood that the specific structure of the ultrasonic fingerprint sensor is not limited in this application embodiment, as long as it meets the requirements. Optionally, the ultrasonic fingerprint sensor in this application may include multiple ultrasonic sub-units, each of which can transmit and receive ultrasonic signals, and the multiple ultrasonic sub-units can form an array of M columns and N rows. Each ultrasonic sub-unit can be equivalent to a "pixel".

[0032] Optionally, the ultrasonic subunit may include a piezoelectric material layer, capable of emitting and receiving ultrasonic signals based on the piezoelectric effect. For example, in a scenario where an ultrasonic fingerprint sensor collects fingerprints, a finger can be pressed above the detection area of ​​the ultrasonic fingerprint sensor. Multiple ultrasonic subunits of the sensor can emit ultrasonic signals towards the finger. From the moment the ultrasonic signal is emitted, it passes through the chip layer by layer, then through the cover plate. The finger above the detection area of ​​the sensor can then reflect at least a portion of the ultrasonic signal, forming an ultrasonic echo signal carrying fingerprint information. Multiple ultrasonic subunits receive these echo signals, and the received echo signals can be processed into ultrasonic echo data that can be processed by a computer. The ultrasonic fingerprint sensor can generate an ultrasonic fingerprint image based on this echo data. Alternatively, a control unit (which may be the control unit of a terminal device, including any processor such as a CPU, MCU, etc.) electrically connected to the ultrasonic fingerprint sensor can generate an ultrasonic fingerprint image based on the echo data. Furthermore, the ultrasonic fingerprint image can be used to achieve fingerprint recognition functionality. It should be understood that this description is merely an example for ease of understanding and is not intended to limit the scope of this application.

[0033] Optionally, the ultrasonic fingerprint sensor in this application may include multiple operating modes. For example, in some optional embodiments, the operating modes of the ultrasonic fingerprint sensor include at least one of: fingerprint recognition operating mode, pressure detection operating mode, and navigation operating mode. Based on this, the control method of the first aspect further includes:

[0034] When the ultrasonic fingerprint sensor is operating in fingerprint recognition mode, it collects ultrasonic echo data from the finger and performs fingerprint recognition based on the ultrasonic echo data; and / or...

[0035] When the ultrasonic fingerprint sensor is operating in pressure detection mode, it collects ultrasonic echo data from the finger and performs pressure detection based on the ultrasonic echo data; and / or,

[0036] When the ultrasonic fingerprint sensor is operating in navigation mode, it collects ultrasonic echo data from the finger and determines navigation control information for navigating the terminal device based on the ultrasonic echo data.

[0037] Based on this, the embodiments of this application utilize multiple operating modes of the ultrasonic fingerprint sensor to meet the different needs of terminal devices, including but not limited to underwater use, thereby improving the underwater performance of the ultrasonic fingerprint sensor and the terminal device.

[0038] It should be understood that fingerprint recognition can refer to generating an ultrasonic fingerprint image and performing fingerprint recognition based on the ultrasonic fingerprint image; pressure detection can refer to detecting whether the detection area of ​​the ultrasonic fingerprint sensor is pressed; and navigation control can refer to controlling the terminal device to complete a predetermined task by detecting finger movements.

[0039] It should be noted that, in the first aspect of the embodiment, the fingerprint recognition, pressure detection, and determination of navigation control information described above can be implemented by an ultrasonic fingerprint sensor (which can be executed by the processing unit of the ultrasonic fingerprint sensor). However, in the second aspect of the control method embodiment described below, the fingerprint recognition, pressure detection, and determination of navigation control information can be implemented by the control unit of the terminal device, which will not be elaborated upon here.

[0040] Optionally, the ultrasonic fingerprint sensor may also include a reset mode, which can be used to reset the ultrasonic fingerprint sensor system, facilitating the switching of operating modes. In reset mode, the ultrasonic fingerprint sensor is turned on but neither transmits nor receives ultrasonic signals (simply put, the ultrasonic fingerprint sensor is idle in this reset mode).

[0041] Optionally, for the aforementioned ultrasonic fingerprint sensor comprising M*N ultrasonic subunits, in fingerprint recognition mode, all M*N ultrasonic subunits can be in the state of transmitting and receiving ultrasonic signals. Optionally, in pressure detection mode, some of the M*N ultrasonic subunits can be in the state of transmitting and receiving ultrasonic signals, while others are not in this state. This reduces power consumption. Optionally, different portions of the ultrasonic subunits can also alternately enter the state of transmitting and receiving ultrasonic signals at uniform time intervals to balance time consumption and spatial uniformity. In navigation mode, either all M*N ultrasonic subunits can be in the state of transmitting and receiving ultrasonic signals, or only some ultrasonic subunits can be in the state of transmitting and receiving ultrasonic signals.

[0042] Optionally, when the ultrasonic fingerprint sensor is in navigation mode, if navigation control information is obtained, the control unit of the terminal device can further perform navigation control of the terminal device based on the navigation control information.

[0043] Optionally, depending on the actual application scenario, the ultrasonic fingerprint sensor in this application can have a detection frequency of 10Hz or higher in fingerprint recognition mode, press detection mode, and navigation mode, that is, at least 10 signal acquisitions per second to obtain at least 10 ultrasonic echo data, so as to ensure the effectiveness of the ultrasonic fingerprint sensor and terminal device.

[0044] Optionally, the terminal device in this application can be pre-set to an underwater operating mode to facilitate its underwater use. After entering underwater operating mode, the terminal device can disable certain functions unsuitable for underwater use. These may include, but are not limited to, power output functions. Corresponding to the underwater operating mode, the terminal device can also be set to a normal operating mode (or air operating mode) to meet daily use needs. In normal operating mode, certain functions unsuitable for underwater use can be enabled. When needed, the terminal device can switch from normal operating mode to underwater operating mode. This can be done automatically by the terminal device after certain conditions are met (e.g., automatically switching to underwater operating mode upon detecting that the terminal device has entered the water), or manually by the user (e.g., in one implementation, the underwater operating mode can be enabled through the terminal device's settings interface, thereby switching the terminal device from normal operating mode to underwater operating mode).

[0045] Step S102 described above can determine whether the terminal device has entered underwater operating mode in any suitable manner. In some optional embodiments, the terminal device can automatically switch to underwater operating mode after determining that it has entered the water. In some optional embodiments, step S102 may include: acquiring sensing data detected by the sensors of the terminal device, and determining whether the terminal device has entered underwater operating mode based on the sensing data.

[0046] It should be understood that in this optional embodiment, the sensor may send the sensing data to the processing unit of the ultrasonic fingerprint sensor for processing. Specifically, a suitable sensor can be set on the terminal device. The sensing data detected by the sensor can help determine whether the terminal device has entered the water. Since the terminal device can automatically enter the underwater working mode after entering the water, the sensing data can also be used to accurately determine whether the terminal device has entered the underwater working mode. This facilitates subsequent control of the ultrasonic fingerprint sensor and improves the user experience of using the ultrasonic fingerprint sensor and the terminal device underwater.

[0047] Alternatively, in some other optional embodiments, step S102 may include: acquiring a first indication signal sent by the control unit of the terminal device, and determining that the terminal device has entered the underwater working mode based on the first indication signal, wherein the first indication signal is determined by the control unit based on sensor data detected by the sensors of the terminal device.

[0048] It should be understood that in this alternative embodiment, the sensor may send the sensing data to the control unit of the terminal device. If the control unit determines that the terminal device has entered the water based on the sensing data, since the terminal device can automatically enter underwater working mode after entering the water, the control unit can generate a first indication signal to indicate that the terminal device has entered underwater working mode. The control unit then sends the first indication signal to the processing unit of the ultrasonic fingerprint sensor, so that the processing unit of the ultrasonic fingerprint sensor can accurately determine that the terminal device has entered underwater working mode based on the first indication signal. This facilitates subsequent control of the ultrasonic fingerprint sensor and improves the user experience of using the ultrasonic fingerprint sensor and the terminal device underwater. It should be understood that processing the sensing data through the control unit of the terminal device also helps to reduce the data processing load of the ultrasonic fingerprint sensor, avoid excessive occupation of the ultrasonic fingerprint sensor's computing resources, and improve the processing speed.

[0049] This application does not specifically limit the type of sensor used. For example, in some optional embodiments, the sensor may be a touch sensor. Optionally, the sensing data includes touch sensing data detected by the touch sensor of the terminal device, wherein the touch sensing data includes at least one of capacitance data or touch area data detected by the touch sensor, and the touch area data is used to indicate the pressing area within the detection area of ​​the touch sensor when the terminal device is touched by the touch sensor. The aforementioned "determining whether the terminal device has entered the underwater working mode based on the sensing data" may include: in response to the change in capacitance data within a first preset time period satisfying a first preset condition, and / or, the touch area data indicating that the pressing area has reached a level satisfying a second preset condition, determining that the terminal device has entered the underwater working mode.

[0050] Based on this, in the embodiments of this application, touch sensing data and preset conditions can be used to accurately determine whether the terminal device has entered the underwater working mode, so as to facilitate the subsequent control of the ultrasonic fingerprint sensor and improve the user's underwater experience of using the ultrasonic fingerprint sensor and the terminal device.

[0051] The sensing data detected by the touch sensor includes capacitance data, meaning the touch sensor can be a capacitive touch sensor. Since the capacitance data detected by the capacitive touch sensor changes before and after the terminal device is submerged in water, a first preset time and a first preset condition can be preset. If the change in capacitance data within the first preset time meets the first preset condition, the terminal device can be considered submerged. Since the terminal device automatically enters underwater operating mode after submersion, the above method can accurately determine whether the terminal device has entered underwater operating mode.

[0052] Optionally, the first preset time can be set as needed, for example, to 1-2 seconds. Optionally, the first preset condition can be set as needed, for example, a threshold condition. For example, if it is determined that the change in capacitance data exceeds a certain preset threshold in the first preset time, it can be determined that the terminal device has entered the water, thereby accurately determining that the terminal device has entered the underwater working mode.

[0053] The reason why the touch area data detected by the touch sensor can be used to determine whether the terminal device has entered underwater operation mode is that after the terminal device is submerged in water, the water will press a large area of ​​the touch sensor's detection area, even up to 100% of the detection area. Therefore, the pressed area indicated by the touch area data will change significantly compared to before the terminal device was submerged. Thus, a second preset condition can be set. If the touch area data meets the second preset condition, it can be considered that the terminal device has entered water. Since the terminal device automatically enters underwater operation mode after being submerged, this method can accurately determine whether the terminal device has entered underwater operation mode.

[0054] Optionally, the second preset condition can be set as needed, such as a threshold condition. For example, if the touch area data indicates that the pressed area exceeds 90% of the detection area of ​​the touch sensor (this is just an example; the threshold can be set as needed), then the terminal device is considered to have entered the water, thus determining that the terminal device has entered the underwater operating mode. Optionally, as an embodiment, the second preset condition can also be set to the pressed area reaching 100% of the detection area of ​​the touch sensor. If the touch area data indicates that the pressed area reaches 100% of the detection area of ​​the touch sensor, then the terminal device is considered to have entered the water, thus accurately determining that the terminal device has entered the underwater operating mode.

[0055] It should be understood that the aforementioned capacitance data and touch area data can be combined or either one can be chosen to determine whether the terminal device has entered underwater working mode, and this application does not impose any restrictions on this.

[0056] It should be understood that since ultrasonic fingerprint sensors are also a type of sensor for terminal devices, in some optional embodiments, the function of ultrasonic fingerprint sensors can also be used to determine whether the terminal device has entered underwater operating mode. Optionally, the sensing data includes ultrasonic echo data collected by the ultrasonic fingerprint sensor. The aforementioned "determining whether the terminal device has entered underwater operating mode based on sensing data" includes: determining that the terminal device has entered underwater operating mode in response to the change in ultrasonic echo data within a second preset time period satisfying a third preset condition, and / or, the acoustic impedance data determined based on the ultrasonic echo data satisfying a fourth preset condition.

[0057] Based on this, in the embodiments of this application, ultrasonic echo data and preset conditions can be used to accurately determine whether the terminal device has entered the underwater working mode, so as to facilitate the subsequent control of the ultrasonic fingerprint sensor and improve the user's underwater experience of using the ultrasonic fingerprint sensor and the terminal device.

[0058] Optionally, when using ultrasonic echo data collected by an ultrasonic fingerprint sensor to determine whether the terminal device has entered underwater working mode, the ultrasonic fingerprint sensor can operate in press detection mode. This working mode has lower power consumption and can effectively achieve the purpose.

[0059] Since the ultrasonic echo data detected by the ultrasonic fingerprint sensor will change before and after the terminal device is submerged in water, a second preset time and a third preset condition can be preset. If the change in ultrasonic echo data within the second preset time meets the third preset condition, it can be considered that the terminal device has been submerged in water. Since the terminal device can automatically enter the underwater working mode after being submerged in water, the above method can be used to accurately determine that the terminal device has entered the underwater working mode.

[0060] Optionally, the second preset time can be set as needed, for example, to 1-2 seconds. Optionally, the third preset condition can be set as needed, for example, a threshold condition. For example, if it is determined that the change in ultrasonic echo data during the third preset time exceeds a certain preset threshold, it can be determined that the terminal device has entered the water, thereby accurately determining that the terminal device has entered the underwater working mode.

[0061] Since the propagation medium of ultrasonic signals changes from air to water before and after the terminal device enters the water, and there is a difference in acoustic impedance between air and water (the acoustic impedance of water is greater than that of air), acoustic impedance data can be calculated based on ultrasonic echo data, and a fourth preset condition can be preset. If the acoustic impedance data meets the fourth preset condition, it can be considered that the terminal device has entered the water. Since the terminal device can automatically enter the underwater working mode after entering the water, the above method can be used to accurately determine that the terminal device has entered the underwater working mode.

[0062] Optionally, the fourth preset condition can be set as needed. For example, the fourth preset condition can be a range condition. For example, this range condition can be the acoustic impedance range of water. If the acoustic impedance data determined based on the ultrasonic echo data falls within the acoustic impedance range of water, it can be determined that the terminal device has entered the water, thereby accurately determining that the terminal device has entered the underwater working mode. Alternatively, the fourth preset condition can also be a threshold condition. If the acoustic impedance data determined based on the ultrasonic echo data exceeds a certain preset threshold, it can be determined that the terminal device has entered the water, thereby accurately determining that the terminal device has entered the underwater working mode. It should be understood that this is only for ease of understanding and is not intended to limit this application.

[0063] It should be understood that the changes in the ultrasonic signal data and the acoustic impedance data mentioned above can be combined or either one can be chosen to determine whether the terminal device has entered the underwater working mode. This application does not impose any restrictions on this.

[0064] In some alternative embodiments, the method of determining whether the terminal device has entered the underwater working mode in step S102 may include: determining that the terminal device has entered the underwater working mode in response to the user setting the terminal device to the underwater working mode.

[0065] Based on this, since the terminal device has been set to underwater working mode by the user, it can be accurately determined that the terminal device has entered underwater working mode, so as to facilitate the subsequent control of the ultrasonic fingerprint sensor and improve the user's underwater experience of using the ultrasonic fingerprint sensor and the terminal device.

[0066] For example, if a user wishes to use the terminal device underwater, they can pre-configure it to underwater operating mode as needed to prepare. One implementation allows users to enable underwater operating mode through the terminal device's settings interface.

[0067] Optionally, the control unit of the terminal device can generate a second indication signal to indicate that the terminal device has entered the underwater working mode after the user sets the terminal device to the underwater working mode, and send the second indication signal to the ultrasonic fingerprint sensor. The processing unit of the ultrasonic fingerprint sensor can determine that the terminal device has entered the underwater working mode based on the second indication signal.

[0068] S104: In response to the terminal device entering underwater working mode, determine the target working mode of the ultrasonic fingerprint sensor and control the ultrasonic fingerprint sensor to enter the target working mode for operation.

[0069] Based on this, in the optional implementation of steps S102 to S104 in this application embodiment, on the one hand, the terminal device uses an ultrasonic fingerprint sensor to realize the fingerprint function. Since the ultrasonic fingerprint sensor realizes the fingerprint function through ultrasonic signals, and the ultrasonic signals are less affected underwater, compared with other types of fingerprint sensors, the use of an ultrasonic fingerprint sensor can better maintain the fingerprint function of the terminal device when it is used underwater. On the other hand, since the terminal device in the control scheme of this application has a dedicated underwater working mode, it can better meet the needs of the terminal device when used underwater, thereby improving the user experience. Furthermore, since the target working mode of the ultrasonic fingerprint sensor can be determined when the terminal device has entered the underwater working mode, and the ultrasonic fingerprint sensor can be controlled to enter the target working mode, it can enter the appropriate target working mode to operate while ensuring that the ultrasonic fingerprint sensor can be turned on and work in the underwater working mode, thereby better meeting the needs of users to use the ultrasonic fingerprint sensor and the terminal device underwater, and further improving the underwater user experience of the terminal device.

[0070] Optionally, the target operating mode of the ultrasonic fingerprint sensor defined in this application may be one of the above-mentioned fingerprint recognition operating mode, pressure detection operating mode, navigation operating mode, and reset mode.

[0071] Optionally, the current operating mode of the ultrasonic fingerprint sensor can be the same as the target operating mode. If the current operating mode is the same as the target operating mode, the ultrasonic fingerprint sensor can be controlled to maintain its current operating mode, thereby achieving the purpose of controlling the ultrasonic fingerprint sensor to enter the target operating mode.

[0072] Optionally, if the current operating mode and the target operating mode of the ultrasonic fingerprint sensor are different, during the switching process from the current operating mode to the target operating mode, if the target operating mode is not a reset mode, the ultrasonic fingerprint sensor can first be controlled to enter the reset mode from the current operating mode (in the reset mode, the ultrasonic fingerprint sensor is turned on but does not transmit or receive ultrasonic signals), and then the ultrasonic fingerprint sensor can be controlled to switch from the reset mode to the target operating mode. By first entering the reset state and then completing the switching of the ultrasonic fingerprint sensor to the target operating mode, the stability and reliability of the switching are improved. Alternatively, if the target operating mode is the reset mode, the ultrasonic fingerprint sensor can be directly controlled to enter the reset mode from the current operating mode.

[0073] Alternatively, in other embodiments, if the current operating mode and the target operating mode are different, and neither is a reset mode, the current operating mode can be switched directly to the target operating mode without going through the reset mode, as long as the requirements are met.

[0074] This application does not specifically limit the method for determining the target operating mode of the ultrasonic fingerprint sensor. For example, the control unit of the terminal device can send a mode activation signal to the processing unit of the ultrasonic fingerprint sensor. The processing unit of the ultrasonic fingerprint sensor can receive the mode activation signal from the control unit of the terminal device and determine the target operating mode that the ultrasonic fingerprint sensor needs to enter based on the mode activation signal. Then, it can control the ultrasonic fingerprint sensor to enter the target operating mode. For example, taking the navigation operating mode as an example, after determining that the terminal device has entered the operating mode, the control unit of the terminal device can send a mode activation signal to the processing unit of the ultrasonic fingerprint sensor to enable the navigation operating mode, so that the processing unit determines the target operating mode as the navigation operating mode and controls the ultrasonic fingerprint sensor to enter the navigation operating mode.

[0075] Alternatively, the processing unit of the ultrasonic fingerprint sensor can determine the target working mode according to preset rules. For example, it can be preset that when the terminal device enters the underwater working mode, the ultrasonic fingerprint sensor needs to operate in the press detection mode / fingerprint recognition mode / navigation working mode. Therefore, the target working mode can be directly determined as the press detection mode / fingerprint recognition mode / navigation working mode, and the ultrasonic fingerprint sensor can be controlled to enter the target working mode.

[0076] In this application embodiment, when the ultrasonic fingerprint sensor is operating in navigation mode, in some optional embodiments, the above-mentioned method of "determining navigation control information for navigation control of the terminal device based on ultrasonic echo data" refers to... Figure 2 The flowchart shown may include the following steps S202, S204, and S206, specifically:

[0077] S202: Acquire multiple ultrasonic echo data obtained by the ultrasonic fingerprint sensor from the finger at multiple different times.

[0078] For example, we can take an ultrasonic fingerprint sensor as an example, collecting finger data at n different times to obtain n ultrasonic echo data. For instance, the n different times can be n consecutive times of finger collection. n ≥ 2; the following examples will use n = 2.

[0079] Optionally, for an ultrasonic fingerprint sensor comprising multiple ultrasonic sub-units, each ultrasonic sub-unit is used to collect sub-ultrasonic echo data from the finger, and the ultrasonic echo data at any given time includes multiple sub-ultrasonic echo data collected by the multiple ultrasonic sub-units at that time.

[0080] As an example for easy understanding, consider any one of the n times. If the ultrasonic fingerprint sensor has a total of M*N ultrasonic sub-units, and assuming that all M*N ultrasonic sub-units are in the working state of transmitting and receiving ultrasonic signals, then at that time, the M*N ultrasonic sub-units can collect M*N sub-ultrasonic echo data from the finger. Therefore, the ultrasonic data obtained by the ultrasonic fingerprint sensor at that time also includes the M*N sub-ultrasonic echo data.

[0081] S204: Based on multiple ultrasonic echo data, determine multiple pressing positions of the finger within the detection area of ​​the ultrasonic fingerprint sensor at multiple different times.

[0082] For example, taking n=2 as an example, n=2 ultrasonic echo data can obtain two pressing position information of the finger in the detection area of ​​the ultrasonic fingerprint sensor at n=2 different times.

[0083] In some optional embodiments, step S204 may include: for each ultrasonic echo data in a plurality of ultrasonic echo data: determining echo intensity distribution information corresponding to the time of acquisition of the ultrasonic echo data based on the ultrasonic echo signal intensity indicated by the plurality of sub-ultrasonic echo data in the ultrasonic echo data, and determining the pressure center point position coordinates corresponding to the time of acquisition of the ultrasonic echo data based on the echo intensity distribution information, wherein the echo intensity distribution information is used to indicate the intensity distribution of the sub-ultrasonic echo data received by the ultrasonic subunit at different locations; and determining the obtained plurality of pressure center point position coordinates as plurality of pressure position information.

[0084] Ultrasound is a mechanical wave, and its propagation depends on the propagation medium. Ultrasonic signals propagate at a fixed speed and direction in a homogeneous medium. At the interface between different propagation media, ultrasound undergoes reflection and transmission; the reflectivity and transmittance depend on the acoustic impedance and angle of incidence of each medium. Therefore, when a finger is pressed on the detection area of ​​an ultrasonic fingerprint sensor, the ultrasonic signal enters the skin tissue and is reflected, forming an ultrasonic echo signal. Because the degree of contact between the finger and each point within the detection area varies, the intensity of the ultrasonic echo signal received by the ultrasonic sub-units at different locations on the fingerprint sensor differs. Generally, the ultrasonic sub-unit at the center of the pressure point receives the strongest ultrasonic echo signal, while the intensity of the echo signal received by surrounding sub-units gradually decreases with increasing distance from the center point.

[0085] Therefore, this application determines echo intensity distribution information for each ultrasonic echo data point from multiple ultrasonic echo data points, based on the ultrasonic echo signal intensity indicated by the multiple sub-ultrasonic echo data points of that ultrasonic echo data point. This information indicates the intensity distribution of the ultrasonic echo signal received by the ultrasonic subunit at different locations. This allows for accurate determination of the pressure center point coordinates corresponding to the time when the ultrasonic echo data was acquired. After obtaining multiple pressure center point coordinates at multiple times, each coordinate represents the pressure center point position of the finger within the detection area of ​​the ultrasonic fingerprint sensor at that corresponding time. Therefore, these pressure center point coordinates can be defined as pressure position information. Subsequent steps can then determine navigation control information for navigating the terminal device based on this pressure position information. This allows for better finger navigation control via the ultrasonic fingerprint sensor when the terminal device is used underwater, improving the user experience of the terminal device underwater.

[0086] The echo intensity distribution information can be implemented in any suitable form, such as image format, table format, function format, etc., as needed. In some optional embodiments, the echo intensity distribution information is an echo intensity distribution map in image format, which includes multiple image regions corresponding one-to-one with multiple ultrasonic subunits, and the positional arrangement relationship between the multiple image regions is determined based on the positional arrangement relationship between the multiple ultrasonic subunits.

[0087] It should be understood that an image-based echo intensity distribution map is more convenient for calculating the coordinates of the pressure center point. For example, in one implementation described below, an image coordinate system can be preset, and the coordinates of the pressure center point can be determined based on the coordinates of the selected image region in the echo intensity distribution map. This will be explained in detail below and will not be elaborated on here.

[0088] For example, refer to Figure 3A As shown, several examples of the arrangement of multiple ultrasonic subunits are illustrated (it should be understood that the examples shown in the schematic diagrams of this application are not necessarily to actual scale, and are only used to facilitate understanding of the technical solutions of this application, and are not intended to limit this application). The multiple ultrasonic subunits are arranged in a matrix of M columns and N rows, with several example ultrasonic subunits p1, p2, p3, p4, p5, and p6 located in the 2nd row, 2nd column; 1st row, 2nd column; 3rd row, 2nd column; 2nd row, 1st column; 2nd row, 3rd column; and the second-to-last row, second-to-last column, respectively. For example, refer to... Figure 3B It shows the relationship with Figure 3A echo intensity distribution corresponding to multiple sub-ultrasonic units Figure 1Here's an example. Multiple image regions are arranged in a matrix of M columns and N rows. Each image region corresponds one-to-one with a specific ultrasonic subunit, and the positional arrangement of the image regions is determined based on the positional arrangement of the ultrasonic subunits. For example... Figure 3B The image regions q1, q2, q3, q4, q5, and q6 in the examples are respectively related to... Figure 3A The ultrasonic subunits p1, p2, p3, p4, p5, and p6 in the image correspond one-to-one, and the image regions q1, q2, q3, q4, q5, and q6 are respectively located in the 2nd row and 2nd column, the 1st row and 2nd column, the 3rd row and 2nd column, the 2nd row and 1st column, the 2nd row and 3rd column, and the second-to-last row and second-to-last column. Other image regions can be deduced similarly from the example above. Therefore, after finding a certain image region from the echo intensity distribution map, the corresponding ultrasonic subunit can be determined, so as to accurately determine the position and coordinates of the finger's pressing center point at a certain moment, and thus generate navigation control information for navigation control of the terminal device.

[0089] In some optional embodiments, the above-mentioned "determining the echo intensity distribution information corresponding to the time of acquisition of the ultrasonic echo data based on the ultrasonic echo signal intensity indicated by multiple sub-ultrasonic echo data in the ultrasonic echo data" may include: for each sub-ultrasonic echo data of the ultrasonic echo data, obtaining an echo intensity distribution map to be processed, and assigning image feature values ​​to the image region corresponding to the target ultrasonic subunit in the echo intensity distribution map to be processed based on the ultrasonic echo signal intensity indicated by the sub-ultrasonic echo data; after each image region in the echo intensity distribution map to be processed has been assigned image feature values, an echo intensity distribution map corresponding to the time of acquisition of the ultrasonic echo data is obtained; wherein, the target ultrasonic subunit is the ultrasonic subunit that acquired the sub-ultrasonic echo data, and the echo intensity distribution map to be processed is a blank echo intensity distribution map or a historical echo intensity distribution map.

[0090] Based on this, the present application can effectively obtain an echo intensity distribution map corresponding to the time of ultrasonic echo data acquisition by using the above method, based on the ultrasonic echo signal intensity indicated by multiple sub-ultrasonic echo data in the ultrasonic echo data. This facilitates the subsequent determination of the pressing center point position coordinates corresponding to the time of ultrasonic echo data acquisition based on the echo intensity distribution map (i.e., echo intensity distribution information). The obtained pressing center point position coordinates can be determined as pressing position information, so that subsequent steps can determine the navigation control information used for navigation control of the terminal device based on the obtained pressing position information. Thus, when the terminal device is used underwater, the finger navigation control function can be better realized through the ultrasonic fingerprint sensor, improving the user experience of the terminal device underwater.

[0091] Optionally, the image feature values ​​can be any feature values ​​of the image. For example, saturation, pixel values, etc., can be used.

[0092] Optionally, a blank echo intensity distribution map can be an echo intensity distribution map that has not been assigned image feature values ​​based on the ultrasonic echo signal intensity. In use, image feature values ​​can be directly assigned to the corresponding image region. Optionally, a historical echo intensity distribution map can be the echo intensity distribution map corresponding to the time when the ultrasonic echo data was previously acquired. Historical echo intensity distribution maps may already have image feature values ​​assigned; in use, image feature values ​​can be reassigned based on the ultrasonic echo signal intensity.

[0093] In some optional embodiments, the above-mentioned "determining the position coordinates of the pressing center point corresponding to the time of collecting the ultrasonic echo data based on the echo intensity distribution information" may include: determining the position coordinates of the pressing center point corresponding to the time of collecting the ultrasonic echo data based on the coordinates of the image region with the largest or smallest image feature value in the echo intensity distribution map in a preset image coordinate system.

[0094] As mentioned earlier, generally speaking, the ultrasonic echo signal received by the ultrasonic subunit at the center point of finger pressure is the strongest, and the intensity of the ultrasonic echo signal received by the surrounding ultrasonic subunits gradually decreases. Therefore, the image region with the largest or smallest image feature value assigned in the echo intensity distribution map is more likely to correspond to the ultrasonic subunit at the center point of finger pressure. Thus, this optional method can more accurately determine the coordinates of the center point of pressure corresponding to the time of ultrasonic echo data acquisition based on the echo intensity distribution map. This allows the obtained coordinates of the center point of pressure to be identified as pressure position information, which is then used in subsequent steps to determine navigation control information for navigating the terminal device. Consequently, when the terminal device is used underwater, the ultrasonic fingerprint sensor can effectively achieve finger navigation control, improving the user experience of the terminal device underwater.

[0095] It should be understood that multiple echo intensity distribution maps obtained from multiple ultrasonic echo data can use the same rules to determine the pressure center point coordinates corresponding to the time of ultrasonic echo data acquisition. That is, one possible implementation is: for each of the multiple echo intensity distribution maps, the pressure center point coordinates corresponding to the time of ultrasonic echo data acquisition are determined based on the coordinates of the image region with the largest image feature value in the echo intensity distribution map within a preset image coordinate system. Alternatively, another possible implementation is: for each of the multiple echo intensity distribution maps, the pressure center point coordinates corresponding to the time of ultrasonic echo data acquisition are determined based on the coordinates of the image region with the smallest image feature value in the echo intensity distribution map within a preset image coordinate system.

[0096] The preset image coordinate system can be set as needed. For example, the origin can be set using a vertex of the echo intensity distribution map (e.g., the top left vertex of the image), along the first direction F1 of the echo intensity distribution map and the second direction F2 perpendicular to the first direction F1 (refer to...). Figure 4 For example, the first direction F1 can be the length direction of the echo intensity distribution map, and the second direction F2 can be the width direction of the echo intensity distribution map. Of course, the two can also be interchanged, that is, the first direction F1 is the width direction and the second direction F2 is the length direction. These two coordinate axes are used to pre-establish an xy rectangular coordinate system, and this xy rectangular coordinate system is determined as the preset image coordinate system.

[0097] Optionally, the coordinates of multiple image regions in the echo intensity distribution map can be pre-stored for later use. Optionally, each image region in the echo intensity distribution map may include one or more pixels. The coordinates of the pixel at the center of the image region with the largest or smallest image feature value can be determined as the press center point coordinates. Alternatively, the coordinates of any pixel within the image region can be selected as needed to determine the press center point coordinates. In another optional embodiment, coordinates can be assigned to each image region according to its positional arrangement, for example, using... Figure 3B It can be understood that the image region q1 in the 2nd row and 2nd column can be assigned coordinates (2, 2), the image region q2 in the 1st row and 2nd column can be assigned coordinates (2, 1), the image region q3 in the 3rd row and 2nd column can be assigned coordinates (2, 3), the image region q4 in the 2nd row and 1st column can be assigned coordinates (1, 2), and the image region q5 in the 2nd row and 3rd column can be assigned coordinates (3, 2). This process can be repeated for other image regions. When needed, the coordinates of the selected image region can be used as the coordinates of the press center point. It should be understood that the specific implementation method can be chosen as needed, and this application does not impose specific restrictions.

[0098] Optionally, when assigning image feature values ​​to an image region based on the ultrasonic echo signal intensity indicated by the sub-ultrasonic echo data, the image feature values ​​can be directly proportional to or inversely proportional to the ultrasonic echo signal intensity. When directly proportional, a larger ultrasonic echo signal intensity results in a larger image feature value. Therefore, the coordinates of the image region with the largest image feature value in the echo intensity distribution map, within a preset image coordinate system, can be used to determine the pressure center point position coordinates corresponding to the time when the ultrasonic echo data was acquired. When inversely proportional, a larger ultrasonic echo signal intensity results in a smaller image feature value. Therefore, the coordinates of the image region with the smallest image feature value in the echo intensity distribution map, within a preset image coordinate system, can be used to determine the pressure center point position coordinates corresponding to the time when the ultrasonic echo data was acquired.

[0099] The following is combined Figure 3A , Figure 3B , Figure 4 The process of determining the echo intensity distribution map and calculating the coordinates of the pressure center point is explained in an example. For instance, consider the ultrasonic fingerprint sensor acquiring the first ultrasonic echo data from two ultrasonic echo data points at n=2 time intervals. Assume the ultrasonic fingerprint sensor comprises M*N ultrasonic sub-units (e.g., refer to...). Figure 3A For example, if the ultrasonic echo signal from the finger is received in all cases, then the first ultrasonic echo data includes M*N ultrasonic sub-units that have collected M*N sub-ultrasonic echo data. The echo intensity distribution map to be processed can be obtained, for example, using the echo intensity distribution map to be processed as... Figure 3B Taking the echo intensity distribution map (which can be understood as a blank echo intensity distribution map for illustrative purposes) as an example, image feature values ​​are assigned to image region q1 in the echo distribution map to be processed based on the ultrasonic echo signal intensity indicated by the sub-ultrasonic echo data collected by ultrasonic subunit p1. Similarly, image feature values ​​are assigned to image region q2 based on the ultrasonic echo signal intensity indicated by the sub-ultrasonic echo data collected by ultrasonic subunit p2, and to image region q3 based on the ultrasonic echo signal intensity indicated by the sub-ultrasonic echo data collected by ultrasonic subunit p3. This process is repeated for other image regions in the echo distribution map to be processed, thus obtaining the echo intensity distribution map corresponding to the time when the first ultrasonic echo data was collected. Taking saturation as an example, assuming the ultrasonic echo signal intensity indicated by the sub-ultrasonic echo data collected by ultrasonic subunit p1 is the largest, then the image feature value assigned to image region q1 is also the largest. (Refer to...) Figure 4In the echo intensity distribution map corresponding to the first moment shown, along the first direction F1, the image feature values ​​allocated to image region q5 and other image regions gradually decrease (when the ultrasonic echo signal intensity is too low, the image feature values ​​of multiple image regions can also be set to 0 based on the ultrasonic echo signal intensity). Similarly, along the second direction F2, along the opposite direction of the first direction F1, and along the opposite direction of the second direction F2, the image feature values ​​allocated to other image regions will also gradually decrease. By further processing the echo intensity distribution map corresponding to the first moment, the coordinates of the image region q1 with the largest image feature value in the preset image coordinate system can be determined according to the magnitude of the image feature values ​​of each image region, and the coordinates (x1, y1) of the pressing center point position corresponding to the first moment of acquiring the first ultrasonic echo data can be determined.

[0100] Let's take the second ultrasonic echo data collected by an ultrasonic fingerprint sensor at n=2 time points as an example. We can use a blank echo intensity distribution map or the echo intensity distribution map at the first time point as the echo intensity distribution map to be processed. Assuming we use the echo intensity distribution map at the first time point as the echo intensity distribution map to be processed, then based on the ultrasonic echo signal intensity indicated by the sub-ultrasonic echo data collected by each ultrasonic subunit, we reassign image feature values ​​to the image region in the echo distribution map to be processed (refer to the above explanation, which will not be repeated here). This will yield the echo intensity distribution map corresponding to the time when the second ultrasonic echo data was collected. Taking saturation as an example, assuming the ultrasonic echo signal indicated by the sub-ultrasonic echo data collected by the ultrasonic subunit p6 corresponding to image region q6 is the largest, then the image feature value assigned to its image region q1 will also be the largest. (Refer to...) Figure 4 The echo intensity distribution map corresponding to the second time point shown in the figure shows that the image feature values ​​assigned to image regions q10, q9, q8, q7, and other image regions gradually decrease along each direction: along the first direction F1, along the second direction F2, the opposite direction of the first direction F1, and the opposite direction of the second direction F2. Further processing of the echo intensity distribution map corresponding to the second time point allows us to determine the coordinates of the image region q6 with the largest image feature value in a preset image coordinate system, based on the magnitude of the image feature values ​​of each image region. This determines the coordinates (x2, y2) of the pressure center point corresponding to the second time point at which the second ultrasonic echo data was acquired.

[0101] Subsequently, the obtained coordinates of the two pressure center points (x1, y1) and (x2, y2) can be used to determine multiple pressure position information for subsequent navigation control information calculations. The above example illustrates that the pressure center point of the finger in the detection area of ​​the ultrasonic fingerprint sensor moves at two different times, from the position of ultrasonic subunit p1 corresponding to image region q1 to the position of ultrasonic subunit p6 corresponding to image region q6 (refer to...). Figure 5 (As shown). It is understood that, in another scenario, if the coordinates of the two pressure center points are the same, it indicates that the finger did not move from the first moment to the second moment. It should be understood that the above examples are not intended to limit the scope of the embodiments of this application.

[0102] S206: Based on the obtained press position information, determine the navigation control information used for navigation control of the terminal device.

[0103] Based on this, in the optional implementation of steps S202 to S206 described above, multiple ultrasonic echo data obtained by the ultrasonic fingerprint sensor at multiple different times are acquired. Then, based on the multiple ultrasonic echo data, multiple pressing position information of the finger in the detection area of ​​the ultrasonic fingerprint sensor at multiple different times is determined. Based on the obtained pressing position information, navigation control information for navigation control of the terminal device can be accurately and effectively determined. Thus, when the terminal device is used underwater, the finger navigation control function can be better realized through the ultrasonic fingerprint sensor, improving the user experience of the terminal device underwater.

[0104] It should be understood that the movement of the finger can be characterized by determining the change in the pressing position information. Therefore, the obtained pressing position information can be used to calculate navigation control information, which can facilitate finger navigation.

[0105] In some optional embodiments, step S206 may include: determining the movement information of the finger in the detection area of ​​the ultrasonic fingerprint sensor based on the coordinates of multiple press center points, wherein the movement information includes at least one of movement direction, movement distance, and movement speed; and determining navigation control information for navigating the terminal device based on the movement information.

[0106] Optionally, taking the pressure center point coordinates (x1, y1) and (x2, y2) as an example, it can be detected that from the first moment to the second moment, the finger moved from the position corresponding to ultrasonic subunit p1 to the position corresponding to ultrasonic subunit p6 within the detection area of ​​the ultrasonic fingerprint sensor. The direction of finger movement within the detection area of ​​the ultrasonic fingerprint sensor can then be determined using coordinates (x1, y1) and (x2, y2). Combining coordinates (x1, y1) and (x2, y2) with the physical dimensions of the ultrasonic subunits of the ultrasonic fingerprint sensor, the distance the finger moved within the detection area can be calculated. Combining the distance moved with the time interval from the first moment to the second moment, the speed of finger movement within the detection area can also be calculated. The obtained results can then be used as movement information. Furthermore, navigation control information for navigating the terminal device can be determined based on this movement information.

[0107] Optionally, the navigation control information may include, but is not limited to, at least one of navigation control signals, navigation control parameters, etc. Some navigation control information corresponding to different types of movement information can be preset. After determining the movement information, the corresponding navigation control information can be determined. Upon receiving the navigation control information, the control unit of the terminal device can perform corresponding navigation control on the terminal device based on the navigation control information, enabling the terminal device to complete the predetermined task.

[0108] Based on this, this application determines the movement information of the finger in the detection area of ​​the ultrasonic fingerprint sensor by using the coordinates of multiple pressing center points. This can accurately and effectively determine the navigation control information used for navigation control of the terminal device. As a result, when the terminal device is used underwater, the ultrasonic fingerprint sensor can better realize the finger navigation control function, thereby improving the user experience of the terminal device underwater.

[0109] It should be understood that the above exemplary description of the control method provided in the first aspect of the embodiments of this application is not intended to limit the embodiments of this application.

[0110] Figure 6 This is a flowchart illustrating the steps of a control method provided according to a second aspect of an embodiment of this application. According to the second aspect of an embodiment of this application, a control method is provided for a control unit of a terminal device, referring to… Figure 1 As shown, the control method includes steps S602 and S604, specifically:

[0111] S602: Determine whether the terminal device has entered the underwater working mode, and generate an indication signal in response to determining that the terminal device has entered the underwater working mode.

[0112] S604: Send an indication signal to the ultrasonic fingerprint sensor so that the ultrasonic fingerprint sensor responds to the indication signal, determines the target operating mode of the ultrasonic fingerprint sensor, and enters the target operating mode.

[0113] Based on this, in the optional implementation of steps S602 to S604 in this application, on the one hand, the terminal device uses an ultrasonic fingerprint sensor to realize the fingerprint function. Since the ultrasonic fingerprint sensor realizes the fingerprint function through ultrasonic signals, and the ultrasonic signals are less affected underwater, compared with other types of fingerprint sensors, the use of an ultrasonic fingerprint sensor can better maintain the fingerprint function of the terminal device when it is used underwater. On the other hand, since the control scheme of this application has a dedicated underwater working mode for the terminal device, it can better meet the needs of the terminal device when used underwater, thereby improving the user experience. Furthermore, since an indication signal can be generated and sent to the ultrasonic fingerprint sensor when it is determined that the terminal device has entered the underwater working mode, the ultrasonic fingerprint sensor can determine that the terminal device has entered the underwater working mode according to the indication signal, and determine the target working mode of the ultrasonic fingerprint sensor in response to the indication signal, and enter the target working mode to operate. Therefore, while ensuring that the ultrasonic fingerprint sensor can be turned on and work in the underwater working mode, it can also enter a suitable target working mode to operate, thereby better meeting the needs of users using the ultrasonic fingerprint sensor and the terminal device underwater, and further improving the underwater user experience of the terminal device.

[0114] It should be understood that the control method provided in the second aspect of this application can be executed by the control unit of the terminal device. For details regarding the ultrasonic fingerprint sensor, terminal device, underwater operating mode, target operating mode, etc., please refer to the relevant content of the control method embodiment in the first aspect above. Other related content can also be understood with reference to the preceding text and will not be repeated here.

[0115] In some optional embodiments, the ultrasonic fingerprint sensor in this application may include at least one of a side-mounted ultrasonic fingerprint sensor, a rear-mounted ultrasonic fingerprint sensor, and an under-display ultrasonic fingerprint sensor. Using the above types of ultrasonic fingerprint sensors, side-mounted fingerprint recognition, rear-mounted fingerprint recognition, or under-display fingerprint recognition can be achieved to meet the usage requirements of terminal devices.

[0116] In some optional embodiments, the operating modes of the ultrasonic fingerprint sensor include at least one of a fingerprint recognition operating mode, a pressure detection operating mode, and a navigation operating mode. Based on this, the control method of the second aspect further includes: when the ultrasonic fingerprint sensor is operating in the fingerprint recognition operating mode, acquiring ultrasonic echo data obtained by the ultrasonic fingerprint sensor from the finger, and performing fingerprint recognition based on the ultrasonic echo data; and / or, when the ultrasonic fingerprint sensor is operating in the pressure detection operating mode, acquiring ultrasonic echo data obtained by the ultrasonic fingerprint sensor from the finger, and performing pressure detection based on the ultrasonic echo data; and / or, when the ultrasonic fingerprint sensor is operating in the navigation operating mode, acquiring ultrasonic echo data obtained by the ultrasonic fingerprint sensor from the finger, and determining navigation control information for navigating the terminal device based on the ultrasonic echo data.

[0117] Based on this, the embodiments of this application utilize multiple operating modes of the ultrasonic fingerprint sensor to meet the diverse needs of terminal devices, including but not limited to underwater use, thereby improving the underwater performance of both the ultrasonic fingerprint sensor and the terminal device. It should be understood that the optional embodiments described above have been detailed in the control method embodiment of the first aspect. The difference lies in that the control unit of the terminal device needs to acquire ultrasonic echo data from the ultrasonic fingerprint sensor, and the control unit performs the aforementioned fingerprint recognition, pressure detection, and determination of navigation control information. For details, please refer to the control method embodiment of the first aspect for further understanding; further elaboration will not be repeated here.

[0118] In some optional embodiments, the indication signal includes a first indication signal; step S604 may include: acquiring sensing data detected by the sensors of the terminal device, determining whether the terminal device has entered underwater operating mode based on the sensing data, and generating a first indication signal in response to determining that the terminal device has entered underwater operating mode. Further, in step S604, the first indication signal may be sent to the ultrasonic fingerprint sensor, so that the ultrasonic fingerprint sensor determines that the terminal device has entered underwater mode in response to the first indication signal, determines the target operating mode of the ultrasonic fingerprint sensor, and enters the target operating mode.

[0119] It should be understood that the content related to "acquiring sensing data detected by the sensor of the terminal device and determining whether the terminal device has entered the underwater working mode based on the sensing data" in the above optional embodiments can be understood with reference to the relevant content of the control method embodiment of the first aspect above. The difference between here and the previous embodiment is that the sensing data is sent by the sensor to the control unit of the terminal device for processing, while in the embodiment of the first aspect, the sensor sends the data to the processing unit of the ultrasonic fingerprint sensor for processing. The specific implementation details and principles are similar, so they will not be repeated here.

[0120] Furthermore, the first indication signal was also described in the first aspect embodiment above, and can be understood in conjunction with it. Specifically, in the above optional embodiments, if the control unit determines that the terminal device has entered the water based on the sensor data, since the terminal device can automatically enter the underwater working mode after entering the water, the control unit can generate a first indication signal to indicate that the terminal device has entered the underwater working mode. The control unit then sends the first indication signal to the processing unit of the ultrasonic fingerprint sensor, so that the processing unit of the ultrasonic fingerprint sensor can accurately determine that the terminal device has entered the underwater working mode based on the first indication signal. This facilitates subsequent control of the ultrasonic fingerprint sensor and improves the user's underwater experience when using the ultrasonic fingerprint sensor and the terminal device. It should be understood that processing the sensor data through the control unit of the terminal device also helps to reduce the data processing load of the ultrasonic fingerprint sensor, avoid excessive occupation of the ultrasonic fingerprint sensor's computing resources, and improve the processing speed.

[0121] In some optional embodiments, the sensor may be a touch sensor. Optionally, the sensing data includes touch sensing data detected by the touch sensor of the terminal device, wherein the touch sensing data includes at least one of capacitance data or touch area data detected by the touch sensor, and the touch area data is used to indicate the pressing area within the detection area of ​​the touch sensor when the terminal device is touched by the touch sensor; the above-mentioned "determining whether the terminal device has entered the underwater working mode based on the sensing data" includes: in response to the change in capacitance data within a first preset time satisfying a first preset condition, and / or, the touch area data indicating that the pressing area has reached a level satisfying a second preset condition, determining that the terminal device has entered the underwater working mode.

[0122] Based on this, in this embodiment, touch sensing data and preset conditions can be used to accurately determine whether the terminal device has entered underwater working mode, so as to facilitate subsequent control of the ultrasonic fingerprint sensor and improve the user experience of using the ultrasonic fingerprint sensor and the terminal device underwater. It should be understood that the above optional embodiments can be understood with reference to the relevant content of the control method embodiment of the first aspect above. The difference between here and the previous embodiment is that here the processing is performed by the control unit of the terminal device, while in the embodiment of the first aspect the processing is performed by the processing unit of the ultrasonic fingerprint sensor. The specific implementation details and principles are similar, and therefore will not be repeated.

[0123] In some optional embodiments, the sensing data includes ultrasonic echo data collected by an ultrasonic fingerprint sensor; the above-mentioned "determining whether the terminal device has entered the underwater working mode based on the sensing data" includes: in response to the change in the ultrasonic echo data within a second preset time satisfying a third preset condition, and / or, the acoustic impedance data determined based on the ultrasonic echo data satisfying a fourth preset condition, determining that the terminal device has entered the underwater working mode.

[0124] Based on this, in this embodiment, the presence of ultrasonic echo data and preset conditions can be used to accurately determine whether the terminal device has entered underwater working mode, thereby facilitating subsequent control of the ultrasonic fingerprint sensor and improving the user experience of using the ultrasonic fingerprint sensor and the terminal device underwater. It should be understood that the above optional embodiments can be understood with reference to the control method embodiment of the first aspect above. The difference between this and the previous embodiment is that here the processing is performed by the control unit of the terminal device, while in the embodiment of the first aspect, the processing is performed by the processing unit of the ultrasonic fingerprint sensor. The specific implementation details and principles are similar, and therefore will not be repeated.

[0125] In some optional embodiments, the indication signal includes a second indication signal; step S602 may include: determining whether the terminal device has been set to underwater operating mode by the user, and in response to indicating that the user has set the terminal device to underwater operating mode, determining that the terminal device has entered underwater operating mode, and generating a second indication signal. Further, in step S604, the second indication signal may be sent to the ultrasonic fingerprint sensor, so that the ultrasonic fingerprint sensor, in response to the second indication signal, determines that the terminal device has entered underwater mode, determines the target operating mode of the ultrasonic fingerprint sensor, and operates in the target operating mode.

[0126] Based on this, since the terminal device has been set to underwater working mode by the user, it can be accurately determined that the terminal device has entered underwater working mode, so as to facilitate the subsequent control of the ultrasonic fingerprint sensor and improve the user's underwater experience of using the ultrasonic fingerprint sensor and the terminal device.

[0127] For example, if a user wishes to use the terminal device underwater, they can pre-configure it to underwater operating mode as needed to prepare. One implementation allows users to enable underwater operating mode through the terminal device's settings interface.

[0128] Furthermore, the second indication signal has also been described in the first aspect embodiment above. Optionally, after the user sets the terminal device to underwater operating mode, the control unit of the terminal device can generate a second indication signal to indicate that the terminal device has entered underwater mode, and send the second indication signal to the ultrasonic fingerprint sensor. The processing unit of the ultrasonic fingerprint sensor can determine that the terminal device has entered underwater operating mode based on the second indication signal.

[0129] In some optional embodiments, the above-mentioned "determining navigation control information for navigation control of terminal device based on ultrasonic echo data" includes: acquiring multiple ultrasonic echo data obtained by the ultrasonic fingerprint sensor from collecting fingers at multiple different times; determining multiple pressing position information of the fingers in the detection area of ​​the ultrasonic fingerprint sensor at multiple different times based on the multiple ultrasonic echo data; and determining navigation control information for navigation control of terminal device based on the obtained pressing position information.

[0130] Based on this, this application, through the above optional implementation method, acquires multiple ultrasonic echo data obtained by the ultrasonic fingerprint sensor from the finger at multiple different times, and then determines multiple pressing position information of the finger within the detection area of ​​the ultrasonic fingerprint sensor at multiple different times based on the multiple ultrasonic echo data. According to the obtained pressing position information, navigation control information for navigation control of the terminal device can be accurately and effectively determined. Therefore, when the terminal device is used underwater, the finger navigation control function can be better realized through the ultrasonic fingerprint sensor, improving the user experience of the terminal device underwater. It should be understood that the above optional embodiments can be understood with reference to the relevant content of "steps S202 to S206" in the control method embodiment of the first aspect. The difference between here and the previous embodiment is that here the processing is performed by the control unit of the terminal device, while the "steps S202 to S206" embodiment of the first aspect is processed by the processing unit of the ultrasonic fingerprint sensor. The specific implementation details and principles are similar, and therefore will not be repeated.

[0131] In some optional embodiments, the ultrasonic fingerprint sensor includes multiple ultrasonic sub-units, each of which is used to collect sub-ultrasonic echo data from a finger. The ultrasonic echo data at any given time includes multiple sub-ultrasonic echo data collected by the multiple ultrasonic sub-units at that time. The aforementioned "determining multiple pressing position information of the finger at multiple different times within the detection area of ​​the ultrasonic fingerprint sensor based on multiple ultrasonic echo data" includes: for each ultrasonic echo data in the multiple ultrasonic echo data: determining echo intensity distribution information corresponding to the time when the ultrasonic echo data was collected based on the ultrasonic echo signal intensity indicated by the multiple sub-ultrasonic echo data in the ultrasonic echo data, and determining the pressing center point position coordinates corresponding to the time when the ultrasonic echo data was collected based on the echo intensity distribution information, wherein the echo intensity distribution information is used to indicate the intensity distribution of the ultrasonic echo signal received by the ultrasonic sub-units at different positions; and determining the multiple pressing center point position coordinates as multiple pressing position information.

[0132] Based on this, this application determines echo intensity distribution information for each ultrasonic echo data point from multiple ultrasonic echo data points, based on the ultrasonic echo signal intensity indicated by the multiple sub-ultrasonic echo data points of that ultrasonic echo data point. This information indicates the intensity distribution of the ultrasonic echo signal received by the ultrasonic sub-unit at different locations. This allows for the accurate determination of the pressure center point coordinates corresponding to the time when the ultrasonic echo data was acquired. After obtaining multiple pressure center point coordinates at multiple times, each pressure center point coordinate represents the pressure center point position of the finger in the detection area of ​​the ultrasonic fingerprint sensor at the corresponding time. Therefore, these pressure center point coordinates can be defined as pressure position information. Subsequent steps can then determine navigation control information for navigating the terminal device based on this pressure position information. This allows for better finger navigation control via the ultrasonic fingerprint sensor when the terminal device is used underwater, improving the user experience of the terminal device underwater. It should be understood that the above optional embodiments can be understood with reference to the relevant content under "step S204" of the control method embodiment of the first aspect. The difference between here and the previous embodiment is that here it is processed by the control unit of the terminal device, while the first aspect embodiment is processed by the processing unit of the ultrasonic fingerprint sensor. The specific implementation details and principles are similar, so they will not be repeated here.

[0133] In some optional embodiments, the echo intensity distribution information is an echo intensity distribution map in the form of an image. The echo intensity distribution map includes multiple image regions corresponding one-to-one with multiple ultrasonic sub-units, and the positional arrangement relationship between the multiple image regions is determined based on the positional arrangement relationship between the multiple ultrasonic sub-units. The above-mentioned "determining the echo intensity distribution information corresponding to the time of acquisition of the ultrasonic echo data based on the ultrasonic echo signal intensity indicated by multiple sub-ultrasonic echo data in the ultrasonic echo data" includes: for each sub-ultrasonic echo data of the ultrasonic echo data, obtaining an echo intensity distribution map to be processed, and assigning image feature values ​​to the image regions corresponding to the target ultrasonic sub-unit in the echo intensity distribution map to be processed according to the ultrasonic echo signal intensity indicated by the sub-ultrasonic echo data. After each image region in the echo intensity distribution map to be processed has been assigned image feature values, an echo intensity distribution map corresponding to the time of acquisition of the ultrasonic echo data is obtained. Wherein, the target ultrasonic sub-unit is the ultrasonic sub-unit that acquired the sub-ultrasonic echo data, and the echo intensity distribution map to be processed is a blank echo intensity distribution map or a historical echo intensity distribution map.

[0134] Based on this, the present application can effectively obtain an echo intensity distribution map corresponding to the time of ultrasonic echo data acquisition by using the above method, based on the ultrasonic echo signal intensity indicated by multiple sub-ultrasonic echo data in the ultrasonic echo data. This facilitates the subsequent determination of the pressing center point position coordinates corresponding to the time of ultrasonic echo data acquisition based on the echo intensity distribution map (i.e., echo intensity distribution information). The obtained pressing center point position coordinates can be used as pressing position information, allowing subsequent steps to determine navigation control information for navigation control of the terminal device. This enables better finger navigation control via the ultrasonic fingerprint sensor when the terminal device is used underwater, improving the user experience of the terminal device underwater. It should be understood that the above optional embodiments can be understood with reference to the relevant content under "Step S204" of the control method embodiment of the first aspect. The difference between this and the previous embodiment is that this is processed by the control unit of the terminal device, while the first aspect embodiment is processed by the processing unit of the ultrasonic fingerprint sensor. The specific implementation details and principles are similar and will not be repeated here.

[0135] In some optional embodiments, the step of "determining the position coordinates of the pressing center point corresponding to the time of collecting the ultrasonic echo data based on the echo intensity distribution information" includes: determining the position coordinates of the pressing center point corresponding to the time of collecting the ultrasonic echo data based on the coordinates of the image region with the largest or smallest image feature value in the echo intensity distribution map in a preset image coordinate system.

[0136] Based on this, this optional method allows for a more accurate determination of the pressure center point coordinates corresponding to the time of ultrasonic echo data acquisition, according to the echo intensity distribution map. This allows the obtained pressure center point coordinates to be used as pressure position information, enabling subsequent steps to determine navigation control information for the terminal device. Consequently, when the terminal device is used underwater, the ultrasonic fingerprint sensor can effectively achieve finger navigation control, improving the user experience. It should be understood that the above optional embodiment can be understood with reference to the relevant content under "Step S204" of the first aspect's control method embodiment. The difference here is that the processing is performed by the terminal device's control unit, while in the first aspect's embodiment, it is performed by the ultrasonic fingerprint sensor's processing unit. The specific implementation details and principles are similar and will not be repeated here.

[0137] In some optional embodiments, the step of "determining navigation control information for navigating the terminal device based on the obtained press position information" includes: determining the movement information of the finger in the detection area of ​​the ultrasonic fingerprint sensor based on the coordinates of multiple press center points, wherein the movement information includes at least one of movement direction, movement distance, and movement speed; and determining the navigation control information for navigating the terminal device based on the movement information.

[0138] Based on this, this application determines the finger's movement information within the detection area of ​​the ultrasonic fingerprint sensor by using the coordinates of multiple pressing center points. This allows for accurate and effective determination of navigation control information for navigating the terminal device. Consequently, when the terminal device is used underwater, the ultrasonic fingerprint sensor can effectively achieve finger navigation control, improving the user experience of the terminal device underwater. It should be understood that the above optional embodiments can be understood with reference to the relevant content below "Step S206" of the control method embodiment of the first aspect. The difference between this and the previous embodiments is that this processing is performed by the control unit of the terminal device, while the first aspect embodiment is processed by the processing unit of the ultrasonic fingerprint sensor. The specific implementation details and principles are similar and will not be repeated here.

[0139] This application does not specifically limit the method for determining the target operating mode of the ultrasonic fingerprint sensor. For example, the processing unit of the ultrasonic fingerprint sensor can receive a mode activation signal from the control unit of the terminal device to determine the target operating mode that the ultrasonic fingerprint sensor needs to enter based on the mode activation signal. Then, it can control the ultrasonic fingerprint sensor to enter and operate in that target operating mode. For example, taking the navigation operating mode as an example, after determining that the terminal device has entered the operating mode, the control unit of the terminal device can send a mode activation signal to the processing unit of the ultrasonic fingerprint sensor to activate the navigation operating mode, causing the processing unit to determine the target operating mode as the navigation operating mode and control the ultrasonic fingerprint sensor to enter and operate in the navigation operating mode.

[0140] Alternatively, the processing unit of the ultrasonic fingerprint sensor can determine the target working mode according to preset rules. For example, it can be preset that when the terminal device enters the underwater working mode, the ultrasonic fingerprint sensor needs to operate in the press detection mode / fingerprint recognition mode / navigation working mode. Therefore, the target working mode can be directly determined as the press detection mode / fingerprint recognition mode / navigation working mode, and the ultrasonic fingerprint sensor can be controlled to enter the target working mode.

[0141] Optionally, the ultrasonic fingerprint sensor may also include a reset mode, which can be used to reset the ultrasonic fingerprint sensor system, facilitating the switching of operating modes. In reset mode, the ultrasonic fingerprint sensor is turned on but neither transmits nor receives ultrasonic signals (simply put, the ultrasonic fingerprint sensor is idle in this reset mode).

[0142] Optionally, the target operating mode of the ultrasonic fingerprint sensor defined in this application may be one of the above-mentioned fingerprint recognition operating mode, pressure detection operating mode, navigation operating mode, and reset mode.

[0143] Optionally, the current operating mode of the ultrasonic fingerprint sensor can be the same as the target operating mode. If the current operating mode is the same as the target operating mode, the ultrasonic fingerprint sensor can be controlled to maintain its current operating mode, thereby achieving the purpose of controlling the ultrasonic fingerprint sensor to enter the target operating mode.

[0144] Optionally, if the current operating mode and the target operating mode of the ultrasonic fingerprint sensor are different, during the switching process from the current operating mode to the target operating mode, if the target operating mode is not a reset mode, the ultrasonic fingerprint sensor can first be controlled to enter the reset mode from the current operating mode (in the reset mode, the ultrasonic fingerprint sensor is turned on but does not transmit or receive ultrasonic signals), and then the ultrasonic fingerprint sensor can be controlled to switch from the reset mode to the target operating mode. By first entering the reset state and then completing the switching of the ultrasonic fingerprint sensor to the target operating mode, the stability and reliability of the switching are improved. Alternatively, if the target operating mode is the reset mode, the ultrasonic fingerprint sensor can be directly controlled to enter the reset mode from the current operating mode.

[0145] Alternatively, in other embodiments, if the current operating mode and the target operating mode are different, and neither is a reset mode, the current operating mode can be switched directly to the target operating mode without going through the reset mode, as long as the requirements are met.

[0146] Regarding the step S604 of "determining the target operating mode of the ultrasonic fingerprint sensor", the relevant content of the first aspect of the embodiment has been described in detail above, and can be understood by referring to the previous text, so it will not be repeated here.

[0147] Optionally, in the control method embodiment of the third aspect, if the ultrasonic fingerprint sensor is turned off, the control unit may also control the ultrasonic fingerprint sensor to turn on in response to determining that the terminal device has entered the underwater working mode, so that the ultrasonic fingerprint sensor can respond to the command signal, determine the target working mode of the ultrasonic fingerprint sensor, and enter the target working mode to operate.

[0148] It should be understood that in any optional embodiment of the control method of the third aspect, the control unit of the terminal device undertakes most of the processing work, which can avoid excessive occupation of the computing resources of the ultrasonic fingerprint sensor to a certain extent.

[0149] Below, in conjunction with Figure 7 The flowchart shown illustrates the implementation process of an example scenario in which the control unit determines navigation control information when the ultrasonic fingerprint sensor is operating in navigation mode, as described in this application embodiment. Figure 7As shown, firstly, the control unit of the terminal device can send a mode start command to the ultrasonic fingerprint sensor to enter the navigation working mode. The processing unit of the ultrasonic fingerprint sensor can determine the target working mode as the navigation working mode according to the mode start command and control the ultrasonic fingerprint sensor to enter the navigation working mode. Then, the ultrasonic fingerprint sensor collects the ultrasonic echo signal reflected by the finger in real time to obtain ultrasonic echo data and puts the ultrasonic echo data into a buffer. The control unit obtains the ultrasonic echo data from the ultrasonic fingerprint sensor. Then, the control unit calculates navigation control information based on the ultrasonic echo data (optional methods can be understood by referring to the relevant content of the previous embodiment, determining the coordinates of the pressing center point, and then determining the navigation control information, which will not be repeated here). The control unit determines in real time whether to end the navigation detection. If not, the control unit reads the data cyclically and continues to obtain ultrasonic echo data from the ultrasonic fingerprint sensor for processing to continue calculating navigation control information. If yes, the control unit sends a mode exit command to the ultrasonic fingerprint sensor to exit the navigation working mode. The processing unit of the ultrasonic fingerprint sensor controls the ultrasonic fingerprint sensor to exit the navigation working mode and ends the process. It should be understood that the above Figure 7 The exemplary descriptions provided are not intended to limit the scope of the embodiments described in this application.

[0150] Reference Figure 8 As shown, according to a third aspect of the embodiments of this application, a control device 800 is provided for an ultrasonic fingerprint sensor of a terminal device, the control device 800 comprising:

[0151] The first determining module 802 is used to determine whether the terminal device has entered the underwater working mode;

[0152] The first control module 804 is used to determine the target working mode of the ultrasonic fingerprint sensor in response to the terminal device entering the underwater working mode, and control the ultrasonic fingerprint sensor to enter the target working mode for operation.

[0153] The control device 1000 and its optional embodiments in the third aspect of this application have been described in detail in the control method embodiments of the first aspect. Therefore, its related content and beneficial effects can be understood by referring to the content of the optional embodiments of the above method, and will not be repeated here.

[0154] Reference Figure 9 As shown, according to a fourth aspect of the embodiments of this application, a control device 900 is provided for a control unit of a terminal device, the control device 900 comprising:

[0155] The second determining module 902 is used to determine whether the terminal device has entered the underwater working mode, and in response to determining that the terminal device has entered the underwater working mode, generates an indication signal;

[0156] The second control module 904 is used to send an indication signal to the ultrasonic fingerprint sensor so that the ultrasonic fingerprint sensor responds to the indication signal, determines the target working mode of the ultrasonic fingerprint sensor, and enters the target working mode to operate.

[0157] The control device 900 and its optional embodiments in the fourth aspect of this application have been described in detail in the foregoing control method embodiments. Therefore, their related content and beneficial effects can be understood by referring to the content of the optional embodiments of the above-mentioned method, and will not be repeated here.

[0158] According to a fifth aspect of the present application, an electronic device is provided, comprising: a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other via the communication bus; the memory is used to store a computer program; and the processor is used to execute the control method described in the first or second aspect by running the computer program stored in the memory.

[0159] Figure 10 A structural block diagram of an optional electronic device according to an embodiment of this application is shown. This application does not limit the specific implementation of the electronic device 1000; however, as an example, reference is made to... Figure 10 The electronic device 1000 provided in this application embodiment includes: a processor 1002, a communications interface 1004, a memory 1006, and a communication bus 1008. Wherein:

[0160] The processor 1002, communication interface 1004, and memory 1006 communicate with each other via communication bus 1008.

[0161] Communication interface 1004 is used to communicate with other electronic devices or servers.

[0162] The processor 1002 is used to execute the computer program 1010, specifically the relevant steps in any of the aforementioned control method embodiments.

[0163] Specifically, computer program 1010 may include program code that includes computer operation instructions.

[0164] The processor 1002 may be a CPU, a GPU (Graphics Processing Unit), an Application Specific Integrated Circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of this application. The one or more processors included in the smart device may be processors of the same type, such as one or more CPUs; or they may be processors of different types, such as one or more CPUs and one or more ASICs.

[0165] Memory 1006 is used to store computer program 1010. Memory 1006 may include high-speed RAM memory, and may also include non-volatile memory, such as at least one disk storage device.

[0166] Computer program 1010 can be used to cause processor 1002 to execute the control method described in the first or second aspect of the foregoing embodiments.

[0167] The specific implementation of each step in computer program 1010 can be found in the corresponding descriptions of the steps and units in any of the control method embodiments of the first or second aspect described above, and will not be repeated here. Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working process of the devices and modules described above can be referred to the corresponding process descriptions in the aforementioned method embodiments, and will not be repeated here.

[0168] The electronic device 1000 in this application embodiment has been described in detail in the foregoing control method embodiment. Therefore, its related content and beneficial effects can be understood by referring to the above method embodiment, and will not be repeated here.

[0169] According to a fourth aspect of the embodiments of this application, this application also provides a computer storage medium storing a computer program thereon, which, when executed by a processor, implements the control method described in any of the embodiments of the first or second aspect of the method described above. The computer storage medium includes, but is not limited to, compact disc read-only memory (CD-ROM), random access memory (RAM), floppy disk, hard disk, or magneto-optical disk, etc.

[0170] According to a fifth aspect of the embodiments of this application, the embodiments of this application also provide a computer program product, including a computer program that, when executed by a processor, implements the control method as described in any of the embodiments of the first or second aspect above.

[0171] The control device 800 / control device 900 / electronic device 1000 / computer storage medium / computer program product embodiments in this application have been described in detail in the foregoing control method embodiments. Therefore, their related content and beneficial effects can be understood by referring to the above method embodiments, and will not be repeated here.

[0172] It should be understood that the various figures in this embodiment are for the purpose of illustrating the structure, and the dimensions of each structure may not be drawn according to the actual scale.

[0173] Furthermore, it should be noted that the user-related information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to sample data used for training the model, data used for analysis, stored data, displayed data, etc.) involved in the embodiments of this application are all information and data authorized by the user or fully authorized by all parties. Moreover, the collection, use and processing of related data must comply with the relevant laws, regulations and standards of the relevant countries and regions, and corresponding operation entry points are provided for users to choose to authorize or refuse.

[0174] It should be noted that, depending on the implementation needs, the various components / steps described in this embodiment can be broken down into more components / steps, or two or more components / steps or parts of the operation of a component / step can be combined into a new component / step to achieve the purpose of this application embodiment.

[0175] The methods described in the embodiments of this application can be implemented in hardware, firmware, or as software or computer code that can be stored in a recording medium (such as a CD-ROM, RAM, floppy disk, hard disk, or magneto-optical disk), or as computer code downloaded over a network that is originally stored in a remote recording medium or a non-transitory machine-readable medium and will be stored in a local recording medium. Thus, the methods described herein can be stored on a recording medium using a general-purpose computer, a dedicated processor, or programmable or dedicated hardware (such as an Application Specific Integrated Circuit (ASIC) or a Field Programmable Gate Array (FPGA)). It is understood that the computer, processor, microprocessor controller, or programmable hardware includes storage components (e.g., Random Access Memory (RAM), Read-Only Memory (ROM), Flash memory, etc.) capable of storing or receiving software or computer code, which, when accessed and executed by the computer, processor, or hardware, implements the methods described herein. Furthermore, when a general-purpose computer accesses code used to implement the methods shown herein, the execution of the code transforms the general-purpose computer into a dedicated computer for executing the methods shown herein.

[0176] Those skilled in the art will recognize that the units and method steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for specific applications, but such implementations should not be considered beyond the scope of the embodiments of this application.

[0177] The above embodiments are only used to illustrate the embodiments of this application, and are not intended to limit the embodiments of this application. Those skilled in the art can make various changes and modifications without departing from the spirit and scope of the embodiments of this application. Therefore, all equivalent technical solutions also fall within the scope of the embodiments of this application, and the patent protection scope of the embodiments of this application should be defined by the claims.

Claims

1. A control method for an ultrasonic fingerprint sensor in a terminal device, the method comprising: Determine whether the terminal device has entered underwater working mode; In response to the terminal device entering underwater working mode, the target working mode of the ultrasonic fingerprint sensor is determined, and the ultrasonic fingerprint sensor is controlled to enter the target working mode for operation. The ultrasonic fingerprint sensor has a working mode including a navigation working mode. When the ultrasonic fingerprint sensor is operating in the target working mode of the navigation working mode, the ultrasonic fingerprint sensor is controlled to collect ultrasonic echo data from the finger. Based on the ultrasonic echo data, navigation control information for navigation control of the terminal device is determined. The step of determining navigation control information for navigating the terminal device based on the ultrasonic echo data includes: acquiring multiple ultrasonic echo data obtained by the ultrasonic fingerprint sensor at multiple different times when collecting data from the finger. Based on the multiple ultrasonic echo data, multiple pressing position information of the finger at multiple different times within the detection area of ​​the ultrasonic fingerprint sensor is determined; based on the obtained pressing position information, navigation control information for navigating the terminal device is determined.

2. The method according to claim 1, wherein, Determining whether the terminal device has entered underwater working mode includes: Acquire sensing data detected by the sensors of the terminal device, and determine whether the terminal device has entered underwater working mode based on the sensing data; or, The control unit of the terminal device receives a first indication signal and determines that the terminal device has entered underwater working mode based on the first indication signal. The first indication signal is determined by the control unit based on the sensor data detected by the sensors of the terminal device.

3. The method according to claim 2, wherein, The sensing data includes touch sensing data detected by the touch sensor of the terminal device, wherein the touch sensing data includes at least one of capacitance data or touch area data detected by the touch sensor, and the touch area data is used to indicate the pressing area within the detection area of ​​the touch sensor when the terminal device is touched by the touch sensor; Determining whether the terminal device has entered underwater operating mode based on the sensor data includes: In response to the change in capacitance data within a first preset time period satisfying a first preset condition, and / or the touch area data indicating that the pressing area has reached a level satisfying a second preset condition, it is determined that the terminal device has entered underwater working mode.

4. The method according to claim 2, wherein, The sensing data includes ultrasonic echo data collected by the ultrasonic fingerprint sensor; Determining whether the terminal device has entered underwater operating mode based on the sensor data includes: In response to the change in the ultrasonic echo data within a second preset time period satisfying a third preset condition, and / or the acoustic impedance data determined based on the ultrasonic echo data satisfying a fourth preset condition, it is determined that the terminal device has entered the underwater working mode.

5. The method according to claim 1, wherein, Determining whether the terminal device has entered underwater working mode includes: In response to the fact that the terminal device has been set to underwater working mode by the user, it is determined that the terminal device has entered underwater working mode.

6. The method according to any one of claims 1-5, wherein, The ultrasonic fingerprint sensor also includes at least one of the following working modes: fingerprint recognition working mode and pressure detection working mode; The method further includes: When the ultrasonic fingerprint sensor operates in the fingerprint recognition mode, it is controlled to collect ultrasonic echo data from the finger, and fingerprint recognition is performed based on the ultrasonic echo data; and / or... When the ultrasonic fingerprint sensor is operating in the press detection mode, it is controlled to collect ultrasonic echo data from the finger and perform press detection based on the ultrasonic echo data.

7. The method according to any one of claims 1-5, wherein, The ultrasonic fingerprint sensor includes multiple ultrasonic sub-units, each of which is used to collect sub-ultrasonic echo data from the finger. The ultrasonic echo data at any given time includes multiple sub-ultrasonic echo data collected by the multiple ultrasonic sub-units at that time. The step of determining multiple pressing positions of the finger within the detection area of ​​the ultrasonic fingerprint sensor at multiple different times based on the multiple ultrasonic echo data includes: For each ultrasonic echo data in the plurality of ultrasonic echo data: based on the ultrasonic echo signal intensity indicated by the plurality of sub-ultrasonic echo data in the ultrasonic echo data, determine the echo intensity distribution information corresponding to the time of acquisition of the ultrasonic echo data, and based on the echo intensity distribution information, determine the position coordinates of the pressing center point corresponding to the time of acquisition of the ultrasonic echo data, wherein the echo intensity distribution information is used to indicate the intensity distribution of the ultrasonic echo signal received by the ultrasonic sub-unit at different positions. The coordinates of the multiple pressing center points are determined as the multiple pressing position information.

8. The method according to claim 7, wherein, The echo intensity distribution information is an echo intensity distribution map in the form of an image. The echo intensity distribution map includes multiple image regions that correspond one-to-one with the multiple ultrasonic subunits, and the positional arrangement relationship between the multiple image regions is determined based on the positional arrangement relationship between the multiple ultrasonic subunits. The step of determining the echo intensity distribution information corresponding to the time of acquisition of the ultrasonic echo data based on the ultrasonic echo signal intensity indicated by multiple sub-ultrasonic echo data in the ultrasonic echo data includes: For each sub-ultrasonic echo data of the ultrasonic echo data, an echo intensity distribution map to be processed is obtained. Based on the ultrasonic echo signal intensity indicated by the sub-ultrasonic echo data, image feature values ​​are assigned to the image regions corresponding to the target ultrasonic sub-unit in the echo intensity distribution map to be processed. After each image region of the echo intensity distribution map to be processed is assigned an image feature value, an echo intensity distribution map corresponding to the time of acquisition of the ultrasonic echo data is obtained. The target ultrasonic subunit is the ultrasonic subunit that collects the echo data of the sub-ultrasonic wave, and the echo intensity distribution map to be processed is a blank echo intensity distribution map or a historical echo intensity distribution map.

9. The method according to claim 8, wherein, The step of determining the coordinates of the pressure center point corresponding to the time of collecting the ultrasonic echo data based on the echo intensity distribution information includes: Based on the coordinates of the image region with the largest or smallest image feature value in the echo intensity distribution map in the preset image coordinate system, determine the coordinates of the pressing center point corresponding to the time when the ultrasonic echo data was collected.

10. The method according to claim 9, wherein, The step of determining navigation control information for navigating the terminal device based on the obtained press position information includes: Based on the coordinates of the multiple pressing center points, the movement information of the finger in the detection area of ​​the ultrasonic fingerprint sensor is determined, wherein the movement information includes at least one of the movement direction, movement distance, and movement speed; Based on the movement information, navigation control information for navigating the terminal device is determined.

11. The method according to any one of claims 1-5, wherein, The ultrasonic fingerprint sensor includes at least one of a side ultrasonic fingerprint sensor, a rear ultrasonic fingerprint sensor, and an under-display ultrasonic fingerprint sensor.

12. A control method for a control unit of a terminal device, the method comprising: Determine whether the terminal device has entered underwater working mode, and generate an indication signal in response to determining that the terminal device has entered underwater working mode; Send an indication signal to the ultrasonic fingerprint sensor so that the ultrasonic fingerprint sensor responds to the indication signal, determines the target operating mode of the ultrasonic fingerprint sensor, and enters the target operating mode to operate; The ultrasonic fingerprint sensor has a working mode including a navigation working mode. When the ultrasonic fingerprint sensor is operating in the target working mode of the navigation working mode, it acquires ultrasonic echo data obtained by the ultrasonic fingerprint sensor from the finger, and determines navigation control information for navigation control of the terminal device based on the ultrasonic echo data. The step of determining navigation control information for navigating the terminal device based on the ultrasonic echo data includes: acquiring multiple ultrasonic echo data obtained by the ultrasonic fingerprint sensor at multiple different times when collecting data from the finger. Based on the multiple ultrasonic echo data, multiple pressing position information of the finger at multiple different times within the detection area of ​​the ultrasonic fingerprint sensor is determined; based on the obtained pressing position information, navigation control information for navigating the terminal device is determined.

13. The method according to claim 12, wherein, The indication signal includes a first indication signal; The step of determining whether the terminal device has entered underwater operating mode includes generating an indication signal in response to determining that the terminal device has entered underwater operating mode, including: Acquire sensing data detected by the sensors of the terminal device, determine whether the terminal device has entered underwater working mode based on the sensing data, and generate the first indication signal in response to determining that the terminal device has entered underwater working mode.

14. The method according to claim 13, wherein, The sensing data includes touch sensing data detected by the touch sensor of the terminal device, wherein the touch sensing data includes at least one of capacitance data or touch area data detected by the touch sensor, and the touch area data is used to indicate the pressing area within the detection area of ​​the touch sensor when the terminal device is touched by the touch sensor; Determining whether the terminal device has entered underwater operating mode based on the sensor data includes: In response to the change in capacitance data within a first preset time period satisfying a first preset condition, and / or the touch area data indicating that the pressing area has reached a level satisfying a second preset condition, it is determined that the terminal device has entered underwater working mode.

15. The method according to claim 13, wherein, The sensing data includes ultrasonic echo data collected by the ultrasonic fingerprint sensor; Determining whether the terminal device has entered underwater operating mode based on the sensor data includes: In response to the change in the ultrasonic echo data within a second preset time period satisfying a third preset condition, and / or the acoustic impedance data determined based on the ultrasonic echo data satisfying a fourth preset condition, it is determined that the terminal device has entered the underwater working mode.

16. The method according to claim 12, wherein, The indication signal includes a second indication signal; The step of determining whether the terminal device has entered underwater operating mode includes generating an indication signal in response to determining that the terminal device has entered underwater operating mode, including: Determine whether the terminal device has been set to underwater working mode by the user, and in response to indicating that the user has set the terminal device to underwater working mode, determine that the terminal device has entered underwater working mode, and generate the second indication signal.

17. The method according to any one of claims 12-16, wherein, The ultrasonic fingerprint sensor also includes at least one of the following working modes: fingerprint recognition working mode and pressure detection working mode; The method further includes: When the ultrasonic fingerprint sensor operates in the fingerprint recognition mode, it acquires ultrasonic echo data obtained from the finger collected by the ultrasonic fingerprint sensor, and performs fingerprint recognition based on the ultrasonic echo data; and / or, When the ultrasonic fingerprint sensor is operating in the press detection mode, it acquires the ultrasonic echo data obtained by the ultrasonic fingerprint sensor from the finger, and performs press detection based on the ultrasonic echo data.

18. The method according to any one of claims 12-16, wherein, The ultrasonic fingerprint sensor includes multiple ultrasonic sub-units, each of which is used to collect sub-ultrasonic echo data from the finger. The ultrasonic echo data at any given time includes multiple sub-ultrasonic echo data collected by the multiple ultrasonic sub-units at that time. The step of determining multiple pressing positions of the finger within the detection area of ​​the ultrasonic fingerprint sensor at multiple different times based on the multiple ultrasonic echo data includes: For each ultrasonic echo data in the plurality of ultrasonic echo data: based on the ultrasonic echo signal intensity indicated by the plurality of sub-ultrasonic echo data in the ultrasonic echo data, determine the echo intensity distribution information corresponding to the time of acquisition of the ultrasonic echo data, and based on the echo intensity distribution information, determine the position coordinates of the pressing center point corresponding to the time of acquisition of the ultrasonic echo data, wherein the echo intensity distribution information is used to indicate the intensity distribution of the ultrasonic echo signal received by the ultrasonic sub-unit at different positions. The coordinates of the multiple pressing center points are determined as the multiple pressing position information.

19. The method according to claim 18, wherein, The echo intensity distribution information is an echo intensity distribution map in the form of an image. The echo intensity distribution map includes multiple image regions that correspond one-to-one with the multiple ultrasonic subunits, and the positional arrangement relationship between the multiple image regions is determined based on the positional arrangement relationship between the multiple ultrasonic subunits. The step of determining the echo intensity distribution information corresponding to the time of acquisition of the ultrasonic echo data based on the ultrasonic echo signal intensity indicated by multiple sub-ultrasonic echo data in the ultrasonic echo data includes: For each sub-ultrasonic echo data of the ultrasonic echo data, an echo intensity distribution map to be processed is obtained. Based on the ultrasonic echo signal intensity indicated by the sub-ultrasonic echo data, image feature values ​​are assigned to the image regions corresponding to the target ultrasonic sub-unit in the echo intensity distribution map to be processed. After each image region of the echo intensity distribution map to be processed is assigned an image feature value, an echo intensity distribution map corresponding to the time of acquisition of the ultrasonic echo data is obtained. The target ultrasonic subunit is the ultrasonic subunit that collects the echo data of the sub-ultrasonic wave, and the echo intensity distribution map to be processed is a blank echo intensity distribution map or a historical echo intensity distribution map.

20. The method according to claim 19, wherein, The step of determining the coordinates of the pressure center point corresponding to the time of collecting the ultrasonic echo data based on the echo intensity distribution information includes: Based on the coordinates of the image region with the largest or smallest image feature value in the echo intensity distribution map in the preset image coordinate system, determine the coordinates of the pressing center point corresponding to the time when the ultrasonic echo data was collected.

21. The method according to claim 18, wherein, The step of determining navigation control information for navigating the terminal device based on the obtained press position information includes: Based on the coordinates of the multiple pressing center points, the movement information of the finger in the detection area of ​​the ultrasonic fingerprint sensor is determined, wherein the movement information includes at least one of the movement direction, movement distance, and movement speed; Based on the movement information, navigation control information for navigating the terminal device is determined.

22. The method according to any one of claims 12-16, wherein, The ultrasonic fingerprint sensor includes at least one of a side ultrasonic fingerprint sensor, a rear ultrasonic fingerprint sensor, and an under-display ultrasonic fingerprint sensor.

23. A control device for an ultrasonic fingerprint sensor in a terminal device, the control device comprising: The first determining module is used to determine whether the terminal device has entered the underwater working mode; The first control module is used to determine the target working mode of the ultrasonic fingerprint sensor in response to the terminal device entering the underwater working mode, and control the ultrasonic fingerprint sensor to enter the target working mode for operation. The ultrasonic fingerprint sensor has a working mode including a navigation working mode. When the ultrasonic fingerprint sensor is operating in the target working mode of the navigation working mode, the ultrasonic fingerprint sensor is controlled to collect ultrasonic echo data from the finger. Based on the ultrasonic echo data, navigation control information for navigation control of the terminal device is determined. The step of determining navigation control information for navigating the terminal device based on the ultrasonic echo data includes: acquiring multiple ultrasonic echo data obtained by the ultrasonic fingerprint sensor at multiple different times when collecting data from the finger. Based on the multiple ultrasonic echo data, multiple pressing position information of the finger at multiple different times within the detection area of ​​the ultrasonic fingerprint sensor is determined; based on the obtained pressing position information, navigation control information for navigating the terminal device is determined.

24. A control device for a control unit of a terminal device, the control device comprising: The second determining module is used to determine whether the terminal device has entered the underwater working mode, and in response to determining that the terminal device has entered the underwater working mode, generates an indication signal; The second control module is used to send an indication signal to the ultrasonic fingerprint sensor so that the ultrasonic fingerprint sensor responds to the indication signal, determines the target working mode of the ultrasonic fingerprint sensor, and enters the target working mode to operate. The ultrasonic fingerprint sensor has a working mode including a navigation working mode. When the ultrasonic fingerprint sensor is operating in the target working mode of the navigation working mode, it acquires ultrasonic echo data obtained by the ultrasonic fingerprint sensor from the finger, and determines navigation control information for navigation control of the terminal device based on the ultrasonic echo data. The step of determining navigation control information for navigating the terminal device based on the ultrasonic echo data includes: acquiring multiple ultrasonic echo data obtained by the ultrasonic fingerprint sensor at multiple different times when collecting data from the finger. Based on the multiple ultrasonic echo data, multiple pressing position information of the finger at multiple different times within the detection area of ​​the ultrasonic fingerprint sensor is determined; based on the obtained pressing position information, navigation control information for navigating the terminal device is determined.

25. An electronic device, comprising: The processor, the communication interface, the memory, and the communication bus are provided, wherein the processor, the communication interface, and the memory communicate with each other via the communication bus. The memory is used to store computer programs; The processor is configured to perform the method of any one of claims 1-22 by running the computer program stored in the memory.

26. A computer storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the method as described in any one of claims 1-22.

27. A computer program product comprising a computer program that, when executed by a processor, implements the method as described in any one of claims 1-22.

Images