Control method and device, electronic equipment, storage medium and computer program product

The ultrasonic fingerprint sensor collects data and determines navigation control information, which solves the problem of fingerprint failure when used in different environments of terminal devices, and improves user experience and device stability.

CN119068516APending Publication Date: 2024-12-03SHENZHEN GOODIX TECH CO LTD
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
CN202411240427.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2024-06-27
Filing Date
2024-09-05
Publication Date
2024-12-03

AI Technical Summary

Technical Problem

When existing terminal devices are used in different environmental scenarios, fingerprint sensors are easily affected by environmental factors, resulting in failure of unlocking, trading and other functions, and poor user experience.

Method used

Ultrasonic fingerprint sensor is used to collect ultrasonic echo data and determine navigation control information, realize navigation control of terminal devices and improve user interaction experience.

Benefits of technology

Maintain the stability and experience of fingerprint function and navigation control function in various environmental scenarios (such as underwater, strong light, high and low temperatures), and reduce the restrictions on users by environmental factors.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119068516A_ABST
    Figure CN119068516A_ABST
Patent Text Reader

Abstract

The embodiment of the invention provides a control method and device, electronic equipment, a storage medium and a computer program product. The control method comprises the following steps: acquiring ultrasonic echo data obtained by acquiring a finger by an ultrasonic fingerprint sensor; determining navigation control information based on the ultrasonic echo data; and based on the navigation control information, performing navigation control on terminal equipment on which the ultrasonic fingerprint sensor is mounted.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] This application claims priority to the PCT patent application with an application date of June 27, 2024, international application number "PCT / CN2024 / 102113", and patent name "Control method, device, electronic device, storage medium and computer program product", all contents of which are hereby introduced as reference. Technical Field

[0002] The embodiments of the present application relate to the technical field of fingerprint sensors, and in particular to a control method, device, electronic device, storage medium, and computer program product. Background Art

[0003] At this stage, mobile phones and other terminal devices have high requirements for user experience. Terminal devices often operate in different environmental scenarios (for example, including but not limited to underwater scenarios, rainy scenes, strong light scenes, etc.), and are easily affected by many environmental factors when used. Some terminal devices rely on fingerprint sensors to achieve functions such as unlocking and transactions. Therefore, how to adopt some new technical solutions related to fingerprint sensors to improve the user experience of using terminal devices has become a technical problem that needs to be solved. Summary of the invention

[0004] In view of this, an embodiment of the present application provides a control solution.

[0005] According to a first aspect of an embodiment of the present application, a control method is provided, including: obtaining ultrasonic echo data obtained by an ultrasonic fingerprint sensor collecting a finger; determining navigation control information based on the ultrasonic echo data; and performing navigation control on a terminal device on which the ultrasonic fingerprint sensor is installed based on the navigation control information.

[0006] In some optional embodiments, determining navigation control information based on the ultrasonic echo data includes:

[0007] Acquire multiple ultrasonic echo data of the finger collected by the ultrasonic fingerprint sensor at multiple different times;

[0008] Determine, according to the plurality of ultrasonic echo data, a plurality of pressing position information of the finger in the detection area of ​​the ultrasonic fingerprint sensor at the plurality of different moments;

[0009] The navigation control information is determined according to the obtained multiple pressing position information.

[0010] In some optional embodiments, the ultrasonic fingerprint sensor includes a plurality of ultrasonic sub-units, each of which is used to collect sub-ultrasonic echo data of a finger, and the ultrasonic echo data at any moment includes a plurality of sub-ultrasonic echo data collected by the plurality of ultrasonic sub-units at that moment;

[0011] The determining, according to the plurality of ultrasonic echo data, a plurality of pressing position information of the finger in the detection area of ​​the ultrasonic fingerprint sensor at the plurality of different moments comprises:

[0012] For each ultrasonic echo data in the plurality of ultrasonic echo data: determining echo intensity distribution information corresponding to the moment when the ultrasonic echo data is collected according to the ultrasonic echo signal strengths indicated by the plurality of sub-ultrasonic echo data in the ultrasonic echo data, and determining the position coordinates of the pressing center point corresponding to the moment when the ultrasonic echo data is collected according to the echo intensity distribution information, wherein the echo intensity information is used to indicate the intensity distribution of ultrasonic echo signals received by ultrasonic sub-units at different positions;

[0013] The obtained multiple pressing center point position coordinates are determined as the multiple pressing position information.

[0014] In some optional embodiments, the echo intensity distribution information is an echo intensity distribution diagram in image form, the echo intensity distribution diagram includes a plurality of image areas corresponding one-to-one to the plurality of ultrasonic sub-units, and the position arrangement relationship between the plurality of image areas is determined based on the position arrangement relationship between the plurality of ultrasonic sub-units;

[0015] The step of determining the echo intensity distribution information corresponding to the time when the ultrasonic echo data is collected according to the ultrasonic echo signal strength indicated by the plurality of sub-ultrasonic echo data in the ultrasonic echo data comprises:

[0016] For each sub-ultrasonic echo data of the ultrasonic echo data, an echo intensity distribution map to be processed is obtained, and according to the ultrasonic echo signal intensity indicated by the sub-ultrasonic echo data, an image feature value is assigned to an image area corresponding to a target ultrasonic subunit in the echo intensity map to be processed, and after each image area in the echo intensity map to be processed is assigned an image feature value, an echo intensity distribution map corresponding to the moment when the ultrasonic echo data is collected is obtained;

[0017] The target ultrasonic subunit is an ultrasonic subunit that collects the sub-ultrasonic echo data, and the echo intensity distribution diagram to be processed is a blank echo intensity distribution diagram or a historical echo intensity distribution diagram.

[0018] In some optional embodiments, determining the position coordinates of the pressing center point corresponding to the moment of collecting the ultrasonic echo data according to the echo intensity distribution information includes:

[0019] The coordinates of the pressing center point position corresponding to the moment of collecting the ultrasonic echo data are determined according to the coordinates of the image area with the maximum or minimum image characteristic value in the echo intensity distribution diagram in the preset image coordinate system.

[0020] In some optional embodiments, determining the navigation control information according to the obtained multiple pressing position information includes:

[0021] Determine, according to the multiple pressing center point position coordinates, movement information of the finger in the detection area of ​​the ultrasonic fingerprint sensor, wherein the movement information includes at least one of movement direction information, movement distance information, and movement speed information;

[0022] The navigation control information is determined according to the movement information.

[0023] In some optional embodiments, the performing navigation control on the terminal device on which the ultrasonic fingerprint sensor is installed based on the navigation control information includes:

[0024] Based on the navigation control information, at least one of the following control methods is performed on the terminal device: device volume increase or decrease control, screen brightness increase or decrease control, device camera focus control, device screen zoom control, page element zoom control, and application interface sliding control.

[0025] In some optional embodiments, the control method is the control of a software application of the terminal device.

[0026] In some optional embodiments, the ultrasonic fingerprint sensor includes at least one of a side ultrasonic fingerprint sensor, a back ultrasonic fingerprint sensor, and an under-screen ultrasonic fingerprint sensor.

[0027] According to a second aspect of an embodiment of the present application, a control device is provided, including: an acquisition module for obtaining ultrasonic echo data obtained by an ultrasonic fingerprint sensor collecting a finger; a determination module for determining navigation control information based on the ultrasonic echo data; and a control module for performing navigation control on a terminal device on which the ultrasonic fingerprint sensor is installed based on the navigation control information.

[0028] According to a third aspect of an embodiment of the present application, there is provided an electronic device, comprising: a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other via the communication bus; the memory is used to store a computer program; and the processor is used to execute the method described in the first aspect above by running the computer program stored in the memory.

[0029] According to a fourth aspect of an embodiment of the present application, a computer storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the method described in the first aspect is implemented.

[0030] According to a fifth aspect of an embodiment of the present application, a computer program product is provided, including a computer program, which implements the method described in the first aspect when executed by a processor.

[0031] According to the control scheme provided in the embodiment of the present application, on the one hand, since the ultrasonic echo data obtained by the ultrasonic fingerprint sensor collecting the finger can be obtained, and then the navigation control information is determined based on the ultrasonic echo data, and then the terminal device on which the ultrasonic fingerprint sensor is installed is navigated and controlled based on the navigation control information, the technical scheme of the present application can effectively realize the navigation control function of the terminal device through the ultrasonic fingerprint sensor, so that the user can control and interact with the terminal device through the ultrasonic fingerprint sensor, thereby effectively improving the use experience of the ultrasonic fingerprint sensor and the terminal device; on the other hand, the ultrasonic fingerprint sensor is used in the present scheme to realize the fingerprint function and the navigation control function. Since the ultrasonic fingerprint sensor is used to realize the fingerprint function and the navigation control function through ultrasonic signals, and various environmental scenarios in daily use have little effect on the ultrasonic signal, compared with other types of fingerprint sensors, the ultrasonic fingerprint sensor is used to realize the fingerprint function and the navigation control function when the terminal device is used in multiple different environmental scenarios, which can reduce the restrictions of environmental factors on the user, thereby better maintaining the use effect and experience of the fingerprint function and the navigation control function of the terminal device. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in the embodiments of the present application. For ordinary technicians in this field, other drawings can also be obtained based on these drawings.

[0033] Figure 1 A step flow chart of a control method provided in the first aspect of an embodiment of the present application.

[0034] Figure 2 An optional flowchart for determining navigation control information according to an embodiment of the present application.

[0035] Figure 3A Schematic diagram of the position arrangement of multiple sub-ultrasonic units of an ultrasonic fingerprint sensor according to some examples of the embodiments of the present application.

[0036] Figure 3B For Figure 3A An optional schematic diagram of an echo intensity distribution diagram corresponding to multiple sub-ultrasonic units.

[0037] Figure 4 This is the echo intensity distribution diagram corresponding to two different time points in an example.

[0038] Figure 5 For Figure 4 The corresponding schematic diagram of the change in the position of the finger pressing center point at two different times.

[0039] Fig. 6A It is a schematic diagram of an xy rectangular coordinate system corresponding to the echo intensity distribution diagram of an embodiment of the present application.

[0040] Figure 6B A schematic diagram of an application example of navigation control according to an embodiment of the present application.

[0041] Figure 6C A schematic diagram of another application example of navigation control according to an embodiment of the present application.

[0042] Fig.6D This is a schematic diagram of yet another application example of navigation control according to an embodiment of the present application.

[0043] Figure 7 This is a flowchart for implementing an optional scenario in which the control unit determines navigation control information when the ultrasonic fingerprint sensor of an embodiment of the present application operates in a navigation working mode.

[0044] Figure 8 A schematic diagram of a control device provided for the second aspect of an embodiment of the present application.

[0045] Fig. 9 A schematic structural diagram of an electronic device provided for the third aspect of an embodiment of the present application. DETAILED DESCRIPTION

[0046] In order to enable those skilled in the art to better understand the technical solutions in the embodiments of the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the embodiments of the present application should fall within the scope of protection of the embodiments of the present application.

[0047] The specific implementation of the embodiment of the present application is further explained below in conjunction with the accompanying drawings of the embodiment of the present application.

[0048] Figure 1 A control method is provided according to the first aspect of the embodiment of the present application. According to the first aspect of the embodiment of the present application, a control method is provided for an ultrasonic fingerprint sensor of a terminal device, referring to Figure 1 As shown, the control method includes steps S102, S104 and S106, specifically:

[0049] S102: Obtaining ultrasonic echo data collected by the ultrasonic fingerprint sensor.

[0050] S104: Determine navigation control information based on the ultrasonic echo data.

[0051] S106: Based on the navigation control information, navigation control is performed on the terminal device on which the ultrasonic fingerprint sensor is installed.

[0052] According to the control scheme provided in the embodiment of the present application, on the one hand, since the ultrasonic echo data obtained by the ultrasonic fingerprint sensor collecting the finger can be obtained, and then the navigation control information is determined based on the ultrasonic echo data, and then the terminal device on which the ultrasonic fingerprint sensor is installed is navigated and controlled based on the navigation control information, the technical scheme of the present application can effectively realize the navigation control function of the terminal device through the ultrasonic fingerprint sensor, so that the user can control and interact with the terminal device through the ultrasonic fingerprint sensor, thereby effectively improving the use experience of the ultrasonic fingerprint sensor and the terminal device; on the other hand, the ultrasonic fingerprint sensor is used in the present scheme to realize the fingerprint function and the navigation control function. Since the ultrasonic fingerprint sensor is used to realize the fingerprint function and the navigation control function through ultrasonic signals, and various environmental scenarios in daily use have little effect on the ultrasonic signal, compared with other types of fingerprint sensors, the ultrasonic fingerprint sensor is used to realize the fingerprint function and the navigation control function when the terminal device is used in multiple different environmental scenarios, which can reduce the restrictions of environmental factors on the user, thereby better maintaining the use effect and experience of the fingerprint function and the navigation control function of the terminal device.

[0053] It should also be understood that the more conventional environmental scene when the terminal device is used is that the temperature, humidity, and light intensity are moderate, neither high nor low, and it is an environment suitable for the human body. However, the environmental scene when the terminal device is actually used usually also includes: high and low temperature, high humidity, weak light intensity, strong light intensity and other environments. In the above environmental scenes, both capacitors and optical fingerprints have more or less failure. For example, in an environment with high humidity and water (such as an underwater environment), both optical and capacitor fingerprints will cause inaccurate results due to poor resistance to environmental noise. For example, under strong light, optical fingerprints are easily disturbed by ambient light, making the navigation results inaccurate. The ultrasonic fingerprint fingerprint module uses ultrasonic signals, and its principle is different from that of capacitors and optical fingerprints. It can realize normal fingerprint functions and navigation control functions in a water environment, without being affected by humidity, and can also accurately realize navigation control under strong light and high and low temperatures. Therefore, in the embodiment of the present application, an ultrasonic fingerprint sensor is used to realize the fingerprint function and the navigation control function of the terminal device, which can adapt to various environmental scenes, has a wide range of usage scenarios, and the fingerprint function and navigation control function have high robustness. Furthermore, the embodiments of the present application provide a solution for controlling and interacting with electronic devices through an ultrasonic fingerprint sensor, which effectively improves the application value of the ultrasonic fingerprint sensor, and further effectively improves the user experience of the ultrasonic fingerprint sensor and the terminal device.

[0054] An ultrasonic fingerprint sensor may be a fingerprint sensor that implements its functions through ultrasonic signals. Optionally, the control method provided in the first aspect of the present application may be performed by any control unit or processing unit. For example, the control method may be implemented by a control unit (which may include any processor, such as a CPU, MCU, etc.) of an electronic device used by an ultrasonic fingerprint sensor. Alternatively, it may be performed by a processing unit (which may include any processor, such as a CPU, MCU, etc.) inside an ultrasonic fingerprint sensor.

[0055] In the embodiments of the present application, the terminal device may be any type of electronic device, such as a mobile terminal such as a mobile phone, a tablet computer, a computer, a server, etc. In the following, the terminal device may be exemplified and understood as a mobile phone.

[0056] Optionally, the type of ultrasonic fingerprint sensor in the present application may include at least one of a side ultrasonic fingerprint sensor, a back ultrasonic fingerprint sensor, and an under-screen ultrasonic fingerprint sensor. Through the above types of ultrasonic fingerprint sensors, side fingerprint recognition, back fingerprint recognition, or under-screen fingerprint recognition can be implemented to meet the usage requirements of the terminal device.

[0057] It should be understood that the specific structure of the ultrasonic fingerprint sensor is not limited in any way in the embodiments of the present application, as long as it can meet the requirements. Optionally, the ultrasonic fingerprint sensor in the present application may include multiple ultrasonic subunits, each of which can transmit and receive ultrasonic signals, and multiple ultrasonic subunits can form an M*N array. Each ultrasonic subunit can be equivalent to a "pixel".

[0058] Optionally, the ultrasonic subunit may include a piezoelectric material layer, and may transmit and receive ultrasonic signals based on the piezoelectric effect. For example, taking the scenario of an ultrasonic fingerprint sensor for fingerprint collection as an example, a finger may be pressed above the detection area of ​​the ultrasonic fingerprint sensor, and multiple ultrasonic subunits of the ultrasonic fingerprint sensor may transmit ultrasonic signals to the finger. Starting from the transmission of the ultrasonic signal, it will pass through the chip layer by layer, and then penetrate the cover plate. After that, the finger above the detection area of ​​the ultrasonic fingerprint sensor may reflect at least part of the ultrasonic signal to form an ultrasonic echo signal carrying fingerprint information. Multiple ultrasonic subunits receive the ultrasonic echo signal respectively, and the ultrasonic echo signal received by each ultrasonic subunit may be processed into ultrasonic echo data that can be processed by a computer. The ultrasonic fingerprint sensor may generate an ultrasonic fingerprint image based on the ultrasonic echo data, or a control unit electrically connected to the ultrasonic fingerprint sensor (which may be a control unit of a terminal device, and may include any processor, such as a CPU, MCU, etc.) may generate an ultrasonic fingerprint image based on the ultrasonic echo data, and further the function of fingerprint recognition may be realized through the ultrasonic fingerprint image. It should be understood that the description here is only an example for easy understanding, and is not any limitation to the present application.

[0059] Optionally, the ultrasonic fingerprint sensor in the present application may include multiple working modes. For example, in some optional embodiments, the working modes of the ultrasonic fingerprint sensor include: at least one of a fingerprint recognition working mode, a press detection working mode and a navigation working mode. On this basis, the control method of the first aspect further includes:

[0060] When the ultrasonic fingerprint sensor operates in the fingerprint recognition working mode, the ultrasonic fingerprint sensor is controlled to collect the ultrasonic echo data of the finger, and the fingerprint recognition is performed based on the ultrasonic echo data; and / or,

[0061] When the ultrasonic fingerprint sensor operates in the press detection working mode, the ultrasonic fingerprint sensor is controlled to collect ultrasonic echo data of the finger, and press detection is performed based on the ultrasonic echo data; and / or,

[0062] When the ultrasonic fingerprint sensor operates in the navigation working mode, the ultrasonic fingerprint sensor is controlled to collect the ultrasonic echo data of the finger, and based on the ultrasonic echo data, the navigation control information used for navigation control of the terminal device is determined.

[0063] Based on this, in the embodiments of the present application, multiple working modes of the above-mentioned ultrasonic fingerprint sensor are used to meet the different needs of terminal devices including but not limited to underwater use, so as to improve the use effect of the ultrasonic fingerprint sensor and the terminal device.

[0064] It should be understood that fingerprint recognition may refer to generating an ultrasonic fingerprint image and performing fingerprint recognition based on the ultrasonic fingerprint image; press detection may refer to detecting whether the detection area of ​​the ultrasonic fingerprint sensor is pressed; and navigation control may refer to controlling the terminal device to complete a predetermined task based on the detected finger movement.

[0065] It should be noted that the above-mentioned fingerprint recognition, press detection, and determination of navigation control information can be implemented by the control unit of the terminal device, and can also be implemented by the ultrasonic fingerprint sensor (which can be executed by the processing unit of the ultrasonic fingerprint sensor).

[0066] Optionally, the working mode of the ultrasonic fingerprint sensor may further include a reset mode, which can be used to reset the system of the ultrasonic fingerprint sensor, facilitating the switching of the working mode. In the reset mode, the ultrasonic fingerprint sensor is turned on but does not transmit or receive ultrasonic signals (it can be simply understood that the ultrasonic fingerprint sensor is idle in this reset mode).

[0067] Optionally, for the case where the ultrasonic fingerprint sensor includes M*N ultrasonic subunits, in the fingerprint recognition working mode, all of the M*N ultrasonic subunits can be in the working state of transmitting and receiving ultrasonic signals. Optionally, in the press detection working mode, part of the M*N ultrasonic subunits can be in the working state of transmitting and receiving ultrasonic signals, while the other part is not in such a working state, which has the advantage of reducing power consumption; optionally, different parts of the ultrasonic subunits can be made to enter the working state of transmitting and receiving ultrasonic signals in turn at uniform time intervals to take into account both time consumption and spatial uniformity. In the navigation working mode, it can be a method in which all of the M*N ultrasonic subunits are in the working state of transmitting and receiving ultrasonic signals, or it can be a method in which some of the ultrasonic subunits are in the working state of transmitting and receiving ultrasonic signals.

[0068] Optionally, when the ultrasonic fingerprint sensor is in the navigation working mode, if navigation control information is obtained, the control unit of the terminal device can further perform navigation control of the terminal device based on the navigation control information.

[0069] Optionally, in combination with actual application scenarios, the ultrasonic fingerprint sensor in this application can have a detection frequency of above 10 Hz in the fingerprint recognition working mode, press detection working mode, and navigation working mode, that is, at least 10 signal acquisitions are performed in 1 second, and at least 10 ultrasonic echo data are obtained to ensure the use effect of the ultrasonic fingerprint sensor and the terminal device.

[0070] In the embodiment of the present application, when the ultrasonic fingerprint sensor operates in the navigation working mode, in some optional embodiments, the above-mentioned method of "determining navigation control information based on ultrasonic echo data" refers to Figure 2 The flowchart shown may include the following steps S202, S204 and S206, specifically:

[0071] S202: Acquire multiple ultrasonic echo data collected by the ultrasonic fingerprint sensor at multiple different times.

[0072] For example, an ultrasonic fingerprint sensor may collect fingerprints at n different times to obtain n ultrasonic echo data. For example, the n different times may be n times of continuously collecting fingerprints. n≥2, and n may be 2 for example below.

[0073] Optionally, for the ultrasonic fingerprint sensor including multiple ultrasonic sub-units, each ultrasonic sub-unit is used to collect the sub-ultrasonic echo data of the finger, and the ultrasonic echo data at any moment includes the multiple sub-ultrasonic echo data collected by the multiple ultrasonic sub-units at that moment.

[0074] As an example for easy understanding, taking any one of the n moments, if the ultrasonic fingerprint sensor has a total of M*N ultrasonic sub-units, assuming that the M*N ultrasonic sub-units are in a working state of transmitting and receiving ultrasonic signals, then at this moment, the M*N ultrasonic sub-units can respectively collect fingers to obtain M*N sub-ultrasonic echo data, then the ultrasonic data obtained by the ultrasonic fingerprint sensor at this moment also includes the M*N sub-ultrasonic echo data.

[0075] S204: Determine, based on the plurality of ultrasonic echo data, a plurality of pressing position information of the finger within the detection area of ​​the ultrasonic fingerprint sensor at a plurality of different moments.

[0076] For example, taking n=2 as an example, n=2 ultrasonic echo data can obtain 2 pressing position information of the finger in the detection area of ​​the ultrasonic fingerprint sensor at n=2 different moments.

[0077] In some optional embodiments, step S204 may include: for each ultrasonic echo data in the multiple ultrasonic echo data: according to the ultrasonic echo signal strength indicated by the multiple sub-ultrasonic echo data in the ultrasonic echo data, determine the echo intensity distribution information corresponding to the moment when the ultrasonic echo data was collected, and according to the echo intensity distribution information, determine the compression center point position coordinates corresponding to the moment when the ultrasonic echo data was collected, wherein the echo intensity information is used to indicate the strength distribution of the sub-ultrasonic echo data received by the ultrasonic sub-units at different positions; and determine the obtained multiple compression center point position coordinates as multiple compression position information.

[0078] Ultrasonic waves are mechanical waves. The propagation of ultrasonic waves depends on the propagation medium. Ultrasonic signals propagate at a fixed speed and in a constant direction in the same uniform propagation medium. Ultrasonic waves will be reflected and transmitted at the interface of different propagation media. The reflectivity and transmittance depend on the acoustic impedance and incident angle of different media. Therefore, when the finger is pressed on the detection area of ​​the ultrasonic fingerprint sensor, the ultrasonic signal enters the skin tissue of the finger and is reflected to form an ultrasonic echo signal. Due to the different degree of contact between the finger and each point in the detection area, the ultrasonic sub-units at different positions of the ultrasonic fingerprint sensor receive different intensities of ultrasonic echo signals. Generally speaking, the ultrasonic echo signal received by the ultrasonic sub-unit at the center of the finger's pressing has the highest intensity, and the intensity of the ultrasonic echo signal received by the surrounding ultrasonic sub-units gradually decreases as the distance from the center of the pressing increases.

[0079] Therefore, in the present application, for each ultrasonic echo data in the multiple ultrasonic echo data, according to the ultrasonic echo signal strength indicated by the multiple sub-ultrasonic echo data of the ultrasonic echo data, the echo intensity distribution information that can indicate the intensity distribution of the ultrasonic echo signal received by the ultrasonic sub-units at different positions is determined, so as to accurately determine the press center point position coordinates corresponding to the moment of collecting the ultrasonic echo data according to the echo intensity distribution information. After obtaining multiple press center point position coordinates at multiple moments, each press center point position coordinate can represent the press center point position of the finger in the detection area of ​​the ultrasonic fingerprint sensor at the corresponding moment, so these press center point position coordinates can be determined as press position information, so as to facilitate the subsequent steps to determine the navigation control information for navigation control of the terminal device based on the obtained press position information, and then when the terminal device is used, the function of finger navigation control can be better realized through the ultrasonic fingerprint sensor, improving the user's use of the terminal device in various environmental scenarios including but not limited to underwater.

[0080] The echo intensity distribution information may be implemented in any suitable form, such as an image form, a table form, a function form, etc., which can be selected as needed. In some optional embodiments, the echo intensity distribution information is an echo intensity distribution diagram in an image form, and the echo intensity distribution diagram includes a plurality of image areas corresponding to a plurality of ultrasonic subunits, and the position arrangement relationship between the plurality of image areas is determined based on the position arrangement relationship between the plurality of ultrasonic subunits.

[0081] It should be understood that the echo intensity distribution diagram in the form of an image is more convenient for calculating the position coordinates of the compression center point. For example, in one implementation below, an image coordinate system can be preset, and the position coordinates of the compression center point can be determined according to the coordinates of the image area selected in the echo intensity distribution diagram, which will be described in detail below and will not be repeated here.

[0082] For example, refer to Figure 3A As shown, some exemplary positional arrangements of multiple ultrasonic subunits are shown (it should be understood that the examples shown in the various schematic diagrams of the present application are not necessarily in actual proportion, and are only used to facilitate understanding of the technical solutions of the present application, and are not intended to limit the present application). Among them, multiple ultrasonic subunits are arranged in a matrix of M rows and N columns, wherein several exemplary ultrasonic subunits p1, p2, p3, p4, p5, and p6 are located at the 2nd row and 2nd column, the 1st row and 2nd column, the 3rd row and 2nd column, the 2nd row and 1st column, the 2nd row and 3rd column, and the 2nd to last row and 2nd to last column, respectively. For another example, referring to Figure 3B Shown with Figure 3A The echo intensity distribution corresponding to multiple sub-ultrasonic units Figure 1 An example. In which, multiple image areas are also arranged in a matrix with M rows and N columns, multiple image areas correspond to multiple ultrasonic sub-units one by one, and the position arrangement relationship between the multiple image areas is determined based on the position arrangement relationship between the multiple ultrasonic sub-units, for example Figure 3B The image regions q1, q2, q3, q4, q5, and q6 of several examples are respectively Figure 3A The ultrasonic subunits p1, p2, p3, p4, p5, and p6 in the image are corresponding to each other, and the image areas q1, q2, q3, q4, q5, and q6 are also correspondingly located at the second row and second column, the first row and second column, the third row and second column, the second row and first column, the second row and third column, and the second row and second column from the bottom. Other image areas can also be analogized according to the above example. Therefore, after finding a certain image area from the echo intensity distribution map, it is possible to determine which ultrasonic subunit it is, so as to accurately determine the position and coordinates of the finger's pressing center point at a certain moment, so as to generate navigation control information for navigation control of the terminal device.

[0083] In some optional embodiments, the above-mentioned "determining the echo intensity distribution information corresponding to the moment when the ultrasonic echo data was collected according to the ultrasonic echo signal strengths indicated by multiple sub-ultrasonic echo data in the ultrasonic echo data" may include: for each sub-ultrasonic echo data of the ultrasonic echo data, obtaining an echo intensity distribution map to be processed, and according to the ultrasonic echo signal strength indicated by the sub-ultrasonic echo data, assigning image feature values ​​to the image areas corresponding to the target ultrasonic subunits in the echo intensity map to be processed; after each image area of ​​the echo intensity map to be processed is assigned an image feature value, obtaining an echo intensity distribution map corresponding to the moment when the ultrasonic echo data was collected; wherein, the target ultrasonic subunit is the ultrasonic subunit that collects the sub-ultrasonic echo data, and the echo intensity distribution map to be processed is a blank echo intensity distribution map or a historical echo intensity distribution map.

[0084] Based on this, in the present application, through the above method, it is possible to effectively obtain an echo intensity distribution diagram corresponding to the moment when the ultrasonic echo data is collected according to the ultrasonic echo signal strength indicated by multiple sub-ultrasonic echo data in the ultrasonic echo data, so that it is convenient to determine the pressing center point position coordinates corresponding to the moment when the ultrasonic echo data is collected more conveniently and accurately according to the echo intensity distribution diagram (that is, the echo intensity distribution information) in the future, so that the obtained pressing center point position coordinates can be determined as the pressing position information, so that the subsequent steps can determine the navigation control information used for navigation control of the terminal device based on the obtained pressing position information, and then when the terminal device is used, the function of finger navigation control can be better realized through the ultrasonic fingerprint sensor, thereby improving the user's use of the terminal device in various environmental scenarios including but not limited to underwater.

[0085] Optionally, the image feature value may be any feature value of the image, such as saturation, pixel value, etc.

[0086] Optionally, the blank echo intensity distribution diagram may be an echo intensity distribution diagram to which no image characteristic value has been assigned according to the ultrasonic echo signal intensity. When used, the image characteristic value may be directly assigned to the corresponding image area. Optionally, the historical echo intensity distribution diagram may be an echo intensity distribution diagram corresponding to the moment when the ultrasonic echo data was previously collected. The historical echo intensity distribution diagram may have been assigned an image characteristic value, and the image characteristic value may be reassigned according to the ultrasonic echo signal intensity when used.

[0087] In some optional embodiments, the above-mentioned "determining the position coordinates of the compression center point corresponding to the moment of collecting the ultrasonic echo data according to the echo intensity distribution information" may include: determining the position coordinates of the compression center point corresponding to the moment of collecting the ultrasonic echo data according to the coordinates of the image area with the largest or smallest image characteristic value in the echo intensity distribution diagram in a preset image coordinate system.

[0088] Referring to the foregoing, generally speaking, the intensity of the ultrasonic echo signal received by the ultrasonic subunit at the center point of the finger's pressing is the largest, and the intensity of the ultrasonic echo signal received by the surrounding ultrasonic subunits gradually decreases. Therefore, the image area with the largest or smallest image feature value assigned in the echo intensity distribution diagram is more likely to correspond to the ultrasonic subunit at the center point of the finger's pressing. Therefore, through such an optional method, the pressing center point position coordinates corresponding to the moment of collecting the ultrasonic echo data can be more accurately determined according to the echo intensity distribution diagram, so that the obtained pressing center point position coordinates can be determined as the pressing position information, so that the subsequent steps can determine the navigation control information for navigating the terminal device based on the obtained pressing position information, and then when the terminal device is used, the function of finger navigation control can be better realized through the ultrasonic fingerprint sensor, improving the user's use of the terminal device in various environmental scenarios including but not limited to underwater.

[0089] It should be understood that the multiple echo intensity distribution graphs obtained from the multiple ultrasonic echo data can use the same rules to determine the position coordinates of the compression center point corresponding to the moment when the ultrasonic echo data is collected. That is, an optional implementation method is: for each of the multiple echo intensity distribution graphs obtained, the position coordinates of the compression center point corresponding to the moment when the ultrasonic echo data is collected are determined according to the coordinates of the image area with the largest image characteristic value in the echo intensity distribution graph in the preset image coordinate system. Or, another optional implementation method is: for each of the multiple echo intensity distribution graphs obtained, the position coordinates of the compression center point corresponding to the moment when the ultrasonic echo data is collected are determined according to the coordinates of the image area with the smallest image characteristic value in the echo intensity distribution graph in the preset image coordinate system.

[0090] The preset image coordinate system can be set as needed. For example, a vertex of the echo intensity distribution graph can be used as the origin (the upper left vertex of the image can be used as an example), along the first direction F1 of the echo intensity distribution graph, and the second direction F2 perpendicular to the first direction F1 (refer to Figure 4For example, the first direction F1 can be the length direction of the echo intensity distribution diagram, and the second direction F2 can be the width direction of the echo intensity distribution diagram. Of course, the two can also be interchanged, that is, the first direction F1 is the width direction, and the second direction F2 is the length direction) are used as the two coordinate axis directions to pre-establish an xy rectangular coordinate system, and the xy rectangular coordinate system is determined as the preset image coordinate system.

[0091] Optionally, the coordinates of multiple image areas in the echo intensity distribution map can be pre-stored for easy use. Optionally, the image area of ​​the echo intensity distribution map may include one or more pixel points, and the coordinates of the pixel point at the center of the image area with the largest or smallest image characteristic value may be determined as the press center point position coordinates. Alternatively, the coordinates of a pixel point may be randomly selected from the image area as needed to determine the press center point position coordinates. Alternatively, in another optional embodiment, coordinates may be assigned to each image area according to the position arrangement, for example, in the form of Figure 3B It is understood that the coordinates of the image area q1 in the second row and second column can be assigned as (2, 2), the coordinates of the image area q2 in the first row and second column can be assigned as (2, 1), the coordinates of the image area q3 in the third row and second column can be assigned as (2, 3), the coordinates of the image area q4 in the second row and first column can be assigned as (1, 2), and the coordinates of the image area q5 in the second row and third column can be assigned as (3, 2). The same can be applied to other image areas. When needed, the coordinates of the selected image area can be determined as the coordinates of the pressing center point position. It should be understood that the specific implementation method can be selected as needed, and the present application does not impose specific restrictions here.

[0092] Optionally, when allocating image characteristic values ​​to image regions according to the ultrasonic echo signal strength indicated by the sub-ultrasonic echo data, the image characteristic values ​​may be proportional to the ultrasonic echo signal strength, or may be inversely proportional to the ultrasonic echo signal strength. When proportional, the greater the ultrasonic echo signal strength, the greater the image characteristic value. The coordinates of the image region with the largest image characteristic value in the echo intensity distribution diagram in the preset image coordinate system may be used to determine the position coordinates of the pressing center point corresponding to the moment when the ultrasonic echo data was collected. When inverse, the greater the ultrasonic echo signal strength, the smaller the image characteristic value. The coordinates of the image region with the smallest image characteristic value in the echo intensity distribution diagram in the preset image coordinate system may be used to determine the position coordinates of the pressing center point corresponding to the moment when the ultrasonic echo data was collected.

[0093] Combine the following Figure 3A , Figure 3B , Figure 4The example process of determining the echo intensity distribution map and calculating the coordinates of the pressing center point position is described. For example, an ultrasonic fingerprint sensor collects the first ultrasonic echo data of two ultrasonic echo data at n=2 moments. Assume that the ultrasonic fingerprint sensor includes N*M ultrasonic subunits (for example, refer to Figure 3A For example, if the ultrasonic echo signal of the finger is received, the first ultrasonic echo data includes N*M ultrasonic sub-units collecting N*M sub-ultrasonic echo data. The intensity distribution diagram of the echo to be processed can be obtained. For example, the intensity distribution diagram of the echo to be processed is Figure 3B Taking the echo intensity distribution diagram in the middle (which can be regarded as a blank echo intensity distribution diagram for illustrative understanding here) as an example, according to the ultrasonic echo signal strength indicated by the sub-ultrasonic echo data collected by the ultrasonic sub-unit p1, an image feature value is assigned to the image area q1 in the echo distribution diagram to be processed; according to the ultrasonic echo signal strength indicated by the sub-ultrasonic echo data collected by the ultrasonic sub-unit p2, an image feature value is assigned to the image area q2 in the echo distribution diagram to be processed; according to the ultrasonic echo signal strength indicated by the sub-ultrasonic echo data collected by the ultrasonic sub-unit p3, an image feature value is assigned to the image area q3 in the echo distribution diagram to be processed; and so on, image feature values ​​are respectively assigned to the remaining image areas in the echo distribution diagram to be processed, so that the echo intensity distribution diagram corresponding to the moment when the first ultrasonic echo data is collected can be obtained. Taking the image feature value as saturation as an example, assuming that the ultrasonic echo signal strength indicated by the sub-ultrasonic echo data collected by the ultrasonic sub-unit p1 is the largest, the image feature value assigned to the image area q1 is also the largest. Refer to Figure 4 As shown in the echo intensity distribution diagram corresponding to the first moment, along the first direction F1, the image characteristic values ​​assigned to the image area q5 and other image areas will gradually decrease (when the ultrasonic echo signal intensity is too low, the image characteristic values ​​of multiple image areas can also be set to 0 based on the ultrasonic echo signal intensity). Similarly, along the second direction F2, along the opposite direction of the first direction F1, and along the opposite direction of the second direction F2, the image characteristic values ​​assigned to other image areas will also gradually decrease. In this way, the echo intensity distribution diagram corresponding to the first moment can be processed again, and the coordinates of the image area q1 with the largest image characteristic value in the preset image coordinate system can be determined according to the image characteristic value size of each image area, and the position coordinates (x1, y1) of the pressing center point corresponding to the first moment of collecting the first ultrasonic echo data can be determined.

[0094] Let's take the example of the ultrasonic fingerprint sensor collecting the second ultrasonic echo data of two ultrasonic echo data at n=2 moments as an example. A blank echo intensity distribution diagram or the echo intensity distribution diagram at the first moment can be used as the echo intensity distribution diagram to be processed. Assuming that the echo intensity distribution diagram at the first moment is used as the echo intensity distribution diagram to be processed, the image feature value is reallocated to the image area in the echo distribution diagram to be processed according to the ultrasonic echo signal intensity indicated by the sub-ultrasonic echo data collected by each ultrasonic sub-unit (refer to the above for understanding, no further details are given here), so that the echo intensity distribution diagram corresponding to the moment when the second ultrasonic echo data is collected can be obtained. Taking the image feature value as saturation as an example, assuming that the ultrasonic echo signal indicated by the sub-ultrasonic echo data collected by the ultrasonic sub-unit p6 corresponding to the image area q6 is the largest, the image feature value allocated to its image area q1 is also the largest. Refer to Figure 4 In the echo intensity distribution diagram corresponding to the second moment shown in , along the first direction F1, along the second direction F2, in the opposite direction of the first direction F1, and in the opposite direction of the second direction F2, the image characteristic values ​​assigned to the image areas q10, q9, q8, q7 and other image areas will gradually decrease along each direction. In this way, the echo intensity distribution diagram corresponding to the second moment can be processed again, and the coordinates of the image area q6 with the largest image characteristic value in the preset image coordinate system can be determined according to the image characteristic values ​​of each image area, and the position coordinates (x2, y2) of the pressing center point corresponding to the second moment of collecting the second ultrasonic echo data can be determined.

[0095] Afterwards, the obtained two pressing center point position coordinates (x1, y1) and (x2, y2) can be determined as multiple pressing position information for calculation of navigation control information in subsequent steps. The above example illustrates that the pressing center point position of the finger in the detection area of ​​the ultrasonic fingerprint sensor moves from the position of the ultrasonic subunit p1 corresponding to the image area q1 to the position of the ultrasonic subunit p6 corresponding to the image area q6 at two moments (refer to Figure 5 As shown). It is understood that, in another case, if the coordinates of the two pressing center points are the same, it can be said that the finger has not moved from the first moment to the second moment. It should be understood that the above example description does not serve as any limitation to the embodiments of the present application.

[0096] S206: Determine navigation control information according to the obtained multiple pressing position information.

[0097] Based on this, in the present application, through the optional implementation of the above steps S202 to S206, by obtaining multiple ultrasonic echo data collected by the ultrasonic fingerprint sensor at multiple different times and obtaining multiple pressing position information of the finger in the detection area of ​​the ultrasonic fingerprint sensor at multiple different times, the multiple ultrasonic echo data are determined. According to the multiple pressing position information obtained, the navigation control information used for navigation control of the terminal device can be accurately and effectively determined, and then when the terminal device is used, the function of finger navigation control can be better realized through the ultrasonic fingerprint sensor, thereby improving the use effect of the terminal device in various environmental scenarios including but not limited to underwater.

[0098] In this application, the navigation control information can be used to control the navigation of the terminal device. It should be understood that the movement of the finger can be characterized by determining the change of the pressing position information, so the navigation control information is calculated from the multiple pressing position information, which can facilitate the implementation of finger navigation.

[0099] In some optional embodiments, step S206 may include: determining the movement information of the finger in the detection area of ​​the ultrasonic fingerprint sensor based on multiple press center point position coordinates, wherein the movement information includes at least one of movement direction information, movement distance information, and movement speed information; and determining navigation control information based on the movement information.

[0100] Optionally, taking the above-mentioned coordinates of the pressing center point position (x1, y1) and (x2, y2) as an example, it can be detected that from the first moment to the second moment, the finger moves from the position corresponding to the ultrasonic subunit p1 to the position corresponding to the ultrasonic subunit p6 in the detection area of ​​the ultrasonic fingerprint sensor, and the moving direction of the finger in the detection area of ​​the ultrasonic fingerprint sensor can be determined by the coordinates (x1, y1) and (x2, y2); the moving distance of the finger in the detection area of ​​the ultrasonic fingerprint sensor can be calculated by combining the coordinates (x1, y1) and (x2, y2) and the physical size data of the ultrasonic subunit of the ultrasonic fingerprint sensor; the moving speed of the finger in the detection area of ​​the ultrasonic fingerprint sensor can also be calculated by combining the moving distance and the time interval from the first moment to the second moment; and the obtained result can be used as movement information. Further, according to the movement information, navigation control information for navigation control of the terminal device can be determined.

[0101] For example, refer to Fig. 6AThe xy rectangular coordinate system corresponding to the echo intensity distribution diagram shown, for example, in one example, the x-axis direction (which can be the opposite direction of the first direction F1 and the first direction F1, the opposite direction of the first direction F1 can be the negative direction of the x-axis, and the first direction F1 can be the positive direction of the x-axis) can correspond to the left and right direction of the detection area of ​​the ultrasonic fingerprint sensor, and the y-axis direction (which can be the opposite direction of the second direction F2 and the second direction F2, the opposite direction of the second direction F2 can be the negative direction of the y-axis, and the second direction F2 can be the positive direction of the y-axis) can correspond to the up and down direction of the detection area of ​​the ultrasonic fingerprint sensor. Optionally, in some exemplary embodiments, when designing an ultrasonic fingerprint sensor, the spacing between adjacent ultrasonic subunits can be designed to be small enough so that the distance between the two can be regarded as the physical width or length of the ultrasonic subunit when calculating. For example, the physical size data of the ultrasonic subunit can be m*m, and the unit can be, for example, micrometers (um), and the coordinates of the pressing center point position collected at a total of n moments from T1 to Tn are (x1, y1), (x2, y2), ..., (xn, yn) respectively.

[0102] by Fig. 6A For example, optionally, the moving direction information may indicate at least one of: the finger moves to the right in the detection area (which may correspond to the position coordinates of the pressing center point at time Tn relative to time T1 moving along the positive direction of the x-axis), the finger moves to the left in the detection area (which may correspond to the position coordinates of the pressing center point at time Tn relative to time T1 moving along the negative direction of the x-axis), the finger moves downward in the detection area (which may correspond to the position coordinates of the pressing center point at time Tn relative to time T1 moving along the positive direction of the y-axis), the finger moves upward in the detection area (which may correspond to the position coordinates of the pressing center point at time Tn relative to time T1 moving along the negative direction of the y-axis), etc. For example, Fig. 6A As shown, the calculation is performed using the press center point position coordinates (x1, y1) at time T1 and the press center point position coordinates (xn, yn) at time Tn. The content indicated by the moving direction information can be determined by the following calculation method: if xn-x1>0, the moving direction information can indicate that the finger moves to the right in the detection area; if xn-x1<0, the moving direction information can indicate that the finger moves to the left in the detection area; if yn-y1>0, the moving direction information can indicate that the finger moves downward in the detection area; if yn-y1<0, the moving direction information can indicate that the finger moves upward in the detection area.

[0103] Optionally, the moving distance information may indicate, for example, at least one of: the moving distance of the finger in the left-right direction of the detection area (which may correspond to the distance between the position coordinates of the pressing center points along the x-axis direction), the moving distance of the finger in the upper-lower direction of the detection area (which may correspond to the distance between the position coordinates of the pressing center points along the y-axis direction), and the straight-line distance of the finger in the detection area (which may correspond to the distance between the position coordinates of the pressing center points along the vector direction). For example, Fig. 6A As shown, the calculation is performed using the coordinates of the pressing center point position at time T1 (x1, y1) and the coordinates of the pressing center point position at time Tn (xn, yn). The content indicated by the moving distance information can be determined by the following calculation method: by Lx=|xn-x1*m, the moving distance Lx of the finger in the left and right directions of the detection area is calculated; by Ly=|yn-y1*m, the moving distance Ly of the finger in the up and down directions of the detection area is calculated; by Calculate the linear distance L that the finger moves in the detection area. Since the physical size data of the ultrasonic subunit is m*m, m in the above formulas can be the physical width or length of the ultrasonic subunit.

[0104] Optionally, the movement speed information may indicate, for example, at least one of: the movement speed of the finger in the left-right direction of the detection area, the movement speed of the finger in the up-down direction of the detection area, the total movement speed of the finger in the detection area (which may be equivalent to the sum of the movement speed of the finger in the left-right direction of the detection area and the movement speed of the finger in the up-down direction of the detection area, corresponding to the vector direction between the coordinates of the press center point position), etc. For example, Fig. 6A As shown, the calculation is performed using the pressing center position coordinates (x1, y1) at time T1 and the pressing center position coordinates (xn, yn) at time Tn. The content indicated by the moving speed information can be determined by the following calculation method: Calculate the finger's moving speed Vx in the left and right directions of the detection area; Calculate the finger's moving speed Vy in the up and down directions of the detection area; Calculate the total moving speed V of the finger in the detection area. In the above formulas, Tn is the time when the ultrasonic echo data corresponding to (xn, yn) is collected and calculated, T1 is the time when the ultrasonic echo data corresponding to (x1, y1) is collected and calculated, and Tn-T1 is the time interval between the two times.

[0105] It should be understood that in this embodiment, the x-axis direction corresponds to the left and right direction of the detection area of ​​the ultrasonic fingerprint sensor, and the y-axis direction corresponds to the up and down direction of the detection area of ​​the ultrasonic fingerprint sensor for illustrative explanation. In other optional embodiments, the x-axis direction can also correspond to the up and down direction of the detection area of ​​the ultrasonic fingerprint sensor, and the y-axis direction can correspond to the left and right direction of the detection area of ​​the ultrasonic fingerprint sensor. It can be set as needed. The principles of the two situations are similar, so they will not be repeated here.

[0106] It should be understood that in actual use, the movement information may adopt at least one of the above-mentioned movement direction information, movement distance information, and movement speed information, which may be set according to actual needs and is not specifically limited here.

[0107] Optionally, the navigation control information may include but is not limited to at least one of a navigation control signal, a navigation control parameter, etc. Navigation control information corresponding to some different styles of movement information may be preset. After the movement information is determined, the navigation control information corresponding to the movement information may be determined. After obtaining the navigation control information, the control unit of the terminal device may perform corresponding navigation control on the terminal device based on the navigation control information, so that the terminal device completes the predetermined task.

[0108] Based on this, in this application, the movement information of the finger in the detection area of ​​the ultrasonic fingerprint sensor is determined by using multiple press center point position coordinates, which can accurately and effectively determine the navigation control information used to navigate the terminal device. Therefore, when the terminal device is used, the finger navigation control function can be better realized through the ultrasonic fingerprint sensor, thereby improving the user's use of the terminal device in various environmental scenarios including but not limited to underwater.

[0109] In some optional embodiments, step S106 includes: based on the navigation control information, performing at least one of the following control methods on the terminal device: device volume plus or minus control, screen brightness plus or minus control, device camera focus control, device screen zoom control, page element zoom control, application interface sliding control. Through the above control methods, it is beneficial to utilize the navigation control function realized by the ultrasonic fingerprint sensor to effectively realize multiple controls of the terminal device, so as to improve the user experience.

[0110] Optionally, the above-mentioned application interface sliding control may include controlling at least one of the sliding distance and sliding speed of the application interface. In this control mode, the navigation control of the ultrasonic fingerprint sensor can achieve an application effect similar to controlling the sliding distance of the application interface by the sliding distance of the mouse wheel, and controlling the fast and slow sliding of the application interface by the fast and slow sliding of the mouse wheel, which has application value in including but not limited to reading documents / web pages on terminal devices, or using game applications.

[0111] Optionally, the page element zoom control may be set to any page element of the terminal device, such as but not limited to application icons, images, text, display windows, etc.

[0112] In some embodiments, the above control method in the present application can be a global control of the terminal device. As an example, the device volume plus or minus control can be a plus or minus control of the global volume of the terminal device; the screen brightness plus or minus control can be a plus or minus control of the global screen brightness of the terminal device; the device screen zoom control can be a zoom control of the global screen of the terminal device; the page element zoom control can be a zoom control of the global page element of the terminal device, and so on. It should be understood that the above examples are used to facilitate understanding and are not intended to be any limitation on the embodiments of the present application. It should also be understood that through the above control method, it is beneficial to utilize the navigation control function realized by the ultrasonic fingerprint sensor to effectively facilitate the global control of the terminal device, so as to improve the user experience.

[0113] In other embodiments, the above control method in the present application can also be the control of the software application of the terminal device. As an example, the volume addition and subtraction control of the device can also be the volume addition and subtraction control of any software application such as the music application and video application of the terminal device; the screen brightness addition and subtraction control can also be the screen brightness addition and subtraction control of any software application such as the browser application of the terminal device; the device camera focus control can also be the focus control of the camera, image editing application and other software applications of the terminal device; the device screen zoom control can also be the display screen addition and subtraction control of any software application such as the video application and the browser application; the page element zoom control can also be the zoom control of any one or more page elements of any software application such as the video application and the browser application; the application interface sliding control can also be the application interface sliding control of any software application such as the reading document / webpage application and the game application, etc. It should be understood that the above examples are used for ease of understanding and are not intended to be any limitation to the embodiments of the present application. It should also be understood that through the above control method, it is beneficial to use the navigation control function realized by the ultrasonic fingerprint sensor to effectively realize multiple controls on the software applications of the terminal device, so as to improve the user experience.

[0114] Combine the following Figure 6B to Figure 6D Let's take a few examples to explain the above control method for easy understanding.

[0115] Example 1: For example Figure 6BAs shown, taking the movement information indicating that the finger moves downward in the detection area of ​​the ultrasonic fingerprint sensor and the movement distance is Ly as an example, the navigation control information can be generated according to the movement information, so as to control the terminal device to increase the volume of the device based on the navigation control information (such as Figure 6B As shown in the figure, the volume is increased under this control), and the increased device volume can be proportional to the moving distance Ly; similarly, if the movement information indicates that the finger moves upward in the detection area of ​​the ultrasonic fingerprint sensor and the moving distance is Ly, the navigation control information can be generated according to the movement information, so that the terminal device can be controlled to reduce the device volume based on the navigation control information, and the reduced device volume can be proportional to the moving distance Ly. For another example, taking the movement information indicating that the finger moves to the right in the detection area of ​​the ultrasonic fingerprint sensor and the moving distance is Lx as an example, the navigation control information can be generated according to the movement information, so that the terminal device can be controlled to increase the device volume based on the navigation control information, and the increased device volume can be proportional to the moving distance Ly; similarly, if the movement information indicates that the finger moves to the left in the detection area of ​​the ultrasonic fingerprint sensor and the moving distance is Lx, the navigation control information can be generated according to the movement information, so that the terminal device can be controlled to reduce the device volume based on the navigation control information, and the reduced device volume can be proportional to the moving distance Lx. It can be seen from this that the device volume addition and subtraction control of the terminal device can be achieved through the navigation control function of the ultrasonic fingerprint sensor.

[0116] Example 2: For example Figure 6C As shown, taking the movement information indicating that the finger moves downward in the detection area of ​​the ultrasonic fingerprint sensor and the movement distance is Ly as an example, the navigation control information can be generated according to the movement information, so as to control the terminal device to increase the screen brightness based on the navigation control information (such as Figure 6CAs shown in the figure, the brightness is increased under this control), and the increased screen brightness can be proportional to the moving distance Ly; similarly, if the movement information indicates that the finger moves upward in the detection area of ​​the ultrasonic fingerprint sensor by a moving distance of Ly, the navigation control information can be generated according to the movement information, so that the terminal device can be controlled to reduce the screen brightness based on the navigation control information, and the reduced screen brightness can be proportional to the moving distance Ly. For another example, taking the movement information indicating that the finger moves to the right in the detection area of ​​the ultrasonic fingerprint sensor and the moving distance is Lx as an example, the navigation control information can be generated according to the movement information, so that the terminal device can be controlled to increase the screen brightness based on the navigation control information, and the increased screen brightness can be proportional to the moving distance Ly; similarly, if the movement information indicates that the finger moves to the left in the detection area of ​​the ultrasonic fingerprint sensor and the moving distance is Lx, the navigation control information can be generated according to the movement information, so that the terminal device can be controlled to reduce the screen brightness based on the navigation control information, and the reduced screen brightness can be proportional to the moving distance Lx. It can be seen from this that the screen brightness addition and subtraction control of the terminal device can be achieved through the navigation control function of the ultrasonic fingerprint sensor.

[0117] Example 3: For example Fig.6D As shown, taking the movement information indicating that the finger moves downward in the detection area of ​​the ultrasonic fingerprint sensor and the movement distance is Ly as an example, the navigation control information can be generated according to the movement information, so as to control the terminal device to increase the camera focal length based on the navigation control information (such as Fig.6D As shown, under this control, the focal length of the camera is increased from 0.6x focal length to 5.5x focal length), and the increased focal length of the camera can be proportional to the moving distance Ly; similarly, if the movement information indicates that the finger moves upward in the detection area of ​​the ultrasonic fingerprint sensor by a moving distance of Ly, the navigation control information can be generated according to the movement information, so that the terminal device can be controlled to reduce the focal length of the camera based on the navigation control information, and the reduced focal length of the camera can be proportional to the moving distance Ly. For another example, taking the movement information indicating that the finger moves to the right in the detection area of ​​the ultrasonic fingerprint sensor and the moving distance is Lx as an example, the navigation control information can be generated according to the movement information, so that the terminal device can be controlled to increase the focal length of the camera based on the navigation control information, and the increased focal length of the camera can be proportional to the moving distance Ly; similarly, if the movement information indicates that the finger moves to the left in the detection area of ​​the ultrasonic fingerprint sensor and the moving distance is Lx, the navigation control information can be generated according to the movement information, so that the terminal device can be controlled to reduce the focal length of the camera based on the navigation control information, and the reduced focal length of the camera can be proportional to the moving distance Lx. It can be seen that the focus control of the device camera of the terminal device can be achieved through the navigation control function of the ultrasonic fingerprint sensor.

[0118] Example 4: Taking the example that the movement information indicates that the finger moves downward in the detection area of ​​the ultrasonic fingerprint sensor and the movement distance is Ly, the navigation control information can be generated according to the movement information, so as to control the terminal device to enlarge the page element based on the navigation control information, and the enlargement ratio can be proportional to the movement distance Ly; similarly, if the movement information indicates that the finger moves upward in the detection area of ​​the ultrasonic fingerprint sensor and the movement distance is Ly, the navigation control information can be generated according to the movement information, so as to control the terminal device to reduce the page element based on the navigation control information, and the reduction ratio can be proportional to the movement distance Ly. For another example, taking the example that the movement information indicates that the finger moves to the right in the detection area of ​​the ultrasonic fingerprint sensor and the movement distance is Lx, the navigation control information can be generated according to the movement information, so as to control the terminal device to enlarge the page element based on the navigation control information, and the enlargement ratio can be proportional to the movement distance Ly; similarly, if the movement information indicates that the finger moves to the left in the detection area of ​​the ultrasonic fingerprint sensor and the movement distance is Lx, the navigation control information can be generated according to the movement information, so as to control the terminal device to reduce the page element based on the navigation control information, and the reduction ratio can be proportional to the movement distance Lx. It can be seen that the page element zoom control of the terminal device can be achieved through the navigation control function of the ultrasonic fingerprint sensor.

[0119] Example 5: Taking the example that the movement information indicates that the finger moves downward in the detection area of ​​the ultrasonic fingerprint sensor and the movement distance is Ly, the navigation control information can be generated according to the movement information, so as to control the terminal device to enlarge the device screen based on the navigation control information, and the enlargement ratio can be proportional to the movement distance Ly; similarly, if the movement information indicates that the finger moves upward in the detection area of ​​the ultrasonic fingerprint sensor and the movement distance is Ly, the navigation control information can be generated according to the movement information, so as to control the terminal device to reduce the device screen based on the navigation control information, and the reduction ratio can be proportional to the movement distance Ly. For another example, taking the example that the movement information indicates that the finger moves to the right in the detection area of ​​the ultrasonic fingerprint sensor and the movement distance is Lx, the navigation control information can be generated according to the movement information, so as to control the terminal device to enlarge the device screen based on the navigation control information, and the enlargement ratio can be proportional to the movement distance Ly; similarly, if the movement information indicates that the finger moves to the left in the detection area of ​​the ultrasonic fingerprint sensor and the movement distance is Lx, the navigation control information can be generated according to the movement information, so as to control the terminal device to reduce the device screen based on the navigation control information, and the reduction ratio can be proportional to the movement distance Lx. It can be seen that the device screen zoom control of the terminal device can be achieved through the navigation control function of the ultrasonic fingerprint sensor.

[0120] Example 6: Taking the example where movement information indicates that the finger moves downward in the detection area of ​​the ultrasonic fingerprint sensor and the moving distance is Ly and the moving speed is Vy or V (total moving speed), navigation control information can be generated based on the movement information, so as to control the sliding distance and sliding speed of the application interface sliding downward by the terminal device based on the navigation control information. The sliding distance of the application interface sliding downward can be directly proportional to the moving distance Ly, and the sliding speed can be directly proportional to the moving speed (Vy or V); similarly, if the movement information indicates that the finger moves upward in the detection area of ​​the ultrasonic fingerprint sensor and the moving distance is Ly and the moving speed is Vy or V (total moving speed), navigation control information can be generated based on the movement information, so as to control the sliding distance and sliding speed of the application interface sliding upward by the terminal device based on the navigation control information. The sliding distance of the application interface sliding upward can be directly proportional to the moving distance Ly, and the sliding speed can be directly proportional to the moving speed (Vy or V). For another example, if the movement information indicates that the finger moves to the right in the detection area of ​​the ultrasonic fingerprint sensor and the movement distance is Lx and the movement speed is Vx or V (total movement speed), navigation control information can be generated according to the movement information, so as to control the sliding distance and sliding speed of the application interface sliding downward by the terminal device based on the navigation control information, and the sliding distance of the application interface sliding downward can be proportional to the movement distance Lx, and the sliding speed can be proportional to the movement speed (Vx or V); similarly, if the movement information indicates that the finger moves to the left in the detection area of ​​the ultrasonic fingerprint sensor and the movement distance is Lx and the movement speed is Vx or V (total movement speed), navigation control information can be generated according to the movement information, so as to control the sliding distance and sliding speed of the application interface sliding upward by the terminal device based on the navigation control information, and the sliding distance of the application interface sliding upward can be proportional to the movement distance Lx, and the sliding speed can be proportional to the movement speed (Vx or V). It can be seen that the application interface sliding control of the terminal device can be realized through the navigation control function of the ultrasonic fingerprint sensor.

[0121] It should be understood that the above examples are not intended to limit the embodiments of the present application, and are only used to facilitate understanding. The embodiments of the present application may also have more feasible control logics, which will not be described in detail here.

[0122] It should be understood that the above exemplary description of the control method provided in the first aspect of the embodiment of the present application is not intended to limit the embodiment of the present application in any way.

[0123] Next, combine Figure 7The flowchart shown in the figure illustrates the implementation process of an example scenario in which the control unit determines navigation control information when the ultrasonic fingerprint sensor in the embodiment of the present application operates in the navigation working mode. For example, it can be implemented by the control unit of the terminal device. Figure 7 As shown, first, the control unit of the terminal device can send a mode start instruction to the ultrasonic fingerprint sensor to enter the navigation working mode. The processing unit of the ultrasonic fingerprint sensor can determine that the target working mode is the navigation working mode according to the mode start instruction, and control the ultrasonic fingerprint sensor to enter the navigation working mode; then, the ultrasonic fingerprint sensor collects the ultrasonic echo signal reflected by the finger in real time to obtain ultrasonic echo data, and puts the ultrasonic echo data into the cache; the control unit obtains the ultrasonic echo data from the ultrasonic fingerprint sensor; then, the control unit calculates the navigation control information based on the ultrasonic echo data (the optional method can refer to the relevant content of the previous embodiment for understanding, determine the coordinates of the pressing center point position, and then determine the navigation control information, which will not be repeated here), and then the terminal device can be navigated based on the navigation control information; the control unit determines in real time whether to end the navigation detection. If not, the control unit reads the data in a loop and continues to obtain the ultrasonic echo data from the ultrasonic fingerprint sensor for processing to continue to calculate the navigation control information; if yes, the control unit sends a mode exit instruction to the ultrasonic fingerprint sensor to exit the navigation working mode, and the processing unit of the ultrasonic fingerprint sensor controls the ultrasonic fingerprint sensor to exit the navigation working mode and end the process. It should be understood that the above Figure 7 The exemplary description is not intended to limit the embodiments of the present application in any way.

[0124] In summary, the control scheme provided by the embodiment of the present application, on the one hand, can obtain the ultrasonic echo data obtained by the ultrasonic fingerprint sensor collecting the finger, and then determine the navigation control information based on the ultrasonic echo data, and then perform navigation control on the terminal device on which the ultrasonic fingerprint sensor is installed based on the navigation control information. Therefore, the technical scheme of the present application can effectively realize the navigation control function of the terminal device through the ultrasonic fingerprint sensor, so that the user can control and interact with the terminal device through the ultrasonic fingerprint sensor, thereby effectively improving the use experience of the ultrasonic fingerprint sensor and the terminal device; on the other hand, the ultrasonic fingerprint sensor is used in the present scheme to realize the fingerprint function and the navigation control function. Since the ultrasonic fingerprint sensor is used to realize the fingerprint function and the navigation control function through ultrasonic signals, and various environmental scenarios in daily use have little effect on the ultrasonic signal, compared with other types of fingerprint sensors, the ultrasonic fingerprint sensor is used to realize the fingerprint function and the navigation control function when the terminal device is used in multiple different environmental scenarios, which can reduce the restrictions of environmental factors on the user, thereby better maintaining the use effect and experience of the fingerprint function and the navigation control function of the terminal device.

[0125] Reference Figure 8 As shown, according to a second aspect of an embodiment of the present application, a control device 100 is provided, and the control device 100 includes:

[0126] An acquisition module 102 is used to obtain ultrasonic echo data acquired by an ultrasonic fingerprint sensor from a finger;

[0127] A determination module 104, configured to determine navigation control information based on the ultrasonic echo data;

[0128] The control module 106 is used to perform navigation control on the terminal device on which the ultrasonic fingerprint sensor is installed based on the navigation control information.

[0129] In some optional embodiments, the determination module 104 is specifically used to: obtain multiple ultrasonic echo data collected by the ultrasonic fingerprint sensor from the finger at multiple different times; determine multiple pressing position information of the finger in the detection area of ​​the ultrasonic fingerprint sensor at the multiple different times based on the multiple ultrasonic echo data; determine the navigation control information based on the multiple pressing position information obtained.

[0130] In some optional embodiments, the ultrasonic fingerprint sensor includes multiple ultrasonic sub-units, and the ultrasonic sub-units are respectively used to collect sub-ultrasonic echo data of fingers, and the ultrasonic echo data at any moment includes multiple sub-ultrasonic echo data collected by the multiple ultrasonic sub-units at that moment; the determination module 104 is specifically used to: for each ultrasonic echo data in the multiple ultrasonic echo data: according to the ultrasonic echo signal strength indicated by the multiple sub-ultrasonic echo data in the ultrasonic echo data, determine the echo intensity distribution information corresponding to the moment when the ultrasonic echo data was collected, and according to the echo intensity distribution information, determine the pressing center point position coordinates corresponding to the moment when the ultrasonic echo data was collected, wherein the echo intensity information is used to indicate the intensity distribution of ultrasonic echo signals received by ultrasonic sub-units at different positions; and determine the obtained multiple pressing center point position coordinates as the multiple pressing position information.

[0131] In some optional embodiments, the echo intensity distribution information is an echo intensity distribution map in image form, and the echo intensity distribution map includes multiple image areas corresponding to the multiple ultrasonic sub-units one by one, and the position arrangement relationship between the multiple image areas is determined based on the position arrangement relationship between the multiple ultrasonic sub-units; the determination module 104 is specifically used to: for each sub-ultrasonic echo data of the ultrasonic echo data, obtain the echo intensity distribution map to be processed, and according to the ultrasonic echo signal intensity indicated by the sub-ultrasonic echo data, assign image feature values ​​to the image areas corresponding to the target ultrasonic sub-units in the echo intensity map to be processed, and after each image area in the echo intensity map to be processed is assigned an image feature value, obtain an echo intensity distribution map corresponding to the moment when the ultrasonic echo data is collected; wherein the target ultrasonic sub-unit is the ultrasonic sub-unit that collects the sub-ultrasonic echo data, and the echo intensity distribution map to be processed is a blank echo intensity distribution map or a historical echo intensity distribution map.

[0132] In some optional embodiments, the determination module 104 is specifically used to determine the position coordinates of the pressing center point corresponding to the moment of collecting the ultrasonic echo data according to the coordinates of the image area with the maximum or minimum image characteristic value in the echo intensity distribution diagram in a preset image coordinate system.

[0133] In some optional embodiments, the determination module 104 is specifically used to: determine the movement information of the finger in the detection area of ​​the ultrasonic fingerprint sensor according to the multiple press center point position coordinates, wherein the movement information includes at least one of the movement direction information, the movement distance information, and the movement speed information; and determine the navigation control information according to the movement information.

[0134] In some optional embodiments, the control module 106 is specifically used to: based on the navigation control information, perform at least one of the following control methods on the terminal device: device volume increase or decrease control, screen brightness increase or decrease control, device camera focus control, device screen zoom control, page element zoom control, and application interface sliding control.

[0135] In some optional embodiments, the control method is the control of a software application of the terminal device.

[0136] In some optional embodiments, the ultrasonic fingerprint sensor includes at least one of a side ultrasonic fingerprint sensor, a back ultrasonic fingerprint sensor, and an under-screen ultrasonic fingerprint sensor.

[0137] The control device 100 and its optional embodiments of the second aspect in the embodiments of the present application have been described in detail in the aforementioned control method embodiment of the first aspect. Therefore, their relevant contents and beneficial effects can be understood by referring to the contents of the various optional embodiments of the above-mentioned method, and will not be repeated here.

[0138] According to a third aspect of an embodiment of the present application, there is provided an electronic device, comprising: a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other via the communication bus; the memory is used to store a computer program; and the processor is used to execute the control method described in the first aspect above by running the computer program stored in the memory.

[0139] Fig. 9 1000 is a block diagram of an optional electronic device in an embodiment of the present application. The present application embodiment does not limit the specific implementation of the electronic device 1000. Fig. 9 The electronic device 1000 provided in the embodiment of the present application includes: a processor 1002, a communication interface 1004, a memory 1006, and a communication bus 1008. Among them:

[0140] The processor 1002 , the communication interface 1004 , and the memory 1006 communicate with each other via a communication bus 1008 .

[0141] The communication interface 1004 is used to communicate with other electronic devices or servers.

[0142] The processor 1002 is used to execute the computer program 1010, and specifically can execute the relevant steps in any of the above-mentioned control method embodiments.

[0143] Specifically, the computer program 1010 may include program codes, which include computer operation instructions.

[0144] The processor 1002 may be a CPU, or a GPU (Graphic Processing Unit), or an ASIC (Application Specific Integrated Circuit), or one or more integrated circuits configured to implement the embodiments of the present application. The one or more processors included in the smart device may be processors of the same type, such as one or more CPUs; or may be processors of different types, such as one or more CPUs and one or more ASICs.

[0145] The memory 1006 is used to store the computer program 1010. The memory 1006 may include a high-speed RAM memory, and may also include a non-volatile memory (non-volatile memory), such as at least one disk memory.

[0146] The computer program 1010 can be used to enable the processor 1002 to execute the control method in the aforementioned first aspect embodiment.

[0147] The specific implementation of each step in the computer program 1010 can refer to the corresponding description of the corresponding steps and units in any of the control method embodiments of the first aspect, which will not be repeated here. Those skilled in the art can clearly understand that for the convenience and simplicity of description, the specific working process of the above-described devices and modules can refer to the corresponding process description in the above-mentioned method embodiments, which will not be repeated here.

[0148] The electronic device 1000 in the embodiment of the present application has been described in detail in the aforementioned control method embodiment, so its related contents and beneficial effects can be understood with reference to the aforementioned method embodiment and will not be described again here.

[0149] According to a fourth aspect of the embodiments of the present application, the embodiments of the present application further provide a computer storage medium on which a computer program is stored, and when the computer program is executed by a processor, the control method described in any one of the embodiments of the method of the first aspect is implemented. The computer storage medium includes, but is not limited to: a compact disc read-only memory (CD-ROM), a random access memory (RAM), a floppy disk, a hard disk or a magneto-optical disk, etc.

[0150] According to the fifth aspect of the embodiments of the present application, the embodiments of the present application also provide a computer program product, including a computer program, which, when executed by a processor, implements the control method described in any one of the embodiments of the first aspect above.

[0151] The control device 100 / electronic device 1000 / computer storage medium / computer program product embodiment in the embodiment of the present application has been described in detail in the aforementioned control method embodiment, so its related content and beneficial effects can be understood with reference to the above-mentioned method embodiment and will not be repeated here.

[0152] It should be understood that the dimensions of the various structures in the drawings of this embodiment are not necessarily drawn according to the actual proportions in order to facilitate the illustration of the structures.

[0153] In addition, it should be noted that the user-related information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to sample data used to train the model, data used for analysis, stored data, displayed data, etc.) involved in the embodiments of the present application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data need to comply with the relevant laws, regulations and standards of the relevant countries and regions, and provide corresponding operation entrances for users to choose to authorize or refuse.

[0154] It should be pointed out that, according to the needs of implementation, the various components / steps described in this embodiment can be split into more components / steps, or two or more components / steps or partial operations of components / steps can be combined into new components / steps to achieve the purpose of the embodiments of the present application.

[0155] The above-mentioned method according to the embodiment of the present application can be implemented in hardware, firmware, or implemented as software or computer code that can be stored in a recording medium (such as a CD-ROM, RAM, floppy disk, hard disk or magneto-optical disk), or implemented as a computer code originally stored in a remote recording medium or a non-temporary machine-readable medium downloaded through a network and stored in a local recording medium, so that the method described herein can be stored in such software processing on a recording medium using a general-purpose computer, a dedicated processor or programmable or dedicated hardware (such as an application-specific integrated circuit (ASIC) or a field programmable gate array (FPGA)). It can be understood that a computer, a processor, a microprocessor controller or programmable hardware includes a storage component (e.g., a random access memory (RAM), a read-only memory (ROM), a flash memory, etc.) that can store or receive software or computer code, and when the software or computer code is accessed and executed by a computer, a processor or hardware, the method described herein is implemented. In addition, when a general-purpose computer accesses the code for implementing the method shown here, the execution of the code converts the general-purpose computer into a dedicated computer for executing the method shown here.

[0156] Those of ordinary skill in the art will appreciate that the units and method steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for specific applications, but such implementation should not be considered to be beyond the scope of the embodiments of the present application.

[0157] The above implementation methods are only used to illustrate the embodiments of the present application, and are not limitations on the embodiments of the present application. Ordinary technicians in the relevant technical field can make various changes and modifications without departing from the spirit and scope of the embodiments of the present application. Therefore, all equivalent technical solutions also belong to the scope of the embodiments of the present application. The scope of patent protection of the embodiments of the present application should be limited by the claims.

Claims

1. A control method, comprising: Obtain ultrasonic echo data obtained by collecting the ultrasonic fingerprint sensor from the finger; Determining navigation control information based on the ultrasonic echo data; Based on the navigation control information, navigation control is performed on the terminal device on which the ultrasonic fingerprint sensor is installed.

2. The method according to claim 1, wherein: The determining of navigation control information based on the ultrasonic echo data includes: Acquire multiple ultrasonic echo data of the finger collected by the ultrasonic fingerprint sensor at multiple different times; Determine, according to the plurality of ultrasonic echo data, a plurality of pressing position information of the finger in the detection area of ​​the ultrasonic fingerprint sensor at the plurality of different moments; The navigation control information is determined according to the obtained multiple pressing position information.

3. The method according to claim 2, wherein: The ultrasonic fingerprint sensor includes a plurality of ultrasonic sub-units, each of which is used to collect sub-ultrasonic echo data of a finger, and the ultrasonic echo data at any moment includes a plurality of sub-ultrasonic echo data collected by the plurality of ultrasonic sub-units at that moment; The determining, according to the plurality of ultrasonic echo data, a plurality of pressing position information of the finger in the detection area of ​​the ultrasonic fingerprint sensor at the plurality of different moments comprises: For each ultrasonic echo data in the plurality of ultrasonic echo data: determining echo intensity distribution information corresponding to the moment when the ultrasonic echo data is collected according to the ultrasonic echo signal strengths indicated by the plurality of sub-ultrasonic echo data in the ultrasonic echo data, and determining the position coordinates of the pressing center point corresponding to the moment when the ultrasonic echo data is collected according to the echo intensity distribution information, wherein the echo intensity information is used to indicate the intensity distribution of ultrasonic echo signals received by ultrasonic sub-units at different positions; The obtained multiple pressing center point position coordinates are determined as the multiple pressing position information.

4. The method according to claim 3, wherein: The echo intensity distribution information is an echo intensity distribution diagram in the form of an image, the echo intensity distribution diagram includes a plurality of image areas corresponding to the plurality of ultrasonic sub-units one by one, and the position arrangement relationship between the plurality of image areas is determined based on the position arrangement relationship between the plurality of ultrasonic sub-units; The step of determining the echo intensity distribution information corresponding to the time when the ultrasonic echo data is collected according to the ultrasonic echo signal strength indicated by the plurality of sub-ultrasonic echo data in the ultrasonic echo data comprises: For each sub-ultrasonic echo data of the ultrasonic echo data, an echo intensity distribution map to be processed is obtained, and according to the ultrasonic echo signal intensity indicated by the sub-ultrasonic echo data, an image feature value is assigned to an image area corresponding to a target ultrasonic subunit in the echo intensity map to be processed, and after each image area in the echo intensity map to be processed is assigned an image feature value, an echo intensity distribution map corresponding to the moment when the ultrasonic echo data is collected is obtained; The target ultrasonic subunit is an ultrasonic subunit that collects the sub-ultrasonic echo data, and the echo intensity distribution diagram to be processed is a blank echo intensity distribution diagram or a historical echo intensity distribution diagram.

5. The method according to claim 4, wherein: The step of determining the position coordinates of the pressing center point corresponding to the moment of collecting the ultrasonic echo data according to the echo intensity distribution information includes: The coordinates of the pressing center point position corresponding to the moment of collecting the ultrasonic echo data are determined according to the coordinates of the image area with the maximum or minimum image characteristic value in the echo intensity distribution diagram in the preset image coordinate system.

6. The method according to claim 3, wherein: The determining the navigation control information according to the obtained multiple pressing position information includes: Determine, according to the multiple pressing center point position coordinates, movement information of the finger in the detection area of ​​the ultrasonic fingerprint sensor, wherein the movement information includes at least one of movement direction information, movement distance information, and movement speed information; The navigation control information is determined according to the movement information.

7. The method according to any one of claims 1 to 6, wherein: The step of performing navigation control on a terminal device on which the ultrasonic fingerprint sensor is installed based on the navigation control information includes: Based on the navigation control information, at least one of the following control methods is performed on the terminal device: device volume increase or decrease control, screen brightness increase or decrease control, device camera focus control, device screen zoom control, page element zoom control, and application interface sliding control.

8. The method according to claim 7, wherein: The control method is the control of the software application of the terminal device.

9. The method according to any one of claims 1 to 6, wherein: The ultrasonic fingerprint sensor includes at least one of a side ultrasonic fingerprint sensor, a back ultrasonic fingerprint sensor and an under-screen ultrasonic fingerprint sensor.

10. A control device comprising: An acquisition module is used to obtain ultrasonic echo data collected by an ultrasonic fingerprint sensor from a finger; A determination module, configured to determine navigation control information based on the ultrasonic echo data; A control module is used to perform navigation control on the terminal device on which the ultrasonic fingerprint sensor is installed based on the navigation control information.

11. An electronic device, comprising: A processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other via the communication bus; The memory is used to store computer programs; The processor is configured to execute the method according to any one of claims 1 to 9 by running the computer program stored in the memory.

12. A computer storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the method according to any one of claims 1 to 9.

13. A computer program product, comprising a computer program, which, when executed by a processor, implements the method according to any one of claims 1 to 9.

Citation Information

Patent Citations

  • Direction navigation method and device based on fingerprint recognition, and fingerprint image sensor

    CN107563262A

  • Control execution method and device, storage medium and electronic device

    CN108255397A

  • Electronic device control method, electronic device and computer readable storage medium

    CN108595098A

  • Ultrasonic fingerprint identification method and related equipment

    CN110287919A

  • Electronic equipment and control method thereof

    CN110472399A