Ultrasonic sensing

Abstract

In one example, a method includes receiving an indication that an object is within a distance of an ultrasonic transducer array, configuring a subset of the ultrasonic transducer array to perform an ultrasonic sensing operation on the object based on the indication, obtaining an output of the ultrasonic sensing operation from the subset of the ultrasonic transducer array, and performing an action based on the output of the ultrasonic sensing operation.

Description

Technical Field

[0001] This disclosure relates to ultrasonic sensing, and more particularly to techniques for performing power-efficient ultrasonic sensing.

[0002] Related technical descriptions

[0003] Electronic devices (such as smartphones, tablets, or “Internet of Things” (IoT) devices and appliances) can be made more powerful by being equipped with sensors to provide convenient ways to input information. One example of such sensors is biometric sensors, such as fingerprint sensors, which allow electronic devices to perform automated authentication of users without requiring users to manually enter passwords, usernames, or other credential information.

[0004] Biometric sensors can be implemented based on an ultrasonic sensor system that includes an ultrasonic transmitter and an ultrasonic receiver. The ultrasonic transmitter sends ultrasonic waves toward the finger. Fingerprint ridges, valleys between adjacent ridges, etc., can reflect ultrasonic waves of varying intensities back to the ultrasonic sensor. The distribution of reflected signal intensity can be obtained to generate a fingerprint image. This image can then be compared with a reference fingerprint image of the user for user authentication.

[0005] However, ultrasonic sensor systems can be power inefficient, especially when integrated with the displays of electronic devices. Therefore, improved ultrasonic sensing technologies that offer higher power efficiency are desirable.

[0006] Brief Overview

[0007] According to this disclosure, an example method includes: receiving an indication that an object is within a distance of an array of ultrasonic transducers. The method further includes: configuring a subset of the ultrasonic transducer array to perform an ultrasonic sensing operation on the object based on the indication. The method further includes: obtaining an output of the ultrasonic sensing operation from the subset of the ultrasonic transducer array. The method further includes: performing an action based on the output of the ultrasonic sensing operation.

[0008] According to this disclosure, an example apparatus includes a memory storing a set of instructions. The apparatus further includes a hardware processor configured to execute the set of instructions to: receive an indication that an object is within a distance of an array of ultrasonic transducers; the hardware processor is further configured to execute the set of instructions to: configure a subset of the ultrasonic transducer array to perform an ultrasonic sensing operation on the object based on the indication; the hardware processor is further configured to execute the set of instructions to: obtain the output of the ultrasonic sensing operation from the subset of the ultrasonic transducer array; and the hardware processor is further configured to execute the set of instructions to: perform an action based on the output of the ultrasonic sensing operation.

[0009] An example non-transient computer-readable medium stores an instruction set that, when executed by a hardware processor, causes the processor to: receive an indication that an object is within a distance of an array of ultrasonic transducers. The instruction set, when executed by the hardware processor, further causes the processor to: configure a subset of the ultrasonic transducer array to perform an ultrasonic sensing operation on the object based on the indication. The instruction set, when executed by the hardware processor, further causes the processor to: obtain the output of the ultrasonic sensing operation from the subset of the ultrasonic transducer array. The instruction set, when executed by the hardware processor, further causes the processor to: perform an action based on the output of the ultrasonic sensing operation.

[0010] According to this disclosure, an example apparatus includes: means for receiving an indication that an object is within a distance of an ultrasonic transducer array. The apparatus further includes: means for configuring a subset of the ultrasonic transducer array to perform an ultrasonic sensing operation on the object based on the indication. The apparatus further includes: means for obtaining an output of the ultrasonic sensing operation from the subset of the ultrasonic transducer array. The apparatus further includes: means for performing an action based on the output of the ultrasonic sensing operation. Brief description of the attached diagram

[0012] Details of one or more implementations of the subject matter described in this specification are set forth in this disclosure and the accompanying drawings. Other features, aspects, and advantages will become apparent from a reading of this disclosure. Note that the relative dimensions of the drawings and other illustrations in this disclosure are not drawn to scale. The sizes, thicknesses, arrangements, materials, etc., shown and described in this disclosure are merely illustrative and should not be construed as limiting. Similar reference numerals and designations in the various drawings indicate similar elements.

[0013] Figure 1A , Figure 1B and Figure 1C Examples of some implemented ultrasonic sensing systems and their applications are explained;

[0014] Figure 2A and Figure 2B An ultrasonic sensing system according to various examples of this disclosure and another example of focused ultrasonic sensing operation performed by the sensing system are explained;

[0015] Figure 3A , Figure 3B , Figure 3C , Figure 3D and Figure 3E Example techniques for performing focused ultrasound sensing operations according to various examples of this disclosure are explained;

[0016] Figure 4Additional example techniques for performing focused ultrasound sensing operations according to various examples of this disclosure are explained;

[0017] Figure 5 Examples of ultrasonic controllers that can implement at least some of the disclosed technologies according to various examples of this disclosure are explained;

[0018] Figure 6 Example methods for operating an ultrasonic sensing system according to various examples of this disclosure are explained; and

[0019] Figure 7 Examples of computing systems that can implement the various examples of this disclosure are explained.

[0020] Detailed description

[0021] Various aspects of this disclosure relate to improving the power efficiency of ultrasonic sensor systems integrated with displays. Traditionally, the sensor area of ​​an ultrasonic sensor system is separated from the display area of ​​an electronic device. To reduce footprint and / or increase display size, ultrasonic sensor systems may be integrated with displays to form part of a touch display interface. The ultrasonic sensor system can emit ultrasonic waves across the entire display area to detect and image a user's finger. However, such an arrangement is often power inefficient because the user's finger only overlaps a small portion of the display and reflects only a small fraction of the ultrasonic waves emitted by the ultrasonic sensor system, while a significant amount of power is wasted in generating and emitting ultrasonic waves that are not reflected by the user's finger and do not participate in the imaging of the user's fingerprint.

[0022] According to various aspects of this disclosure, a subset of the ultrasonic transducer array is used to perform ultrasonic sensing operations based on indications that an object (such as a user's finger) is near the ultrasonic transducer array. For example, this indication may correspond to an object being within a specific distance of the ultrasonic transducer array and may be received, for example, from a capacitive sensor module. One or more ultrasonic transducers located within the array but not part of the subset of ultrasonic transducers may be disabled or operated at a reduced power level, thereby reducing the overall energy consumption of the ultrasonic sensor system.

[0023] The following description is directed to certain implementations in order to illustrate the innovative aspects of this disclosure. However, those skilled in the art will readily recognize that the teachings herein can be applied in many different ways. The described implementations can be implemented in any device, apparatus, or system including millimeter-band communication capabilities. Furthermore, it is contemplated that the described implementations can be included in or associated with a variety of electronic devices, such as, but not limited to: mobile phones, Internet-enabled multimedia cellular phones, mobile TV receivers, wireless devices, smartphones, smart cards, wearable devices (such as wristbands, armbands, wrist straps, rings, headbands, and patches), Bluetooth... Devices, Personal Data Assistants (PDAs), Wireless Email Receivers, Handheld or Portable Computers, Netbooks, Notebooks, Smartbooks, Tablets, Printers, Copiers, Scanners, Fax Equipment, Global Positioning System (GPS) Receivers / Navigators, Cameras, Digital Multimedia Players (such as MP3 Players), Camcorders, Game Consoles, Wristwatches, Clocks, Calculators, Television Monitors, Flat Panel Displays, Electronic Reading Devices (e.g., E-readers), Mobile Health Devices, Computer Monitors, Automatic Displays (including odometer and speedometer displays), Cockpit Controls and / or Displays, Steering Wheels Camera visual displays (such as displays for rearview cameras in vehicles), electronic photographs, electronic billboards or signs, projectors, building structures, microwave ovens, refrigerators, stereo systems, cassette recorders or players, DVD players, CD players, VCRs, radios, portable storage chips, washing machines, dryers, washer / dryer systems, automated teller machines (ATMs), parking timers, packages (such as in electromechanical systems (EMS) applications, including microelectromechanical systems (MEMS) applications, along with non-EMS applications), aesthetic structures (such as image displays on a piece of jewelry or clothing), and various EMS devices. The teachings herein can also be applied to applications such as, but not limited to, electronic switching devices, radio frequency filters, sensors, accelerometers, gyroscopes, motion sensing devices, magnetometers, inertial components for consumer electronics devices, components for consumer electronics products, varactor tubes, liquid crystal devices, electrophoresis equipment, drive schemes, manufacturing processes, and electronic test equipment. Therefore, these teachings are not intended to be limited to the implementations depicted in the figures, but have a broad applicability as will be apparent to those skilled in the art.

[0024] Details of one or more implementations of the subject matter described in this specification are set forth in this disclosure (including the description and claims herein and the accompanying drawings). Other features, aspects, and advantages will become apparent from a reading of this disclosure. Note that the relative dimensions of the drawings and other illustrations in this disclosure are not drawn to scale. The sizes, thicknesses, arrangements, materials, etc., shown and described in this disclosure are merely illustrative and should not be construed as limiting.

[0025] The systems, methods, and apparatus disclosed herein each have several innovative aspects, and no single aspect is solely responsible for the desired properties disclosed herein.

[0026] Figure 1A The example ultrasonic sensing system 100 was explained. Figure 1A The left figure illustrates a perspective view of the ultrasonic sensing system 100, while Figure 1BThe right figure illustrates a cross-sectional side view of the ultrasonic sensing system. The ultrasonic sensing system 100 may include an ultrasonic transducer 102 superimposed on a substrate 104, both the transducer 102 and the substrate 104 being located below a pressure plate (e.g., a "cover plate" or "cover glass") 106 to form a stack along an axis (e.g., the z-axis) perpendicular to the plane (e.g., the xy-plane) of the pressure plate 106. The ultrasonic transducer 102 may include both an ultrasonic transmitter 108 and an ultrasonic receiver 110.

[0027] The ultrasonic transmitter 108 can be configured to generate ultrasonic waves and emit them toward the pressure plate 106, and in the illustrated implementation, to emit ultrasonic waves toward a human finger portion 112 located on the upper surface of the pressure plate 106. In some examples, the ultrasonic transmitter 108 can be configured to generate ultrasonic plane waves and emit them toward the pressure plate 105. The ultrasonic transmitter 108 may include a piezoelectric material to convert electrical signals provided by the controller of the ultrasonic sensing system into a continuous or pulsed sequence of ultrasonic plane waves at a scanning frequency. In some implementations, such as Figure 1A As shown, the ultrasonic transmitter 108 includes a piezoelectric material layer, for example, such as polyvinylidene fluoride (PVDF) or a PVDF copolymer (such as PVDF-TrFE). In some examples, other piezoelectric materials, such as aluminum nitride (AlN) or lead zirconate titanate (PZT), may be used in the ultrasonic transmitter 108 and / or the ultrasonic receiver 110. In some implementations, the ultrasonic transmitter 108 and / or the ultrasonic receiver 110 may additionally or alternatively include a capacitive ultrasonic device (such as a capacitive microprocessor ultrasonic transducer (CMUT)) or a piezoelectric ultrasonic device (such as a piezoelectric microprocessor ultrasonic transducer (PMUT, also referred to as a "piezoelectric microprocessor ultrasonic transducer")).

[0028] Additionally, the ultrasound receiver 110 can be configured to detect ultrasound reflections 114 caused by the interaction of ultrasound waves emitted by the ultrasound transmitter 108 with the ridges 116 and valleys 118 of a fingerprint defining the portion 112 of the finger being scanned. In some examples, such as Figure 1A and Figure 1BAs shown, an ultrasonic transmitter 108 may be located between a pressure plate 106 and an ultrasonic receiver 110, while in some examples, the ultrasonic receiver 110 may be located between the pressure plate 106 and the ultrasonic transmitter 108. In some examples, the ultrasonic receiver 110 may include a second piezoelectric layer different from the piezoelectric layer of the ultrasonic transmitter 108. For example, the piezoelectric material of the ultrasonic receiver 110 may be any suitable piezoelectric material, such as, for example, a PVDF layer or a PVDF-TrFE copolymer. The piezoelectric layer of the ultrasonic receiver 110 can convert vibrations caused by ultrasonic reflection into an electrical output signal. In some implementations, the ultrasonic receiver 110 further includes a thin-film transistor (TFT) layer. In some such implementations, the TFT layer may include circuitry configured to amplify or buffer the electrical output signal generated by the piezoelectric layer of the ultrasonic receiver 110.

[0029] Ridges 116 and valleys 118 can reflect ultrasonic waves of different intensities back to the ultrasonic sensor, which can generate a signal intensity distribution of ultrasonic reflections 114. TFT circuitry can generate electrical output signals that reflect this distribution, and these electrical output signals can be used to create a fingerprint image represented by ridges 116 and valleys 118.

[0030] The ultrasonic sensing system 100 can be integrated with electronic devices (such as smartphones, tablets, etc.) to provide an input interface. In some examples, the ultrasonic sensing system 100 can be configured as a biometric sensor system to collect biometric information (such as fingerprint information) to authenticate users seeking access to certain functions of the electronic device. The collection of fingerprint information can be performed as an alternative (or supplement) to requiring users to manually enter passwords or other credential information. For example, see also... Figure 1A The ultrasonic sensing system 100 can perform ultrasonic sensing operations to capture a fingerprint image of a user seeking access to an electronic device. This image can then be compared with a reference fingerprint image to authenticate the user. After user authentication, access to those functions of the electronic device can subsequently be granted to the user.

[0031] To reduce footprint and / or increase display size of electronic devices, the ultrasonic sensor system 100 may integrate a display to form a touch display interface. Figure 1B An example of an electronic device 120 with a touch display interface 122 featuring an integrated ultrasonic sensor system 100 is illustrated. The left figure illustrates a top view of the electronic device 120, while the right figure illustrates a perspective view of the display interface 122. Figure 1BAs shown, the touch display interface 122 may include a display screen 124 (which may be part of or include the pressure plate 106) and an ultrasonic transducer array 126 (such as ultrasonic transducers 126a and 126b) (which is part of the ultrasonic sensing system 100). The ultrasonic transducer array 126 may be arranged as a two-dimensional grid below the entire display screen 124.

[0032] Reference Figure 1B As shown in the right figure, a display screen 124, a display pixel circuit layer 128, and an ultrasonic transducer array 126 can be stacked to form a touch display interface 122. The display screen 124 can transmit content output by the display pixel circuit 128. Additionally, each ultrasonic transducer in the ultrasonic transducer array 126 can emit ultrasonic waves (such as ultrasonic waves 130a, 130b, 130c, 130d, 130e, 130f, 130g, etc.) through the display screen 124, so that ultrasonic waves 130 are emitted across the entire display area to detect and image the user's finger. Figure 1B In the display screen 124, a finger portion 112 with ridges 116 and valleys 118 is located above a region 132 that overlaps with one or more ultrasonic transducers 126 (which can emit ultrasonic waves 130b). The finger portion 112 can reflect the ultrasonic waves 130b back to the transducer 126b as reflected waves 114, which can be detected by the transducer 126b.

[0033] Figure 1C The example application of the touch display interface 122 is explained. Figure 1C In this configuration, electronic device 120 may initially be in a locked state, where touch display interface 122 displays a lock screen showing, for example, the current time and date. The user can place his / her finger anywhere on display screen 124 (such as area 132). The one or more ultrasonic transducers 126 located beneath area 132 can detect and image a fingerprint of the finger portion 112. After authenticating the user based on the fingerprint image, electronic device 120 may transition to an active state, where touch display interface 122 displays an active screen including icon 134, which the user can select to access one or more applications.

[0034] Figures 1A-1C The arrangement provides a touch display interface with an integrated ultrasonic sensing system, which eliminates the need for a separate ultrasonic sensing interface and thus reduces the footprint and / or increases the available display size of the electronic device 120. However... Figures 1A-1C The ultrasonic sensing system 100 may be power inefficient. Specifically, refer to... Figure 1BThe finger portion 112 overlaps only with a small portion of the display 124 (e.g., region 132) and reflects only a small portion of the ultrasonic waves 130 emitted by the ultrasonic transducer array 126 (e.g., ultrasonic wave 130b), while a large amount of power is wasted in generating and emitting ultrasonic waves that are not reflected by the user's finger and do not participate in the imaging of the user's fingerprint (e.g., ultrasonic waves 130a and 130c-h).

[0035] Figure 2A and Figure 2B The text describes a touch display interface 222 that can provide improved power efficiency. (For example...) Figure 2A As shown, the touch display interface 222 may include a display screen 124 (which may be part of or include the pressure plate 106) and an array of ultrasonic transducers 226. The array of ultrasonic transducers 226 may be arranged in a two-dimensional grid beneath the entire display screen 124. Furthermore, each ultrasonic transducer in the array of ultrasonic transducers 226 can be individually addressed and controlled. Specifically, see reference... Figure 2B The ultrasonic transducer 226 array may include: a set of row buses 230 (e.g., 230a, 230b, 230c, 230n, etc.), each row bus 230 being driven by a row selector 232; and a set of column buses 240 (e.g., 240a, 240b, 240c, 240m, etc.), each column bus 240 being driven by a column selector 242. Each ultrasonic transducer may be coupled to both the row bus 230 and the column bus 240. A subset of the ultrasonic transducer 226 array can be selected to emit ultrasonic waves and detect reflected ultrasonic waves by a combination of row selection signals provided by the row selector 232 on the row bus 230 and column selection signals provided by the column selector 242 on the column bus 240. For example, by transmitting row selection signals on row buses 240b and 240c and column selection signals on column buses 230b and 230c, a subset of the ultrasonic transducer 226 array, including ultrasonic transducers 226a-226d, can be selected.

[0036] Based on the subset of the ultrasonic transducer array 226 located in the area of ​​the display 124 overlapping with the finger portion 112, those ultrasonic transducers can be selected to perform a focused detection operation. For example, referring again... Figure 2A Only a subset of the ultrasonic transducers 226 located below region 132 (the area where the finger portion 112 overlaps / contacts with the display screen 124) are activated to emit ultrasonic waves 130 toward the finger portion 112. Figure 2AIn this configuration, ultrasonic transducers 226a-226d can be enabled because they are located in region 132. Conversely, the remaining ultrasonic transducers 226 outside region 132 can be disabled or otherwise operated at a lower power level than ultrasonic transducers 226a-226d. For example, the transmitter of each of the remaining ultrasonic transducers 226 outside region 132 can be disabled to prevent the emission of ultrasonic waves, or it can be operated to emit ultrasonic waves with reduced signal strength.

[0037] use Figure 2A In this arrangement, only a subset of the ultrasonic transducer array 226 is activated to perform focused sensing operations. Such an arrangement can eliminate or at least reduce the generation and emission of ultrasonic waves that are not reflected by the user's finger and do not participate in the imaging of the user's fingerprint (e.g., Figure 1C The power wasted during ultrasonic waves (130a and 130c-h) can be reduced. As a result, the power efficiency of ultrasonic sensing operations can be improved.

[0038] Figures 3A-3E An example technique for identifying a subset of the ultrasonic transducer array 226 to perform focused sensing operations is explained. For example... Figure 3A As shown, the touch display interface 222 may include an array of capacitive sensors 302, which may be formed as a stack having a display screen 124, a display pixel circuit layer 128, and an array of ultrasonic transducers 226. The array of capacitive sensors 302 may be arranged as a two-dimensional grid beneath the entire display screen 124 and the entire array of ultrasonic transducers 226. Each capacitive sensor 302 may measure the capacitance of the display screen 124 over an area overlapping with one or more ultrasonic transducers 226 (e.g., in the xy plane). For example, in Figure 3A In this embodiment, capacitor sensor 302f can measure the capacitance over the region 304 of display screen 124 that overlaps with ultrasonic transducer 226f. In some other examples, each capacitor sensor can measure the capacitance over the region covering multiple ultrasonic transducers (e.g., rows or columns of ultrasonic transducers 226).

[0039] As will be described below, depending on the capacitance measurement operating mode, the measured capacitance of the area increases or decreases as an object approaches the area. The extent of the change in capacitance measured from the array of capacitive sensors 302 can then be used to determine the proximity of an object (e.g., finger portion 112) to the touch display interface 222 (e.g., at a threshold distance) and to determine the area of ​​the display screen 124 that overlaps with the object.

[0040] Specifically, refer to Figure 3BThe array of capacitive sensors 302 can output a set of capacitance measurements, such as an array of capacitance measurements 312, where each capacitance measurement is output by a capacitive sensor in the array of capacitive sensors 302. When an object is within a predetermined distance from region 314 of the display screen 124, a subset of the capacitive sensors 302 below region 314 can output capacitance C1, while each of the remaining capacitive sensors 302 in the array of capacitive sensors 302 outputs capacitance C0. Capacitance C0 may be the initial capacitance measured by the subset of capacitive sensors 302 below region 314 when the object is outside a threshold distance from the touch display interface 222, while capacitance C1 may be greater than or less than capacitance C0. The difference between capacitances C0 and C1 can represent the degree of change in capacitance measured by the subset of capacitive sensors 302 below region 314. A determination that the object is within a threshold distance from the touch display interface 222 can be made based, for example, the difference between capacitances C0 and C1 exceeding a threshold. Furthermore, based on the capacitance change within region 314 (between capacitances C0 and C1) exceeding a threshold, it can be determined that an object (e.g., finger portion 112) overlaps with region 314, and a subset of the ultrasonic transducer 226 array below region 314 can be enabled to perform ultrasonic sensing operations.

[0041] Figure 3C , Figure 3D and Figure 3E An example of the internal components of the capacitive sensor 302 array is explained. For example... Figure 3C As shown, the capacitive sensor 302 array includes a first set of electrodes arranged along a first axis (e.g., the x-axis) and configured as column electrodes 320 (e.g., electrodes 320a, 320b, 320n, etc.), and a second set of electrodes arranged along a second axis (e.g., the y-axis) and configured as row electrodes 322 (e.g., electrodes 322a, 322b, 322m, etc.). The row electrodes 322 may be superimposed on the column electrodes 320, and the two sets of electrodes may be separated by an electrical insulator. Each electrode may form a capacitive sensor. These electrodes may form a two-dimensional grid located beneath the entire display screen 124. The intersections between row electrodes and column electrodes on the two-dimensional grid (including intersections 324a, 324b, and 324n between row electrode 322a and each of column electrodes 320a, 320b, and 320n; intersections 326a, 326b, and 326n between row electrode 322b and each of column electrodes 320a, 320b, and 320n; and intersections 328a, 328b, and 328n between row electrode 322m and each of column electrodes 320a, 320b, and 320n) can define different positions on the display screen 124.

[0042] Additionally, column electrode 320 is connected to transmitting circuit 340, while row electrode 332 is connected to receiving circuit 342. As will be described below, depending on the capacitance measurement operation mode, transmitting circuit 340 and receiving circuit 342 can use different signals to drive the row and column electrodes to measure the absolute capacitance of each electrode or the mutual capacitance between each row electrode and each column electrode at the intersection. In both cases, the capacitance at different regions of the two-dimensional grid formed by the row and column electrodes can be measured, and capacitance changes in a specific region can be detected when an object is near that region.

[0043] Figure 3D An example of the first capacitance measurement operation mode was explained, in which the absolute capacitance of each electrode was measured. For example... Figure 3D As shown, each row electrode and each column electrode may have an initial capacitance C0 relative to ground. When an object (e.g., finger portion 112) is near a particular electrode, an additional capacitance to ground is formed between the object and the electrode, which increases the initial capacitance C0 of that electrode. The increased capacitance depends on the distance between the object and the electrode (the shorter the distance, the greater the increase in capacitance, and vice versa). For example, in Figure 3D In this configuration, the finger portion 112 is located near the row electrode 322b and the column electrode 320b. As a result, each electrode can have an increased capacitance to ground, C0+ΔC.

[0044] To perform the first capacitance measurement operating mode, the transmitting circuit 340 can connect the transmitting column electrodes to ground, while the receiving circuit 342 can connect the row electrodes to ground. The scanning circuit can sequentially scan through each row and column electrode, such as by connecting the electrodes to an AC source (e.g., AC sources 350 and 352), and measure the amount of current on each electrode, which indicates the capacitance (relative to ground) of each electrode. In some examples, the scanning circuit can operate in a low-power mode and only scan through each row electrode. When the finger portion 112 approaches one or more electrodes, the capacitance of those electrodes increases, which is reflected in the increased current flowing through those electrodes.

[0045] Table 360 ​​illustrates an example of the scan results. As shown in Table 360, row electrodes 1 and 2, and column electrodes 2 and 3, have a measured absolute capacitance C1, while the remaining electrodes have an initial absolute capacitance C0. If the difference between capacitances C0 and C1 exceeds a threshold (which indicates that the object is within a threshold distance from row electrodes 1 and 2, and column electrodes 2 and 3), a determination can be made regarding the object's proximity to the region defined by the intersection of electrode row 1 with each of column electrodes 2 and 3, and between electrode row 2 with one of column electrodes 2 and 3. A subset of ultrasonic transducers 226 overlapping this region can then be activated to perform ultrasonic sensing operations on the object.

[0046] Figure 3E An example of a second capacitance measurement operation mode is explained, in which the mutual capacitance between each row electrode and each column electrode at the intersection is measured. In the second capacitance measurement operation mode, each row electrode and each column electrode can be connected to a voltage source to generate an electric field at the intersection between the row electrode and the column electrode. For example, as... Figure 3E As shown, row electrode 322b can be connected to voltage source 362 to conduct a first voltage, while column electrode 320b can be connected to voltage source 363 to conduct a second voltage, and an electric field 364 can be generated at the intersection 326b between the first and second voltages. This electric field can also set the initial mutual capacitance C0 between row electrode 322b and column electrode 320b at the intersection 326b. When an object (e.g., finger portion 112) is near a particular intersection, the object may interrupt / interfere with the electric field between these electrodes at that intersection, and the mutual capacitance at that intersection may become reduced. The reduction in capacitance also depends on the distance between the object and the electrodes (the shorter the distance, the greater the electric field blockage and the greater the capacitance reduction, and vice versa). For example, in Figure 3D In the middle, the finger part 112 is near the intersection 326b, and the mutual capacitance can be changed to C0-ΔC.

[0047] To perform the second capacitance measurement operation mode, the transmitting circuit 340 can connect the transmitting column electrodes to a first set of voltage sources (e.g., voltage source 362), while the receiving circuit 342 can connect the row electrodes to a second set of voltage sources (e.g., voltage source 363, which may include ground). The scanning circuit can, for example, connect the electrodes to an AC source (such as...). Figure 3D AC sources 350 and 352 are used to scan through each pair of intersecting row and column electrodes and measure the current on each electrode. This current measures the capacitance (relative to ground) of each electrode, which is half the mutual capacitance between these electrodes at the intersection point. As the finger portion 112 approaches the intersection point, the mutual capacitance at that point decreases, which is reflected in the increase in the current flowing through those electrodes.

[0048] Table 370 illustrates an example of the scan results. As shown in Table 370, the first intersection between row 0 and column 1, and the second intersection between row 0 and column 2, may have a reduced mutual capacitance C1, while the remaining intersections have an initial mutual capacitance C0. Based on Table 370, a determination can be made about the object in the vicinity of the first and second intersections. A subset of ultrasonic transducers 226 overlapping with those intersections can then be enabled to perform ultrasonic sensing operations on that object.

[0049] Figure 3EThe mutual capacitance measurement operation allows for the measurement of capacitance changes at individual intersection points, which allows for the detection of multiple objects (e.g., multiple fingers) across multiple discrete areas of display screen 124. This arrangement, in turn, allows a subset of multiple ultrasonic transducers 226 beneath these discrete areas to perform ultrasonic sensing operations on these multiple objects. Figure 3E Mutual capacitance measurements in [the context of] [the system] typically use more power (e.g., compared to [other methods]). Figure 3D In absolute capacitance measurement operations, the electrodes are connected to a voltage source to generate an electric field. Therefore, in cases where only a single object needs to be detected (e.g., a single finger portion to provide a single fingerprint), Figure 3D The absolute capacitance measurement operation can be used to detect the object, and to identify a subset of individual ultrasonic transducers 226 under a single area of ​​display screen 124 to perform ultrasonic sensing operations.

[0050] In some examples, as a supplement or alternative to the output from the array of capacitive sensors 302, a prediction can be made about which area of ​​the display screen 124 is being touched or operated by the user based on the operating state of the electronic device 120. A subset of the ultrasonic transducer array 226 below the predicted area can then be enabled.

[0051] Figure 4 An example technique for predicting whether an area on display 124 will be touched or manipulated by a user is explained. For example... Figure 4 As shown on the left, electronic device 120 may include a button 402 that, when pressed by a user, wakes up electronic device 120 and causes display screen 124 to display a lock screen. Upon receiving indication that button 402 has been pressed, a prediction can be made regarding whether the user is touching or operating within area 404 of display screen 124. This prediction may be based on, for example, the user's history of operating electronic device 120, which may indicate that the user frequently touches or gestures in touch area 404 when the lock screen is displayed. Based on this prediction, a subset of the ultrasonic transducer array 226 below area 404 can then be enabled to detect the user's finger portion, while the remaining ultrasonic transducers 226 outside area 404 can be disabled or operated in a low-power state.

[0052] In some examples, this prediction can also be made solely based on the fact that content is being displayed. For example, such as Figure 4As shown on the right, electronic device 120 can display multiple icons, each associated with an application or specific function of electronic device 120, including icon 406. Each icon is activated by a user by touching an area of ​​the display screen surrounding the icon (such as area 408 surrounding icon 406). Based on the display of the multiple icons by electronic device 120, a subset of the ultrasonic transducer array 226 under area 408 can then be enabled to detect the user's finger portion. In some examples, a subset of the ultrasonic transducer array 226 under each area surrounding the icon can be enabled, but operates at different power states. The subset of ultrasonic transducers 226 under the area surrounding the icon most likely to be touched by the user (e.g., based on the user's usage history, current time / date, etc.) can operate at the highest power state.

[0053] Figure 5 An example ultrasonic transducer controller 500 that can implement the techniques described above has been explained. In some examples, the ultrasonic transducer controller 500 may be part of an application processor and coupled to an array of ultrasonic transducers 226. The ultrasonic transducer controller 500 includes a transmit control module 502 and a receive signal processing module 504. The transmit control module 502 may determine a subset of the array of ultrasonic transducers 226 to be enabled to perform focused ultrasonic sensing operations on an object. Based on this selection, the transmit control module 502 may transmit a signal 506 (which may include row selection and column selection signals oriented toward row selector 232 and column selector 242) to enable the selected subset of ultrasonic transducers 226 to emit ultrasonic waves. The receive signal processing module 504 may receive a signal 508 indicating the distribution of reflected ultrasonic waves detected by the selected subset of ultrasonic transducers 226. Based on this distribution, an image of the object (e.g., a fingerprint image) may be created.

[0054] In some examples, the ultrasonic transducer controller 500 may be coupled to a capacitive sensor module 512, which includes an array of capacitive sensors 302 and a capacitive sensor controller 514, wherein the array of capacitive sensors 302 and the array of ultrasonic transducers 226 are stacked as part of a touch display interface 222, such as... Figure 3A As shown in the diagram, the capacitive sensor controller 514 can track the capacitance measured by the array of capacitive sensors 302 and detect the presence of an object near the array of capacitive sensors 302 based on changes in capacitance measured by at least one capacitive sensor (e.g., the absolute capacitance of a particular row electrode, the absolute capacitance of a particular column electrode, the mutual capacitance at a particular intersection between row and column electrodes, etc.) exceeding a threshold. Based on this detection, the capacitive sensor controller 514 can transmit an instruction 516 to the ultrasonic transducer controller 500. In some examples, the instruction 516 may be an interrupt.

[0055] Upon receiving instruction 516, the ultrasonic transducer controller 500 may send a query 518 to the capacitive sensor controller 514 to obtain raw capacitance measurements. Raw capacitance measurements may include, for example, measurements of the capacitance for each row and column electrode obtained from the capacitive sensor array, measurements of the capacitance for each row electrode (in the case of the capacitive sensor controller 514 operating in low-power mode), mutual capacitance at each specific intersection, etc. Figure 3D Table 360 ​​and Figure 3E The measurement results are shown in Table 370. Based on the original capacitance measurements, the transmission control module 502 can determine the subset of ultrasonic transducers 226 to be activated. For example, refer to... Figure 3D The transmit control module 502 can identify row and column electrodes where the absolute capacitance decreases beyond a threshold and determine the area of ​​the display screen 124 defined by these row and column electrodes. As another example, see [reference needed]. Figure 3E The emission control module 502 can identify intersections where mutual capacitance decreases beyond a threshold and determine the area of ​​display screen 124 that includes the identified intersections. In both examples, the emission control module 502 can then enable a subset of ultrasonic transducers 226 overlapping with that area to perform ultrasonic sensing operations on an object.

[0056] In some examples, the ultrasonic transducer controller 500 may be coupled to an operation status module 522 that tracks the operation status of the electronic device 120. The operation status may include, for example, the wake-up state of the electronic device 120, or content being displayed by the electronic device 120. The operation status module 522 may transmit an instruction 524 indicating that the user will operate (or manipulate) the display screen 124 based on, for example, receiving a button press on the electronic device (e.g., ...). Figure 4 The button 402 is pressed and a lock screen indicator is displayed on the display screen 124, which is displaying multiple icons, etc.

[0057] Upon receiving instruction 524, the transmission control module 502 can predict the area where the user will touch or operate the display screen 124. This prediction can be based on, for example, the user's history of operating the electronic device 120 (e.g., based on prior raw capacitance measurements from the capacitive sensor module 512), which can instruct the user to frequently touch or gesture in a specific area 404 when the lock screen is displayed. The prediction can also be based on the position of icons, where each icon will be activated by the user by touching the area surrounding the icon on the display screen 124. The transmission control module 502 can then enable a subset of ultrasonic transducers 226 under the predicted area to perform focused ultrasound sensing operations.

[0058] Figure 6 An example method 600 for performing ultrasonic sensing operations has been described. Method 600 can be, for example, Figure 5The ultrasonic transducer controller 500 is used in conjunction with other components of the electronic device 120 (such as the display screen 124) to perform this function.

[0059] In operation 602, the ultrasonic transducer controller 500 receives an indication that an object is within a distance of the ultrasonic transducer array (e.g., the ultrasonic transducer array 226).

[0060] Specifically, in some examples, the indication may come from a capacitive sensor module, such as a capacitive sensor module 512 including a capacitive sensor array 302 and a capacitive sensor controller 514, wherein the capacitive sensor array 302 and the ultrasonic transducer array 226 are stacked as part of a touch display interface 222, as shown below. Figure 3A As shown in the diagram, the capacitive sensor controller 514 can track the capacitance measured by the array of capacitive sensors 302 and detect the presence of an object near the array of capacitive sensors 302 based on, for example, a change in capacitance measured by at least one capacitive sensor exceeding a threshold. The measured capacitance may include, for example, the absolute capacitance of a specific row electrode, the absolute capacitance of a specific column electrode, the mutual capacitance at a specific intersection between the row and column electrodes, etc. Figure 3C and Figure 3D As described in [the document]. Based on this detection, the capacitive sensor controller 514 can transmit an indication to the ultrasonic transducer controller 500. In some examples, this indication can be an interrupt.

[0061] In some examples, the indication can also reflect the operating status of the electronic device 120, such as whether the electronic device 120 is awake, whether the electronic device 120 is displaying content, etc. The indication can be received from the operation status module 522 to instruct the user to operate (or manipulate) the display screen 124 based on, for example, receiving a button press related to the electronic device (e.g., ...). Figure 4 The button 402 is pressed and a lock screen indicator is displayed on the display screen 124, which is displaying multiple icons, etc.

[0062] In operation 604, based on the instruction, the ultrasonic transducer controller 500 configures a subset of the ultrasonic transducer array to perform an ultrasonic sensing operation on the object.

[0063] Specifically, when the ultrasonic transducer controller 500 receives this instruction from the capacitive sensor module 512, the ultrasonic transducer controller 500 may send a query 518 to the capacitive sensor controller 514 of the capacitive sensor module to obtain a raw capacitance measurement 520. The raw capacitance measurement 520 may be sent back to the ultrasonic transducer controller 500 from the capacitive sensor controller 514. The raw capacitance measurement may include, for example, measurements of the capacitance of each row and column electrode obtained from the capacitive sensor array, measurements of the capacitance of each row electrode (in the case where the capacitive sensor controller 514 operates in low-power mode), mutual capacitance at each specific intersection, etc. Figure 3D Table 360 ​​and Figure 3E The measurement results are shown in Table 370. Based on the original capacitance measurements, the transmission control module 502 can determine the subset of ultrasonic transducers 226 to be activated. For example, refer to... Figure 3D The transmit control module 502 can identify row and column electrodes where the absolute capacitance decreases beyond a threshold and determine the area of ​​the display screen 124 defined by these row and column electrodes. As another example, see [reference needed]. Figure 3E The emission control module 502 can identify intersections where mutual capacitance decreases beyond a threshold and determine the area of ​​display screen 124 that includes the identified intersections. In both examples, the emission control module 502 can then enable a subset of ultrasonic transducers 226 overlapping with that area to perform ultrasonic sensing operations on an object.

[0064] According to certain aspects of this disclosure, scanning patterns are used to make object (e.g., user touch) detection a more efficient process. For example, in relation to the capacitive sensor controller 514 scanning individual sensors in the array of capacitive sensors 302 in a sequential manner, the capacitive sensor controller 514 may do so according to a scanning pattern. This scanning pattern may follow a conventional path, such as starting with the first sensor in a row, then the second sensor in the same row, and so on, until the row is complete, repeating the same procedure for each row in an orderly manner. However, in some examples, the scanning pattern may follow a different path that takes into account the location most likely to be touched by a sensor at any given time. Instead of starting at a location corresponding to, for example, the first row and first column of the array of capacitive sensors 302, the scanning pattern may begin at the location most likely to be touched by a user.

[0065] The scanning pattern can vary depending on factors such as the details of the user interface, the icons associated with the application being presented and / or used, and so on. In one example, when the electronic device 120 is locked and the user touches the screen by swiping left or right towards the bottom (to perform an unlock operation), the scanning pattern may begin in the lower half of the screen. For example, the scanning pattern may begin at the top of the lower half of the screen. The scanning pattern may then continue line by line towards the bottom of the screen and then into the upper half. Such an unconventional scanning path can be more efficient and faster in detecting user touches when the electronic device 120 is in a locked mode. In another example, the scanning pattern prioritizes locations such as the locations of known icons where the user is more likely to touch. In yet another example, the scanning pattern prioritizes the location of user controls, such as the location of the "back" button. Such a scanning pattern can be used, for example, by the capacitive sensor module 514 in generating an indication 516 and / or generating a raw capacitance measurement 520 provided to the ultrasonic transducer controller 500. By utilizing scanning patterns that prioritize locations more likely to be touched by the user, the actual detection of user touch in the scanning sequence can occur earlier, leading to earlier detection and improved overall efficiency of ultrasound sensing operations.

[0066] Furthermore, when the ultrasonic transducer controller 500 receives an instruction from the operation status module 522, after receiving the instruction 524, the transmission control module 502 can predict the area of ​​the display screen 124 that the user will touch or operate. This prediction can be based on, for example, the user's history of operating the electronic device 120 (e.g., based on prior raw capacitance measurements from the capacitive sensor module 512), which can instruct the user to frequently touch or gesture at the touch area 404 when the lock screen is displayed. The prediction can also be based on the position of each icon, where each icon will be activated by the user by touching the area surrounding the icon on the display screen 124. The transmission control module 502 can then activate a subset of the ultrasonic transducers 226 under the predicted area to perform focused ultrasound sensing operations.

[0067] In operation 606, the ultrasonic transducer controller 500 receives the output of the ultrasonic sensing operation from the subset of the ultrasonic transducer array. Specifically, refer to... Figure 1A and Figure 1B The ultrasonic transducer array 226's ultrasonic sensors can receive ultrasonic waves of varying intensities reflected by an object (e.g., a finger). The receiving signal processing module 504 can generate a signal intensity distribution of the ultrasonic reflection 114.

[0068] In operation 608, the ultrasonic transducer controller 500 or other components of the electronic device 120 perform actions based on the output of the ultrasonic sensing operation. These actions may include, for example, generating a finger image based on the signal intensity distribution of the reflected ultrasonic signal, comparing this image with a reference fingerprint image to produce a comparison result, and, based on this comparison result, allowing access to the device's functions. For example, based on the comparison result, a user seeking access to certain icons / applications on the electronic device may be authenticated and granted access to those icons / applications.

[0069] Figure 7 A schematic diagram of one embodiment of a computer system 700 capable of performing various blocks of methods provided by various other embodiments is provided. Figure 7 The computer system described herein can be incorporated as part of the previously described computerized equipment (such as electronic device 120). It should be noted that... Figure 7 This is merely intended to provide a general explanation of the various components, which can be appropriately utilized by any or all of them. Therefore, Figure 7 It broadly explains how individual system components can be implemented in a relatively separate or relatively more integrated manner.

[0070] Computer system 700 is shown as including hardware elements electrically coupled (or otherwise communicatively connected) via bus 705. The hardware elements may include one or more processors 710, including but not limited to one or more general-purpose processors and / or one or more special-purpose processors (such as digital signal processing chips, graphics accelerators, video decoders, etc.); one or more input devices 715, including but not limited to mice, keyboards, remote controls, etc.; and one or more output devices 720, including but not limited to display devices, printers, etc. As used herein, a controller may include the functionality of a processor (such as processor 710).

[0071] The computer system 700 may further include one or more non-transient storage devices 725 (and / or in communication with said one or more non-transient storage devices 725), which may include, but are not limited to, local and / or network-accessible storage, and / or may include, but are not limited to, disk drives, drive arrays, optical storage devices, solid-state storage devices (such as random access memory (“RAM”) and / or read-only memory (“ROM”)), which may be programmable, flash-updatable, etc. Such storage devices may be configured to implement any suitable data storage, including but not limited to various file systems, database structures, etc.

[0072] Computer system 1700 may also include a communication subsystem 770, which may include, but is not limited to, a modem, a network interface card (NIC) (wireless or wired), an infrared communication device, a wireless communication device, and / or a chipset (such as a Bluetooth device, an 802.11 device, a Wi-Fi device, a WiMAX device, a cellular communication device, GSM, CDMA, WCDMA, LTE, LTE-A, LTE-U, etc.). Communication subsystem 770 may permit the exchange of data with a network (for example, such as the network described below), other computer systems, and / or any other device described herein. In many embodiments, computer system 700 will further include working memory 775, which may include RAM or ROM devices as described above.

[0073] Computer system 700 may also include software elements (shown as currently residing within working memory 775) including operating system 740, device drivers, executable libraries, and / or other code (such as one or more application programs 745). These software elements may include computer programs provided by various embodiments, and / or may be designed to implement methods provided by other embodiments, and / or configure systems provided by other embodiments, as described herein. By way of example only, one or more procedures described with respect to the methods discussed above may be implemented as code and / or instructions executable by a computer (and / or a processor within a computer); in one aspect, such code and / or instructions may then be used to configure and / or adapt a general-purpose computer (or other device) to perform one or more operations according to the described methods.

[0074] These sets of instructions and / or code may be stored on non-transient computer-readable storage media (such as the aforementioned non-transient storage devices 725). In some cases, the storage medium may be incorporated into a computer system (such as computer system 700). In other embodiments, the storage medium may be separate from the computer system (e.g., a removable medium, such as a compressed disk), and / or may be provided in an installation package so that the storage medium can be used to program, configure, and / or adapt a general-purpose computer storing the instructions / code. These instructions may take the form of executable code (which can be executed by computer system 700) and / or may take the form of source code and / or installable code, which takes the form of executable code when compiled and / or installed on computer system 700 (e.g., using various general-purpose compilers, installers, compression / decompression utilities, etc.).

[0075] It will be apparent to those skilled in the art that substantial modifications can be made to suit specific requirements. For example, custom hardware may be used, and / or specific elements may be implemented in hardware, software (including portable software such as applets), or both. Furthermore, connectivity to other computing devices (such as network input / output devices) may be employed.

[0076] As mentioned above, in one aspect, some embodiments may employ a computer system (such as computer system 700) to perform methods according to various embodiments of the invention. According to one set of embodiments, some or all of the procedures of such methods may be executed by computer system 700 in response to processor 710 executing one or more sequences of one or more instructions contained in working memory 775 (which may be incorporated into operating system 740 and / or other code, such as application program 745). Such instructions may be read into working memory 775 from another computer-readable medium (such as one or more non-transitory storage devices 725). By way of example only, executing a sequence of instructions contained in working memory 775 may cause processor 710 to perform one or more procedures of the methods described herein.

[0077] As used herein, the terms “machine-readable medium,” “computer-readable storage medium,” and “computer-readable medium” refer to any medium that participates in providing data that enables a machine to operate in a particular manner. These media may be non-transient. In embodiments implemented using computer system 700, various computer-readable media may relate to providing instructions / code to processor(s) 710 for execution, and / or being used to store and / or carry such instructions / code. In many implementations, computer-readable media are physical and / or tangible storage media. Such media may take the form of non-volatile or volatile media. Non-volatile media include, for example, optical discs and / or magnetic disks, such as non-transient storage devices 725. Volatile media include, but are not limited to, dynamic memory, such as working memory 775.

[0078] Common forms of physical and / or tangible computer-readable media include, for example: floppy disks, floppy disks, hard disks, magnetic tapes, or any other magnetic media, CD-ROMs, any other optical media, any other physical media with marking patterns, RAM, PROMs, EPROMs, FLASH-EPROMs, any other memory chips or memory cartridges, or any other media from which a computer can read instructions and / or code.

[0079] Various forms of computer-readable media may be involved when carrying one or more sequences of one or more instructions to processor 710 for execution. By way of example only, the instructions may initially be carried on a disk and / or optical disc of a remote computer. The remote computer may load the instructions into its dynamic memory and transmit the instructions as signals via a transmission medium for computer system 700 to receive and / or execute.

[0080] The communication subsystem 770 (and / or its components) will generally receive signals, and the bus 705 may subsequently carry the signals (and / or data, instructions, etc. carried by the signals) to the working memory 775, from which the processor(s) retrieve and execute instructions. Instructions received by the working memory 775 may optionally be stored on a non-transient storage device 725 before or after execution by the processor(s).

[0081] It should be further understood that the components of computer system 700 can be distributed across a network. For example, some processing may be executed using a first processor in one location, while other processing may be executed by another processor located far from the first processor. Other components of computer system 700 can be similarly distributed. Thus, computer system 700 can be interpreted as a distributed computing system that performs processing in multiple locations. In some instances, computer system 700 can be interpreted as a single computing device, such as different laptops, desktop computers, etc., depending on the context.

[0082] The methods, systems, and apparatus discussed above are examples. Various configurations may appropriately omit, substitute, or add various procedures or components. For example, in alternative configurations, these methods may be performed in a different order than described, and stages may be added, omitted, and / or combined. Furthermore, features described with respect to certain configurations may be combined in various other configurations. Different aspects and elements of configurations may be combined in a similar manner. Moreover, technology evolves, and thus, many elements are examples and do not limit the scope of this disclosure or the claims.

[0083] Specific details are set forth in this specification to provide a thorough understanding of the example configurations (including implementations). However, these configurations may be practiced without these specific details. For example, well-known circuits, processes, algorithms, structures, and techniques have been shown without unnecessary detail to avoid obscuring these configurations. This specification provides only example configurations and does not limit the scope, applicability, or configuration of the claims. Specifically, the foregoing description of the various configurations will provide those skilled in the art with a description of how to enable the implementation of the described techniques. Various changes may be made to the function and arrangement of the elements without departing from the spirit or scope of this disclosure.

[0084] Each configuration may also be described as a process depicted as a flowchart or block diagram. While each flowchart or block diagram may describe operations as a sequential process, many operations may be performed in parallel or simultaneously. Furthermore, the order of operations may be rearranged. The process may have additional steps not included in the accompanying drawings. Moreover, examples of these methods can be implemented using hardware, software, firmware, middleware, microcode, hardware description languages, or any combination thereof. When implemented in software, firmware, middleware, or microcode, the program code or code segments used to perform the necessary tasks may be stored in a non-transitory computer-readable medium (such as a storage medium). The processor can execute the described tasks.

[0085] Several example configurations have been described, and various modifications, substitutions, constructs, and equivalents may be used without departing from the spirit of this disclosure. For example, the above elements may be components of a larger system, where other rules may take precedence over or otherwise modify the application of this invention. Furthermore, several steps may be taken before, during, or after considering the above elements.

[0086] As used herein, the terms “and” and “or” can include a variety of meanings, which are also contemplated to depend at least in part on the context in which such terms are used. Generally, “or,” when used in relation to a list such as A, B, or C, is intended to mean A, B, and C (in the inclusive sense) and A, B, or C (in the exclusive sense). Additionally, the term “one or more” as used herein can be used to describe any feature, structure, or property in the singular form, or can be used to describe some combination of features, structures, or properties. However, it should be noted that this is merely an illustrative example, and the claimed subject matter is not limited to this example. Furthermore, the term “at least one of” when used in relation to a list such as A, B, or C can be interpreted as meaning any combination of A, B, and / or C, such as A, AB, AA, AAB, AABBCCC, etc.

[0087] In view of this specification, various embodiments may include different combinations of features. Examples of implementations are described in the following numbered clauses.

[0088] Clause 1. A method comprising: receiving an indication that an object is within a distance of an array of ultrasonic transducers; configuring a subset of the ultrasonic transducers array to perform an ultrasonic sensing operation on the object based on the indication; obtaining an output of the ultrasonic sensing operation from the subset of the ultrasonic transducers array; and performing an action based on the output of the ultrasonic sensing operation.

[0089] Clause 2. The method of Clause 1, wherein the indication is received from a capacitive sensor module comprising a capacitive sensor array stacked with the ultrasonic transducer array; and wherein the indication is generated based on the capacitive sensor module detecting that the object is within the distance of the capacitive sensor array.

[0090] Clause 3. The method of any of Clauses 1-2, wherein the indication is generated based on the degree of change in capacitance measured by the capacitive sensors in the capacitive sensor array exceeding a first threshold.

[0091] Clause 4. The method of Clause 3, wherein the capacitive sensor array comprises an electrode array; and wherein the capacitance measured by the capacitive sensor is between one electrode in the electrode array and ground.

[0092] Clause 5. The method of any one of Clauses 1-4, wherein the capacitive sensor array comprises a first electrode array and a second electrode array; and wherein the capacitance measured by the capacitive sensor is the mutual capacitance at the intersection between the first electrode in the first electrode array and the second electrode in the second electrode array.

[0093] Clause 6. The method of any one of Clauses 3-5 further comprises: receiving from the capacitive sensor module a capacitance measured by the capacitive sensor array; determining a subset of the capacitive sensor array whose measured capacitance changes by a degree exceeding a second threshold; and identifying the subset of the ultrasonic transducer array based on the subset of the capacitive sensor array.

[0094] Clause 7. The method of any one of Clauses 2-6, wherein the indication is generated by the capacitive sensor module by sequentially scanning the sensors in the capacitive sensor array according to a scanning pattern that prioritizes locations that may be touched by the user.

[0095] Clause 8. The method of any one of Clauses 1-7, wherein each ultrasonic transducer in the ultrasonic transducer array includes an ultrasonic signal transmitter and an ultrasonic signal receiver; and wherein configuring a subset of the ultrasonic transducer array to perform a sensing operation on the object comprises: configuring the ultrasonic signal transmitter of the subset of the ultrasonic transducer array to transmit an ultrasonic signal; configuring the subset of the ultrasonic transducer array to detect the ultrasonic signal reflected by the object; and receiving a detection output of the reflected ultrasonic signal from the subset of the ultrasonic transducer array.

[0096] Clause 9. The method of Clause 8, wherein the subset of the ultrasonic transducer array is a first subset of the ultrasonic transducer array; wherein the method further comprises: disabling a second subset of the ultrasonic transducer array or reducing the power level of the second subset of the ultrasonic transducer array when the first subset of the ultrasonic transducer array performs the ultrasonic sensing operation.

[0097] Clause 10. The method of any one of Clauses 1-9, wherein the object includes a finger; and wherein the action includes: generating an image of the finger based on the signal intensity distribution of a reflected ultrasonic signal; transmitting the image to another component to enable the other component to compare the image with a reference fingerprint image to generate a comparison result, and controlling access to the functions of the device based on the comparison result.

[0098] Clause 11. An apparatus comprising: a memory storing an instruction set; and a hardware processor configured to execute the instruction set to: receive an indication that an object is within a distance of an array of ultrasonic transducers; configure a subset of the ultrasonic transducers array to perform an ultrasonic sensing operation on the object based on the indication; obtain an output of the ultrasonic sensing operation from the subset of the ultrasonic transducers array; and perform an action based on the output of the ultrasonic sensing operation.

[0099] Clause 12. The apparatus of Clause 11, wherein the indication is received from a capacitive sensor module comprising a capacitive sensor array stacked with the ultrasonic transducer array; and wherein the indication is generated based on the capacitive sensor module detecting that the object is within the distance from the capacitive sensor array.

[0100] Clause 13. The apparatus of any of Clauses 11-12, wherein the indication is generated based on the degree of change in capacitance measured by the capacitive sensors in the capacitive sensor array exceeding a first threshold.

[0101] Clause 14. The apparatus of Clause 13, wherein the capacitive sensor array comprises an electrode array; and wherein the capacitance measured by the capacitive sensor is between one electrode in the electrode array and ground.

[0102] Clause 15. An apparatus of any one of Clauses 11-14, wherein the capacitive sensor array comprises a first electrode array and a second electrode array; and wherein the capacitance measured by the capacitive sensor is the mutual capacitance at the intersection between a first electrode in the first electrode array and a second electrode in the second electrode array.

[0103] Clause 16. An apparatus as described in any of Clauses 13-15, wherein the hardware processor is further configured to execute the set of instructions to: receive from the capacitive sensor module a capacitance measured by the capacitive sensor array; determine a subset of the capacitive sensor array whose measured capacitance changes by a degree exceeding a second threshold; and identify the subset of the ultrasonic transducer array based on the subset of the capacitive sensor array.

[0104] Clause 17. An apparatus of any of Clauses 12-16, wherein the capacitive sensor module is configured to generate the indication by sequentially scanning sensors in the capacitive sensor array, based on a scanning pattern that prioritizes locations that may be touched by a user.

[0105] Clause 18. An apparatus of any one of Clauses 11-17, wherein each ultrasonic transducer in the ultrasonic transducer array includes an ultrasonic signal transmitter and an ultrasonic signal receiver; and wherein configuring a subset of the ultrasonic transducer array to perform a sensing operation on the object includes the hardware processor being configured to: configure the ultrasonic signal transmitter of the subset of the ultrasonic transducer array to transmit an ultrasonic signal; configure the subset of the ultrasonic transducer array to detect the ultrasonic signal reflected by the object; and receive a detection output of the reflected ultrasonic signal from the subset of the ultrasonic transducer array.

[0106] Clause 19. The apparatus of Clause 18, wherein the subset of the ultrasonic transducer array is a first subset of the ultrasonic transducer array; wherein the hardware processor is further configured to execute the set of instructions to: disable a second subset of the ultrasonic transducer array or reduce the power level of the second subset of the ultrasonic transducer array when the first subset of the ultrasonic transducer array performs the ultrasonic sensing operation.

[0107] Clause 20. An apparatus of any one of Clauses 11-19, wherein the object comprises a finger; and wherein the action comprises: generating an image of the finger based on a signal intensity distribution of a reflected ultrasonic signal; transmitting the image to another component such that the other component is able to compare the image with a reference fingerprint image to generate a comparison result, and controlling access to the functions of the apparatus based on the comparison result.

[0108] Clause 21. An example non-transient computer-readable medium storing a set of instructions, which, when executed by a hardware processor, causes the hardware processor to: receive an indication that an object is within a distance of an array of ultrasonic transducers; configure a subset of the ultrasonic transducers array to perform an ultrasonic sensing operation on the object based on the indication; obtain an output of the ultrasonic sensing operation from the subset of the ultrasonic transducers array; and perform an action based on the output of the ultrasonic sensing operation.

[0109] Clause 22. A non-transient computer-readable medium as described in Clause 21, wherein the indication is received from a capacitive sensor module comprising a capacitive sensor array stacked with the ultrasonic transducer array; and wherein the indication is generated based on the capacitive sensor module detecting that the object is within the distance from the capacitive sensor array.

[0110] Clause 23. A non-transient computer-readable medium as described in any of Clauses 21-22, wherein the indication is generated based on a change in capacitance measured by a capacitive sensor in the capacitive sensor array exceeding a first threshold.

[0111] Clause 24. A non-transient computer-readable medium as described in Clause 23, wherein the capacitive sensor array comprises an electrode array; and wherein the capacitance measured by the capacitive sensor is between one electrode in the electrode array and ground.

[0112] Clause 25. A non-transient computer-readable medium as described in any of Clauses 21-24, wherein the capacitive sensor array comprises a first electrode array and a second electrode array; and wherein the capacitance measured by the capacitive sensor is the mutual capacitance at the intersection between a first electrode in the first electrode array and a second electrode in the second electrode array.

[0113] Clause 26. A non-transient computer-readable medium as described in any of Clauses 23-25, further comprising instructions that, when executed by the hardware processor, cause the hardware processor to perform the following operations: receive capacitance measured by the capacitive sensor array from the capacitive sensor module; determine a subset of the capacitive sensor array in which the degree of change of the measured capacitance exceeds a second threshold; and identify the subset of the ultrasonic transducer array based on the subset of the capacitive sensor array.

[0114] Clause 27. A non-transient computer-readable medium as described in any of Clauses 22-26, wherein the indication is generated by the capacitive sensor module by sequentially scanning the sensors in the capacitive sensor array according to a scanning pattern that prioritizes locations that may be touched by the user.

[0115] Clause 28. A non-transient computer-readable medium as described in any of Clauses 21-27, wherein each ultrasonic transducer in the ultrasonic transducer array includes an ultrasonic signal transmitter and an ultrasonic signal receiver; and wherein the non-transient computer-readable medium further includes instructions, when executed by the hardware processor, causing the hardware processor to: configure the ultrasonic signal transmitter of the subset of the ultrasonic transducer array to transmit an ultrasonic signal; configure the subset of the ultrasonic transducer array to detect the ultrasonic signal reflected by the object; and receive a detection output of the reflected ultrasonic signal from the subset of the ultrasonic transducer array.

[0116] Clause 29. A non-transient computer-readable medium as described in Clause 28, wherein the subset of the ultrasonic transducer array is a first subset of the ultrasonic transducer array; wherein the non-transient computer-readable medium further includes instructions, when executed by the hardware processor, causing the hardware processor to: disable a second subset of the ultrasonic transducer array, or reduce the power level of the second subset of the ultrasonic transducer array, when the first subset of the ultrasonic transducer array performs the ultrasonic sensing operation; wherein the object includes a finger; and wherein the action includes: generating an image of the finger based on the signal intensity distribution of the reflected ultrasonic signal; and transmitting the image to another component to enable the other component to compare the image with a reference fingerprint image to generate a comparison result, and controlling access to the functions of the device based on the comparison result.

[0117] Clause 30. An apparatus comprising: means for receiving an indication that an object is within a distance of an array of ultrasonic transducers; means for configuring a subset of the ultrasonic transducers array to perform an ultrasonic sensing operation on the object based on the indication; means for obtaining an output of the ultrasonic sensing operation from the subset of the ultrasonic transducers array; and means for performing an action based on the output of the ultrasonic sensing operation.

Claims

1. A method for ultrasonic sensing, comprising: Receive an indication that an object is within a distance from an ultrasonic transducer array, wherein the indication is generated based on a change in capacitance measured by a capacitive sensor in a capacitive sensor array exceeding a first threshold and the object being detected to be within the distance from the capacitive sensor array, wherein the indication is received from a capacitive sensor module including the capacitive sensor array, the capacitive sensor array being stacked with the ultrasonic transducer array; Receive the capacitance measured by the capacitive sensor array from the capacitive sensor module; Determine a subset of the capacitive sensor array whose measured capacitance changes exceed a second threshold; A subset of the ultrasonic transducer array is identified based on the subset of the capacitive sensor array; Based on the instructions, the subset of the ultrasonic transducer array is configured to perform ultrasonic sensing operations on the object; The output of the ultrasonic sensing operation is obtained from the subset of the ultrasonic transducer array; as well as The action is performed based on the output of the ultrasonic sensing operation.

2. The method of claim 1, wherein the capacitive sensor array comprises an electrode array; and The capacitance measured by the capacitive sensor is between one electrode in the electrode array and ground.

3. The method of claim 1, wherein the capacitive sensor array comprises a first electrode array and a second electrode array; and The capacitance measured by the capacitive sensor is the mutual capacitance at the intersection point between the first electrode in the first electrode array and the second electrode in the second electrode array.

4. The method of claim 1, wherein the indication is generated by the capacitive sensor module by sequentially scanning the sensors in the capacitive sensor array according to a scanning pattern that prioritizes locations that may be touched by the user.

5. The method of claim 1, wherein each ultrasonic transducer in the ultrasonic transducer array comprises an ultrasonic signal transmitter and an ultrasonic signal receiver; and Configuring a subset of the ultrasonic transducer array to perform sensing operations on the object includes: Configure the ultrasonic signal transmitter of the subset of the ultrasonic transducer array to transmit ultrasonic signals; Configure the subset of the ultrasonic transducer array to detect the ultrasonic signal reflected by the object; as well as The detection output receives the reflected ultrasonic signal from the subset of the ultrasonic transducer array.

6. The method of claim 5, wherein the subset of the ultrasonic transducer array is a first subset of the ultrasonic transducer array; The method further includes: When the first subset of the ultrasonic transducer array performs the ultrasonic sensing operation, the second subset of the ultrasonic transducer array is disabled, or the power level of the second subset of the ultrasonic transducer array is reduced.

7. The method of claim 6, wherein the object comprises a finger; and The actions mentioned include: The image of the finger is generated based on the signal intensity distribution of the reflected ultrasonic signal; as well as The image is transmitted to another component, which is then able to compare the image with a reference fingerprint image to generate a comparison result, and control access to device functions based on the comparison result.

8. An apparatus for ultrasonic sensing, comprising: Memory for storing instruction sets; as well as Hardware processor, configured to execute the instruction set to: Receive an indication that an object is within a distance from an ultrasonic transducer array, wherein the indication is generated based on a change in capacitance measured by a capacitive sensor in a capacitive sensor array exceeding a first threshold and the object being detected to be within the distance from the capacitive sensor array, wherein the indication is received from a capacitive sensor module including the capacitive sensor array, the capacitive sensor array being stacked with the ultrasonic transducer array; Receive the capacitance measured by the capacitive sensor array from the capacitive sensor module; Determine a subset of the capacitive sensor array whose measured capacitance changes exceed a second threshold; A subset of the ultrasonic transducer array is identified based on the subset of the capacitive sensor array; Based on the instructions, the subset of the ultrasonic transducer array is configured to perform ultrasonic sensing operations on the object; The output of the ultrasonic sensing operation is obtained from the subset of the ultrasonic transducer array; as well as The action is performed based on the output of the ultrasonic sensing operation.

9. The apparatus of claim 8, wherein the capacitive sensor array comprises an electrode array; and The capacitance measured by the capacitive sensor is between one electrode in the electrode array and ground.

10. The apparatus of claim 8, wherein the capacitive sensor array comprises a first electrode array and a second electrode array; and The capacitance measured by the capacitive sensor is the mutual capacitance at the intersection point between the first electrode in the first electrode array and the second electrode in the second electrode array.

11. The apparatus of claim 8, wherein the capacitive sensor module is configured to generate the indication by sequentially scanning sensors in the capacitive sensor array according to a scanning pattern that prioritizes locations that may be touched by a user.

12. The apparatus of claim 8, wherein each ultrasonic transducer in the ultrasonic transducer array comprises an ultrasonic signal transmitter and an ultrasonic signal receiver; and Configuring a subset of the ultrasonic transducer array to perform sensing operations on the object includes configuring the hardware processor to: Configure the ultrasonic signal transmitter of the subset of the ultrasonic transducer array to transmit ultrasonic signals; The subset of the ultrasonic transducer array is configured to detect the ultrasonic signal reflected by the object; and The detection output receives the reflected ultrasonic signal from the subset of the ultrasonic transducer array.

13. The apparatus of claim 12, wherein the subset of the ultrasonic transducer array is a first subset of the ultrasonic transducer array; The hardware processor is further configured to execute the instruction set to: disable a second subset of the ultrasonic transducer array or reduce the power level of the second subset of the ultrasonic transducer array when the first subset of the ultrasonic transducer array performs the ultrasonic sensing operation.

14. The apparatus of claim 13, wherein the object comprises a finger; and The actions mentioned include: The image of the finger is generated based on the signal intensity distribution of the reflected ultrasonic signal; as well as The image is transmitted to another component, which is then able to compare the image with a reference fingerprint image to generate a comparison result, and control access to device functions based on the comparison result.

15. An example non-transient computer-readable medium storing an instruction set for ultrasonic sensing, the instruction set causing the hardware processor to perform the following operations when executed by the hardware processor: Receive an indication that an object is within a distance from an ultrasonic transducer array, wherein the indication is generated based on a change in capacitance measured by a capacitive sensor in a capacitive sensor array exceeding a first threshold and the object being detected to be within the distance from the capacitive sensor array, wherein the indication is received from a capacitive sensor module including the capacitive sensor array, the capacitive sensor array being stacked with the ultrasonic transducer array; Receive the capacitance measured by the capacitive sensor array from the capacitive sensor module; Determine a subset of the capacitive sensor array whose measured capacitance changes exceed a second threshold; A subset of the ultrasonic transducer array is identified based on the subset of the capacitive sensor array; Based on the instructions, the subset of the ultrasonic transducer array is configured to perform ultrasonic sensing operations on the object; The output of the ultrasonic sensing operation is obtained from the subset of the ultrasonic transducer array; as well as The action is performed based on the output of the ultrasonic sensing operation.

16. The non-transient computer-readable medium of claim 15, wherein the capacitive sensor array comprises an electrode array; and The capacitance measured by the capacitive sensor is between one electrode in the electrode array and ground.

17. The non-transient computer-readable medium of claim 15, wherein the capacitive sensor array comprises a first electrode array and a second electrode array; and The capacitance measured by the capacitive sensor is the mutual capacitance at the intersection point between the first electrode in the first electrode array and the second electrode in the second electrode array.

18. The non-transient computer-readable medium of claim 15, wherein the indication is generated by the capacitive sensor module by sequentially scanning the sensors in the capacitive sensor array according to a scanning pattern that prioritizes locations that may be touched by the user.

19. The non-transient computer-readable medium of claim 15, wherein each ultrasonic transducer in the ultrasonic transducer array comprises an ultrasonic signal transmitter and an ultrasonic signal receiver; and The non-transient computer-readable medium further includes instructions that, when executed by the hardware processor, cause the hardware processor to perform the following operations: Configure the ultrasonic signal transmitter of the subset of the ultrasonic transducer array to transmit ultrasonic signals; The subset of the ultrasonic transducer array is configured to detect the ultrasonic signal reflected by the object; and The detection output receives the reflected ultrasonic signal from the subset of the ultrasonic transducer array.

20. The non-transient computer-readable medium of claim 19, wherein the subset of the ultrasonic transducer array is a first subset of the ultrasonic transducer array; The non-transient computer-readable medium further includes instructions that, when executed by the hardware processor, cause the hardware processor to perform the following operations: when the first subset of the ultrasonic transducer array performs the ultrasonic sensing operation, disable the second subset of the ultrasonic transducer array, or reduce the power level of the second subset of the ultrasonic transducer array. The object mentioned includes fingers; and The actions mentioned include: The image of the finger is generated based on the signal intensity distribution of the reflected ultrasonic signal; as well as The image is transmitted to another component, which is then able to compare the image with a reference fingerprint image to generate a comparison result, and control access to device functions based on the comparison result.

21. An apparatus for ultrasonic sensing, comprising: A means for receiving an indication that an object is within a distance from an ultrasonic transducer array, wherein the indication is generated based on a change in capacitance measured by a capacitive sensor in a capacitive sensor array exceeding a first threshold and the detection that the object is within the distance from the capacitive sensor array, wherein the indication is received from a capacitive sensor module including the capacitive sensor array, the capacitive sensor array being stacked with the ultrasonic transducer array; A means for receiving capacitance measured by the capacitive sensor array from the capacitive sensor module; A means for determining a subset of the capacitive sensor array whose measured capacitance changes exceed a second threshold. A means for identifying a subset of the ultrasonic transducer array based on the subset of the capacitive sensor array; A means for configuring the subset of the ultrasonic transducer array to perform ultrasonic sensing operations on the object based on the instruction; A means for obtaining the output of the ultrasonic sensing operation from the subset of the ultrasonic transducer array; as well as A means for performing an action based on the output of the ultrasonic sensing operation.

Images