Ultrasonic detection of user presence

Abstract

Techniques and apparatus are described for implementing an ultrasonic sensor capable of detecting user presence. The ultrasonic sensor can detect user presence without relying on time-of-flight technology. Specifically, the ultrasonic sensor can determine user presence based on occlusion of at least one receiving transducer (e.g., microphone occlusion), occlusion of at least one transmitting transducer (e.g., speaker occlusion), or a detected change in the audible noise floor of at least one transducer. In this way, the ultrasonic sensor can continue to detect user presence even when the user occludes one or more transducers of the ultrasonic sensor. The ultrasonic sensor can also control the operation of another component within the computing device based on the user's presence to improve the user experience and / or improve power management.

Description

Background Art

[0001] Computing devices (e.g., smartphones) can enable remote communication, information access, enhanced security, and more. For example, the portable design of smartphones allows users to maintain a clear communication line while away from fixed forms of communication (e.g., landline phones, desktop computers). Such smartphones can access the Internet, enable wireless communication, install useful applications (e.g., navigation, social media, news, shopping, banking, photo albums, music), and contain sensors (e.g., cameras, location sensors, health sensors).

[0002] New features for computing devices are continually being developed that facilitate the operation of the devices or expand their capabilities by utilizing sensors or high-performance circuitry. While users may find these devices beneficial, there are many challenges associated with the development of computing device technology. These challenges may include designing components to fit within the size constraints of the computing device, operating the components within the available power constraints of the device, and improving the user experience. Summary of the Invention

[0003] Techniques and apparatus are described for detecting user presence using ultrasonic sensors. The ultrasonic sensor can detect user presence without relying on time-of-flight technology. Specifically, the ultrasonic sensor can determine user presence based on occlusion of at least one receiving transducer (e.g., microphone occlusion), occlusion of at least one transmitting transducer (e.g., speaker occlusion), or a detected change in the audible noise floor of at least one transducer. In this way, the ultrasonic sensor can continue to detect user presence even if the user occludes one or more transducers of the ultrasonic sensor. The ultrasonic sensor can also control the operation of another component within the computing device based on the user's presence to improve the user experience and / or improve power management.

[0004] Aspects described below include a method for detecting the presence of a user performed by an ultrasonic sensor. The method includes transmitting an ultrasonic transmit signal. The method also includes receiving an ultrasonic receive signal using a first transducer of the ultrasonic sensor. The ultrasonic receive signal includes a version of the ultrasonic transmit signal. The method further includes detecting occlusion of a second transducer of the ultrasonic sensor. In response to detecting occlusion of the second transducer, the method further includes determining the presence of an object.

[0005] Aspects described below include another method for detecting the presence of a user performed by an ultrasonic sensor. The method includes transmitting a first ultrasonic transmit signal using a first transducer of the ultrasonic sensor. The method also includes transmitting a second ultrasonic transmit signal using a second transducer of the ultrasonic sensor. The first ultrasonic transmit signal and the second ultrasonic transmit signal have different waveforms. The method also includes receiving an ultrasonic receive signal. The ultrasonic receive signal includes a version of the first ultrasonic transmit signal. The method also includes detecting occlusion of the second transducer. In response to detecting occlusion of the second transducer, the method also includes determining the presence of an object.

[0006] Aspects described below include additional methods for detecting the presence of a user performed by an ultrasonic sensor. The method includes receiving an audible receive signal. The method also includes detecting a change in a noise floor associated with the audible receive signal. In response to detecting the change in the noise floor, the method also includes determining that an object is present.

[0007] The aspects described below also include an apparatus comprising an ultrasonic sensor configured to perform any of the methods described.

[0008] The aspects described below also include a system having a device for detecting the presence of a user. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] Devices and techniques for detecting user presence are described with reference to the following drawings. Like reference numerals are used throughout the drawings to reference similar features and components:

[0010] Figure 1 illustrates an example environment in which detecting user presence may be implemented;

[0011] Figure 2 illustrates an example implementation of an ultrasonic sensor as part of a computing device;

[0012] Figure 3-1 illustrates example operations of an ultrasonic sensor as part of a computing device;

[0013] Figure 3-2 illustrates an example sequence flow diagram for detecting user presence based on user proximity;

[0014] Figure 3-3 illustrates an example sequence flow diagram for changing the operational state of a component of a computing device based on user presence;

[0015] Figure 4 illustrates an example implementation of an ultrasonic sensor's transducer, analog circuitry, and system processor;

[0016] Figure 5illustrates example microphone, speaker, and optical sensor locations on a computing device;

[0017] Figure 6 illustrates example techniques for detecting user presence based on microphone occlusion;

[0018] Figure 7 Another example technique for detecting user presence based on speaker occlusion is illustrated;

[0019] Figure 8 Additional example techniques for detecting user presence based on changes in the audible noise floor are illustrated;

[0020] Figure 9 An example method for detecting user presence based on microphone occlusion is illustrated;

[0021] Figure 10 An example method for detecting user presence based on speaker occlusion is illustrated;

[0022] Figure 11 illustrates an example method for detecting user presence based on changes in the audible noise floor; and

[0023] Figure 12 An example computing system is illustrated that includes an ultrasonic sensor capable of detecting the presence of a user, or in which techniques supporting the use of an ultrasonic sensor capable of detecting the presence of a user may be implemented. DETAILED DESCRIPTION

[0024] Overview

[0025] New features for computing devices are continually being developed that utilize sensors or high-performance circuitry to facilitate the operation of the device or expand its capabilities. While users may find these devices beneficial, there are many challenges associated with the development of computing device technology. These challenges may include designing components to fit within the size constraints of the computing device, operating the components within the available power constraints of the device, and improving the user experience.

[0026] One such challenge includes providing a desired user experience on a computing device. A user may desire uninterrupted access to the device's user interface. However, some of the device's sensors may distract the user when in an active operating state. For example, when an optical sensor is in an active (e.g., operational) state, it may emit light to detect the proximity of nearby objects. When the optical sensor is active, the user may observe the emitted light in environments with both high and low ambient light. In some cases, the user may become distracted or annoyed by the light and lose their train of thought, resulting in an undesirable user experience. Optical sensors may also include photoconductive devices, photovoltaic devices, photodiodes, and phototransistors, and have a variety of applications, including generating, producing, distributing, or converting electrical energy, among others.

[0027] Another challenge may be related to the size constraints or power limitations of computing devices. In the case of smartphones, users may desire a compact device that fits easily in their pocket or purse. These size constraints can limit the device's capabilities. For example, a compact design can reduce the number or types of components available to enhance the user experience. The operation of these components may also have power limitations based on the device's battery capacity. A compact smartphone design may require a smaller battery, which can limit the user's active time on the device and / or the operation of these components.

[0028] To address these challenges, this document describes techniques and devices for determining user presence using ultrasonic sensors of a computing device. In some embodiments, the ultrasonic sensor utilizes a pre-existing microphone and / or speaker on the device. This enables the ultrasonic sensor to be implemented on space-constrained devices. In addition to determining the distance between the user and a component of the device (e.g., an optical sensor), the ultrasonic sensor can also determine the distance between the user and the device. The ultrasonic sensor can control the operation of the component based on the user's presence to improve the user experience and / or improve power management.

[0029] In one example, an ultrasonic sensor changes the operating state of a component (e.g., turning it on or off) to improve the user experience. For example, an ultrasonic sensor can turn off an optical sensor (e.g., place it in an inactive state) to prevent it from emitting light when a user is nearby. This can prevent the user from becoming distracted by the light and promote a more enjoyable user experience. However, once the ultrasonic sensor detects that the user is within a threshold distance for operating the optical sensor, the ultrasonic sensor can trigger the optical sensor to transition to an active state in which it emits light. In this way, the ultrasonic sensor can reduce the amount of time the optical sensor is in the active state, thereby improving the user experience.

[0030] Ultrasonic sensors can also save power within computing devices to enhance the user experience. When the presence of a user is detected, the ultrasonic sensor can change the operating state of a component to manage the power consumption of the device. For example, if the ultrasonic sensor determines that the user is not near the device, it can turn off the component to save power (for example, turn off the display). If the ultrasonic sensor determines that the user is near the device, it can turn on the component to allow startup time. For example, when it is determined that the user is near the device, the component can be turned on in advance so that it is ready for use by the user. Therefore, the computing device does not have to rely on a timer or manual input from the user to activate the component, and instead can improve the user experience by reducing startup delays.

[0031] Some ultrasonic sensors can detect user presence by relying on time-of-flight technology. To utilize this technology, these ultrasonic sensors measure the time elapsed between transmitting and receiving ultrasonic signals. However, in certain situations, the ultrasonic sensor may be blocked from transmitting and / or receiving these ultrasonic signals. Consider an example where an ultrasonic sensor is integrated into a handheld computing device. In this example, the user's hand obstructs the ultrasonic sensor's transducer from transmitting or receiving ultrasonic signals. Consequently, these ultrasonic sensors are prevented from detecting the user using time-of-flight technology.

[0032] In contrast, the described ultrasonic sensor can detect user presence without relying on time-of-flight technology. Specifically, the ultrasonic sensor can determine user presence based on occlusion of at least one receiving transducer (e.g., microphone occlusion), occlusion of at least one transmitting transducer (e.g., speaker occlusion), or a detected change in the audible noise floor of at least one transducer. In this way, the ultrasonic sensor can continue to detect user presence even if a user occludes one or more transducers of the ultrasonic sensor. In some embodiments, the transducer of the ultrasonic sensor is positioned near a component controlled by the ultrasonic sensor. In this way, the ultrasonic sensor can continue to control the operating state of the component in response to detecting that the transducer is occluded or experiences a change in the audible noise floor.

[0033] In some embodiments, an ultrasonic sensor can utilize both time-of-flight and non-time-of-flight techniques to detect user presence. For example, an ultrasonic sensor can utilize time-of-flight techniques when the user does not obstruct the transducer, and utilize non-time-of-flight techniques (particularly those disclosed herein) when the user obstructs one or more transducers.

[0034] Sample Environment

[0035] Figure 11 is an illustration of example environments 100-1 through 100-6 in which techniques using and devices including ultrasonic sensors 102 may be incorporated. In the depicted environments 100-1 through 100-6, ultrasonic sensors 102 of computing devices 104 are capable of detecting one or more objects (e.g., users). Computing devices 104 are illustrated as smartphones in environments 100-1 through 100-6. In general, computing devices 104 may be, for example, computing devices including a computer processor and a computer-readable medium.

[0036] In environments 100-1 and 100-2, a user is far away from computing device 104 and ultrasonic sensor 102 does not detect the user's presence. In environment 100-1, computing device 104 is alone in the environment (e.g., an empty room). In environment 100-2, a user approaches computing device 104 from a large distance. For example, this distance may be on the order of several meters (e.g., greater than 5 meters). Ultrasonic sensor 102 does not detect the user's presence in environments 100-1 and 100-2 because the user is beyond the maximum detection range of ultrasonic sensor 102.

[0037] When a user is very close to computing device 104 (e.g., within the maximum detection range of ultrasonic sensor 102), ultrasonic sensor 102 detects the presence of the user. In environment 100-3, the user moves their hand toward computing device 104, which reduces the distance between computing device 104 and the user's hand. In environment 100-4, two users are sitting near computing device 104 (e.g., on a nearby sofa). In this example, ultrasonic sensor 102 can detect the presence of one or more users.

[0038] Ultrasonic sensor 102 also detects the presence of a user when the user makes contact with computing device 104, as shown in environments 100-5 and 100-6. Contact between the user and computing device 104 may include a touch with a hand, a rubbing motion with a hand, or a sliding or rolling motion with a hand. In environment 100-5, a hand touches the display of computing device 104 and ultrasonic sensor 102 detects the presence of the user. In environment 100-6, a user reaches for computing device 104 stored in a wallet and ultrasonic sensor 102 detects contact between the user and computing device 104. Figure 2 The computing device 104 and the ultrasonic sensor 102 are further described.

[0039] Example Ultrasonic Sensor

[0040] Figure 2An ultrasonic sensor 102 is illustrated as part of a computing device 104. The computing device 104 is illustrated with various non-limiting example devices, including a desktop computer 104-1, a tablet computer 104-2, a laptop computer 104-3, a television 104-4, a computing watch 104-5, computing glasses 104-6, a gaming system 104-7, a microwave oven 104-8, and a vehicle 104-9. Other devices may also be used, including home service devices, smart speakers, smart thermostats, security cameras, baby monitors, Routers, drones, trackpads, drawing tablets, netbooks, e-readers, home automation and control systems, wall displays, virtual reality headsets, and other home appliances. Note that computing device 104 can be wearable, non-wearable but mobile, or relatively stationary (e.g., desktop computers and appliances).

[0041] The computing device 104 includes one or more computer processors 202 and one or more computer-readable media 204 (including memory media and storage media). Applications and / or operating systems (not shown) embodied as computer-readable instructions on the computer-readable media 204 can be executed by the computer processor 202 to provide some of the functionality described herein. The computer-readable media 204 also includes an ultrasonic sensor application 206 that uses data generated by the ultrasonic sensor 102 to perform functions. For example, the ultrasonic sensor application 206 uses ultrasonic sensor data to perform functions to improve the user experience. If there is an occlusion of the speaker or microphone of the computing device 104, the ultrasonic sensor application 206 can notify the user. For example, the notification can include an alert on the display of the computing device 104, an alert sound, or tactile feedback.

[0042] The computing device 104 may also include a network interface 208 for transmitting data over a wired, wireless, or optical network. For example, the network interface 208 may transmit data over a local area network (LAN), a wireless local area network (WLAN), a personal area network (PAN), a wired local area network (WAN), an intranet, the Internet, a peer-to-peer network, a point-to-point network, a mesh network, etc. The computing device 104 may also include a display (not shown).

[0043] The ultrasonic sensor 102 includes a communication interface 210 to transmit ultrasonic sensor data to a remote device, although its use is not required when the ultrasonic sensor 102 is integrated within the computing device 104. Generally speaking, the ultrasonic sensor data provided by the communication interface 210 is in a format usable by the ultrasonic sensor application 206.

[0044] The ultrasonic sensor 102 includes at least one transducer 212 that can convert electrical signals into sound waves. The transducer 212 can also detect sound waves and convert them into electrical signals. These electrical signals and sound waves can include frequencies in the ultrasonic range and / or the audible range, either of which can be used to detect the presence of a user.

[0045] The spectrum (e.g., frequency range) used by the transducer 212 to generate the ultrasonic signal can include frequencies from the low end of the audible range to the high end of the ultrasonic range, 20 hertz (Hz) to 2 megahertz (MHz), or include frequencies within the ultrasonic range, 20 kilohertz (kHz) to 2 MHz. In some cases, the spectrum can be divided into multiple sub-spectra with similar or different bandwidths. For example, the different frequency sub-spectra can include 30 to 500 kHz, 30 to 70 kHz, 80 to 500 kHz, 1 to 2 MHz, 26 to 29 kHz, 31 to 34 kHz, or 33 to 36 kHz.

[0046] These frequency sub-spectra may be contiguous or non-contiguous, and the transmitted signal may be modulated in phase and / or frequency. To achieve coherence, the transducer 212 may use multiple frequency sub-spectra (contiguous or non-contiguous) having the same bandwidth to generate multiple ultrasonic signals, which are transmitted simultaneously or separated in time. In some cases, a single ultrasonic signal may be transmitted using multiple contiguous frequency sub-spectra, thereby enabling the ultrasonic signal to have a wide bandwidth.

[0047] In an exemplary embodiment, the transducer 212 of the ultrasonic sensor 102 has a monostatic topology. With this topology, the transducer 212 can convert electrical signals into acoustic waves and vice versa (e.g., can transmit or receive ultrasonic signals). Example monostatic transducers can include piezoelectric transducers, capacitive transducers, and micromachined ultrasonic transducers (MUTs) using microelectromechanical systems (MEMS) technology.

[0048] Alternatively, the transducer 212 can be implemented using a bistatic topology, which includes multiple transducers located at different locations on the computing device 104. In this case, the first transducer converts electrical signals into sound waves (e.g., transmits ultrasonic signals) and the second transducer converts sound waves into electrical signals (e.g., receives ultrasonic signals). The example bistatic topology can be implemented using at least one microphone and at least one speaker. The microphone and speaker can be dedicated to the operation of the ultrasonic sensor 102. Alternatively, the microphone and speaker can be shared by the computing device 104 and the ultrasonic sensor 102.

[0049] The ultrasonic sensor 102 includes at least one analog circuit 214, which includes circuitry and logic for conditioning electrical signals in the analog domain. The analog circuit 214 may include waveform generators, analog-to-digital converters, amplifiers, filters, mixers, and switches for generating and modifying electrical signals. In some embodiments, the analog circuit 214 includes other hardware circuitry associated with a speaker or microphone.

[0050] The ultrasonic sensor 102 also includes one or more system processors 216 and one or more system media 218 (e.g., one or more computer-readable storage media). The system processor 216 processes the electrical signals in the digital domain. The system media 218 optionally includes a user detection module 220 and a component control module 222. The user detection module 220 and the component control module 222 can be implemented using hardware, software, firmware, or a combination thereof. In this example, the system processor 216 implements the user detection module 220 and the component control module 222. Together, the user detection module 220 and the component control module 222 enable the system processor 216 to process responses (e.g., electrical signals) from the transducer 212 to detect the presence of a user and change the operating state of the component 224 accordingly.

[0051] The user detection module 220 detects the presence of a user based on the electrical signal received by the transducer 212. Figure 1 In the embodiment of the present invention, the user detection module 220 uses time-of-flight technology to detect the presence of the user when the user is in close proximity to the computing device 104, as shown in environments 100-3 and 100-4. The user detection module 220 also uses non-time-of-flight technology to detect the presence of the user when the user is in contact with the computing device 104, as shown in environments 100-5 and 100-6.

[0052] In response to detecting the presence of a user, the component control module 222 controls the operating state of at least one component 224 of the computing device 104. Figure 1 , ultrasonic sensor 102 detects users in environments 100 - 3 , 100 - 4 , 100 - 5 , and 100 - 6 due to close proximity or contact between the users and computing device 104 . In response, component control module 222 triggers a change in the operating state (e.g., active or inactive state) of component 224 to improve the user experience and / or manage power of computing device 104 .

[0053] The computing device 104 includes a component 224 that is distinct from (e.g., separate from) the ultrasonic sensor 102 and has at least two operating states. In some examples, the component 224 consumes different amounts of power in different operating states. In other examples, the component 224 operates differently in the various operating states (e.g., selectively emitting sound in a first operating state and remaining silent in a second operating state, selectively emitting light in a first operating state and not emitting light in a second operating state, transmitting radio frequency signals at different power levels or beam steering angles). Figure 3-1 The example component 224 is further described.

[0054] Figure 3-1 1 and 2. Example interconnections between the ultrasonic sensor 102 and other components of the computing device 104 are illustrated. In the depicted example, the ultrasonic sensor 102 is connected (directly or indirectly) to the component 224. During operation, the ultrasonic sensor 102 transmits a control signal 302 to the component 224 to change the operating state of the component 224. For example, the control signal 302 may include a command to change the operating state of the component 224 from an inactive state to an active state (or vice versa), a command to adjust the amount of power consumed by the component 224, or a command to change the sound or light emitted from the computing device 104. In other embodiments not shown, the ultrasonic sensor 102 may transmit the control signal 302 to the component 224. Figure 2 ) computer processor 202, which forwards the control signal 302 to component 224.

[0055] As an example, component 224 may include an optical sensor 304 that emits light in an active state and does not emit light in an inactive state. Additionally or alternatively, component 224 may include a position sensor, a camera, a display, a health sensor, an accelerometer, a barometer, an inertial motion sensor, or a wireless communication module. An example sequence of events may cause ultrasonic sensor 102 to change the operating state of component 224, such as with respect to Figure 3-2 and 3-3 Further described.

[0056] Figure 3-2 and 3-3 The sequence flow chart is shown in Figure 306-1, with time progressing from left to right. At 306-1, user 305 is at a distance 308-1 from computing device 104. This distance is large enough (e.g., 5 meters or more) that ultrasonic sensor 102 cannot detect the presence of user 305. When user 305 approaches computing device 104 and is at a smaller distance 308-2 as shown at 306-2, ultrasonic sensor 102 detects the presence of user 305 because user 305 is within the detectable range of ultrasonic sensor 102.

[0057] Figure 3-3Ultrasonic sensor 102 is shown changing the operational state of component 224. In this example, component 224 is optical sensor 304, which emits light in second operational state 312 (e.g., active state). At 314-1, ultrasonic sensor 102 places optical sensor 304 in first operational state 316 (e.g., inactive state), in which the sensor does not emit light, because user 305 is located at a distance 308-3 from computing device 104 that is greater than a threshold distance. As an example, the threshold distance may be five centimeters. In this case, ultrasonic sensor 102 may detect the presence of user 305 in 314-1, but user 305 is far enough away from optical sensor 304 to maintain component 224 in the inactive state.

[0058] At 314-2, user 305 reaches for computing device 104, bringing user 305 within distance 308-4 of computing device 104. In this case, distance 308-4 is less than a threshold distance (e.g., five centimeters). As a result, ultrasonic sensor 102 triggers optical sensor 304 to change operating state. Optical sensor 304 changes from first operating state 316 to second operating state 312, in which it emits light 320 to detect close proximity of user 305 or to perform other operations.

[0059] Although Figure 3-1 and 3-3 The example component 224 is shown as an optical sensor 304, and the component 224 may also include Figure 3-1 . For example, if component 224 is a display, ultrasonic sensor 102 can control the brightness of the display based on the presence of user 305 to improve the user experience or save power when user 305 is not present. In this example, user 305 reaches for computing device 104, triggering component 224 to increase the display brightness. User 305 may find the automatic brightening of the display pleasing. In this way, ultrasonic sensor 102 anticipates the needs or desires of user 305.

[0060] return Figure 3-1 , computing device 104 may optionally include an inertial sensor 322 that detects motion of computing device 104. Inertial sensor 322 may control the operational state of ultrasonic sensor 102 based on the motion or lack of motion of computing device 104. If inertial sensor 322 detects motion of computing device 104, inertial sensor 322 transmits an alert signal 324 to ultrasonic sensor 102 to indicate that computing device 104 is in motion and may be being held by user 305. Alert signal 324 triggers a change in the operational state of ultrasonic sensor 102.

[0061] In other embodiments, the inertial sensor 322 can influence the ultrasonic sensor 102's control of the component 224. For example, in response to determining that the user 305 is less than a threshold distance from the optical sensor 304 and the alert signal 324 indicates that the computing device 104 is in motion, the ultrasonic sensor 102 can cause the optical sensor 304 to transition from the first operating state 316 to the second operating state 312. In this case, the ultrasonic sensor 102 can be in an active state even if the alert signal 324 indicates that the computing device 104 is stationary.

[0062] For example, in Figure 3-2 In the example, at 306-1, ultrasonic sensor 102 is operating in an inactive state or power saving state. At 306-2, when user 305 touches computing device 104, inertial sensor 322 detects the motion of computing device 104. As a result, inertial sensor 322 causes ultrasonic sensor 102 to transition from the inactive state to the active state. In the active state, ultrasonic sensor 102 transmits and receives ultrasonic signals and detects user 305. By controlling the operating state of ultrasonic sensor 102, inertial sensor 322 enables computing device 104 to save power when computing device 104 is stationary and user 305 is outside the detectable range of ultrasonic sensor 102. In this way, inertial sensor 322 limits the operation of ultrasonic sensor 102 to situations where user 305 is likely to be present and / or interacting with computing device 104 (e.g., moving it).

[0063] At 306-2, 314-1, and 314-2, the ultrasonic sensor 102 may utilize time-of-flight technology, occlusion detection technology (eg, non-time-of-flight technology), or a combination thereof to detect the user. Figure 4 The operation of the ultrasonic sensor 102 for detecting the presence of a user is further described.

[0064] Figure 4 An example embodiment of the transducer 212, analog circuitry 214, and system processor 216 of the ultrasonic sensor 102 is illustrated. In the depicted configuration, the analog circuitry 214 is coupled between the transducer 212 and the system processor 216. The analog circuitry 214 includes a transmitter 402 and a receiver 404. The transmitter 402 includes a waveform generator 406 coupled to the system processor 216. The receiver 404 includes a plurality of receive channels 408-1 through 408-M, where M represents a positive integer. In other embodiments not shown, the receiver 404 includes a single receive channel 408-1. The receive channels 408-1 through 408-M are coupled to the system processor 216.

[0065] The transducer 212 is implemented in a bi-static topology and includes at least one speaker 410-1 and at least one microphone 412-1. The speaker 410-1 is coupled to the transmitter 402, while the microphone 412-1 is coupled to the receiving channel 408-1 of the receiver 404. Figure 4 , an additional speaker 410-S is shown coupled to the transmitter 402 and an additional microphone 412-M is shown coupled to the receive channel 408-M, where S comprises an integer value corresponding to the number of speakers used by the ultrasonic sensor 102 and M comprises an integer value corresponding to the number of microphones used by the ultrasonic sensor 102.

[0066] Although Figure 4 The ultrasonic sensor 102 in FIG. 1 includes multiple speakers 410 - 1 and 410 -S and multiple microphones 412 - 1 and 412 -M. Other embodiments of the ultrasonic sensor 102 may include a single speaker and a single microphone, multiple speakers and a microphone, a single speaker and multiple microphones, or other types of transducers capable of transmitting and / or receiving. In some embodiments, the speakers 410 - 1 to 410 -S and the microphones 412 - 1 to 412 -M may also operate using audible signals. For example, the computing device 104 may play music through the speakers 410 - 1 to 410 -S and detect the voice of the user 305 using the microphones 412 - 1 to 412 -M.

[0067] During transmission, transmitter 402 transmits electrical signals to speakers 410-1 through 410-S, which transmit ultrasonic transmit signals 414-1 and 414-S, respectively. Specifically, waveform generator 406 generates electrical signals that may have similar waveforms (e.g., similar amplitude, phase, and frequency) or different waveforms (e.g., different amplitude, phase, and / or frequency). Waveform generator 406 also transmits the electrical signals to system processor 216 for digital signal processing. Ultrasonic transmit signals 414-1 through 414-S may or may not be reflected by an object (e.g., user 305).

[0068] During reception, each microphone 412-1 to 412-M receives a version of an ultrasonic receive signal 416-1 to 416-M, respectively. The relative phase difference, frequency, and amplitude between the ultrasonic receive signals 416-1 to 416-M and the ultrasonic transmit signals 414 to 414-S may vary due to the interaction of the ultrasonic transmit signals 414-1 to 414-S with nearby objects or the external environment (e.g., path loss, noise sources). Based on the location of the microphones 412-1 and 412-M on the computing device 104, the ultrasonic receive signals 416-1 to 416-M may have different phases. Therefore, a "version of the ultrasonic transmit signal" refers to the ultrasonic transmit signal after it has interacted with nearby objects (e.g., a user) and / or the environment. Generally speaking, such interactions may change one or more properties of the transmitted signal (e.g., the frequency, phase, and / or amplitude of the transmitted signal), otherwise distort the transmitted signal (e.g., by adding or removing one or more frequency components, or changing the amplitude and / or phase of one or more frequency components relative to other frequency components), and / or introduce a time delay.

[0069] Depending on the circumstances, ultrasonic receive signals 416-1 and 416-M may each include a version of ultrasonic transmit signal 414-1, a version of ultrasonic transmit signal 414-S, an audible signal, or some combination thereof. In other cases, at least one of ultrasonic receive signals 416-1 and 416-M does not include a version of ultrasonic transmit signal 414-1 or 414-S.

[0070] System processor 216 includes user detection module 220 and component control module 222. User detection module 220 receives signals from waveform generator 406 and receive channels 408-1 and 408-M and analyzes these signals to determine the presence of user 305. In some cases, user detection module 220 uses digital filters to separate signals in the audible frequency range from signals in the ultrasonic frequency range. Figure 6-8 Exemplary occlusion detection techniques are further described.User detection module 220 may also perform range compression, baseband processing, clutter filter removal, constant false alarm rate detection, and / or heuristics.

[0071] In some cases, the user detection module 220 uses time-of-flight technology and / or triangulation technology to directly measure the slant distance and angle to the user 305, respectively. In this way, the user detection module 220 can determine the relative position of the user 305. In addition, if the relative position of the component 224 is known to the ultrasonic sensor 102, the user detection module 220 can also determine the relative position of the user 305 with respect to the component 224. With this knowledge, the ultrasonic sensor 102 can perform more precise control over the operating state of the component 224 based on the relative position of the user 305 with respect to the component 224. In other cases, the user detection module 220 uses occlusion detection technology to detect the presence of a user. Figure 6-8 These occlusion detection techniques (eg, non-time-of-flight techniques) are further described.

[0072] In response to detecting the user 305, the user detection module 220 may transmit a detection signal 418 to the ultrasonic sensor application 206. The detection signal 418 may alert the computing device 104 to the detection event and be passed along with additional ultrasonic sensor data (e.g., information about the user's location or movement). The user detection module 220 may also pass the detection signal 418 to the component control module 222. Based on the detection signal 418, the component control module 222 generates a control signal 302 that controls the operating state of the component 224, such as Figure 3-3 shown.

[0073] In some embodiments, the system processor 216 receives the Figure 3-1 The inertial sensor 322 receives the warning signal 324. Based on the warning signal 324, the system processor 216 operates the ultrasonic sensor 102 in an inactive state or an active state. Figure 5 Example locations of microphones 412 - 1 through 412 -M and speakers 410 - 1 and 410 -S on computing device 104 are further described.

[0074] Figure 5 Example locations of microphones 412-1 through 412-M and speakers 410-1 through 410-S on computing device 104 are shown. Figure 5 The example computing device 104 is shown as including multiple microphones 412-1 and 412-M and multiple speakers 410-1 and 410-S, and the ultrasonic sensor 102 can operate with one or more of these microphones 412-1 through 412-M and one or more of these speakers 410-1 through 410-S at any given time.

[0075] In environment 500, microphone 412-1 is positioned at a distance 502-1 from microphone 412-M, and speaker 410-1 is positioned at a distance 502-2 from speaker 410-S. In some embodiments, distances 502-1 and 502-2 may be at least five centimeters. Additionally or alternatively, microphones 412-1 through 412-M and speakers 410-1 through 410-S are positioned within different portions of computing device 104. Consider an example in which computing device 104 includes a first portion 504 and a second portion 506 defined by a plane perpendicular to the longest side of computing device 104 and passing through the middle of computing device 104. In this example, speaker 410-1 is positioned within first portion 504, and speaker 410-1S is positioned within second portion 506. Similarly, microphone 412-1 is positioned within first portion 504, and microphone 412-M is positioned within second portion 506. Generally speaking, the positions of microphones 412-1 through 412-M make it unlikely that a user would obstruct all of microphones 412-1 through 412-M with a typical grip. In other words, distance 502-1 is far enough away that at least one of microphones 412 is not obstructed by a user's appendage, which obstructs at least one of the other microphones 412. Similarly, the positions of speakers 410-1 through 410-S make it unlikely that a user would obstruct all of speakers 410-1 through 410-S with a typical grip. In other words, distance 502-2 is far enough away that at least one of speakers 410 is not obstructed by a user's appendage, which obstructs at least one of the other speakers 410.

[0076] Computing device 104 is also Figure 5 1 and 410-1. The ultrasonic sensor 102 is shown to include an optical sensor 304 located near (e.g., in proximity to) the microphone 412-1 and the speaker 410-1. In this way, the ultrasonic sensor 102 can utilize occlusion detection techniques to control the operating state of the optical sensor 304. For example, if the ultrasonic sensor 102 detects that the user 305 is near the microphone 412-1 and / or the speaker 410-1, the ultrasonic sensor 102 can assume that the user 305 is also near the optical sensor 304 and adjust the operating state of the optical sensor 304 accordingly. The ultrasonic sensor 102 of the example computing device 104 can detect user presence based on occlusion of one or more microphones (412-1 or 412-M), occlusion of one or more speakers (410-1 or 410-S), and / or changes in the audible background noise, as described with respect to FIG. Figure 6 、 7 and 8 as further described.

[0077] In an example embodiment, the ultrasonic sensor 102 uses a single microphone (e.g., microphone 412-1) and a single speaker (e.g., speaker 410-1). In this case, the ultrasonic sensor 102 can use occlusion detection technology to detect the presence of a user. During operation, the speaker 410-1 transmits an ultrasonic transmit signal 414-1. If the microphone 412-1 does not receive the ultrasonic receive signal 416-1, the user detection module 220 determines that the user 305 is present and is occluding the speaker 410-1 or the microphone 412-1. The component control module 222 can transmit the control signal 302 to the component 224 to change its operating state. In this example, the ultrasonic sensor 102 may not be able to determine which transducer 212 (speaker 410-1 or microphone 412-1) is occluded. To better locate the occlusion, the ultrasonic sensor 102 can utilize multiple microphones 412 and / or speakers 410, as described with respect to FIG. Figure 6 and 7 Further described.

[0078] Figure 6 An example technique for detecting user presence based on microphone occlusion is illustrated. In environment 600, ultrasonic sensor 102 transmits at least one of ultrasonic transmit signals 414-1 and 414-S using speakers 410-1 and 410-S, respectively. However, ultrasonic sensor 102 receives ultrasonic receive signal 416-1 using only microphone 412-1. Ultrasonic receive signal 416-1 represents a version of ultrasonic transmit signal 414-1 and / or 414-S that may or may not be reflected by user 305. In this case, microphone 412-M either does not receive ultrasonic receive signal 416-M or receives ultrasonic receive signal 416-M with insufficient amplitude for detection due to user 305's hand obscuring microphone 412-M.

[0079] Receiver 404 communicates this information to system processor 216. User detection module 220 determines that microphone 412-M is blocked and generates a detection signal 418 to indicate the presence of user 305. Detection signal 418 may further indicate that user 305 is near microphone 412-M. In some cases, component control module 222 may transmit control signal 302 to change the operating state of component 224. For example, if user 305 reaches for computing device 104 and blocks microphone 412-M, ultrasonic sensor 102 may detect this blockage and trigger optical sensor 304 to change to second operating state 312, as shown in FIG. Figure 3-3 shown.

[0080] Figure 7Another example technique for detecting user presence based on speaker occlusion is illustrated. In environment 700, ultrasonic sensor 102 transmits ultrasonic transmit signals 414-1 through 414-S. Ultrasonic transmit signals 414-1 through 414-S have different waveforms to enable ultrasonic sensor 102 to distinguish between received versions of these signals. Figure 7 , ultrasonic transmit signal 414-S is not explicitly depicted because the hand of user 305 blocks speaker 410-S. Ultrasonic sensor 102 receives at least one of ultrasonic receive signals 416-1 through 416-M, which includes a version of ultrasonic transmit signal 414-1. The version of ultrasonic transmit signal 414-1 may or may not be reflected by the hand of user 305.

[0081] The receiver 404 communicates this information to the system processor 216. The user detection module 220 determines that the speaker 410-S is blocked and generates a detection signal 418 to indicate the presence of the user 305. The detection signal 418 may further indicate that the user 305 is close to the speaker 410-S. In some cases, the component control module 222 may transmit a control signal 302 to change the operating state of the component 224. For example, if the user 305 reaches for the computing device 104 and blocks the speaker 410-S, the ultrasonic sensor 102 may detect this blockage and trigger the optical sensor 304 to change to the second operating state 312, as shown in FIG. Figure 3-3 shown.

[0082] In another example embodiment, the ultrasonic sensor 102 detects the presence of a user using a single microphone (e.g., microphone 416-1). In this case, the microphone 416-1 does not receive a detectable version of the ultrasonic transmit signals 414-1 through 414-S. In this case, the ultrasonic sensor 102 determines that the user 305 is present and is blocking the speakers 410-1 through 410-S and / or the microphone 416-1.

[0083] In yet another example embodiment, the ultrasonic sensor 102 uses two microphones and a single speaker (e.g., speaker 410-1) to detect user presence based on speaker occlusion. In this case, the speaker 410-1 transmits an ultrasonic transmit signal 414-1. If neither the microphones 412-1 nor 412-M receive a detectable version of the ultrasonic transmit signal 414-1, the ultrasonic sensor 102 determines that the speaker 410-1 is occluded (e.g., by the hand of the user 305).

[0084] Figure 8 An example technique for detecting the presence of a user based on changes in the audible noise floor 802 is illustrated. Figure 8, the example sequence of events results in a change in the audible noise floor 802 associated with the audible received signal 804. In some cases, the audible noise floor 802 may change due to frictional motion of the user's 305 hand across or near the microphone 412-M (e.g., rubbing of the hand, movement of fingers).

[0085] In environment 806-1, microphone 412-M is not obstructed and receives audible receive signal 804. Audible receive signal 804 has a corresponding audible noise floor 802. At this point, audible noise floor 802 has a low amplitude. Later, in environment 806-2, user 305 moves their hand over or next to microphone 412-M, which causes a frictional motion across computing device 104. This contact between user 305 and computing device 104 increases the amplitude of audible noise floor 802, resulting in a noise floor change 808 that can be detected by ultrasonic sensor 102.

[0086] Generally, the noise floor variation 808 may include variations in the amplitude, frequency, and / or phase of the audible noise floor 802. Figure 8 , noise floor change 808 includes a detectable change over time in audible noise floor 802. For example, the detectable change may include a 50% or greater increase in the amplitude of audible noise floor 802. In environment 806-2, the amplitude of audible noise floor 802 increases significantly due to the rubbing action performed by user 305.

[0087] Alternatively, noise floor change 808 may include a decrease in the magnitude of audible noise floor 802. For example, if user 305 blocks at least a portion of microphone 412-M, noise floor 802 may decrease due to a decrease in detected ambient noise. Ultrasonic sensor 102 may detect this noise floor change 808 and determine that user 305 is in the vicinity of computing device 104.

[0088] Additionally or alternatively, the ultrasonic sensor 102 can detect the presence of a user by comparing the audible noise floor 802 with a noise floor associated with an ultrasonic frequency range (e.g., an ultrasonic noise floor). If the audible noise floor 802 has a higher amplitude (e.g., 50% or more) than the ultrasonic noise floor, the ultrasonic sensor 102 determines that the user is present.

[0089] Ultrasonic sensor 102 can also analyze the shape of audible received signal 804 to detect user 305. In some cases, the spectrum of audible received signal 804 has a Gaussian shape when microphone 412-M is not obstructed, and has an irregular shape when user 305 is close to microphone 412-M. By detecting changes in audible noise floor 802, detecting differences between audible noise floor 802 and ultrasonic noise floor, and / or detecting changes in the shape of audible received signal 804, ultrasonic sensor 102 can detect user 305 using a single receiving transducer 212.

[0090] In some embodiments, the ultrasonic sensor 102 can also detect the presence of a user based on changes in the ultrasonic noise floor (not depicted). Similar techniques as described above with respect to detecting changes in the audible noise floor 802 can be applied to detect the presence of the user 305 based on changes in the ultrasonic noise floor.

[0091] Although not depicted, Figure 6-8 The techniques for detecting the presence of a user described in

[0045] can be applied to a computing device 104 that includes any of: at least one microphone, where M is greater than or equal to 1; and at least one speaker, where S is greater than or equal to 1. For example, the ultrasonic sensor 102 can operate using M microphones and S speakers to detect occlusion of the one or more transducers 212, where M and S are integer values.

[0092] Example Method

[0093] Figure 9 An example method 900 for detecting user presence based on microphone occlusion is depicted. The method 900 is shown as a set of operations (or actions) performed and is not necessarily limited to the order or combination of operations shown herein. Furthermore, any one or more operations may be repeated, combined, reorganized, or chained to provide a wide range of additional and / or alternative methods. In portions of the following discussion, reference may be made to Figure 1 Environment 100-1 to 100-6 and Figure 2 4, references thereto are made by way of example only. These techniques are not limited to execution by one or more entities operating on one computing device 104.

[0094] At 902, an ultrasonic sensor is used to transmit an ultrasonic transmission signal. For example, the ultrasonic sensor 102 transmits an ultrasonic transmission signal 414-1 or 414-S, such as Figure 6As shown. The ultrasonic transmit signal 414-1 or 414-S includes a frequency between approximately 20 kHz and 2 MHz and can represent a pulsed signal or a continuous signal. In some cases, the ultrasonic sensor 102 modulates the characteristics of the ultrasonic transmit signal 414-1 or 414-S, including the phase and / or frequency. In some embodiments, the ultrasonic sensor 102 transmits the ultrasonic transmit signal 414-1 or 414-S in response to receiving the alert signal 324 from the inertial sensor 322, such as Figure 3-1 shown.

[0095] The ultrasonic sensor 102 may transmit the ultrasonic transmit signal 414-1 or 414-S using the dedicated transducer 212. In other embodiments, the ultrasonic sensor 102 may transmit the ultrasonic transmit signal 414-1 or 414-S using a shared speaker (e.g., speaker 410-1 or 410-S) of the computing device 104. In some cases, the shared speaker also transmits an audible signal during a portion of the time that the ultrasonic transmit signal 414-1 or 414-S is transmitted.

[0096] At 904, an ultrasonic receive signal is received using a first transducer of an ultrasonic sensor. The ultrasonic receive signal includes a version of the ultrasonic transmit signal. For example, the ultrasonic sensor 102 uses Figure 6 The first microphone 412-1 receives an ultrasonic receive signal 416-1. The ultrasonic receive signal 416-1 is a version of the ultrasonic transmit signal 414-1 (e.g., a delayed version of the ultrasonic transmit signal 414-1). In some cases, the ultrasonic receive signal 416-1 has a different amplitude and / or is offset in phase and / or frequency than the ultrasonic transmit signal 414-1. The ultrasonic receive signal 416-1 may or may not include a version of the ultrasonic transmit signal 414-1 that was reflected by an object (e.g., the user 305). In some embodiments, the ultrasonic sensor 102 receives the ultrasonic receive signal 416-1 during at least a portion of the time that the ultrasonic transmit signal 414-1 or 414-S is being transmitted.

[0097] At 906, occlusion of the second transducer of the ultrasonic sensor is detected. For example, the ultrasonic sensor 102 detects that the microphone 412-M is blocked. Specifically, the ultrasonic sensor 102 may analyze the ultrasonic receive signal 416-M received by the microphone 412-M to determine whether the version of the ultrasonic transmit signal 414-1 is not present or the amplitude of the version of the ultrasonic transmit signal 414-1 is less than a detection threshold.

[0098] At 908 , the presence of an object is determined in response to detecting that the second transducer is occluded. For example, the ultrasonic sensor 102 determines that an object (eg, the user 305 ) is present in response to detecting an occlusion of the microphone 412 -M.

[0099] Figure 10 An example method 1000 for detecting user presence based on speaker occlusion is depicted. The method 1000 is shown as a set of operations (or actions) performed but is not necessarily limited to the order or combination of operations shown herein. Furthermore, any one or more of the operations may be repeated, combined, reorganized, or chained to provide a wide range of additional and / or alternative methods. In portions of the following discussion, reference may be made to Figure 1 Environment 100-1 to 100-6 and Figure 2 4, references thereto are by way of example only. These techniques are not limited to execution by one or more entities operating on one computing device 104.

[0100] At 1002, the ultrasonic sensor transmits a first ultrasonic transmission signal. For example, the ultrasonic sensor 102 transmits a first ultrasonic transmission signal 414-1 using the first speaker 410-1, such as Figure 7 shown.

[0101] At 1004, a second ultrasonic transmission signal is transmitted using a second transducer of the ultrasonic sensor. The first ultrasonic transmission signal and the second ultrasonic transmission signal have different waveforms. For example, the ultrasonic sensor 102 uses Figure 7 The speaker 410-S transmits an ultrasonic transmission signal 414-S. The ultrasonic transmission signals 414-1 and 414-S have different waveforms. For example, the ultrasonic transmission signals 414-1 and 414-S may have different amplitudes, phases, and / or frequencies.

[0102] Ultrasonic transmit signals 414-1 and 414-S include frequencies between approximately 20 kHz and 2 MHz. Ultrasonic transmit signals 414-1 and 414-S may also be pulsed or continuous signals. In some cases, ultrasonic sensor 102 modulates characteristics of ultrasonic transmit signals 414-1 and 414-S, including phase and / or frequency. In some embodiments, ultrasonic sensor 102 transmits ultrasonic transmit signals 414-1 and 414-S in response to receiving alert signal 324 from inertial sensor 322, as shown in FIG3 .

[0103] The ultrasonic sensor 102 may transmit the ultrasonic transmit signals 414-1 and 414-S using the dedicated transducer 212. In other embodiments, the ultrasonic sensor 102 may transmit the ultrasonic transmit signals 414-S using a shared speaker (e.g., speakers 410-1 and 410-S) of the computing device 104. In some cases, the shared speaker also transmits an audible signal during a portion of the time that the ultrasonic transmit signals 414-S are being transmitted.

[0104] At 1006, the ultrasonic sensor receives an ultrasonic receive signal. The ultrasonic receive signal includes a version of the first ultrasonic transmit signal. For example, the ultrasonic sensor 102 uses Figure 7 Microphone 412-1 receives ultrasonic receive signal 416-1. Ultrasonic receive signal 416-1 is a version of ultrasonic transmit signal 414-1. In some cases, ultrasonic receive signal 416-1 has a different amplitude than ultrasonic transmit signal 414-1 and is offset in phase and / or frequency. Ultrasonic receive signal 416-1 may or may not include a version of ultrasonic transmit signal 414-1 that was reflected by an object (e.g., user 305). In some embodiments, ultrasonic sensor 102 receives ultrasonic receive signal 416-1 during at least a portion of the time that ultrasonic transmit signals 414-1 and 414-S are transmitted.

[0105] At 1008, occlusion of the second transducer of the ultrasonic sensor is detected. For example, the ultrasonic sensor 102 detects that the speaker 410-S is blocked. Specifically, the ultrasonic sensor 102 may compare the ultrasonic transmit signal 414-S with the ultrasonic receive signal 416-M corresponding to the ultrasonic transmit signal 414-S to determine whether a version of the ultrasonic transmit signal 414-S is not present or the amplitude of the ultrasonic transmit signal 414-S is less than a detection threshold.

[0106] At 1010 , the presence of an object is determined in response to detecting that the second transducer is occluded. For example, the ultrasonic sensor 102 determines that an object (eg, the user 305 ) is present in response to detecting an occlusion of the speaker 410 -S.

[0107] Figure 11 An example method 1100 for detecting the presence of a user based on changes in background noise is depicted. The method 1100 is shown as a set of operations (or actions) performed but is not necessarily limited to the order or combination of operations shown herein. In addition, any one or more operations may be repeated, combined, reorganized, or chained to provide a wide range of additional and / or alternative methods. In the following discussion, reference may be made to Figure 1 Environment 100-1 to 100-6 and Figure 2 4, references thereto are made by way of example only. These techniques are not limited to execution by one or more entities operating on one computing device 104.

[0108] At 1102, an audible reception signal is received using an ultrasonic sensor. For example, the ultrasonic sensor 102 receives the audible reception signal 804 using the microphone 412-M, such as Figure 8As shown. The audible received signal 804 includes frequencies within the audible range between approximately 20 Hz and 20 kHz. The audible received signal 804 may include noise (e.g., internal, electrical, external). The noise has an audible noise floor 802, which represents the maximum or average amplitude of the noise. In addition to being able to receive the audible received signal 804, the ultrasonic sensor 102 is also capable of receiving ultrasonic received signals (e.g., signals with a frequency range between approximately 20 kHz and 2 MHz). In this manner, the ultrasonic sensor 102 may be capable of performing methods 900 and / or 1000 and method 1100. Alternatively or additionally, the ultrasonic sensor 102 may be capable of detecting changes in the ultrasonic noise floor and the audible noise floor.

[0109] At 1104, a change in the audible noise floor associated with the audible received signal is detected. For example, Figure 8 The ultrasonic sensor 102 detects a noise floor variation 808 in the audible received signal 804. The noise floor variation 808 may include a change in the amplitude, frequency, or phase of the audible noise floor 802.

[0110] At 1106, the presence of an object is determined in response to detecting a change in the noise floor. For example, the ultrasonic sensor 102 determines that an object (e.g., user 305) is present in response to detecting a change 808 in the noise floor of the audible received signal 804 received by the microphone 412-M. The user's presence may occlude a portion of the transducer 212 and / or include rubbing motion of a user's hand or finger across the transducer 212 of the ultrasonic sensor 102 or in proximity to the transducer 212 of the ultrasonic sensor 102. For example, at Figure 8 , user 305 rubs their fingers across microphone 412 -M, which causes a rubbing motion that changes the audible noise floor 802 associated with the audible received signal 804 .

[0111] Although not explicitly shown in methods 900, 1000, or 1100, the ultrasonic sensor 102 may perform additional operations in response to determining that an object is present. For example, the ultrasonic sensor 102 may use the ultrasonic sensor application 206 to notify the user 305 or the control component 224 of the operating status, such as Figure 2 、 3-2 Furthermore, ultrasonic sensor 102 may combine different operations across methods 900, 1000, and 1100. For example, ultrasonic sensor 102 may determine that user 305 is present in response to detecting two or more of the following: microphone occlusion, speaker occlusion, or a change in audible noise floor 802.

[0112] Example computing system

[0113] Figure 12 The various components of the example computing system 1200 are illustrated, which can be implemented as any type of client, server, and / or computing device, as described with reference to the previous Figure 2 As described above, the ultrasonic sensor 102 is used to detect the presence of a user.

[0114] Computing system 1200 includes a communication device 1202 that enables wired and / or wireless communication of device data 1204 (e.g., received data, data currently being received, data scheduled for broadcast, or data packets). Although not shown, communication device 1202 or computing system 1200 may include one or more ultrasonic sensors 102 and one or more components 224. Device data 1204 or other device content may include configuration settings for the device, media content stored on the device, and / or information associated with a user 305 of the device. Media content stored on computing system 1200 may include any type of audio, video, and / or image data. Computing system 1200 includes one or more data inputs 1206 through which any type of data, media content, and / or input may be received, including human speech, input from ultrasonic sensor 102, user-selectable input (explicit or implicit), messages, music, television media content, recorded video content, and any other type of audio, video, and / or image data received from any content and / or data source.

[0115] The computing system 1200 also includes a communication interface 1208, which can be implemented as any one or more of a serial and / or parallel interface, a wireless interface, any type of network interface, a modem, and any other type of communication interface. The communication interface 1208 provides a connection and / or communication link between the computing system 1200 and a communication network, through which other electronic, computing, and communication devices communicate data with the computing system 1200.

[0116] The computing system 1200 includes one or more processors 1210 (e.g., any of microprocessors, controllers, etc.) that process various computer-executable instructions to control the operation of the computing system 1200 and implement techniques for detecting the user 305 or techniques in which the detection of the user 305 may be included. Alternatively or additionally, the computing system 1200 can be implemented using any one or a combination of hardware, firmware, or fixed logic circuitry implemented in conjunction with processing and control circuitry generally identified at 1212. Although not shown, the computing system 1200 can include a system bus or data transmission system that couples the various components within the device. The system bus can include any one or combination of different bus structures, including a memory bus or memory controller, a peripheral bus, a universal serial bus, and / or a processor or local bus using any one of a variety of bus architectures.

[0117] The computing system 1200 also includes computer-readable media 1214, including one or more memory devices that implement persistent and / or non-transitory data storage (i.e., as opposed to mere signal transmission), examples of which include random access memory (RAM), non-volatile memory (e.g., any one or more of read-only memory (ROM), flash memory, EPROM, EEPROM, etc.), and disk storage devices. The disk storage device can be implemented as any type of magnetic or optical storage device, including a hard drive, a recordable and / or rewritable compact disk (CD), any type of digital versatile disk (DVD), etc. The computing system 1200 may also include a mass storage media device (storage medium) 1216.

[0118] The computer-readable medium 1214 provides a data storage mechanism to store device data 1204 as well as various device applications 1218 and any other type of information and / or data related to the operation of the computing system 1200. For example, an operating system 1220 can be maintained as a computer application using the computer-readable medium 1214 and executed on the processor 1210. The device applications 1218 can include a device manager, including any form of control applications, software applications, signal processing and control modules, native code for a specific device, hardware abstraction layers for a specific device, etc. Using the ultrasonic sensor 102, the computing system 1200 can detect the presence of a user.

[0119] in conclusion

[0120] Although techniques and apparatuses for detecting user presence are described using language specific to features and / or methods, it should be understood that the subject matter of the appended claims is not necessarily limited to the specific features or methods described. Rather, the specific features and methods are disclosed as example implementations of ultrasonic sensors capable of detecting user presence.

[0121] Some examples are described below.

[0122] Example 1: A method of operating an ultrasonic sensor, the method comprising:

[0123] Transmitting ultrasonic transmission signals;

[0124] receiving an ultrasonic receive signal using a first transducer of the ultrasonic sensor, the ultrasonic receive signal including a version of the ultrasonic transmit signal;

[0125] detecting that the second transducer of the ultrasonic sensor is blocked; and

[0126] The object is determined to be present in response to detecting that the second transducer is occluded.

[0127] Example 2: The method of Example 1, wherein detecting that the second transducer is blocked comprises:

[0128] receiving another receive signal using a second transducer; and

[0129] Another received signal is analyzed to determine:

[0130] A version of the ultrasonic transmit signal is not present within the other receive signal; or

[0131] The amplitude of the version of the ultrasonic transmit signal is less than the detection threshold.

[0132] EXAMPLE 3 The method of Example 2, wherein detecting that the second transducer is occluded further comprises detecting a change in a noise floor across at least a portion of audible frequencies of the other received signal.

[0133] Example 4: The method of any preceding example, further comprising:

[0134] transmitting another ultrasonic transmission signal;

[0135] receiving another ultrasonic receive signal using a second transducer, the another ultrasonic receive signal including a version of the another ultrasonic transmit signal;

[0136] detecting that the first transducer is occluded; and

[0137] The presence of another object is determined based on detecting that the first transducer is occluded.

[0138] Example 5: The method of any preceding example, wherein:

[0139] Ultrasonic sensors are integrated into smartphones;

[0140] The first transducer comprises a first microphone of the smartphone; and

[0141] The second transducer comprises a second microphone of the smartphone.

[0142] Example 6: The method of Example 5, wherein:

[0143] The first microphone is spaced a distance from the second microphone; and

[0144] This distance is at least five centimeters.

[0145] EXAMPLE 7: The method of example 5 or 6, further comprising notifying a user of the smartphone of the occlusion in response to detecting that the second transducer is occluded.

[0146] Example 8: The method of any preceding example, further comprising triggering the component to transition from the first operating state to the second operating state in response to determining that the object is present,

[0147] Among other things, this component is different from an ultrasonic sensor.

[0148] Example 9: The method of Example 8, wherein the second transducer is proximate to the component.

[0149] Example 10: The method of Example 8 or 9, wherein the component includes an optical sensor.

[0150] EXAMPLE 11 The method of Example 10, wherein triggering the optical sensor to transition from the first operational state to the second operational state comprises triggering the optical sensor to transition from an inactive state to an active state that emits visible light.

[0151] EXAMPLE 12 The method of any preceding example, wherein the receiving of the ultrasonic receive signal comprises receiving a portion of the ultrasonic receive signal concurrently with transmitting a portion of the ultrasonic transmit signal.

[0152] Example 13: The method of any preceding example, further comprising:

[0153] operating in an inactive state before emitting an ultrasonic transmission signal;

[0154] receiving a warning signal from an inertial sensor; and

[0155] Transitioning from the inactive state to the active state occurs in response to receiving the alert signal.

[0156] Example 14: A method of operating an ultrasonic sensor, the method comprising:

[0157] Using a first transducer of the ultrasonic sensor to transmit a first ultrasonic transmission signal;

[0158] Using a second transducer of the ultrasonic sensor to transmit a second ultrasonic transmission signal, the first ultrasonic transmission signal and the second ultrasonic transmission signal having different waveforms;

[0159] receiving an ultrasonic receive signal, the ultrasonic receive signal including a version of the first ultrasonic transmit signal;

[0160] detecting that the second transducer is occluded; and

[0161] The object is determined to be present in response to detecting that the second transducer is occluded.

[0162] EXAMPLE 15: The method of Example 14, wherein determining that the second transducer is obscured comprises analyzing the ultrasonic receive signal to determine:

[0163] A version of the second ultrasonic transmit signal is not present in the ultrasonic receive signal; or

[0164] The amplitude of the version of the second ultrasonic transmit signal is less than a detection threshold.

[0165] Example 16: The method of Example 14 or 15, wherein the different waveforms of the first ultrasonic transmit signal and the second ultrasonic transmit signal have at least one of the following:

[0166] Different frequencies;

[0167] different phases; or

[0168] Different amplitudes.

[0169] Example 17: The method of any of Examples 14-16, further comprising:

[0170] transmitting a third ultrasonic transmission signal using the first transducer;

[0171] The fourth ultrasonic transmission signal is transmitted using the second transducer, and the third ultrasonic transmission signal and the fourth ultrasonic transmission signal have different waveforms.

[0172] receiving another ultrasonic receive signal, the other ultrasonic receive signal including a version of the fourth ultrasonic transmit signal;

[0173] detecting that the first transducer is occluded; and

[0174] The presence of another object is determined in response to detecting that the first transducer is occluded.

[0175] Example 18: The method of any of Examples 14-17, wherein:

[0176] Ultrasonic sensors are integrated into smartphones;

[0177] The first transducer comprises a first speaker of the smartphone; and

[0178] The second transducer comprises a second speaker of the smartphone.

[0179] Example 19: The method of Example 18, wherein:

[0180] The smartphone has a first portion and a second portion defined by a plane perpendicular to the longest side of the smartphone and passing through a middle portion of the smartphone;

[0181] a first speaker located within the first portion; and

[0182] The second speaker is located in the second portion.

[0183] EXAMPLE 20 The method of Example 18 or 19, further comprising notifying a user of the smartphone of the occlusion in response to detecting that the second speaker is occluded.

[0184] Example 21: The method of any of Examples 14-20, further comprising triggering a transition of the component from the first operating state to the second operating state in response to determining that the object is present,

[0185] Among other things, this component is different from an ultrasonic sensor.

[0186] EXAMPLE 22 The method of Example 21, wherein the second transducer is proximate to the component.

[0187] Example 23: The method of Example 21 or 22, wherein the component comprises an optical sensor.

[0188] EXAMPLE 24 The method of Example 23, wherein triggering the optical sensor to transition from the first operating state to the second operating state comprises triggering the optical sensor to transition from an inactive state to an active state that emits visible light.

[0189] Example 25: A method of operating an ultrasonic sensor, the method comprising:

[0190] receiving an audible reception signal;

[0191] detecting a change in a noise floor associated with an audible received signal; and

[0192] The presence of an object is determined in response to detecting a change in the noise floor.

[0193] EXAMPLE 26 The method of Example 25, wherein detecting a change in the noise floor comprises detecting a change in a magnitude of the noise floor across at least a portion of audible frequencies associated with the audible received signal.

[0194] EXAMPLE 27 The method of Example 25 or 26, wherein the audible received signal is associated with frictional movement of a transducer of the proximity ultrasonic sensor.

[0195] Example 28: The method of Example 27, wherein the frictional motion is caused by rubbing a part of the user beside or across the transducer.

[0196] Example 29: The method of Example 28, wherein:

[0197] Ultrasonic sensors are integrated into smartphones; and

[0198] The transducer includes the microphone of the smartphone.

[0199] Example 30: An apparatus comprising an ultrasonic sensor configured to perform any of the methods of claims 1-29.

[0200] Example 31: The apparatus of Example 30, wherein the apparatus comprises one of the following:

[0201] Smartphone;

[0202] Smartwatches;

[0203] Smart speakers;

[0204] desktop computers;

[0205] laptop computers;

[0206] Smart tablet computers;

[0207] security cameras;

[0208] vehicle; or

[0209] Household appliances.

[0210] Example 32: The apparatus of Example 30 or 31, wherein:

[0211] The device includes components other than an ultrasonic sensor; and

[0212] This component includes one of the following:

[0213] Optical sensors;

[0214] Proximity sensor;

[0215] Position sensor;

[0216] camera;

[0217] health sensors;

[0218] accelerometer;

[0219] barometer; or

[0220] Inertial motion sensor.

[0221] Example 33: The apparatus of Example 32, wherein:

[0222] The assembly includes an optical sensor;

[0223] The optical sensor is selectively configured to operate in an inactive state or an active state; and

[0224] The optical sensor is configured to emit visible light in an active state.

[0225] Example 34: A method of operating an ultrasonic sensor, comprising performing, in any combination:

[0226] The method according to any one of examples 1 to 13; and / or

[0227] The method of any one of Examples 14 to 24; and / or

[0228] The method of any one of Examples 25 to 29.

[0229] Example 35: A computer-readable medium comprising instructions that, when executed by a processor, cause an apparatus comprising a processor and an ultrasonic sensor to perform the method according to any one of Examples 1 to 29 or 34.

Claims

1. A method of operating an ultrasonic sensor, the method comprising: receiving an ultrasonic receive signal using a first transducer of the ultrasonic sensor, the ultrasonic receive signal including a version of the ultrasonic transmit signal; Detecting that a second transducer of the ultrasonic sensor is blocked, wherein detecting that the second transducer is blocked includes: the second transducer does not receive a second ultrasonic receive signal including a version of the ultrasonic transmit signal; or In response to the second transducer receiving the second ultrasonic receive signal, determining that the amplitude of the version of the ultrasonic transmit signal in the second ultrasonic receive signal is less than a threshold; and The presence of an object is determined in response to receiving the ultrasonic reception signal using the first transducer and detecting that the second transducer of the ultrasonic sensor is blocked.

2. The method according to claim 1, wherein Detecting that the second transducer is occluded further includes detecting a change in a noise floor across at least a portion of audible frequencies of an audible signal detected by the second transducer.

3. The method according to claim 1, further comprising: transmitting another ultrasonic transmission signal; receiving, using the second transducer, another ultrasonic receive signal, the another ultrasonic receive signal including a version of the another ultrasonic transmit signal; detecting that the first transducer is blocked; and The presence of another object is determined based on detecting that the first transducer is occluded.

4. The method according to claim 1, wherein: The ultrasonic sensor is integrated into a smartphone; The first transducer comprises a first microphone of the smartphone; and The second transducer includes a second microphone of the smartphone.

5. The method according to claim 4, wherein: The first microphone is positioned a distance from the second microphone; and The distance is at least five centimeters.

6. The method according to claim 4, further comprising: In response to detecting that the second transducer is occluded, a user of the smartphone is notified of the occlusion.

7. The method according to claim 1, further comprising: triggering a component to transition from a first operating state to a second operating state in response to determining that the object is present, Wherein, the component is different from the ultrasonic sensor.

8. The method according to claim 7, wherein: The second transducer is proximate to the component.

9. The method according to claim 7, wherein: The assembly includes an optical sensor.

10. The method according to claim 9, wherein: Triggering the optical sensor to transition from the first operating state to the second operating state includes triggering the optical sensor to transition from an inactive state to an active state that emits visible light.

11. The method according to claim 1, wherein Receiving the ultrasonic reception signal includes receiving a portion of the ultrasonic reception signal while transmitting a portion of the ultrasonic transmission signal.

12. The method according to any one of claims 1 to 11, further comprising: operating in an inactive state prior to transmitting the ultrasonic transmission signal; receiving a warning signal from an inertial sensor; as well as In response to receiving the alert signal, the ultrasonic sensor transitions from the inactive state to an active state, the active state enabling the ultrasonic sensor to transmit or receive ultrasonic signals.

13. An apparatus comprising: Ultrasonic sensors; at least one processor; as well as At least one computer-readable storage medium storing one or more instructions that, when executed by the at least one processor, cause the at least one processor to: receiving an ultrasonic receive signal using a first transducer of the ultrasonic sensor, the ultrasonic receive signal including a version of the ultrasonic transmit signal; Detecting that a second transducer of the ultrasonic sensor is blocked, wherein detecting that the second transducer is blocked includes: the second transducer does not receive a second ultrasonic receive signal including a version of the ultrasonic transmit signal; or In response to the second transducer receiving the second ultrasonic receive signal, determining that the amplitude of the version of the ultrasonic transmit signal in the second ultrasonic receive signal is less than a threshold; and The presence of an object is determined in response to receiving the ultrasonic reception signal using the first transducer and detecting that the second transducer is blocked.

14. The device according to claim 13, wherein The device comprises one of the following: Smartphone; Smartwatches; Smart speakers; desktop computers; laptop computers; Smart tablet computers; security cameras; vehicles; and Household appliances.

15. The device according to claim 13 or 14, wherein: The device includes a component other than the ultrasonic sensor; and The component includes one of the following: Optical sensors; Proximity sensor; Position sensor; camera; health sensors; accelerometer; barometer; and Inertial motion sensor.

16. The apparatus according to claim 15, wherein: The assembly includes the optical sensor; the optical sensor being selectively configured to operate in an inactive state in which the optical sensor does not emit visible light or an active state in which the optical sensor emits visible light; and Execution of the one or more instructions further causes the at least one processor to: In response to determining that the object is present, the optical sensor is transitioned from the inactive state to the active state.

17. The device according to claim 13, wherein Execution of the one or more instructions for detecting that the second transducer is occluded causes the one or more processors to: A change in a noise floor across at least a portion of the audible frequencies of the audible signal detected by the second transducer is detected.

18. The device according to claim 13, wherein Execution of the one or more instructions further causes the at least one processor to: operating the ultrasonic sensor in an inactive state before transmitting the ultrasonic transmit signal; receiving a warning signal from an inertial sensor; and The ultrasonic sensor is transitioned from the inactive state to an active state in which the ultrasonic sensor is enabled to transmit or receive ultrasonic signals in response to receiving the alert signal.

19. The device according to claim 13, wherein Execution of the one or more instructions further causes the at least one processor to: transmitting another ultrasonic transmission signal; receiving, using the second transducer, another ultrasonic receive signal, the another ultrasonic receive signal including a version of the another ultrasonic transmit signal; detecting that the first transducer is blocked; and The presence of another object is determined based on detecting that the first transducer is occluded.

20. The apparatus according to claim 13, wherein Execution of the one or more instructions further causes the at least one processor to: In response to detecting that the second transducer is occluded, a user of the apparatus is notified of the occlusion.

Images