Method and system for detecting human jaw movement based on charge change detection for user voice
The wearable device uses charge collection antennas and algorithms to accurately detect in-ear status and user interaction, enhancing audio routing and power management in small form factor accessories.
Patent Information
- Application Number
- JP2024534056
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2021-12-14
- Publication Date
- 2024-12-04
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Small form factor wireless accessories face challenges in accurately detecting user voice and in-ear status due to noise interference and difficulty distinguishing between living and inanimate objects, leading to inaccurate audio routing and battery waste.
A wearable device uses a charge collection antenna to detect jawbone and muscle movements, employing algorithms for in-ear detection and power management based on charge fluctuations, transitioning between active, standby, and charging modes.
Accurately determines the wearing state and user interaction, improving audio routing and conserving battery life by optimizing power usage based on detected conditions.
Smart Images

Figure 2024544774000001_ABST
Abstract
Description
[Background technology]
[0001] Wireless accessories such as earphones are becoming increasingly smaller. For example, earphones are being designed with smaller form factors to fit more comfortably in the user's ear. Due to the small form factor, it becomes increasingly difficult to achieve robust user voice detection based on bone vibration detection using accelerometers. This requires mounting a high-bandwidth accelerometer close to the bone of the ear canal to obtain the vibration signal.
[0002] Many conventional in-ear detection mechanisms cannot distinguish between a wireless accessory in contact with a living human being and an accessory in contact with an inanimate object, making in-ear detection very difficult in many cases.
[0003] Furthermore, voice detection using conventional mechanisms can be inaccurate: for example, voice detection from bone vibrations using accelerometers can introduce noise from ambient sounds, making the user's voice detection inaccurate. Summary of the Invention
[0004] The present disclosure provides a system and method for using a charge collecting antenna in a wearable device to collect charge changes based on the movement of a user's jaw bone and muscles. The collected charge changes may be used to determine the wearing state of the wearable device. For example, in a wireless earphone, information obtained from the charge collecting antenna may be used to determine whether the user is wearing the earphone in the ear. The collected charge changes may also be used to detect the jaw movement by the user.
[0005] Algorithms for detecting in-ear and jaw movement are described. For example, in-ear detection can be detected by a variance threshold algorithm and jaw bone / muscle movement can be detected by peak signal detection. Such algorithms can switch the device to operate in a low power mode when it is determined that the device is not being worn or is not receiving audio input, thereby conserving system power.
[0006] An aspect of the present disclosure provides a method for determining a state of a wearable electronic device using one or more metal components of the wearable electronic device as an antenna. The method may further include receiving charge change data by one or more metal components of the wearable electronic device, determining by one or more processors whether the received charge change data exceeds a predefined threshold, determining by one or more processors that the wearable electronic device is worn by a user when the received charge change data exceeds the predefined threshold, and operating the wearable electronic device in an active mode when the wearable electronic device is determined to be worn by a user. According to some examples, the method may further include processing the received charge change data, and determining whether the received charge change data exceeds the predefined threshold includes comparing the processed charge change data to a threshold. Processing the received charge change data may include at least one of amplifying the data or filtering the data.
[0007] According to some examples, the method may further include detecting, with one or more processors, peaks in the received charge change data when the device is determined to be worn by the user. The method may further include determining, with the one or more processors, whether the user's jaw is moving based on the detected peaks. The method may further include operating the wearable electronic device in a listening mode when the user's jaw is determined to be moving. In the listening mode, the wearable electronic device may perform at least one of audio noise cancellation or listening for voice input from the user.
[0008] According to some examples, the method may further include, with the one or more processors, determining whether the wearable electronic device is connected to a charger, and operating the wearable electronic device in a standby mode when the wearable electronic device is not connected to the charger, the standby mode being a low power mode, and operating the wearable electronic device in a charging mode when the wearable electronic device is connected to the charger, where in the charging mode the wearable electronic device receives a charge via a charging pad of the wearable electronic device. When the wearable electronic device is not connected to the charger, the charging pad may function as an antenna.
[0009] Another aspect of the present disclosure provides a wearable electronic device comprising a housing, one or more metallic components integrated with, housed by, or coupled to the housing, the one or more metallic components configured to function as one or more antennas, and one or more processors in communication with the one or more metallic components. The one or more processors may be configured to receive charge change data from the one or more antennas, determine whether the received charge change data exceeds a predetermined threshold, determine that the wearable electronic device is worn by a user when the received charge change data exceeds the predetermined threshold, and operate the wearable electronic device in an active mode when the wearable electronic device is determined to be worn by a user.
[0010] According to some examples, the wearable electronic device may further include circuitry in communication with the one or more antennas, the circuitry configured to process the received charge change data. The circuitry may include at least one of an amplifier, a filter, or a digital signal processor. The one or more processors may further be configured to detect a peak in the received charge change data when the device is determined to be worn by a user.
[0011] According to some examples, the one or more processors may be further configured to determine whether the user's jaw is moving based on the detected peaks. The wearable electronic device may operate in a listening mode when the user's jaw is determined to be moving. In the listening mode, the wearable electronic device may perform at least one of audio noise cancellation or listening for voice input from the user.
[0012] According to some examples, at least one of the metal components may include a charging pad. The one or more processors may be further configured to determine whether the wearable electronic device is connected to a charger, operate the wearable electronic device in a standby mode, which is a low power mode, when the wearable electronic device is not connected to the charger, and operate the wearable electronic device in a charging mode, receiving charge via the charging pad of the wearable electronic device, when the wearable electronic device is connected to the charger. The charging pad may function as an antenna when the wearable electronic device is not connected to the charger.
[0013] According to some examples, the wearable electronic device is an earphone.
[0014] Yet another aspect of the present disclosure provides a non-transitory computer-readable medium storing instructions executable by one or more processors to perform a method for determining a state of a wearable electronic device using one or more metallic components of the wearable electronic device as an antenna. The method may include receiving charge change data, determining whether the received charge change data exceeds a predefined threshold, determining that the wearable electronic device is worn by a user when the received charge change data exceeds the predefined threshold, and operating the wearable electronic device in an active mode when the wearable electronic device is determined to be worn by a user. [Brief description of the drawings]
[0015] [Figure 1A] 1 is a pictorial diagram illustrating an example placement of earbuds according to an aspect of the present disclosure. [Figure 1B] 1 is a pictorial diagram illustrating an example placement of earbuds according to an aspect of the present disclosure. [Figure 2A] FIG. 1 is a pictorial diagram illustrating components of an exemplary earphone, according to an aspect of the present disclosure. [Figure 2B]FIG. 1 is a pictorial diagram illustrating components of an exemplary earphone, according to an aspect of the present disclosure. [Figure 2C] FIG. 1 is a pictorial diagram illustrating components of an exemplary earphone, according to an aspect of the present disclosure. [Diagram 3] FIG. 2 is a circuit diagram illustrating an exemplary signal processing chain, according to an aspect of the present disclosure. [Figure 4] AB are examples of output signals indicative of charge fluctuations detected according to an embodiment of the present disclosure. [Diagram 5] AB are examples of output signals indicative of charge fluctuations detected according to an embodiment of the present disclosure. [Figure 6] 1A-B are circuit diagrams illustrating exemplary processing circuits according to embodiments of the present disclosure. [Figure 7] FIG. 1 is a block diagram of an exemplary earphone according to aspects of the present disclosure. [Figure 8] 1 is an example flow diagram according to an aspect of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0016] The present technology generally relates to on-body wear detection of wearable electronic devices. For example, earphones may be configured to provide an enriched user experience based on whether a user is wearing the earphones. For example, when the earphones are worn in the ears, as opposed to being held in a person's hand or placed in a charging case, pocket, or other container, audio may be routed to the earphones' speaker rather than to a speaker of another device, such as a paired phone. As another example, if a call comes in when the earphones are not worn, the audio may be routed to a speaker of another device, such as a paired phone. Additionally, to conserve battery power and battery life, the earphones may enter a standby mode when not worn.
[0017] Accurately detecting whether the earphones are correctly worn can prevent problems caused by inaccurate detection. For example, if the earphones are not correctly worn, audio may be incorrectly routed, causing inconvenience to the user and other users. For example, in a quiet library or on a busy street, music may be routed to the paired mobile phone speaker instead of the earphones worn in the user's ears, causing inconvenience to the user and other users. Also, if the earphones are not correctly detected, the earphones may remain in active mode when not needed, wasting battery power and shortening battery life. In this regard, wireless electronic devices are equipped with the ability to detect whether the device is worn.
[0018] According to some examples, the electronic device is an earphone. The earphone may include a housing and one or more antennas attached to, integrated with, or included within the housing. As an example, a metal snout of the device and / or a charging pad contact of the device may be configured to also function as an antenna for detecting charge changes. The earphone may further include one or more processors configured to measure the charge changes and determine a state of the earphone based on the measured charge changes. For example, the earphone may transition between an active mode, a listening mode, a standby mode, a charging mode, or other modes based on the charge variation information collected by the one or more antennas.
[0019] Additionally, the processor may further detect whether a user wearing the earphones is speaking, for example, the processor may detect whether the user's jaw is moving based on charge variations collected from one or more antennas.
[0020] In some cases, the processor may further base the determination on sensor data from at least one other sensor, such as an inertial measurement unit (IMU). Thus, the one or more processors may, for example, take into account both the determination based on the sensor data and the charge changes collected from one or more antennas, which may improve the reliability of the determination.
[0021] The processor may operate the wearable device based on the detection. For example, the processor may operate the earphones in a first mode based on detecting that the earphones are worn. As an example, the processor may route audio to be output by a speaker of the earphones or control the earphones to enter an active mode from a standby mode. The processor may operate the earphones in a second mode based on detecting a jaw movement of a user wearing the earphones. For example, in the second mode, the earphones may prepare to receive audio input from a user. The processor may operate the earphones in a third mode based on detecting that the earphones are not worn. For example, the processor may route audio to be output by a speaker of another device or control the earphones to enter a standby mode.
[0022] Example System 1A and 1B show an exemplary device, specifically earphones 110. FIG. 1A shows the earphones 110 in a position not worn inside a user's ear 101, and FIG. 1B shows the earphones 110 in a position worn inside the ear 101. By way of example, when worn inside the ear 101, at least a portion of the earphones 110 may be surrounded by the skin of the ear 101. The earphones 110 may be wireless in that they do not require a wired connection for use. For example, the earphones 110 may wirelessly receive signals from a music player, phone, or other device, and perform several functions, such as generating output, communicating with other devices, charging, etc. The earphones 110 may be paired with another earphone. In some cases, the earphones 110 may be completely wireless, with the pair of earphones 110 configured to wirelessly connect to an audio source with no wires between the earphones 110.
[0023] 1A, earphone 110 may include a housing 120 that houses and supports various electronic and / or mechanical components of earphone 110. Housing 120 may be made from any of a number of materials. For example, housing 120 may be made at least in part from a non-conductive material such as plastic, ceramic, etc. In some cases, housing 120 may be made at least in part from a non-permeable material that protects the components inside housing 120 from contaminants in the environment.
[0024] The earphone 110 may include physical features that allow the earphone 110 to fit snugly and comfortably in the ear 101. For example, as shown in FIG. 1A, the earphone 110 may include a cap 130 attached to the housing 120. For example, the cap 130 may be attached to one end of the housing 120. In some cases, the cap 130 may have at least one opening 132 such that sound from inside the earphone 110 may pass through the opening 132 to reach the outside of the earphone 110. The cap 130 may be made from any of a number of materials. For example, the cap 130 may be made at least in part from a flexible, non-conductive material, for example, a polymeric material such as rubber or silicone. The cap 130 may be further configured to fit snugly over the portion of the earphone 110 inserted in the ear 101, such as by changing shape. The flexibility and dimensions of the cap 130 may further accommodate differences in ear structure and personal preferences regarding how the earphone 110 is worn. In some cases, cap 130 may also be configured to provide sound occlusion for sounds originating outside earphone 110.
[0025] The earphone 110 may further include physical features that provide additional mechanical support. For example, as shown in FIG. 1A, the earphone 110 may further include a support 140 attached to the housing 120. The support 140 may be attached to one end of the housing 120, such as the same end as the cap 130. The cap 130 may additionally or alternatively be attached to the support 140. In some examples, at least a portion of the support 140 may be attached to an inner surface of the housing 120 or embedded in the housing 120. As also shown in FIG. 1A, the support 140 may be configured to be shaped like the nose of the earphone 110 and fit inside the ear. For example, the support 140 may have a tubular shape. In some cases, the support 140 may be configured as a sound port of the earphone 110, such that sound from inside the earphone 110 may pass through one or more openings in the support 140 to reach the outside of the earphone 110. The support 140 may be made from any of several materials. For example, the support 140 may be made, at least in part, of a conductive material, such as a metal or alloy.
[0026] According to some examples, the support 140 may function as an antenna. Thus, the support 140 may collect charge from the human body when the earphone 110 is worn by a user. Triboelectric series of materials exhibit different charge characteristics. Body movement induces a charge change in the body that can be detected by using an antenna such as the support 140. According to some examples, described in more detail below, the antenna may be connected to a charge amplifier. The signal may be processed by an analog-to-digital converter (ADC) and a digital filter to provide a detectable output signal when the device is in the ear and the jaw bone / muscle is moving.
[0027] 1B , when the earphone 110 is being worn by a user, the cap 130 and support 140 may be partially or completely inserted into the ear 101. For example, the cap 130 may be in direct contact with an inner skin surface 102 of the ear 101, such as a skin surface that is part of the ear canal 103. When inserted into the ear 101, the flexible material of the cap 130 may change its shape to provide a secure and comfortable fit.
[0028] As shown in FIG. 1B, during wearing, the outer surface of the support 140 may be positioned at a distance d1 from the inner skin surface 102 of the ear 101. The distance d1 may vary within a range depending, for example, on the manner in which the earphone 110 is worn, the flexibility of the cap 130, the user's anatomy, and the user's preferences when wearing the earphone (e.g., the user's preferences regarding how far the earphone is inserted into the ear). However, the range may be relatively small because the cap 130 is configured to ensure a consistent fit despite differences in anatomy and preferences. By way of example, the cap 130 may be configured with dimensions and flexibility that allow it to change shape within a predetermined range. For example, the predetermined range may be set between a predetermined diameter for a relatively narrow ear canal and a predetermined diameter for a relatively wide ear canal. Additionally, the cap 130 may be configured to require a minimum level of compressive force against the ear canal to provide a secure fit. Thus, to achieve a minimum level of compressive force, a user with a wide ear canal may want to push the earphone 110 further into the ear than a user with a narrow ear canal. Therefore, the range of d1 can be relatively small.
[0029] Furthermore, because the tubular shape of the support 140 corresponds approximately to the tubular shape of the ear canal 103, the support 140 may have a relatively large surface area A1 at an approximate distance d1 from the inner skin surface 102 of the ear 101.
[0030] 2A illustrates several exemplary components of the earphone 110. As shown, various components may be housed inside the housing 120. For example, a circuit board 210, such as a printed circuit board ("PCB"), may be provided within the housing 120. The circuit board 210 may provide a ground for the other components of the earphone 110. The circuit board 210 may include any of several circuits configured to perform any of several functions, such as information processing, audio generation, communication, charging, etc. As another example, a battery 220 may be provided within the housing 120. For example, the battery 220 may be charged, store energy, and provide energy to the other components of the earphone 110.
[0031] A speaker 230 may be provided within the housing 120. The speaker 230 may include various components, such as a metal frame, a metal yoke, a magnet, a coil, an amplifier, a diaphragm, and other circuit elements configured to receive analog and / or digital audio signals and convert these audio signals into sound waves perceivable by the ear. For example, the speaker 230 may receive audio signals from a processor of the earphones 110 or from a paired device. In some examples, the received audio signals may be processed by the circuit elements of the speaker 230 and the circuit board 210, such as filters, amplifiers, etc. The speaker 230 may be used to play music, emit audio, such as multimedia files, voice calls, translated voice, etc.
[0032] As mentioned above, the support 140 may be shaped like a nose and function as an antenna, and may be made of or covered by one or more metals typically used for antennas.
[0033] According to some examples, earphones 110 may further include one or more charging pad electrodes 240. The charging pad electrodes may be electronically coupled to battery 220 such that power received via charging pad electrodes 240 may be provided to battery 220 to recharge battery 220, thereby powering the device. For example, charging pad electrodes 240 may contact corresponding elements within a charging case of earphones 110 or on another wireless power supply device. In this regard, power received wirelessly from the charging case via charging pad electrodes 240 may be provided to battery 220 to replenish battery 220.
[0034] The charging pad electrode 240 also functions as an antenna and may be used to detect in-ear status and jaw movement. The charging pad electrode 240 may be coupled to signal processing circuitry such as amplifiers, ADCs, filters, etc. The circuitry is described in further detail with respect to Figures 3 and 6A-B.
[0035] In this example, the charging pad electrode 240 is described as acting as the antenna, however, in other examples, any electrode inside or outside the device may act as an antenna for detecting in-ear status and jaw movement.
[0036] FIG. 2B provides a detailed view of another example earphone 250 including a metal snout 260 that functions as an antenna according to the present disclosure. The metal snout 260 is located at an output portion of the earphone 250 and can be sized and shaped to fit within a user's ear. For example, the metal snout 260 can be generally cylindrical and extend from an end of the housing 252. In some examples, the metal snout 260 can be configured similar to the support 140 of FIGS. 1A-1B. Additionally, the metal snout 260 can be surrounded by a cap 254 similar to the cap 130 described above in connection with FIGS. 1A-1B for comfortable insertion into a user's ear. According to some examples, the metal snout 260 can be attached to a housing 252 made of plastic or other material.
[0037] The metal snout 260 may include one or more holes 266 through which sound may be output from a speaker within the housing 252. The metal snout may be coupled to the device's main logic board (MLB) 256, for example, via a snout wire 262. For example, the snout wire 262 may be coupled between the MLB 256 and a bushing 264.
[0038] Metal snout 260 may be used as an antenna, such as a static charge change sensor antenna. Thus, metal snout 260 may collect charge data, for example, from the user's skin. Such charge data may be used to determine the state of earbud 250, such as whether it is in-ear or out-of-ear. Additionally, charge data may be used to detect a user state, such as whether the user's jaw is moving or not.
[0039] 2C shows details of another example earbud 270 that includes a charging pad 280 that functions as an antenna. As shown, the charging pad 280 can include one or more contacts 282, 284. While two contacts 282, 284 are shown, other examples can include a greater or lesser number of contacts. Additionally, in this example, the contacts 282, 284 are shown as relatively small circles, but in other examples the size and shape of the contacts can vary.
[0040] The charging pad contacts 282, 284 may be coupled to circuitry within the housing of the earbuds 270. For example, in addition to being coupled to a battery and other electronics for charging and powering the earbuds 270, the contacts 282, 284 may be coupled to circuitry for processing the charging signal collected by the charging pad 280 when it functions as an antenna. In some earbuds, the charging pad 280 may provide approximately 5V and have a capacitor of approximately 1-10 uF. An AC capacitor may be placed on the VBUS line that carries the charging pad signal.
[0041] 1-2 show earphones, it should be understood that the wearable electronic device can be any of a variety of other wearable electronic devices, such as smart glasses, a headset, a helmet, etc. The described techniques can also be applied to wearable devices worn on other parts of the body, such as a ring, a pendant, a watch, etc.
[0042] 3 shows an example of charge collection and signal processing. As shown, a sensing antenna 340 of a wearable device collects charge. Charge may be collected by the sensing antenna 340 regardless of whether the device is worn by a user or whether the device is separated from the user. The sensing antenna 340 may be a snout antenna, a charging pad antenna, and / or a separate antenna.
[0043] The charge collected by the sensing antenna 340 is processed by a signal processing chain 320. The signal processing chain may include an amplifier and pre-filter 322 followed by an ADC 324 and a digital filter 326. The amplifier amplifies the signal collected by the sensing antenna 340 and the pre-filter removes background noise. For example, the pre-filter may be used to remove background static noise such as 50 Hz and 60 Hz power line noise. The ADC 324 and digital filter 326 further process the signal to provide a detectable output when the device is in the ear and the jaw bone is moving. For example, the ADC 324 may be used to convert the voltage or current induced by static induction to a digital voltage or current. The digital filter 326 may be used to remove high frequency noise and provide a clean signal of the signal output induced by the jaw movement.
[0044] FIG. 4A illustrates an example output from the system of FIG. 3 when the wearable device is worn by a user. In this example, data collected by one or more antennas is represented by data signal 402, while filtered data output by the signal processing chain is represented by filtered data signal 404. Each of data signal 402 and filtered data signal 404 represents a charge fluctuation. As shown, the charge fluctuation of both signals is near zero before the user wears the device (approximately 2 seconds) and after the user removes the device (approximately 13 seconds). During the period when the user is wearing the device, during a time frame of approximately 2.0 seconds to 2.5 seconds, both data signal 402 and filtered data signal 404 increase and decrease significantly. When the device is worn, during a time frame of approximately 2.5 seconds to 12 seconds, data signal 404 increases and decreases even more significantly. During this period, the charge fluctuation is high, especially when compared to other times. During this period, when the device is worn, filtered data signal 402 is relatively stable during a time frame of approximately 2.5 seconds to 12 seconds. When the device is removed, both signals 402, 404 increase and decrease again before the charge fluctuations drop to zero for a time frame of approximately 12 to 13 seconds.
[0045] FIG. 4B shows another example output from the system of FIG. 3. In this example, the output indicates detection of jaw movement. From 0 seconds to about 4 seconds, the charge fluctuations are relatively high, as indicated by the increase and decrease in data signal 402 and the relative stability of filtered data signal 404. As explained above in relation to FIG. 4B, this may indicate that the device is being worn by a user. During this period, the user is not speaking and therefore the user's jaw is not moving.
[0046] Between approximately 4 seconds and 16 seconds, the user's jaw moves. As a result, data signal 402, representing data collected from one or more antennas, increases and decreases even more, indicating increased charge fluctuations as compared to when the device is worn and the user's jaw is not moving. Filtered data signal 404 also increases and decreases, but to a lesser extent than data signal 402. As shown, peaks occur in both data signal 402 and filtered data signal 404 while the user's jaw is moving. At approximately 16 seconds, when the user's jaw stops moving but the device is still worn, both data signals 402, 404 stabilize again.
[0047] 5A-B show further example outputs from the system of FIG. 3. In FIG. 5A, the output shows the difference between a first state when the device is being worn by a user and a second state when the device is removed from the user. In this example, the device is an earphone. In the first state (approximately 0 seconds to 13 seconds), the device is worn on the user's ear. At approximately 13 seconds, the device is removed from the user's ear and the charge fluctuation decreases accordingly, as indicated, for example, by a decrease in data signal 402. A large spike in charge fluctuation between approximately 15 seconds to 18 seconds may occur, for example, due to handling of the earphone after removal from the ear. For example, a user may hold the earphone in the user's finger for several seconds before placing the earphone in a case, pocket, or other location.
[0048] In FIG. 5B, the output shows the difference between a first state when the device is located in the user's pocket and a second state when the device is removed from the user's pocket. In the first state from about 0 seconds to 14 seconds, the charge fluctuations shown by data signal 402 are relatively low. Some charge fluctuations may be detected based on the user's skin, for example, through one or more layers of material between the user's pocket and the user's skin. The charge fluctuations may differ based on, for example, which pocket the device is in, how tight the user's clothing is worn, how close the user's pocket is to the user's skin, etc. The filtered data signal 404 remains relatively stable while the device is in the user's pocket.
[0049] At approximately 15 seconds, the device is removed from the user's pocket, causing both the data signal 402 and the filtered data signal 404 to increase or decrease. Such an increase or decrease may be caused, for example, by the user's finger touching the device. Thus, one or more antennas on the device may detect an increase in charge change while the device is being handled. As shown in this example, after approximately 18 seconds, the charge fluctuations in both the data signal 402 and the filtered data signal 404 drop and stabilize. This may correspond to the device being placed in a case, on a table, or elsewhere away from the user's skin.
[0050] The difference between the charge change within the pocket and the charge change outside the pocket may be caused, for example, by differences in background noise. For example, the charge variation within the pocket may be about 50, while the charge variation outside the pocket will be close to zero.
[0051] 6A-B show examples of circuits for detecting charge fluctuations using one or more antennas of a wearable device. In each example, a wearable system-on-chip (SoC) is used to process signals received by one or more antennas, represented in these examples by antenna 640.
[0052] 6A, the wearable SoC 650 includes a buffer 652, an amplifier 654, and a digital signal processor (DSP) 656. The buffer 652 may temporarily store data collected from the antenna 640. The amplifier 654 may be, for example, an audio amplifier or any charge amplifier. The amplifier 654 may increase the gain of the signal collected by the antenna 640 and stored in the buffer 652. The DSP 656 may perform filtering and / or other processing techniques and derive a processed signal.
[0053] In FIG. 6B, a separate static charge change processing chip 645 is positioned between the antenna 640 and the SoC 660. The chip 645 can be, for example, an inertial measurement unit (IMU), a pressure sensor, a microphone with a charge change sensing input, or any of a variety of other types of chips. In this example, the chip 645 is used to convert the static charge change signal to a digital output. The chip can include an analog front end that converts the static charge change from the antenna to a voltage or current, an ADC that converts the analog signal to a digital signal, and a digital filter that removes noise.
[0054] The wearable SoC 660, in this example, includes a sensor hub 662 and a DSP 664. The sensor hub 662 can be a microprocessor that can be used to collect data from different sensors and process the data. For example, the sensor hub 662 can collect sensor data from the antenna 640 and / or from any of a variety of other sensors (not shown), such as an IMU, a capacitance sensor, a light sensor, a heat sensor, a proximity sensor, etc. Similar to the DSP 656 of FIG. 6A, the DSP 664 can perform filtering and / or other processing techniques on the signals received from the sensor hub 662.
[0055] In each example, the processed signal from the DSP may be analyzed to identify which state the device is in based on the signal. Such analysis may be performed, for example, by the DSP or by another processing unit coupled with the DSP. Such analysis may determine, for example, whether the device is in the ear, in a pocket, on a table, charging in a case, etc. For example, such determination may be made based on charge variations detected by the antenna 640. In some examples, additional information from other sensors may also be considered in the analysis. For example, information from an accelerometer, microphone, or other device may be used in combination with the detected charge variations to achieve accurate state detection.
[0056] 7 is a functional block diagram of an example earphone 110 in which the features described herein may be implemented. This should not be considered as limiting the scope of the disclosure or the usefulness of the features described herein. Although one earphone 110 is shown, it should be understood that the earphone 110 is one of a pair of earphones, in which case the earphone 110 operates in conjunction with the other earphone. Each earphone of the pair may have a similar structure to one another.
[0057] As shown, earphones 110 may include one or more processors 112, memory 114, and other components typically present in a general-purpose computing device. For example, earphones 110 may include a battery 220, a speaker 230, a clock 119, etc.
[0058] The memory 114 may store information accessible by one or more processors 112, including instructions 116 that may be executed by the one or more processors 112. The memory 114 may also include data 118 that may be retrieved, manipulated, or stored by the processors 112. The memory may be of any non-transitory type capable of storing information accessible by a processor, such as a hard drive, memory card, ROM, RAM, DVD, CD-ROM, writable memory, read-only memory, etc.
[0059] The instructions 116 may be any set of instructions that are executed directly, such as machine code, or any set of instructions that are executed indirectly by one or more processors, such as a script. In that regard, the terms "instructions," "application," "steps," and "program" may be used interchangeably herein. The instructions may be stored in object code format for direct processing by a processor, or may be stored in any other computing device language, including a script or collection of separate source code modules that are interpreted on demand or precompiled. The functions, methods, and routines of the instructions are described in more detail below.
[0060] Data 118 may be obtained, stored, or modified by one or more processors 112 in accordance with instructions 116. For example, data may be stored in computer registers, relational databases as tables with many different fields and records, or XML documents, although the subject matter described herein is not limited by any particular data structure. Data may also be formatted in a form readable by a computing device, such as, but not limited to, binary values, ASCII, or Unicode. Additionally, data may include any information sufficient to identify related information, such as numbers, descriptive text, unique codes, pointers, references to data stored in other memory, such as other network locations, or information used by a function to calculate related data.
[0061] The one or more processors 112 may be any conventional processor, such as a commercially available CPU. Alternatively, the processor may be a dedicated component, such as an application specific integrated circuit ("ASIC") or other hardware-based processor. Although not required, the earphones 110 may include specialized hardware components to make certain computing processes, such as decoding video, matching video frames with images, distorting video, encoding distorted video, etc., faster or more efficient.
[0062] 7 functionally depicts the processor, memory, and other elements of earphones 110 as being within the same block, a processor, computer, computing device, or memory may in fact include multiple processors, computers, computing devices, or memories that may or may not be housed within the same physical housing. For example, a memory may be a hard drive or other storage medium located in a different housing than earphones 110. Thus, references to a processor, computer, computing device, or memory are understood to include references to collections of processors, computers, computing devices, or memories that may or may not operate in parallel.
[0063] 7, earphones 110 may each include one or more user inputs, such as user input 111. For example, user inputs may include mechanical actuators, soft actuators, peripheral devices, sensors, and / or other components. Examples of sensors in input 111 may include vibration sensors, such as microphones, touch sensors, such as capacitive sensors or optical sensors, and the like. For example, a user may be able to use user input 111 to control various audio characteristics, such as turning audio on and off, adjusting the volume, and the like.
[0064] Earphones 110 may include one or more output devices, such as output device 113. For example, output devices may include one or more speakers 230, transducers or other audio outputs, a user display, a haptic interface, or other haptic feedback that provides non-visual and non-auditory information to a user. For example, speakers of output device 113 may be used to play music, emit audio for navigation or other guidance, multimedia files, voice calls, translated speech, etc.
[0065] The earphones 110 may include one or more sensors, such as sensor 115. For example, the sensor 115 may include one or more antennas 240. Other examples of sensors may also include an IMU 245, a barometer, a vibration sensor, a heat sensor, a radio frequency (RF) sensor, a magnetometer, an air pressure sensor, a light sensor, a capacitance sensor, or various other types of sensors.
[0066] To obtain information from other earphones, host devices, or other remote devices and transmit the information to those devices, the earphones 110 may include a communication module, such as communication module 117. The communication module may enable wireless network connections, wireless ad-hoc connections, and / or wired connections. Through the communication module 117, the earphones 110 may establish communication links, such as radio links. The communication module 117 may be configured to support communication over cellular, LTE, 5G, 4G, WiFi, GPS, and other network architectures. The communication module 117 may be configured to support Bluetooth, Bluetooth LE, near field communication, and non-networked wireless configurations. The communication module 117 may support wired connections, such as USB, micro USB, USB Type-C, or other connectors, for example, to receive data and / or power from a laptop, tablet, smartphone, or other device.
[0067] Earphones 110 may each include one or more internal clocks 119. The internal clocks may provide timing information that may be used for timing apps and other programs executed by the computing device, as well as basic operations by the computing device, sensors, input / output, GPS, communication systems, etc.
[0068] The one or more processors 112 may execute instructions 116 to collect charge via one or more antennas 240 and determine, based on the collected charge, whether the earphones are being worn and / or whether the user is speaking, for example, by detecting whether the user's jaw is moving. Additional methods performed by the one or more processors 112 are described in more detail below.
[0069] Example of how to In addition to the example systems described above, exemplary methods are now described. Such methods may be performed using any of the systems described above, modifications thereof, or various systems having different configurations. It should be understood that the operations included in the methods below do not have to be performed in the order described. Rather, various operations may be processed in different orders or simultaneously, and operations may be added or omitted.
[0070] 8 illustrates an example of a flow diagram that may be performed by one or more processors of a wearable device (such as one or more processors 112 of earbuds 110 of FIG. 7). For example, processor 112 may receive data and make various decisions as illustrated in the flow diagram. According to some examples, the wearable device may be earbuds, while in other examples, the wearable device may be smart glasses, a head mounted display, a headset, a helmet, or any other type of wearable electronic device worn on a user's head or other part of the user's body.
[0071] 8, in block 805, the charge variation is detected using one or more antennas of the wearable device. For example, the one or more antennas may include a metal snout of an earbud, a contact of a charging pad, or other metallic element of the wearable device that may be in proximity to the user's skin when the device is worn. Detecting the charge variation may include collecting charge variation data using the antenna. In some examples, detecting the charge variation may further include processing the collected charge variation data, such as by amplifying the data, filtering the data, and / or performing digital signal processing or other processing techniques.
[0072] At block 810, it is determined whether the charge variation is above a default threshold. For example, the default threshold may be set based on a charge variation level known to be associated with wearing the electronic device. According to some examples, the default threshold may be set during a manufacturing process. According to other examples, the default threshold may be calibrated based on a charge level specific to a user's skin. For example, a user may wear a wearable device and go through a setup process to ensure that the device is worn. Thus, the charge variation level detected during that setup process may be used to select the default threshold or adjust the threshold set during manufacturing.
[0073] If the charge variation detected using the antenna exceeds a predefined threshold, it may be determined that the device is worn by the user. For example, if the device is an earphone, it may be determined that the device is worn in the user's ear. Thus, in block 815, the device may operate in an active mode. In the active mode, the device may deliver content to the user via an output of the wearable device. For example, the device may output music, voice calls, notifications, or other audio content via a speaker of the wearable device. In other examples where the device includes a display, the device may output visual content via the display when in the active mode. In further examples, the device may output notifications using haptic feedback, such as vibrations, pulses, etc.
[0074] When in the active mode, the device may further perform a peak detection process (block 820). In this process, the device may analyze the charge variation signal to determine if a peak has occurred. For example, detection of a peak may mean that the user's jaw is moving. In block 825, it is determined whether the user's jaw is moving based on the peak detection. For example, it may be determined whether the peak has an amplitude and / or frequency consistent with the user's jaw movement. As an example, one or more jaw movement detection thresholds may be set such that when a threshold amplitude, frequency, and / or number of peaks are detected, the user's jaw is determined to be moving. As another example, the memory of the device may store a signal profile corresponding to jaw movement, and the detected peaks may be compared to the stored signal profile to determine whether the compared signals are a sufficient match, and if so, the user's jaw may be determined to be moving.
[0075] If, in block 825, it is determined that the user's jaw is moving, then in block 830 the device may transition to operate in a listening mode. In the listening mode, the device may activate a microphone to receive voice input, may perform audio noise cancellation, and / or any number of other processes related to the user's speech. If, in block 825, it is determined that the user's jaw is not moving, then the device may continue to operate in an active mode until jaw movement is detected or the detected charge fluctuation falls below a predefined threshold.
[0076] If it is determined in block 810 that the detected charge fluctuation does not exceed the predefined threshold, it may be determined in block 850 whether the device is connected to a charger. For example, if the device is a pair of earbuds, it may be detected whether the device is stored in a corresponding charging case. In another example, it may be determined whether the wireless charging contacts of the device are electrically connected to the wireless charging contacts of the wireless charger. In a further example, it may be determined whether a charging cable is inserted into the charging port of the device.
[0077] If the device is not connected to a charger, then in block 855, the device may operate in a standby mode. The standby mode may be a low power mode or an ultra-low power mode in which the device deactivates certain functions and / or processes to conserve power when the device is not worn by a user. Such functions deactivated in the standby mode may include, for example, receiving packets from a host device, outputting content, listening to inputs, etc. According to some examples, the device may continue to detect charge fluctuations using an antenna when in the standby mode. In a further example, the device may detect the charging frequency only periodically, such as once per second, once every few seconds, etc.
[0078] If, in block 850, it is determined that the device is connected to a charger, in block 860, the device may operate in a charging mode. In the charging mode, the device may receive charge from a charging device and provide charge to a battery in the wearable device. According to some examples, when operating in the charging mode, the device may switch the function performed by a charging pad on the device from an antenna function to a charging function. The charging pad may continue to function as a mechanism for providing charge to the battery of the device until it is detected that the device is not connected to the charger. For example, when the device transitions to a standby mode after being removed from the charger, the charging pad may switch to operating as an antenna for detecting charge fluctuations.
[0079] The technology is capable of detecting with relatively high accuracy whether a person is currently wearing a device, such as an earbud, in their ear. By using a component on the device that serves as an antenna in addition to other functions such as a charging pad, metal snout, etc., the overall size and cost of the device may be reduced. By transitioning modes based on readings detected by the component acting as an antenna, the device may conserve power and thereby extend battery life. For example, the device may enter a standby state or otherwise reduce power usage when not being worn. Additionally, the user experience may be improved by routing audio to the most appropriate device.
[0080] Unless otherwise stated, the aforementioned alternatives are not mutually exclusive, but may be implemented in various combinations to realize unique advantages. These and other variations and combinations of the features described above may be utilized without departing from the subject matter defined by the claims, and therefore the foregoing description of the embodiments should be construed as illustrative, rather than limiting, the subject matter defined by the claims. Furthermore, the provision of examples described herein, and clauses expressed as "such as," "including," and the like, should not be construed as limiting the subject matter of the claims to any particular example. Rather, the examples are intended to illustrate only one of many possible embodiments. Moreover, the same reference numbers in different drawings may identify the same or similar elements.
Claims
1. 1. A method for determining a state of a wearable electronic device using one or more metallic components of the wearable electronic device as an antenna, comprising: receiving charge change data by the one or more metallic components of the wearable electronic device; determining, by one or more processors, whether the received charge change data exceeds a predetermined threshold; determining, by the one or more processors, that the wearable electronic device is worn by a user when the received charge change data exceeds the predetermined threshold; operating the wearable electronic device in an active mode when the wearable electronic device is determined to be worn by the user; The method comprising:
2. processing the received charge change data; The method of claim 1 , wherein the determining whether the received charge change data exceeds the predetermined threshold comprises comparing the processed charge change data to the threshold.
3. The method of claim 2 , wherein the processing of the received charge change data includes at least one of amplifying the data or filtering the data.
4. The method of claim 1 , further comprising detecting, with the one or more processors, a peak in the received charge change data when the device is determined to be worn by the user.
5. The method of claim 4 , further comprising: determining, with the one or more processors, whether the user's jaw is moving based on the detected peaks.
6. The method of claim 5 , further comprising operating the wearable electronic device in a listening mode when the user's jaw is determined to be moving.
7. The method of claim 6 , wherein in the listening mode, the wearable electronic device performs at least one of audio noise cancellation or listening for voice input from the user.
8. determining, with the one or more processors, whether the wearable electronic device is connected to a charger; operating the wearable electronic device in a standby mode, a low power mode, when the wearable electronic device is not connected to a charger; operating the wearable electronic device in a charging mode in which the wearable electronic device receives charging via a charging pad of the wearable electronic device when the wearable electronic device is connected to the charger; The method of claim 1 further comprising:
9. The method of claim 8 , wherein the charging pad functions as the antenna when the wearable electronic device is not connected to the charger.
10. A wearable electronic device, comprising: Housing and one or more metallic components integrated with, contained by, or coupled to the housing and configured to function as one or more antennas; one or more processors in communication with the one or more metal components; Equipped with The one or more processors: receiving charge change data from the one or more antennas; determining whether the received charge change data exceeds a predetermined threshold; determining that the wearable electronic device is worn by a user when the received charge change data exceeds the predetermined threshold; operating the wearable electronic device in an active mode when the wearable electronic device is determined to be worn by the user; The wearable electronic device is configured to:
11. further comprising circuitry in communication with the one or more antennas; The wearable electronic device of claim 10 , wherein the circuitry is configured to process the received charge change data.
12. 12. The wearable electronic device of claim 11, wherein the circuitry comprises at least one of an amplifier, a filter, or a digital signal processor.
13. 11. The wearable electronic device of claim 10, wherein the one or more processors are further configured to detect a peak in the received charge change data when the device is determined to be worn by the user.
14. The wearable electronic device of claim 13 , wherein the one or more processors are further configured to determine whether the user's jaw is moving based on the detected peaks.
15. The wearable electronic device of claim 14 , wherein when the user's jaw is determined to be moving, the wearable electronic device operates in a listening mode.
16. 16. The wearable electronic device of claim 15, wherein in the listening mode, the wearable electronic device performs at least one of audio noise cancellation or listening for voice input from the user.
17. At least one of the metallic components includes a charging pad; The one or more processors further include: determining whether the wearable electronic device is connected to a charger; operating the wearable electronic device in a standby mode, a low power mode, when the wearable electronic device is not connected to a charger; operating the wearable electronic device in a charging mode in which the wearable electronic device receives charging via the charging pad of the wearable electronic device when the wearable electronic device is connected to the charger; The wearable electronic device of claim 10 , configured to:
18. 20. The wearable electronic device of claim 17, wherein the charging pad functions as the antenna when the wearable electronic device is not connected to the charger.
19. The wearable electronic device of claim 10 , wherein the wearable electronic device is an earphone.
20. 1. A non-transitory computer-readable medium storing instructions executable by one or more processors to perform a method for determining a state of a wearable electronic device using one or more metallic components of the wearable electronic device as an antenna, the method comprising: The method comprises: receiving charge change data; determining whether the received charge change data exceeds a predetermined threshold; determining that the wearable electronic device is worn by a user when the received charge change data exceeds the predetermined threshold; operating the wearable electronic device in an active mode when the wearable electronic device is determined to be worn by the user; The non-transitory computer-readable medium.
Citation Information
Patent Citations
Headset and headset power management
JP2007104670A
Utterance detection apparatus and voice communication system
JP2011188463A
Information processing apparatus
JP2017147652A
Wireless earphone
JP2021029006A
Wearable device, wearing detection method, and storage medium
US20200314527A1
