Headphone system and method for operating a headphone system
Through remote unit analysis and control of the headphone system, the energy consumption and volume problems of existing headphone systems in noise masking and active noise cancellation are solved, providing a personalized quiet sleep experience and extending the battery life of the headphones.
Patent Information
- Application Number
- CN201980101628.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2019-11-08
- Publication Date
- 2025-08-19
- Estimated Expiration
- 2039-11-08
AI Technical Summary
Existing headphone systems have limitations in providing a quiet sleep environment, especially the energy consumption problems of noise masking and active noise cancellation functions, resulting in excessive headphone size or insufficient battery life, which cannot meet users' personalized needs in different noise environments.
The remote unit is used for ambient noise analysis and control, and the sound reproduction unit in the headset is controlled through a wireless connection. The noise masking and active noise cancellation functions are enabled only when needed, reducing the signal processing burden inside the headset, and using the remote unit to optimize the application of noise masking and ANC.
It realizes a personalized quiet sleep experience under different noise environments, reduces the power consumption and volume of the headphones, extends battery life, and meets the user's comfort needs during sleep.
Smart Images

Figure CN114586372B_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to an earphone system and a method for operating an earphone system, and more particularly, to an earphone system that provides a comfortable sleeping environment for a user. Background Art
[0002] Many different disruptive sounds and noises can prevent a person from getting a deep sleep throughout the night. For example, a neighbor may make disturbing noises, another person in the room may snore, or a street or railway line near the bedroom may cause constant or recurring noise. There is a need for a headphone system that provides a user with a comfortable sleeping environment, thereby improving the user's sleep. Summary of the Invention
[0003] A headphone system includes: at least one headphone configured to be inserted into an ear of a user, wherein each of the at least one headphone includes at least one sound reproduction unit; and a remote unit separate from each of the at least one headphone, wherein the remote unit includes at least one microphone configured to capture ambient sound. The remote unit is configured to evaluate, analyze, and / or process the ambient sound captured by the at least one microphone to determine one or more of at least one ambient sound parameter, at least one control parameter, and at least one control command based at least on the evaluation, analysis, and / or processing of the ambient sound, and to send the at least one ambient sound parameter, the at least one control parameter, and / or the at least one control command to at least one of the at least one headphone. The at least one headphone is configured to control the sound reproduced by the corresponding sound reproduction unit in response to the at least one ambient sound parameter, the at least one control parameter, and / or the at least one control command received from the remote unit.
[0004] A method includes capturing ambient sound with a remote unit including at least one microphone; evaluating, analyzing, and / or processing the ambient sound captured by the at least one microphone in the remote unit; determining one or more of at least one ambient sound parameter, at least one control parameter, and at least one control command based at least on the evaluating, analyzing, and / or processing of the ambient sound in the remote unit; and transmitting the at least one ambient sound parameter, the at least one control parameter, and / or the at least one control command to at least one of at least one earphone to control at least one function of the at least one earphone, wherein each of the at least one earphone is separate from the remote unit and configured to be inserted into an ear of a user, and wherein each of the at least one earphone includes at least one sound reproduction unit. The method also includes controlling sound reproduced by the corresponding sound reproduction unit in response to the at least one ambient sound parameter, the at least one control parameter, and / or the at least one control command received from the remote unit.
[0005] Other systems, methods, features, and advantages will be apparent or will become apparent to those skilled in the art after examining the following detailed description and drawings. It is intended that all such additional systems, methods, features, and advantages be included within this description, be within the scope of the present invention, and be protected by the following claims. BRIEF DESCRIPTION OF THE DRAWINGS
[0006] The method may be better understood with reference to the following description and drawings. The components in the figures are not necessarily drawn to scale, but rather are intended to illustrate the principles of the invention. In addition, in the figures, like reference numerals designate corresponding parts throughout the different views.
[0007] Figure 1 An exemplary headphone arrangement is schematically illustrated.
[0008] Figure 2 An exemplary headset is schematically illustrated.
[0009] Figure 3 An exemplary remote unit is schematically illustrated.
[0010] Figure 4 Another exemplary remote unit is schematically illustrated.
[0011] Figure 5 Exemplary methods are schematically illustrated. DETAILED DESCRIPTION
[0012] A user can wear miniature headphones during sleep, which play relaxing sounds throughout the night to mask the ambient noise (surrounding sounds) present in the user's environment. At other times, such as before the user of the headphones wants to go to sleep, general audio content can be played through the headphones. General audio content can include music, audio books, or podcasts. The headphones typically need to be quite small so that they are not uncomfortable for the user. However, extreme miniaturization can have a limiting effect on the functionality of the headphones. For example, the headphones may only be able to play masking sounds stored locally inside the headphones for a maximum of, for example, 12 hours. General audio content can, for example, be wirelessly streamed to the headphones for a limited time (e.g., 2 hours) or stored locally on the headphones. Battery size, for example, can be a limiting factor in playback time because the battery is large compared to the size of the headphones. Therefore, the battery may need to occupy approximately 80% of the total volume of the headphones. However, a small battery may only be able to provide energy for a certain amount of playback time of a locally stored audio file (e.g., <8 hours).
[0013] Headphones can also provide active noise cancellation (ANC). That is, headphones that cancel ambient noise, at least to some extent, can detect and evaluate the ambient noise and can output an acoustic signal. ANC can be combined with the playback of masking sounds or general audio content. In order to provide ANC for an extended period of time (e.g., 12 hours or more), the size of the headphones is generally required to be much larger than headphones that only provide masking of ambient sounds. The reason is that there is additional power consumption for the analog circuitry or digital circuitry used for ANC signal processing and for one or more ANC microphones. These additional power requirements can cause the battery size to increase. Therefore, headphones that provide ANC functionality all night long may be too large to be comfortable for the user to wear at night, for example.
[0014] The headphone system described below is configured to be worn by the user during and before sleep and to play masking sounds, as well as general audio content, and optionally provide active noise cancellation. Not all users prefer noise masking over ANC, or vice versa. Furthermore, noise masking may not be effective in certain situations, such as with typical bedroom noises (e.g., snoring). That is, in some cases, the soothing sounds used for masking may not completely mask the noise, and the user may still perceive at least some noise. In such situations, a combination of ANC and noise masking, or ANC alone, may be most beneficial. Regarding the playback of general audio content, for example, before a user wants to sleep, it may be desirable to keep the audio volume low as the user prepares for sleep. At the same time, users may want to listen to audio content without the distraction of surrounding sounds. Therefore, even general audio content can be adjusted in terms of frequency spectrum and loudness level, similar to masking sounds, to avoid disrupting the listening experience.
[0015] Typically, bedroom noise is not present all night long. For example, snoring may occur occasionally, a neighbor's party may end, or traffic noise levels may vary over time. Therefore, noise masking and active noise cancellation (ANC) will typically not be needed all night long and may be turned off at least during certain periods of time throughout the night.
[0016] To maximize noise masking effectiveness, one or more parameters of the masking sound can be adapted relative to corresponding parameters of the noise to output an acoustic signal that substantially overwhelms the noise. Thus, the acoustic signal can be adapted to match one or more acoustic parameters of the noise (e.g., spectral shape, loudness metric, frequency band energy, or frequency band loudness) as closely as possible. ANC can be adapted to cancel the existing ambient noise as efficiently as possible. ANC systems typically aim to reduce or even eliminate interfering signals (such as noise) in the listening area by providing a noise reduction signal that ideally has the same amplitude over time but an opposite phase compared to the noise signal. By superimposing the noise signal with the noise reduction signal, the resulting signal (also known as the error signal) ideally approaches zero. These adaptations of noise masking and noise cancellation require analysis of the present ambient noise, which is typically an energy-intensive task. Therefore, in the headphone system described herein, the ambient noise is analyzed in a remote device. Furthermore, the signal processing performed within the headphone is remotely controlled by the remote device. This way, ANC and noise masking can be applied only when needed (when noise is present), and noise masking and ANC can be optimized based on the state of the ART algorithm running on the remote device. Because some functions are performed in the remote device rather than in the headset, the power consumption of the headset can be significantly lower.
[0017] When a user is sleeping, even if ambient noise is detected, noise masking and ANC may not be required. Therefore, a headphone system according to one embodiment can be configured to perform sleep monitoring to control the sound processing of the headphone. For example, the sleep monitoring can be performed by a remote device. Sleep monitoring performed by the remote device will be described in more detail further below.
[0018] Now refer to Figure 1 , schematically illustrates a headset system 100 according to an example. The headset system 100 may include a remote unit 20, which is configured to perform ambient noise analysis and headset control. The remote unit 20 may include at least one microphone or microphone array 22 configured to receive ambient noise. The acoustic noise signal received by the at least one microphone 22 may be evaluated, analyzed and / or processed in a suitable manner to receive information about the ambient noise. The processing may be performed in a processing unit (such as a microcontroller or a signal processor ( Figure 1The processing unit may be configured to convert an acoustic noise signal received from at least one microphone 22 into a digital signal (e.g., by analog-to-digital conversion ADC), apply a frequency band filter or a weighted filter, or evaluate a spectral content or spectral energy distribution (e.g., by fast Fourier transform FFT or a filter bank).
[0019] The headset system 100 also includes at least one headset 12, 14. When the headset system 100 is in use, each of the at least one headset 12, 14 can be wirelessly connected to the remote unit 20. That is, a permanent or intermittent wireless connection can be established between the remote unit 20 and the at least one headset 12, 14 after the headset system 100 is started. The wireless connection can be, for example, a Bluetooth connection or a Bluetooth low energy connection. However, other wireless connections can also be used. For example, the remote unit 20 can also be connected to the at least one headset 12, 14 via a WIFI connection or a radio signal with modulated amplitude (AM) or frequency (FM). Typically, the remote unit 20 can be aware of the at least one headset 12, 14. A pairing process can be performed when the headset system 100 is used for the first time. Thereafter, when the headset system 100 is turned on, the headsets 12, 14 and the remote unit 20 can be automatically connected. In this way, the headsets 12, 14 of one system 100 can be controlled by the remote unit 20 of the same headset system 100, but not by the remote unit 20 of another headset system 100. Figure 1 In the example illustrated in FIG, the headphone system 100 includes two headphones 12, 14. That is, the user uses one headphone 12, 14 for each ear. However, some users may prefer to use only one headphone. That is, the user may wear a headphone only in their right ear and not in their left ear, or vice versa. In such a case, only one headphone 12 or 14 can be wirelessly connected to the remote unit 20.
[0020] According to one example, the remote unit 20 may also include (e.g., store) information about one or more headsets 12, 14 connected to the remote unit 20 (this information will also be referred to as headset information hereinafter). Part of this headset information may include information about music that one or more headsets 12, 14 can play for the user or that is stored in one or more headsets 12, 14 (e.g., local storage). Figure 1Another portion of this headphone information may include one or more acoustic transfer functions, such as from an external location (at least one headphone 12, 14, the remote unit 20, and a location external to the user) to the user's ear canal, a dummy or test device (e.g., with or without ANC) with one or more headphone 12, 14 positioned in the user's ear, a dummy or test device (passive or active transfer function), or an acoustic transducer included in one or more headphone 12, 14.
[0021] Furthermore, for example, information regarding active noise insertion loss controlled by one or more ANC configurations of one or more earphones 12, 14 may be stored in the remote unit 20. The remote unit 20 may be configured to determine control parameters or control commands based on ambient noise signals received by the remote unit 20 and based on the information stored in the remote unit 20, and then transmit the control parameters or control commands to at least one of the earphones 12, 14. Any signals or commands sent from the remote unit 20 to the at least one earphone 12, 14 may be transmitted, for example, via a radio connection or any other suitable wireless connection. These control parameters or control commands may be configured to control an operating mode or signal processing within the at least one earphone 12, 14. For example, the sound playback (sound generation) for noise masking or ANC for the at least one earphone 12, 14 may be turned on or off. Certain masking signals may be selected from a set of masking signals stored in a local memory of the at least one earphone 12, 14. Signal processing within the at least one earphone 12, 14 that controls noise masking and / or ANC may be controlled by control parameters (e.g., volume level, filter coefficients) or control commands that control the operation of the at least one earphone 12, 14. The control commands may, for example, control which of a plurality of sets of coefficients stored locally in the at least one earphone 12, 14 is applied in the at least one earphone 12, 14 to process the sound for noise masking or noise cancellation.
[0022] Still refer to Figure 1 , the remote unit 20 may include a first communication unit 24 configured to transmit signals. For example, a signal sent to at least one headset 12, 14 may be sent via the communication unit 24. The signal may include, for example, a control parameter or a control command configured to control at least one function of the at least one headset 12, 14. The communication unit 24 may also be configured to receive signals from the at least one headset 12, 14 or from any other external device. Each of the at least one headset 12, 14 may also include a headset communication unit 122, 142, which is configured to receive signals from the remote unit 20. For example, the headset communication unit 122, 142 may also be configured to send signals to the remote unit 20.
[0023] Now refer to Figure 2 , schematically illustrates an earphone 12 according to another example. Figure 2 In the example illustrated in FIG, the headset 12 includes a sound generating unit 128, such as a speaker. The sound generating unit 128 can output a masking sound and / or a noise reduction signal. The headset communication unit 122 is already Figure 1 . The headset 12 may also include a control unit 124, a battery 126, and a memory unit 130. For example, the control unit 124 may be configured to process signals, control parameters, and control commands received from the remote unit 20 to enable or disable functions of the headset 12 and control the sound generation unit 128. The battery 126 may be configured to provide power to the different components of the headset 12. The memory unit 130 may be configured to store one or more masking sounds that may be output via the sound generation unit 128. The control unit 124 may be configured to access the memory unit 130 when a masking sound is to be played via the sound generation unit 128.
[0024] However, the control unit 124 may not need to evaluate, analyze, and process the ambient noise. As described above, the ambient noise processing is performed in the remote unit 20 instead. The remote unit 20 may transmit the results of the ambient noise evaluation, analysis, and / or processing to the control unit 124. The control unit 124 then only needs to control the sound generation unit 128 to output the masking sound or noise cancellation signal based on the sound analysis results (e.g., one or more sound parameters), control parameters, or control commands received from the remote unit. For example, the earphone communication unit 122 may include at least one antenna ( Figure 2 antennas not specifically illustrated in the figure).
[0025] Now refer to Figure 3 , schematically illustrates an exemplary remote unit 20. As described above, the remote unit 20 includes at least one microphone 22 and a first communication unit 24. For example, the first communication unit 24 may include at least one antenna. The remote unit 20 may also include a processing unit 26, such as a microcontroller or a signal processor. The processing unit 26 may be configured to evaluate, analyze, and / or process ambient noise detected by the at least one microphone 22.
[0026] The term "noise masking" as used herein refers to overlaying a masking sound onto a disturbing noise to reduce the interference of the disturbing noise to the user, or to avoid perceiving the noise as a separate signal, or to avoid perceiving the noise completely. Among other factors, the effectiveness of noise masking generally depends on the relative signal level and spectral content of the noise signal and the masking signal. With regard to noise masking, a signal with known spectral content can be applied as a basic (unadapted) noise signal, such as random noise (such as white noise, pink noise or Brownian noise) or natural signals (wind, waves, fire, etc.) or music (such as musical instrument sounds, chanting, etc.) of a noise-like nature. The wider the spectrum of the masking sound, the better the masking sound can be adapted to mask the disturbing noise with any spectral content. Generally, if the masking sound exhibits a similar spectrum to the disturbing noise, satisfactory noise masking can be achieved. Therefore, the spectrum of the masking sound can be adapted relative to the disturbing noise. The masking signal generally not only masks signals with the same frequency, but also masks signals with frequencies lower than and higher than the masking signal to some extent. The masking threshold of a masking signal (below which it can mask other signals) varies with frequency. The masking threshold is at its highest level at the frequency of the masking signal and gradually decreases towards higher and lower frequencies. Because the masking range of a given masking signal increases (especially towards higher frequencies), the spectrum of the masking signal may optionally include a narrower frequency range than the disturbing noise signal. The location where noise masking should be more effective when wearing headphones is the user's inner ear and ultimately the user's eardrum. Therefore, at least approximate information about the disturbing sound and the masking signal at these locations may be required to optimize noise masking.
[0027] Even when wearing earphones 12, 14, some ambient sound can still leak into the inner ear. Without any valid measurements, the transfer function of ambient sound from the outside to the inner ear is controlled by the passive insertion loss of earphones 12, 14. Therefore, the typical passive insertion loss (PIL) of at least one earphone 12, 14 can be used to determine the disturbing sound spectrum inside the user's ear. Additionally, active noise cancellation can cause active insertion loss (AIL) to be present in the total insertion loss (TIL). Therefore, if ANC is employed, TIL may have to be taken into account. The remote unit 20 can be configured to apply a transfer function based on the PIL or TIL to the ambient noise signal received by at least one microphone 22 of the remote unit 20 to determine a noise signal representative of the noise signal in the user's ear. For example, the PIL or TIL transfer function may have been previously determined through representative measurements. Such measurements can be performed, for example, using a suitable test device (e.g., a headphone test device or a dummy head) including an artificial pinna, or using one or more human subjects as test subjects. For example, information about the PIL and / or TIL transfer functions can be stored in the remote unit 20. Based on the representative noise signal, it can be determined whether noise masking is required. For example, if not required, noise masking can be disabled or kept inactive, or if required, noise masking can be enabled or kept active.
[0028] If noise masking is required, the spectrum, loudness level, and / or frequency band energy or frequency band loudness (energy loudness within at least one frequency band) of the masking sound can be adapted based on the spectral content, loudness level, and / or frequency band energy or frequency band loudness of a representative noise signal within at least one frequency range. Loudness within a frequency band can include the average sound pressure level over a certain time period. In addition, frequency weighting (e.g., A-weighting) and / or level-dependent signal compression can be applied to the loudness assessment. The weighting and / or compression can be based on human loudness perception curves (equal loudness curves). Information about the spectral content, signal level, and / or frequency band energy of the unadapted masking signal can be obtained in the remote unit 20 or determined by the remote unit 20. In addition, the typical transfer function of the acoustic transducers in the earphones 12, 14 or (generally) the sound reproduction unit 128 can be known to the remote unit 20. This information can be combined, for example, to obtain at least one sound parameter of the masking sound, such as the spectrum, loudness level, or a set of frequency band energies or frequency band loudness levels. For example, the acoustic parameters can be obtained or determined for each masking sound in a set of masking sounds stored in at least one earphone 12, 14. At least one parameter of the representative ambient sound signal can be compared to at least one acoustic parameter determined based on an unadapted version of the masking signal played in at least one earphone 12, 14, and the remote unit 20 can determine control parameters, such as a transfer function and gain factors, for masking signal adaptation. The remote unit 20 adapts the spectrum, loudness level, or a set of frequency band energies or frequency band loudness levels of the masking signal to approximate the corresponding acoustic parameters of the representative ambient sound signal. The transfer function used for masking signal adaptation can be represented, for example, by a set of filter coefficients, which the remote unit can transmit to at least one earphone 12, 14. The filter coefficients can describe or control a transfer function of at least one filter. The transfer function used for masking signal adaptation can also be represented by a set of one or more gain factors that control signal processing in at least one earphone 12, 14. For example, the filter bank within at least one earphone 12, 14 can include a plurality of bandpass filters, peaking filters, shelving filters, and the like. The gain in each filter can be controlled by the aforementioned gain factor to control the masking signal loudness in the corresponding frequency band or range.
[0029] Active noise cancellation methods in headphones generally involve either feedforward or feedback techniques. A feedforward system can include a microphone (not specifically illustrated in the figures) that receives ambient sound and is located, for example, below or within the outer surface of the headphone. When the headphone is placed inside a user's ear, the microphone can be adjacent to the surrounding air. The microphone receives the ambient noise and then processes (e.g., filters) the resulting microphone signal and radiates (outputs) the resulting microphone signal toward the inner ear via a speaker within the headphone as a cancellation sound. Processing can be performed so that, within a cancellation frequency range, the cancellation sound is substantially equal in level and opposite in phase to the ambient sound that leaks into the inner ear of the user wearing the headphone. The cancellation frequency range of a feedforward noise cancellation system in a headphone depends on the passive acoustic transfer function of the ambient noise from the outside to the inside of the user's inner ear. Furthermore, the transfer function of the feedforward noise cancellation path (including at least the aforementioned microphone, signal processing, and speaker) within the acoustic environment defined by the headphone and the user's ear influences the cancellation frequency range. Therefore, the cancellation frequency range can be adjusted by adapting the transfer function applied to the microphone signal through signal processing.
[0030] The feedback system may include a microphone (not specifically illustrated in the figures), for example, arranged within a portion of the earphone and adjacent to the inner ear volume of the earphone user. The microphone receives sound within the inner ear (e.g., the ear canal). The microphone signal may be processed and radiated toward the inner ear via a speaker within the earphone as a cancellation sound. Since the microphone also receives the signal radiated by the speaker, the arrangement constitutes a feedback loop comprising at least the microphone, signal processing, and speaker. Primarily, the open-loop transfer function of the feedback loop controls the cancellation frequency range of the feedback noise cancellation system. The open-loop transfer function can be adapted by adapting the transfer function for the microphone signal using signal processing. Due to feedback system stability limitations, the maximum possible cancellation range is typically limited in terms of the frequency and amplitude of the active insertion loss (AIL). However, it is generally possible to choose between a wider frequency range with a lower AIL and a smaller frequency range with a higher AIL. Furthermore, within stability limits, the frequency range with the highest AIL can be selected.
[0031] The remote unit 20 can determine a noise signal representative of the noise signal in the user's ear. To this end, the remote unit 20 can apply a transfer function based on the typical passive insertion loss (PIL) of the earphone to the ambient noise signal received by at least one microphone 22 in the remote unit 20. The remote unit 20 can also analyze the spectral energy distribution of the representative noise signal or a weighted and / or compressed or expanded representative ambient sound signal. Weighting can include applying a transfer function that is inverse to the typical equal-level perception curve of humans (e.g., A-weighting). Weighting can optionally or additionally emphasize (reinforce) lower frequency ranges, where noise masking is less effective or more prominent than in higher frequency ranges. Compression and / or expansion can be based on the human equal-loudness perception curve for various sound pressure levels. Because these curves are not parallel (particularly in the lower frequency region), level-dependent compression and frequency-dependent compression can be applied to determine loudness. For example, the compression and / or expansion can be applied via a low-frequency shelving filter with variable filter parameters controlled by the level of the signal to be dynamically processed (compressed or expanded). Horizontal-dependent processing and frequency-dependent processing can also be applied independently of the various frequency bands that can be provided, for example, by a filter bank or a Fast Fourier Transform (FFT). Based on the spectral energy distribution of a representative noise signal or a weighted and / or dynamically processed representative ambient sound signal, it can be determined whether ANC is needed. If ANC is not needed, ANC can be deactivated or kept inactive.
[0032] If ANC is required, this function can be activated or kept active, and / or an optimal cancellation range in terms of frequency and amplitude can be determined based on the spectral energy distribution of the representative noise signal or the weighted representative noise signal. Based on this, the signal processing in at least one of the feedforward noise cancellation system and the feedback noise cancellation system in at least one earphone can be adapted. For example, a set of filter coefficients that determine the signal processing in the noise cancellation path can be selected from multiple sets of coefficients stored in the remote unit or the earphone. The set of filters can be selected so that the resulting cancellation range in terms of frequency and amplitude provides the most effective cancellation in the frequency range where the spectral energy distribution of the representative noise signal or the weighted and / or compressed or expanded representative noise signal is relatively high.
[0033] Next, sleep monitoring for controlling ANC and noise masking will be described in more detail. During periods when the user of a noise-masking and / or noise-attenuating headphone system has fallen asleep, noise masking and / or ANC may not be required. Noise masking and / or ANC may not be required regardless of whether the volume level of the detected ambient noise / surrounding sounds is above a certain threshold level. Alternatively, the threshold level can be adjusted to reflect reduced noise sensitivity. This is because once the user has fallen asleep, they are less disturbed by noise. Noise may primarily be disruptive when the user is trying to fall asleep. Once the user has fallen asleep, the corresponding headphone function can be disabled to conserve battery power. In one example, once the user has fallen asleep, the function can be disabled regardless of the volume of the ambient noise / surrounding sounds. In another example, one or both functions can be disabled based on the ambient noise / surrounding volume level. Ambient sound levels that could wake the user may still need to be masked and / or eliminated. That is, noise masking or ANC may only be applied if the volume level of the ambient noise exceeds a predefined threshold. In one example, the user can adjust this threshold based on their personal preferences. In another example, this threshold can be a pre-set threshold. The threshold value may be a single value or multiple values (e.g., a different value for each of a plurality of frequencies or frequency bands). The ambient noise / surrounding sound may be analyzed in the remote unit 20 as previously described. In addition, the ambient sound signal representing the ambient sound signal in the user's ear may be compared to certain threshold ranges to obtain an absolute sound level. If the volume of the detected ambient sound is above a certain threshold level, the function may remain active. If the volume of the detected ambient sound is equal to or below the threshold level, the function may be deactivated.
[0034] The remote unit 20 may include a sensor that is suitable for monitoring parameters indicating whether a person is asleep (hereinafter, the parameters will also be referred to as user parameters). The user parameters may, for example, include the user's movement, body temperature, breathing rate or breathing rhythm. For example, during a deep sleep stage, the user may not move at all. Body temperature may be lower during sleep than during the waking stage. If a person falls asleep, the breathing rhythm may change compared to the waking stage. For movement sensing, for example, one or more radar sensors (based on electromagnetic waves), ultrasonic sensors or infrared radiation sensors (called motion detectors) may be utilized. Body temperature may be monitored, for example, by a sensor that measures infrared radiation (called thermal imaging). Breathing may be recorded by at least one microphone or microphone array 22 of the remote unit 20, and the breathing may be analyzed by a signal processing method to obtain the breathing rate.
[0035] According to another example, the user can wear a smartwatch, a tracking wristband, or any other suitable device worn on the body that is capable of detecting user parameters (such as heart rate, body temperature, movement, or any other parameter) that can indicate whether the user is asleep. According to another example, the user parameters can be determined with the help of a sensing device that supports the evaluation of one or more of the aforementioned user parameters, such as a motion-sensing mattress, an electronic device (smartphone or any similar device) including a g-sensor (accelerometer), etc. Today, many people use such devices for sleep monitoring. The external device can be wirelessly connected to the remote unit 20 and transmit any detected user parameters to the remote unit 20 for further evaluation and processing.
[0036] Now refer to Figure 4 The remote unit 20 may also include a user interface 28 that allows the user to control certain functions of at least one headset 12, 14. The user interface 28 may, for example, include a display, buttons, and / or at least one speaker for user interaction. Figure 4 (not specifically illustrated in the figures). The remote unit 20 may also include a docking system for storage and a battery for charging the headsets 12, 14. The remote unit 20 may optionally be a charging case or base station for at least one headset, a smartphone, a tablet, a laptop, or any other suitable portable electronic device.
[0037] Now refer to Figure 5 , illustrates an exemplary method for operating a headphone system. The method includes: capturing ambient noise with a remote unit 20 including at least one microphone 22 (step 501); evaluating, analyzing, and / or processing the ambient noise captured by the at least one microphone 22 in the remote unit 20 (step 502); generating control parameters or control commands based on the evaluation, analysis, and / or processing of the ambient noise in the remote unit 20 (step 503); sending the control parameters or control commands to each of at least one headphone 12, 14 to control at least one function of the at least one headphone 12, 14, wherein each of the at least one headphone 12, 14 is separate from the remote unit 20 and configured to be inserted into an ear of a user, and wherein each of the at least one headphone 12, 14 includes at least one sound reproduction unit 128 (step 504); and outputting at least one of a masking sound and a noise reduction signal via the at least one sound reproduction unit 128 in response to or under the control of the control parameters or control commands received from the remote unit 20 (step 505).
[0038] It will be understood that the illustrated headphone system is merely an example. While various embodiments of the present invention have been described, those skilled in the art will appreciate that many more embodiments and implementations are possible within the scope of the present invention. Specifically, those skilled in the art will recognize the interchangeability of various features from different embodiments. While these techniques and systems have been disclosed in the context of certain embodiments and examples, it will be understood that these techniques and systems can extend beyond the specifically disclosed embodiments to other embodiments and / or uses, as well as obvious modifications thereof. Therefore, the present invention is limited only by the following claims and their equivalents.
[0039] The description of the embodiments has been presented for the purpose of illustration and description. Suitable modifications and variations to the embodiments can be performed in view of the above description or can be obtained when practicing the method. The arrangement is exemplary in nature and may include additional elements and / or omit elements. As used in this application, elements listed in the singular and preceded by the word "a / an" should be understood as not excluding plural elements unless the exclusion is specified. In addition, reference to "one embodiment" or "an example" of the present disclosure is not intended to be interpreted as excluding the existence of additional embodiments that also include the features. The terms "first", "second" and "third" are used only as labels and are not intended to make numerical requirements or special positional order to their objects. The system is exemplary in nature and may include additional elements and / or omit elements. The subject matter of the present disclosure includes all novel and non-obvious combinations and sub-combinations of various systems and configurations and other features, functions and / or properties disclosed. The accompanying claims specifically point out the subject matter that is considered novel and non-obvious in the above disclosure.
Claims
1. An earphone system (100), comprising: at least one earphone (12, 14) configured to be inserted into an ear of a user, wherein each of the at least one earphone (12, 14) comprises at least one sound reproduction unit (128); and a remote unit (20) separate from each of the at least one earphone (12, 14), wherein the remote unit (20) includes at least one microphone (22) configured to capture ambient sound, wherein The remote unit (20) is configured to evaluate, analyze and / or process the ambient sound captured by the at least one microphone (22) to determine one or more of at least one ambient sound parameter, at least one control parameter and at least one control command based at least on the evaluation, analysis and / or processing of the ambient sound, and to send the at least one ambient sound parameter, the at least one control parameter and / or the at least one control command to at least one of the at least one earphones (12, 14), and The at least one earphone (12, 14) is configured to control sound reproduced by a corresponding sound reproduction unit (128) in response to the at least one ambient sound parameter, the at least one control parameter and / or the at least one control command received from the remote unit (20); wherein the remote unit (20) is configured to apply at least one representative of the passive insertion loss PIL, the active insertion loss AIL, or the total insertion loss TIL of the at least one earphone (12, 14) to a representative of an ambient sound signal captured by the at least one microphone (22) to determine an ambient sound signal representative of ambient sound entering an ear of the user, wherein the remote unit (20) determines at least one of the at least one sound parameter, the control parameter, and the control command based at least on the ambient sound signal representative of ambient sound entering the ear of the user; wherein the at least one earphone is configured to apply active noise cancellation, and wherein the active noise cancellation applied by the at least one earphone causes an active insertion loss AIL to be present in a total insertion loss TIL, and the TIL is based at least on the AIL.
2. The earphone system (100) of claim 1, wherein The sound controlled by the at least one earphone (12, 14) includes at least one of normal sound, masking sound, and noise reduction sound; and Controlling the sound reproduced by the corresponding sound reproduction unit (128) includes outputting the corresponding sound, or adapting at least one sound parameter of the corresponding sound, or both.
3. The earphone system (100) according to claim 1 or 2, wherein The at least one earphone (12, 14) is configured to adapt at least one sound parameter of the sound reproduced by the corresponding sound reproduction unit (128) according to at least one corresponding sound parameter of the ambient sound; and The at least one sound parameter represents at least one coefficient of at least one of a spectral shape, a frequency spectrum, a magnitude spectrum, a spectral content and a loudness measure of at least one frequency range of the corresponding sound.
4. The headset system (100) of claim 1, wherein the remote unit (20) is configured to determine the at least one control parameter and / or control command based on at least one sound parameter of any one of a general sound and a noise masking sound, wherein: The at least one sound parameter of the general sound or the noise masking sound is determined based on an audio signal stored locally in the at least one earphone (12, 14) or wirelessly transmitted to the at least one earphone (12, 14) by the remote unit (20), and The at least one sound parameter of the general sound or the noise masking sound is determined from the corresponding audio signal by applying at least one transfer function of the at least one sound reproduction unit (128) of the at least one earphone (12, 14).
5. A headset system (100) as claimed in claim 1, wherein the remote unit (20) is configured to determine the at least one control parameter and / or control command based at least on a comparison of at least one sound parameter of either a general sound or a noise masking sound with at least one sound parameter of the ambient sound captured by the at least one microphone (22).
6. The headset system (100) of claim 1, wherein the remote unit (20) is further configured to evaluating a sleep state of the user, wherein the sleep state indicates whether the user wearing the at least one earphone (12, 14) falls asleep, or receiving information about the sleep state of the user from at least one external device, and Sound output via the at least one sound reproduction unit (128) is controlled based on at least the sleep state of the user.
7. The headset system (100) of claim 6, wherein the remote unit (20) is configured to assess the sleep state of the user based on information about at least one of the user's heart rate, body temperature, breathing rate, breathing rhythm, and movement.
8. The headset system (100) of claim 7, wherein at least one of the remote unit (20) and the at least one headset (12, 14) further comprises at least one of a motion sensor and a temperature sensor.
9. The earphone system (100) of claim 8, wherein at least one The motion sensor includes a radar sensor, an ultrasonic sensor, or an infrared radiation sensor; and The temperature sensor includes a sensor configured to measure infrared radiation.
10. The headset system (100) of claim 7, wherein the remote unit (20) is configured to determine the user's breathing rate and breathing rhythm based on breathing noise captured by the at least one microphone (22).
11. The headset system (100) of claim 1, wherein the remote unit (20) further comprises a user interface (28).
12. The headphone system (100) of claim 1, wherein controlling at least one function of the at least one headphone (12, 14) further comprises sending a signal to each of the at least one headphone (12, 14), the signal comprising a result of the evaluation, the analysis and / or the processing of the ambient noise.
13. The headset system (100) as claimed in claim 1, wherein the remote unit (20) is a charging case or a base station for the at least one headset (12, 14), a smartphone, a tablet or a laptop.
14. A method for a headphone system, the method comprising: capturing ambient sound with a remote unit (20) comprising at least one microphone (22); evaluating, analyzing and / or processing the ambient sound captured by the at least one microphone (22) in the remote unit (20); determining one or more of at least one ambient sound parameter, at least one control parameter, and at least one control command based at least on the evaluating, the analyzing, and / or the processing of the ambient sound in the remote unit (20); sending the at least one ambient sound parameter, the at least one control parameter and / or the at least one control command to at least one of at least one earphone (12, 14) to control at least one function of the at least one earphone (12, 14), wherein each of the at least one earphone (12, 14) is separate from the remote unit (20) and configured to be inserted into an ear of a user, and wherein each of the at least one earphone (12, 14) includes at least one sound reproduction unit (128); controlling the sound reproduced by the corresponding sound reproduction unit (128) in response to the at least one ambient sound parameter, the at least one control parameter and / or the at least one control command received from the remote unit (20); applying at least one representative of the passive insertion loss PIL, active insertion loss AIL, or total insertion loss TIL of the at least one earphone (12, 14) to a representative of the ambient sound signal captured by the at least one microphone (22) to determine an ambient sound signal representative of the ambient sound entering the ear of the user, determining at least one of the at least one sound parameter, the control parameter, and the control command based at least on the ambient sound signal representative of ambient sound entering an ear of the user; Active noise cancellation is configured to be applied via the at least one earphone, and wherein the active noise cancellation applied by the at least one earphone causes an active insertion loss AIL to be present in a total insertion loss TIL, and the TIL is based on at least the AIL.
Citation Information
Patent Citations
Earphones with activity controlled output
CN107005764A
Reducing Occlusion Effect in ANR Headphones
US20140126735A1
Spectral Optimization of Audio Masking Waveforms
US20170352342A1