Control of Headphone Devices

Abstract

A device, method, and computer program for controlling a headphone device are disclosed. The device may include components for detecting a situation corresponding to the headphone device becoming detached from a user's ear and components for operating the headphone device in an adjustment mode based on detecting the situation, wherein in the adjustment mode, operations associated with a touch sensor on the headphone device are changed.

Description

Technical Field

[0001] Example embodiments relate to an apparatus, a method, and a computer program for controlling a headphone device. Background Art

[0002] A headphone device (the term may cover devices placed on, above, or partially inside the ear (such as headphones or earbuds)) is a device configured to output an audio signal or audio data as sound waves to a user's ear via one or more output transducers (such as speakers). A pair of headphone devices may be provided as a set, with each headphone placed above or inside the user's respective ear (i.e., the left ear and the right ear), and thus it can be used to output stereo or even spatial audio to the user. The headphone device may also include input transducers, such as a microphone, an active noise reduction (ANR) function, and / or one or more touch sensors on the body of one or both headphones. Summary of the Invention

[0003] The scope of protection sought by the various embodiments of the present invention is defined by the independent claims. Embodiments and features described in this specification that do not fall within the scope of the independent claims (if any) will be construed as examples useful for understanding the various embodiments of the present invention.

[0004] According to a first aspect, this specification describes an apparatus including components for the following operations:

[0005] detecting a situation corresponding to the headphone device becoming detached from the user's ear; and operating the headphone device in an adjustment mode based on the detected situation, wherein in the adjustment mode, operations associated with a touch sensor on the headphone device are changed.

[0006] In the adjustment mode, the apparatus may be configured to disable the operation of the touch sensor.

[0007] The apparatus may further include components for determining that the user's hand is approaching the headphone device, and wherein the apparatus may be configured to operate the headphone device in the adjustment mode based on the detected situation and the user's hand approaching the headphone device.

[0008] In the adjustment mode, the apparatus is further configured to reduce the volume of the audio signal output by the headphone device or prohibit the output of the audio signal.

[0009] In the adjustment mode, the apparatus may be configured to disable the output of the audio signal and move the output of the audio signal to a second headphone device having a paired relationship with the headphone device.

[0010] In the adjustment mode, the device can be configured to determine the similarity between a first audio signal output from the headphone device and a second audio signal output from a second headphone device, and move the output of the first audio signal to the second headphone device only if the similarity is below a predetermined threshold value.

[0011] In the adjustment mode, the device can also be configured to disable the operation of a microphone provided on the headphone device.

[0012] The device can also be configured to enable the operation of a microphone provided on a second headphone device having a paired relationship with the headphone device.

[0013] The device can also include components for detecting a subsequent situation corresponding to the headphone device becoming re-engaged with the user's ear, wherein the device is configured to cancel the adjustment mode based on the detected re-engagement situation.

[0014] The device can be configured to cancel the adjustment mode based on the re-engagement situation and the user's hand not being close to the headphone device.

[0015] The device can also include components for issuing a notification via a user interface, the notification being associated with operating the headphone device in the adjustment mode.

[0016] The notification can include an audio notification made by an output transducer of the headphone device.

[0017] The device can also include components for: detecting a situation corresponding to the headphone device, as a first headphone device, and a second headphone device having a paired relationship with the first headphone device simultaneously becoming detached from the user's ear; based on detecting the situation: operating the first headphone device in the adjustment mode; detecting a subsequent situation corresponding to the first headphone device becoming re-engaged with the user's ear; canceling the adjustment mode for the first headphone device based on the detected re-engagement situation; and operating the second headphone device in the adjustment mode based on the cancellation of the adjustment mode for the first headphone device.

[0018] The device can also include components for: detecting a situation corresponding to the headphone device becoming completely detached from the user's ear; causing an audio transducer of the headphone device to output an alarm sound before operating the headphone device in the adjustment mode; receiving an input corresponding to the user locating the headphone device; and operating the headphone device in the adjustment mode in response to the received input.

[0019] The apparatus may further include components for determining that the headphone device is beyond a predetermined distance from the user's ear, and in response thereto, the apparatus may be configured to cause an alert sound to be output to another second headphone device having a paired relationship with the headphone device.

[0020] According to a second aspect, this specification describes a method, including:

[0021] Detecting a situation corresponding to the headphone device becoming detached from the user's ear; and operating the headphone device in an adjustment mode based on detecting the situation, wherein in the adjustment mode, operations associated with a touch sensor on the headphone device are changed.

[0022] In the adjustment mode, the method may include disabling the operation of the touch sensor.

[0023] The method may further include determining that the user's hand is approaching the headphone device, and operating the headphone device in the adjustment mode based on detecting the situation and the user's hand approaching the headphone device.

[0024] In the adjustment mode, the method may further include reducing the volume of an audio signal output from the headphone device, or prohibiting the output of the audio signal.

[0025] In the adjustment mode, the method may disable the output of the audio signal and move the output of the audio signal to a second headphone device having a paired relationship with the headphone device.

[0026] In the adjustment mode, the method may determine the similarity between a first audio signal output from the headphone device and a second audio signal output from a second headphone device, and move the output of the first audio signal to the second headphone device only if the similarity is below a predetermined threshold value.

[0027] In the adjustment mode, the method may further include disabling the operation of a microphone provided on the headphone device.

[0028] The method may further include enabling the operation of a microphone provided on a second headphone device having a paired relationship with the headphone device.

[0029] The method may further include detecting a subsequent situation corresponding to the headphone device being re - engaged with the user's ear, and canceling the adjustment mode based on detecting the re - engagement situation.

[0030] The method may include canceling the adjustment mode based on the re - engagement situation and the user's hand not approaching the headphone device.

[0031] The method may include issuing a notification via a user interface, the notification being associated with operating the headphone device in the adjustment mode.

[0032] The notification may include an audio notification made by an output transducer of the earphone device.

[0033] The method may further include: detecting a situation corresponding to the earphone device as a first earphone device and a second earphone device having a paired relationship with the first earphone device being simultaneously detached from the user's ears; based on detecting the situation: operating the first earphone device in an adjustment mode; detecting a subsequent situation corresponding to the first earphone device becoming re - engaged with the user's ears; canceling the adjustment mode for the first earphone device based on the detected re - engagement situation; and operating the second earphone device in the adjustment mode based on the cancellation of the adjustment mode for the first earphone device.

[0034] The method may further include detecting a situation corresponding to the earphone device becoming completely detached from the user's ears; causing an audio transducer of the earphone device to output an alarm sound before operating the earphone device in an adjustment mode; receiving an input corresponding to the user locating the earphone device; and operating the earphone device in the adjustment mode in response to the received input.

[0035] The method may further include determining that the earphone device is beyond a predetermined distance from the user's ears, and in response thereto, causing an alarm sound to be output to another second earphone device having a paired relationship with the earphone device.

[0036] According to a third aspect, this specification describes a computer program including instructions for causing a device to perform at least the following operations: detecting a situation corresponding to the earphone device becoming detached from the user's ears; and operating the earphone device in an adjustment mode based on detecting the situation, wherein in the adjustment mode, operations associated with a touch sensor on the earphone device are changed.

[0037] Example embodiments of the third aspect may also provide any feature of the second aspect.

[0038] According to a fourth aspect, this specification describes a computer - readable medium (such as a non - transient computer - readable medium) including program instructions stored thereon for performing at least the following operations: detecting a situation corresponding to the earphone device becoming detached from the user's ears; and operating the earphone device in an adjustment mode based on detecting the situation, wherein in the adjustment mode, operations associated with a touch sensor on the earphone device are changed.

[0039] According to a fifth aspect, the present specification describes an apparatus, comprising: at least one processor; at least one memory including computer program code which, when executed by the at least one processor, causes the apparatus to: detect a situation corresponding to the headphone device becoming detached from the user's ear; and operate the headphone device in an adjustment mode based on the detected situation, wherein in the adjustment mode, operations associated with a touch sensor on the headphone device are changed. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] Example embodiments will now be described by way of non-limiting example with reference to the accompanying drawings, in which:

[0041] Figure 1 is a schematic diagram of an example system including a headphone device and a user device according to some example embodiments;

[0042] Figure 2 is a flowchart showing processing operations according to some example embodiments;

[0043] Figure 3 is a flowchart showing processing operations according to other example embodiments;

[0044] Figures 4A to 4C is a schematic diagram of a user wearing first and second headphone devices, which helps to understand the operation of some example embodiments when one of the headphone devices becomes detached;

[0045] Figure 5A and Figure 5B is a schematic diagram of a user wearing first and second headphone devices, which helps to understand the operation of some example embodiments when one of the headphone devices becomes completely detached;

[0046] Figure 6 shows an apparatus according to an example embodiment; and

[0047] Figure 7 shows a non-transitory medium according to an example embodiment. DETAILED DESCRIPTION

[0048] Example embodiments may relate to control apparatus, methods, and computer programs for a headphone device, which may be used as a general term to describe headphones or earbuds.

[0049] As will be understood, headphones may be configured to be positioned above or near the user's ear, while earbuds may be at least partially positioned within the user's ear canal during use. The term headphone device encompasses all such examples.

[0050] One or a set of such headphone devices can be provided, each headphone device for placement above or inside a respective ear (i.e., left ear and right ear) of a user, which can be used to output stereo (left and right channels) or even spatial audio to the user.

[0051] The headphone device can be configured to be carried or worn by the user and be capable of generating sound waves from one or more output transducers. The one or more output transducers can be speakers for converting an electrical signal or data into audible sound waves. The headphone device can also include input functions, such as one or more input transducers, e.g., a microphone, for converting sound waves into electrical signals.

[0052] Other input functions can include one or more touch sensors located on the body of one or both headphone devices. Example operations that can be performed in response to receiving user input via the touch sensor include playing audio, pausing audio, advancing to a subsequent track, reverting to a previous track, increasing / decreasing volume, and power-on / off functions in the context of audio playback. Other operations can be performed in other usage contexts, such as when the user is participating in a phone call, a teleconference, or a video conference. For example, selecting the touch sensor during a phone call can end the call.

[0053] The headphone device can communicate signals or data with a user device (e.g., a mobile phone) either wirelessly or through a wired connection. Wireless communication can be via any suitable wireless protocol, such as Bluetooth, Zigbee, or WiFi, e.g., using the IEEE 802.11 communication standard. In some cases, e.g., if the headphone device includes an input transducer such as a microphone, the headphone device can send audio data to the user device. For example, part of a voice call can be received by the microphone of the headphone device and relayed to the user device, such as a smartphone. As another example, a voice command or query can be received by the microphone of the headphone device and relayed to the user device that can provide digital assistant functionality.

[0054] Input received via the one or more touch sensors described above can also communicate with the user device, and the user device can determine via software which operations to perform in response to the received input, which can be based on the currently active application on the user device.

[0055] A user device may include any processing device capable of providing audio data to at least a headset device, such as but not limited to a smartphone, digital assistant, digital music player, personal computer, laptop, tablet computer, or wearable device, such as a smartwatch. The user device may also include one or more decoders for decoding the audio data into a format suitable for output by a speaker of the headset device. The user device may also include one or more memory modules for storing the audio data, although in some embodiments, the user device may be configured to utilize streamed audio data received from a remote source via the cloud and thus can only temporarily store the audio data. The user device may be capable of establishing a communication session with a third party via a network, such as an audio or video conference or a voice call. The user device may be configured to use protocols for 3G, 4G, LTE, 5G, or any future generation communication protocol to send and receive data. The user device may include components for short-range communication using, for example, Bluetooth, Zigbee, or WiFi. The user device may include a display screen and one or more control buttons. The display screen may be touch-sensitive. The user device may include one or more antennas for communicating with external devices, including the headset device.

[0056] The headset device may also include passive and / or active noise reduction (ANR) features or functions for blocking at least some ambient sounds from reaching the user's ears. As will be understood, ambient sounds from noise generation sources external to the headset device may be distracting. The ANR feature may include an ANR system, which is an electrical or electronic system associated with one or more microphones and one or more speakers. The ANR system performs signal processing, such as by processing ambient sounds received by one or more microphones to generate a cancellation signal for output by one or more speakers. The cancellation signal serves to reduce or eliminate the user's perception of the ambient sounds when output through destructive interference. For example, the ANR system may generate a cancellation signal that is out of phase with the received ambient sounds.

[0057] In an apparatus including first and second headset devices, each headset device may include one or more microphones, an ANR system, and a speaker. For each headset device, the microphone of the headset may receive ambient sound waves, which are then converted into ambient sound signals and processed by the ANR system to generate a cancellation signal output by the speaker of the headset device. Thus, each headset device may have an independent ANR function.

[0058] Example embodiments may provide an apparatus, method, and computer program for detecting a situation corresponding to a headset device becoming detached from a user's ear. The term "detached" is intended to cover situations where the headset device becomes loose or displaced from its "in-use" position, e.g., when it is about to fall or has fallen out of the user's ear.

[0059] For example, in the case where the headphone device is an earbud, its in-use position may include at least a portion of the headphone device fitting relatively closely within the user's ear canal. For example, due to the user's movement while wearing one or more headphone devices, a disengagement situation may occur accidentally. For example, a user walking or running while listening to music or during a partial call may experience one or more of the worn headphone devices becoming disengaged. If provided, this may result in a perceived audio quality and / or functional loss of the ANR system.

[0060] The example embodiment may also relate to operating the headphone device in an adjustment mode based on detecting a disengagement situation, wherein in the adjustment mode, the operation associated with a touch sensor on the headphone device may be changed.

[0061] In this context, when it is sensed that a worn headphone device is becoming disengaged, the natural reaction of the user is to move their hand towards the device to re-engage the headphone device. By changing the operation associated with the touch sensor, the user's reactionary contact on the touch sensor can prevent the execution of an unexpected function, such as turning off the headphone device or ending a call. For example, in the adjustment mode, the device may be configured to disable the operation of the touch sensor.

[0062] This may involve making the headphone device not send a signal to the user device in response to a touch input, or may involve making the user device communicating with the headphone device not respond to a signal received from the headphone device generated by a touch input.

[0063] Entering the adjustment mode may cause other operations, which will be explained later. Operations including the above operations may be temporary, and the adjustment mode may be cancelled, for example, after detecting that the headphone device has re-engaged with the user's ear.

[0064] In some embodiments, the adjustment mode may be entered when an object such as the user's hand is detected to be close to the headphone device additionally (i.e., after detecting a disengagement situation).

[0065] Other operations in the adjustment mode may include, for example, reducing the volume of the audio signal output from the headphone device, or prohibiting the output of the audio signal. Additionally, in the case where the headphone device is part of a set (e.g., has a paired relationship with another second headphone device), a portion or all of the disabled audio signal may be moved to the second headphone device, for example, during the duration of the adjustment mode.

[0066] In some embodiments, if there is a high degree of similarity between the audio signal output from the headphone device and the audio signal output from the second headphone device, the device may not move some or all of the first audio signal to the second headphone device. This can be based on determining the similarity between the first audio signal and the second audio signal, and moving the output of the first audio signal to the second headphone only if the similarity is below a predetermined threshold value.

[0067] Other operations in the adjustment mode may include disabling the operation of the microphone provided on the headphone device. In addition, the microphone provided on another second headphone device having a paired relationship with the headphone device may be enabled, so that, for example, a call function can be performed.

[0068] Figure 1 An example system 100 including a first headphone device 102 and a user device 118 is shown.

[0069] The first headphone device 102 may be one of a pair of headphone devices. For ease of illustration, only the first headphone device 102 is shown. It should be understood that the other second headphone device in the pair may include the same hardware and functions, and may differ only in that it receives data / signals intended for that particular headphone device from the user device 118, for example, from its corresponding audio channel.

[0070] The headphone device 102 may include a body composed of an ear-insert portion 104 and an external portion 106. The ear-insert portion 104 is arranged to partially enter the user's ear canal during use, while the external portion 106 remains substantially outside the user's ear during use. An output transducer such as a speaker 108 may be positioned within the ear-insert portion 104 and be directed such that sound waves are emitted towards the user's ear through a hole 109 defined within the ear-insert portion 104 during use. The hole 109 may or may not be closed by a mesh or grille (not shown).

[0071] The headphone device 102 may include a controller 110 within, for example, the external portion 106. The controller 110 may include one or more circuits, processors, controllers, application specific integrated circuits (ASICs) or field programmable gate arrays (FPGAs). The controller 110 may operate under the control of computer-readable instructions or code that, when executed by one or more circuits, processors, controllers, ASICs or FPGAs, may perform the operations described herein.

[0072] The controller 110 may also be configured to provide an active noise reduction (ANR) system, for example, configured to provide a conventional ANR function, although a separate ANR module may be provided for this purpose.

[0073] The first headphone device 102 may include a first microphone 112 mounted on or within the external portion 106. One or more other "external" microphones may be mounted on or within the external portion 106. The first microphone 112 is connected to the controller 110 to provide, in use, a feedforward signal representative of ambient sound 124 from one or more ambient sources 125 picked up by the first microphone 112. The feedforward signal may be used as part of an ANR system. The first headphone device 102 may also include a second microphone 114 mounted on or within the aperture 109 of the ear-insertion portion 104. One or more other "internal" microphones may be mounted on or within the aperture 109 of the ear-insertion portion 104. The second microphone 114 is connected to the controller 110 to provide, in use, a feedback signal representative of the ambient sound 124 when output from the speaker 108. The feedback signal may also be used as part of an ANR system.

[0074] A third microphone 115 mounted on or within the external portion 106 is also shown. The third microphone 115 may be configured to pick up a voice / conversation signal from the user as an input form. In some example embodiments, the first microphone 112 may provide the function of the third microphone 115, and thus this is not necessary.

[0075] The first headphone device 102 may also include a touch sensor 117 mounted on or within the external portion 106. The touch sensor 117 may be of any suitable type, for example, a capacitive touch sensor, whereby in response to user contact, a sensed signal may be generated and received by the controller 110. The controller 110 may respond to the received sensed signal by one or more of: controlling an aspect of the first headphone device 102 (e.g., turning it off), and controlling an aspect of the user device 118 or a user device application (e.g., pausing playback or ending a call). More than one touch sensor 117 may be provided on the first headphone device 102.

[0076] The first headphone device 102 may also include an antenna 116 for signal communication with the antenna 120 of the user device 118. The antenna 116 is shown connected to the controller 110, which may be assumed to include transceiver functionality, for example for Bluetooth, Zigbee or WiFi communication. In some embodiments, a separate transceiver functionality (e.g., communication circuitry) may be associated with the controller 110.

[0077] The user device 118 may also include one or more circuits, processors, controllers, application specific integrated circuits (ASICs), or field programmable gate arrays (FPGAs), generally represented by reference numeral 122, for providing user device functionality such as that of a smart phone, a digital assistant, a digital music player, a personal computer, a laptop computer, a tablet computer, or a wearable device such as a smart watch.

[0078] Reference Figure 2 , shows a flowchart indicating processing operations that may be performed by the controller 110 according to one or more example embodiments. The processing operations may be performed by hardware, software, firmware, or a combination thereof. In some embodiments, the processing operations may be performed by a controller 122 of the user device 118 that is in signal communication with, for example Figure 1 the first headphone device 102 shown.

[0079] A first operation 201 may include detecting a situation corresponding to the headphone device becoming detached from the user's ear.

[0080] A second operation 202 may include operating the headphone device in an adjustment mode based on detecting the situation, where in the adjustment mode, operations associated with a touch sensor on the headphone device are changed.

[0081] There are various methods for detecting the above-described situation corresponding to the headphone device becoming detached.

[0082] For example, referring back to Figure 1 , a photodetector 130 is provided at or within the ear-insertion portion 104 of the headphone device 102. The photodetector 130 may be located outside the ear-insertion portion 104 and electrically connected to the controller 110 such that when properly engaged with the user's ear, the light sensor is covered and thus the photodetector 130 will receive little or no light and thus little or no signal is sent to the controller 110. As the headphone device 102 becomes detached (i.e., loose), some ambient light will be received by the photodetector 130 and thus some signal is sent to the controller 110. If above a threshold, the controller 110 may trigger the adjustment mode. In some embodiments, more than one photodetector 130 may be provided at corresponding positions along the main axis of the ear-insertion portion 104 for a higher resolution detachment indication.

[0083] Additionally or alternatively, the detection that the headphone device 102 becomes detached can be based on audio processing. For example, the controller 110 can be configured to measure the distance between a reference portion of the ear-insertion part 104 and the user's eardrum based on audio processing, and monitor this distance to identify a specific distance indicating a detachment situation or a distance increased from a default distance. For example, the controller 110 can monitor the time delay between sending one or more audio signals from the speaker 108 and receiving one or more corresponding audio signals that have bounced back or echoed from the eardrum, e.g., via an internally mounted microphone in the hole 109, which can be positioned, for example, near or behind the speaker 108. The time delay can be processed by the controller 110 to continuously and / or periodically estimate the distance.

[0084] Additionally or alternatively, the detection that the headphone device 102 becomes detached can be based on the above time-delay principle, but using ultrasonic or optical signals instead of audio signals. For example, a light emitter can emit a light beam or light pulse towards the user's eardrum, and monitor the time delay between emitting the light beam or light pulse and detecting its corresponding return or echo, e.g., via one or more photodetectors placed within the hole 109 of the ear-insertion part 104. The controller 110 can process the time delay to continuously or periodically estimate the distance.

[0085] Additionally or alternatively, the detection that the headphone device 102 becomes detached can be based on signal processing techniques indicating the sealing quality between the ear-insertion part 104 of the headphone device 102 and the user's ear canal. For example, the controller 110 can be configured to determine the impedance of the speaker using current measurement and / or acoustic measurement. Speaker impedance values indicating good sealing quality for a given frequency range can be obtained and stored, and then the speaker impedance can be monitored via current measurement and / or acoustic measurement to identify a poor seal or detachment situation.

[0086] Additionally or alternatively, the detection that the headphone device 102 becomes detached can be based on the operation of the above ANR system. For example, if the feedback signals received from the second microphone 114 change such that their correlation with the feedforward signals received from the first microphone 112 exceeds a value of a predetermined threshold, this can indicate a separation situation because the signals are similar.

[0087] For example, if the ANR system determines the amount of noise reduction it needs to apply based on the difference between the feedback and feedforward signals being higher than a value of a predetermined threshold, this can also indicate a detachment situation.

[0088] In an example embodiment, in the adjustment mode, the controller 110 can disable the operation of the touch sensor 117, thereby preventing any accidental contact by the user when attempting to adjust the first headphone device 102. This avoids causing unintended operations, such as ending a call.

[0089] Reference Figure 3 , shows another flowchart that indicates processing operations that may be performed by the controller 110 in accordance with one or more example embodiments. The processing operations may be performed by hardware, software, firmware, or a combination thereof. In some embodiments, the processing operations may be performed by a controller 122 of a user device 118 that is in signal communication with a headphone device 102 such as shown in, for example Figure 1 .

[0090] A first operation 301 may include detecting a situation corresponding to the headphone device becoming detached from the user's ear.

[0091] A second operation 302 may include identifying that the user's hand is approaching the headphone device.

[0092] A third operation 303 may include operating the headphone device in an adjustment mode based on detecting the situation and the proximity of the user's hand, wherein in the adjustment mode, operations associated with touch sensors on the headphone device are changed.

[0093] An optional fourth operation 304 may include performing one or more other operations, such as those described below.

[0094] Regarding the second operation 302,[[]] Figure 1 the headphone device 102 shown in may include a proximity sensor 140 on an outer portion 106 of the headphone device 102, which may be one or more of an optical sensor, an acoustic sensor, etc. For example, using techniques similar to those described above regarding measuring the distance to the user's eardrum, the distance between a portion of the outer portion 106 and the user's hand may be measured, and if the distance is below a predetermined level, the user's hand may be considered to be approaching. As another example, the controller 110 may monitor the signal received by the first microphone 112 and, based on detecting a relatively sudden change in the audio picked up by the first microphone, e.g., exceeding a predetermined level within a predetermined time period, determine that the user's hand is approaching. Reference to the user's hand may refer to a portion of the user's hand, e.g., a finger.

[0095] Thus, in this example, the adjustment mode is not entered until a detachment situation is identified and the user's hand is approaching.

[0096] In another example embodiment, in response to a first operation 301, a prompt may be output to a user interface such as user device 118. The prompt may include an indication that the headphone device 102 is becoming detached and may ask the user if they want to enter an adjustment mode. This may involve displaying "Yes" and "No" selectable user interface elements, and then if the "Yes" user interface element is selected, the user's selection effectively enters the adjustment mode. Alternatively or additionally, the prompt may be an audio prompt for the headphone device 102 that is becoming detached. A response to the prompt may be made in the above manner via the user interface and / or a voice command picked up via a third microphone 115 of the headphone device 102.

[0097] Other example operations that may be performed in the fourth operation 304 can now be summarized.

[0098] For example, in the adjustment mode, the controller 110 may reduce the volume of the audio signal output from the headphone device 102 or inhibit the output of the audio signal.

[0099] For example, if the headphone device 102 is a first headphone device having a paired relationship with another second headphone device, the output to the first headphone device may be disabled and the corresponding audio signal may be moved to the second headphone device.

[0100] Reference Figures 4A to 4C is made to graphically explain the above example. Figure 4A A user 400 wearing the above-described first headphone device 102 and a second headphone device 103 having a paired relationship with the first headphone device is shown. Each of the first headphone device 102 and the second headphone device 103 outputs an audio signal, for example, a stereo audio signal, with the first headphone device associated with the left (L) channel and the second headphone device associated with the right (R) channel. Figure 4B A situation where the first headphone device 102 becomes detached is shown, as detected using any one of the above-described methods. Thus, based on the above operations, for example, reference is made to Figure 2 or Figure 3 , and the adjustment mode is entered. Then, referring to Figure 4C , the left (L) channel audio signal is moved to the second headphone device 103. It should be understood that in another case, the second headphone device 103 may become detached, in which case the right (R) channel audio signal will be moved to the first headphone device 102.

[0101] In some example embodiments, the controller 110 may be configured to determine the similarity (e.g., a numerical measure of correlation) between a first audio signal (e.g., a left (L) channel audio signal output from the first headphone device 102) and a second audio signal (e.g., a right (R) channel audio signal output from the second headphone device 103), and move the output of the first audio signal to the second headphone only if the similarity is below a value of a predetermined threshold. This can ensure that if the audio content from the first headphone device 102 is different from the audio content from the second headphone device 103, it is not lost.

[0102] For example, in an adjustment mode, the controller 110 may also be configured to disable the operation of a microphone (e.g., the third microphone 115) provided on the headphone device.

[0103] The controller 110 may also be configured to enable the operation of another microphone (e.g., an equivalent third microphone provided on the second headphone device 103). This can ensure that the user can still retain voice functions, e.g., perform a call during a call.

[0104] In the above example embodiments, the adjustment mode may be entered only temporarily.

[0105] The controller 110 may be configured to detect a subsequent situation corresponding to the first headphone device 102 becoming re - engaged with the user's ear in the above situation. The controller 110 may be configured to cancel the adjustment mode based on the detected re - engagement situation. For example, the re - engagement situation may be detected based on the fact that it is determined, based on one or more of the above signal processing methods, that the user's hand is no longer in contact with or close to the first headphone device 102.

[0106] Alternatively or additionally, the other methods described above for determining the detachment situation may be deployed in the opposite sense to detect re - engagement, e.g., based on the fact that the photodetector 130 no longer receives light and thus does not send a signal to the controller 110.

[0107] When the adjustment mode is canceled, the above operations may be canceled. For example, the touch sensor 117 may be enabled. For example, an audio signal that was disabled and / or moved from the first headphone device 102 to the second headphone device 103 may be restored and / or moved back to the first headphone device 102. For example, if the third microphone 115 was disabled, the third microphone 115 may be re - enabled.

[0108] In some example embodiments, an audio notification may be output to one or both of the first headphone device 102 and the second headphone device 103 to indicate a detected detachment situation. The audio notification may simply include a tone that is output to the detached first headphone device 102, for example. The audio notification may include a voice message indicating the detachment situation and / or actually mention which headphone device is detached. After re-engagement, another audio notification, which may be a different tone or voice message, may indicate the detected re-engagement. This may be directed to the re-engaged headphone device, e.g., the first headphone device 102, which is based on the fact that the second headphone device 103 may be playing other audio and thus the user may not hear the other audio notification.

[0109] In some cases, to cancel the above operation, additional touch or voice input may be required after the re-engagement notification.

[0110] In some example embodiments, both the first headphone device 102 and the second headphone device 103 may become detached substantially simultaneously.

[0111] In such a case, the following operations may be performed. These operations may be performed by the controller 110 of each of the first headphone device 102 and the second headphone device 103 operating in series, or by one controller operating on behalf of both the first and second headphone devices, or by the controller of the user device 118.

[0112] The first operation may include detecting a corresponding situation corresponding to the first headphone and the second headphone device having a paired relationship with the first headphone device simultaneously detaching from the user's ears.

[0113] The second operation may include, based on detecting the situation, (i) operating the first headphone device in an adjustment mode, (ii) detecting a subsequent situation corresponding to the first headphone device becoming re-engaged with the user's ears, (iii) canceling the adjustment mode for the first headphone device based on the detected re-engagement situation, and (iv) operating the second headphone device in the adjustment mode based on the cancellation of the adjustment mode for the first headphone device. Thus, only one headphone device may enter the adjustment mode at a given time to maintain some form of continuous functionality.

[0114] In some example embodiments, one of the first headphone device 102 and the second headphone device 103 may become completely detached from the user's ear and fall without the user necessarily noticing. This may occur if no audio is being played at the time of detachment. For example, the first headphone device 102 may fall into the user's jacket hood or even onto the ground, e.g., if they are walking or running.

[0115] For example, a drop of the first headphone device 102 completely out of the user's ear can be detected using one or more of the above examples, such as based on the degree of similarity or correlation of the values of the audio signals received by the first microphone 112 and the second microphone 114 being greater than a predetermined threshold. Alternatively or additionally, the detection can be based on one or more motion sensors (such as an accelerometer, gyroscope), which can indicate to the controller 110 the sensed motion that indicates a sudden drop in height and / or a collision with a surface. Alternatively or additionally, the detection can be based on other positioning or ranging methods, such as the position relative to the user device 118.

[0116] In this case, the controller 110 can operate as follows based on an estimate of how far the first headphone device 102 is from the user.

[0117] For example, referring to Figure 5A , if it is determined that the first headphone device 102 has just fallen out of the user's ear or is within a first range of the user device 118, the controller 110 can be configured to cause an alarm sound 501 to be output by the audio transducer (e.g., speaker 108) of the headphone device before operating the first headphone device in an adjustment mode. The alarm sound 501 can be output at a higher volume relative to the sound 502 from the second headphone device 103 so that the user can locate the first headphone device 102. Then the controller 110 can receive an input corresponding to the user locating the headphone device, e.g., via the touch sensor 117. Then, the controller 110 can operate the first headphone device 102 in an adjustment mode based on the above examples in response to the received input.

[0118] For example, referring to Figure 5B , if it is determined that the first headphone device 102 is outside a first predetermined distance or range of the user device 118, an alarm sound 501 or a different alarm sound can be output by the audio transducer (e.g., speaker) of the second headphone device 103. Assuming the second headphone device 103 is still in the user's ear, they can thus be informed of the situation. After locating the first headphone device 102, the same operations as mentioned above can be performed, e.g., receiving an input via the touch sensor 117, for example, and operating in an adjustment mode in response to the received input.

[0119] The first headphone device 102 being outside the first distance or range may be due to a loss of communication via a short - range link (e.g., a Bluetooth link between the first headphone device and the user device 118). Alternatively, other methods for determining whether the first headphone device 102 is outside the first distance or range can be based on other positioning methods, such as by using positioning markers or sensors on the first headphone device.

[0120] Thus, example embodiments may provide an intuitive way to enable a user to adjust an earphone device when the earphone device is detected to become disengaged (e.g., loose). For example, a touch sensor may be changed, such as disabled, to prevent accidental operation when the user attempts to reengage the earphone device, and the audio may also be moved and / or a microphone function may be enabled on another earphone device. When the earphone device becomes reengaged, feedback may be received and the previous function may be restored through a so-called temporary adjustment mode.

[0121] Example Device

[0122] Figure 6 1 shows an apparatus according to some example embodiments, which may include the controller 110 if configured to perform the disclosed operations, or if a separate apparatus is provided to perform the disclosed operations. Figure 6 The device may include the separate device. The device may be configured to perform the operations described herein, such as the operations described with reference to any disclosed process. The device includes at least one processor 600 and at least one memory 601 directly or closely connected to the processor. The memory 601 includes at least one random access memory (RAM) 601a and at least one read-only memory (ROM) 601b. Computer program code (software) 605 is stored in the ROM 601b. The device may be connected to a transmitter (TX) and a receiver (RX). The device may optionally be connected to a user interface (UI) for instructing the device and / or for outputting data. At least one processor 600 having at least one memory 601 and computer program code 605 is arranged to cause the device to at least perform a method according to any of the aforementioned processes, such as as described with respect to Figure 2 and / or Figure 3 As disclosed in the flowchart and its related features.

[0123] Figure 7 A non-transient medium 700 is shown according to some embodiments. The non-transient medium 700 is a computer readable storage medium. It may be, for example, a CD, a DVD, a USB stick, a Blu-ray disc, etc. The non-transient medium 700 stores computer program code that causes the apparatus to perform methods of any of the aforementioned processes, for example as described with respect to Figure 2 and / or Figure 3 As disclosed in the flowchart and its related features.

[0124] The names of network elements, protocols and methods are based on current standards. In other versions or other technologies, the names of these network elements and / or protocols and / or methods may be different, as long as they provide corresponding functions. For example, embodiments may be deployed in 2G / 3G / 4G / 5G networks and other generations of 3GPP, but may also be deployed in non-3GPP radio networks such as WiFi.

[0125] The memory may be volatile or non-volatile. It may be, for example, RAM, SRAM, flash memory, FPGA block RAM, DCD, CD, USB stick, and Blu-ray disc.

[0126] Unless otherwise stated or clearly apparent from the context, different representations of two entities mean that they perform different functions. This does not necessarily mean that they are based on different hardware. That is, each entity described in this specification may be based on different hardware, or some or all of the entities may be based on the same hardware. This does not necessarily mean that they are based on different software. That is, each entity described in this specification may be based on different software, or some or all of the entities may be based on the same software. Each entity described in this specification may be implemented in the cloud.

[0127] Implementations of any of the above blocks, devices, systems, techniques, or methods include, by way of non-limiting example, implementations as hardware, software, firmware, special-purpose circuitry or logic, general-purpose hardware or controllers, or other computing devices, or some combination thereof. Some embodiments may be implemented in the cloud.

[0128] It should be understood that the above description represents the presently contemplated preferred embodiments. However, it should be noted that the description of the preferred embodiments is given by way of example only, and various modifications may be made without departing from the scope defined by the appended claims.

Claims

1. A device for controlling a headphone device, comprising components for the following operations: Detecting a situation corresponding to the headphone device becoming detached from the user's ear; Determining that the user's hand is approaching the headphone device; Operating the headphone device in an adjustment mode based on detecting the situation and the user's hand approaching the headphone device, wherein in the adjustment mode, operations associated with a touch sensor on the headphone device are changed; And Detecting a subsequent situation corresponding to the headphone device becoming re - engaged with the user's ear, wherein the device is configured to cancel the adjustment mode based on the re - engagement situation and the user's hand not approaching the headphone device.

2. The device according to claim 1, wherein in the adjustment mode, the device is configured to disable the operation of the touch sensor.

3. The device according to claim 1 or claim 2, wherein in the adjustment mode, the device is further configured to reduce the volume of the audio signal output from the headphone device or prohibit the output of the audio signal.

4. The device according to claim 3, wherein in the adjustment mode, the device is configured to disable the output of the audio signal and move the output of the audio signal to a second headphone device having a paired relationship with the headphone device.

5. The device according to claim 4, wherein in the adjustment mode, the device is configured to determine the similarity between a first audio signal output from the headphone device and a second audio signal output from the second headphone device, and move the output of the first audio signal to the second headphone device only if the similarity is lower than a predetermined threshold value.

6. The device according to claim 1 or claim 2, wherein in the adjustment mode, the device is further configured to disable the operation of a microphone provided on the headphone device.

7. The device according to claim 6, wherein the device is further configured to enable the operation of a microphone provided on a second headphone device having a paired relationship with the headphone device.

8. The device according to claim 1 or claim 2, further comprising components for issuing a notification via a user interface, the notification being associated with operating the headphone device in the adjustment mode.

9. The device according to claim 1 or claim 2, further comprising components for the following operations: Detecting a situation corresponding to the headphone device as a first headphone device and a second headphone device having a paired relationship with the first headphone device simultaneously becoming detached from the user's ear; Based on detecting the situation: Operating the first headphone device in the adjustment mode and not operating the second headphone device; Detecting a subsequent situation corresponding to the first headphone device becoming re - engaged with the user's ear; Based on detecting the re - engagement situation, canceling the adjustment mode for the first headphone device; And Based on the adjustment mode for the first headphone device being canceled, operating the second headphone device in the adjustment mode.

10. The apparatus according to claim 1 or claim 2, further comprising components for the following operations: Detecting a situation corresponding to the headphone device becoming completely detached from the user's ear; Causing an audio transducer of the headphone device to output an alert sound before operating the headphone device in an adjustment mode; Receiving an input corresponding to the user locating the headphone device; And Operating the headphone device in the adjustment mode in response to the received input.

11. The apparatus according to claim 10, further comprising components for the following operations: determining that the headphone device is beyond a predetermined distance from the user's ear, and in response thereto, the apparatus is configured to cause the alert sound to be output to another second headphone device having a pairing relationship with the headphone device.

12. A method for controlling a headphone device, comprising: Detecting a situation corresponding to the headphone device becoming detached from the user's ear; Determining that the user's hand is approaching the headphone device; Based on detecting the situation and the user's hand approaching the headphone device, operating the headphone device in an adjustment mode, wherein in the adjustment mode, operations associated with a touch sensor on the headphone device are changed; And Detecting a subsequent situation corresponding to the headphone device becoming re - engaged with the user's ear, wherein based on the re - engagement situation and the user's hand not approaching the headphone device, canceling the adjustment mode.

Images