Audio parameter determination method, related apparatus, and communication system
By performing scene detection and determining audio parameters before wearing the headphones, the problem of headphones failing to use the appropriate parameters in different environments is solved, achieving the best AHA function experience immediately after wearing the headphones.
Patent Information
- Application Number
- PCT/CN2025/110740
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-09-18
- Filing Date
- 2025-07-25
- Publication Date
- 2026-02-05
AI Technical Summary
The headphones failed to use the appropriate audio parameters in different environments, resulting in a poor user experience for the AHA function.
Before being worn, the headphones determine suitable audio parameters, including gain, frequency, phase, and influence range, through scene detection. These parameters are used to process ambient sound to achieve active noise cancellation, ambient sound pass-through, and hearing enhancement.
It provides the best AHA function experience immediately after the user puts on the headphones, reducing the possibility of poor user experience due to untimely audio parameters.
Smart Images

Figure CN2025110740_05022026_PF_FP_ABST
Abstract
Description
Audio parameter determination method, related devices and communication system
[0001] This application claims priority to Chinese Patent Application No. 202411049841.1, filed on July 31, 2024, entitled "Noise Reduction Method and Related Apparatus", and Chinese Patent Application No. 202411049841.1, filed on September 18, 2024, entitled "Audio Parameter Determination Method, Related Apparatus and Communication System", the entire contents of which are incorporated herein by reference. Technical Field
[0002] This application relates to the field of terminal technology, and in particular to audio parameter determination methods, related devices and communication systems. Background Technology
[0003] More and more headphones now feature one or more of the following functions: active noise cancellation (ANC), ambient sound pass-through (HT), and augmentation hearing (AH). ANC, HT, and AH functions can be collectively referred to as the headphone's AHA (ANC, HT, AH) function or AHA characteristic. Headphones can capture ambient sound and process it using appropriate audio parameters before playback to achieve AHA functionality. However, the audio parameters required for AHA to function differ in different environments (e.g., noisy or quiet). If the headphones fail to use appropriate audio parameters to process ambient sound in a timely manner, the user experience of AHA will be poor. Therefore, how to determine the audio parameters in a timely manner is a pressing issue that needs to be addressed. Summary of the Invention
[0004] This application provides a method, related apparatus, and communication system for determining audio parameters. The headphones can perform scene detection before the user wears them to determine the audio parameters used to implement active noise cancellation, ambient sound pass-through, and hearing enhancement functions. This allows for providing the user with the optimal user experience for active noise cancellation, ambient sound pass-through, and hearing enhancement functions immediately after the user wears the headphones.
[0005] Firstly, this application provides an audio parameter determination method. This method can be applied to headphones. When a first condition is met, the headphones acquire a first audio signal and perform scene detection based on the first audio signal to obtain a first scene detection result. The first condition occurs before the headphones are worn. The headphones determine first audio parameters based on the first scene detection result, and the first audio parameters are used to process the audio acquired by the headphones.
[0006] The first audio parameter may include one or more parameters such as gain, frequency, phase, influence range, and gain mode.
[0007] It can be seen that the headphones can determine the audio parameters suitable for the current scene before the user puts them on, thus providing the user with the best AHA function experience immediately after putting on the headphones. This reduces the possibility of a poor AHA function experience for the user for a period of time immediately after putting on the headphones due to untimely audio parameter determination.
[0008] In conjunction with the first aspect, in some embodiments, the earphones are equipped with an earphone case. That is, the earphones can be true wireless stereo (TWS) earphones. The earphone case can be used to house the earphones. A binding relationship can be established between the earphone case and the earphones. When the earphones are equipped with an earphone case, the first condition is that the earphone case is opened when the earphones are placed inside, or the earphones are removed from the earphone case.
[0009] Specifically, when the earbuds are placed in the charging case, the earbuds can detect whether the case is open (i.e., whether the case changes from a closed state to an open state). When the case is detected as open, the earbuds can perform scene detection. Alternatively, the earbuds can detect whether the earbuds have been removed from the case (i.e., whether the earbuds change from an inserted state to an removed state). When the earbuds are removed from the case, the earbuds can perform scene detection.
[0010] Alternatively, in the case of neckband headphones, the first condition is that the left and right earpieces of the neckband headphones are separate. Specifically, the left and right earpieces of the neckband headphones contain magnets that allow them to be magnetically attached together.
[0011] As can be seen, for TWS earbuds, users need to open the charging case and take the earbuds out before wearing them. During this process, the earbuds can simultaneously perform scene detection and determine audio parameters. This allows appropriate audio parameters to be determined before the user puts them on, enabling the AHA (Adaptive Harmony) function and allowing the user to immediately experience the optimal AHA experience after wearing the earbuds.
[0012] The earbuds can also begin scene detection and determine audio parameters based on the scene detection results after detecting that the earbuds have been removed from the charging case. Understandably, removing the earbuds from the case indicates a higher probability that the user will use the earbuds. Performing scene detection when the earbuds are removed from the case saves battery power and reduces the frequency of scene detection caused by the case being opened and closed repeatedly without the earbuds being removed. This allows for earlier scene detection and audio parameter determination, reducing the likelihood of a poor user experience with the AHA (Active Audio Detection and Response) function immediately after wearing the earbuds.
[0013] For neckband headphones, users need to detach the left earbud case and right earbud before wearing them. During this process, the neckband headphones can simultaneously perform scene detection and determine audio parameters. This allows for the determination of appropriate audio parameters before the user puts on the headphones, enabling the AHA (Active Audio Harmony) function and ensuring the user experiences optimal AHA immediately after wearing them.
[0014] In conjunction with the first aspect, in some embodiments, after the headphones determine the first audio parameters based on the first scene detection result, the headphones acquire the second audio and process the second audio using the first audio parameters to obtain the third audio; the headphones then play the third audio.
[0015] The headphones' active noise cancellation (AHA) function, ambient sound pass-through function, or hearing enhancement function are all enabled. The specific content of the first audio parameter is related to the AHA function enabled on the headphones.
[0016] When active noise cancellation is enabled, the headphones may process the second audio signal using the first audio parameters, including gain adjustment and phase inversion. The third audio signal may include an audio signal with the same amplitude but opposite phase to the second audio signal.
[0017] When the ambient sound pass-through function is enabled, the headphones can process the second audio using the first audio parameters, which may include amplifying the second audio signal.
[0018] When the hearing enhancement function is enabled, the headphones can process the second audio using the first audio parameters, which may include amplifying the audio signal of the target type (e.g., human voice) in the second audio.
[0019] It can be seen that the headphones playing the third audio obtained after processing the first audio parameters can provide users with the best user experience for active noise cancellation, ambient sound pass-through, and hearing enhancement.
[0020] In conjunction with the first aspect, in some embodiments, after the earphone determines the first audio parameter based on the first scene detection result, the earphone collects a fourth audio signal and performs scene detection based on the fourth audio signal to obtain a second scene detection result; the earphone adjusts the audio parameters used to process the audio collected by the earphone to the second audio parameters based on the second scene detection result; wherein the second scene detection result is different from the first scene detection result, and the second audio parameter is different from the first audio parameter.
[0021] Specifically, after adjusting the audio parameters to the second audio parameters, the headphones can use the second audio parameters to process the acquired audio and play the audio processed by the second audio parameters.
[0022] As can be seen, after the TWS earbuds are opened from their charging case, removed from the case, or separated from the left and right earbuds of a neckband earphone, the earbuds can perform scene detection at regular intervals. If the scene detection result changes, the earbuds can adjust the audio parameters according to the current scene detection result. This embodiment does not limit the duration of the interval between two consecutive scene detections. Thus, after the TWS earbuds are opened from their charging case, removed from the case, or separated from the left and right earbuds of a neckband earphone, if the scene in which the earbuds are located changes (e.g., from a noisy environment to a quiet environment), the earbuds can adjust the audio parameters in a timely manner to continuously provide the user with the best AHA (Audio-Aided Harmony) experience.
[0023] In conjunction with the first aspect, in some embodiments, the first scene detection result includes a first energy of a first audio, the second scene detection result includes a second energy of a fourth audio, the first audio parameter includes a first gain, and the second audio parameter includes a second gain; wherein, the first energy is greater than the second energy, and the first gain is greater than the second gain.
[0024] It can be seen that the quieter the environment in which the headphones are located, the lower the gain for ambient sound can be in the audio parameters used to achieve AHA (Ambient Noise Reduction) function. This reduces the possibility of excessive gain amplifying the headphone's background noise in quiet environments.
[0025] Secondly, this application provides an audio parameter determination method. This method is applied to a communication system including a first device and headphones. The first device acquires a fifth audio signal and performs scene detection based on the fifth audio signal to obtain a third scene detection result; the first device establishes a communication connection with the headphones; the first device sends the third scene detection result to the headphones; the headphones determine third audio parameters based on the third scene detection result, and the third audio parameters are used to process the audio acquired by the headphones.
[0026] The first device can be an electronic device such as a mobile phone, tablet, or laptop that can establish a communication connection with the headset and use the headset to perform audio input / output services.
[0027] Before the first device establishes a communication connection with the earphone, the first device can perform scene detection at regular intervals. The aforementioned third scene detection result can be the result of the most recent scene detection by the first device before establishing a communication connection with the earphone.
[0028] As can be seen, after the first device establishes a communication connection with the headphones, it can immediately send the scene detection results to the headphones. The headphones can then determine the audio parameters used to implement the AHA function based on the scene detection results from the first device. This allows the headphones to quickly determine the audio parameters for implementing the AHA function without spending further time on scene detection, thus providing users with the best AHA experience in a timely manner.
[0029] In conjunction with the second aspect, in some embodiments, the headphones may use a third audio parameter to process the acquired audio and play the audio processed by the third audio parameter.
[0030] In conjunction with the second aspect, in some embodiments, the earphones are equipped with an earphone case, and the earphone case is opened when the earphones are placed inside the case before the first device establishes a communication connection with the earphones. That is, for TWS earphones, when the earphones are placed inside the earphone case, the first device can immediately establish a communication connection with the earphones when the case is opened. The first device can be the electronic device that the earphones were most recently connected to before being placed in the earphone case; when the case is opened, the earphones can automatically connect to the first device. Alternatively, the earphones may not have been connected to the first device before. When the earphones are in the case-in-case state, in response to the operation of pairing the earphones with the first device, the first device can establish a communication connection with the earphones.
[0031] As can be seen, for TWS earbuds, during the process of a user taking the earbuds out of the charging case and putting them on, the earbuds can simultaneously obtain the scene detection results from the first device and determine the audio parameters. This allows appropriate audio parameters to be determined before the user puts on the earbuds, thereby enabling the AHA function and allowing the user to immediately experience the best AHA user experience after putting on the earbuds.
[0032] In conjunction with the second aspect, in some embodiments, before the first device sends the third scene detection result to the earphone, when the earphone is removed from the case, the earphone sends a first message to the first device, the first message being used to indicate that the earphone is removed from the case.
[0033] As can be seen, for TWS earbuds, the first device can send the scene detection results to the earbuds after they are removed from the charging case.
[0034] In conjunction with the second aspect, in some embodiments, the headphones are neckband headphones, and the neckband headphones are powered on before the first device establishes a communication connection with the headphones.
[0035] Understandably, before using neckband headphones, users typically power them on and connect them to a device that requires audio input / output (e.g., the first device). Once connected, the first device immediately sends the scene detection results to the neckband headphones, allowing them to quickly determine suitable audio parameters and reducing the likelihood of a poor AHA (Audio Harmony Assist) experience due to unsuitable audio parameters.
[0036] In conjunction with the second aspect, in some embodiments, after the first device sends the third scene detection result to the earphone, the first device collects the sixth audio and performs scene detection based on the sixth audio to obtain the fourth scene detection result; the first device sends the fourth scene detection result to the earphone; the earphone adjusts the audio parameters used to process the audio collected by the earphone to the fourth audio parameters based on the fourth scene detection result; wherein, the fourth scene detection result is different from the third scene detection result, and the fourth audio parameters are different from the third audio parameters.
[0037] Specifically, after adjusting the audio parameters to the fourth audio parameter, the headphones can use the fourth audio parameter to process the acquired audio and play the audio processed by the fourth audio parameter.
[0038] As can be seen, after the first device is connected to the headphones, it can continue to perform scene detection at regular intervals. In this way, if the scene in which the first device is located (i.e., the scene in which the headphones are located) changes after the first device is connected to the headphones, the first device can update the scene detection results to the headphones in a timely manner. The headphones can then adjust the audio parameters in a timely manner based on the updated scene detection results, so as to continuously provide users with the best user experience of the AHA function.
[0039] In conjunction with the second aspect, in some embodiments, the third scene detection result includes the third energy of the fifth audio, the fourth scene detection result includes the fourth energy of the sixth audio, the third audio parameter includes the third gain, and the fourth audio parameter includes the fourth gain; wherein, the third energy is greater than the fourth energy, and the third gain is greater than the fourth gain.
[0040] It can be seen that the quieter the environment in which the headphones are located, the lower the gain for ambient sound can be in the audio parameters used to achieve AHA (Ambient Noise Reduction) function. This reduces the possibility of excessive gain amplifying the headphone's background noise in quiet environments.
[0041] In conjunction with the second aspect, in some embodiments, after the first device sends the third scene detection result to the earphone, the first device stops performing scene detection.
[0042] In this process, after the first device stops scene detection, the earphone collects the seventh audio signal and performs scene detection based on the seventh audio signal to obtain the fifth scene detection result. The earphone then adjusts the audio parameters used to process the audio collected by the earphone to the fifth audio parameters based on the fifth scene detection result. The fifth scene detection result is different from the third scene detection result, and the fifth audio parameters are different from the third audio parameters.
[0043] When the first device disconnects from the headphones, the first device resumes scene detection.
[0044] Specifically, after adjusting the audio parameters to the fifth audio parameter, the headphones can use the fifth audio parameter to process the acquired audio and play the audio processed by the fifth audio parameter.
[0045] As can be seen, after the first device connects to the headphones, it can stop scene detection, while the headphones can automatically perform scene detection periodically. This means that if the environment in which the headphones are located changes (e.g., from a noisy environment to a quiet environment), the headphones can adjust their audio parameters promptly to continuously provide the user with the best AHA (Audio-Aided Harmony) experience. If the first device disconnects from the headphones, it can resume scene detection.
[0046] In conjunction with the second aspect, in some embodiments, the first device sends an eighth audio signal to the earpiece; the earpiece plays the eighth audio signal. The eighth audio signal may be audio from an audio playback application (e.g., a music application, a call application, a video playback application, etc.) on the first device. In some embodiments, the first device may also send the collected audio signal to the first device so that the first device can implement corresponding audio input services (e.g., voice call services, recording services, etc.).
[0047] Thirdly, this application provides an audio parameter determination method. This method is applied to a communication system including headphones and a headphone case, the headphone case being used to house the headphones. The headphone case acquires a ninth audio frequency and performs scene detection based on the ninth audio frequency to obtain a sixth scene detection result; when the headphone case is opened while the headphones are inside, or when the headphones are removed from the case, the headphone case sends the sixth scene detection result to the headphones; the headphones determine sixth audio parameters based on the sixth scene detection result, and the sixth audio parameters are used to process the audio acquired by the headphones.
[0048] The headphones can use the sixth audio parameter to process the acquired audio and play the audio processed by the sixth audio parameter.
[0049] Before the earphone case is opened or the earphones are removed from the case, the earphone case can perform a scene detection at regular intervals. The sixth scene detection result mentioned above can be the result of the most recent scene detection before the earphone case is opened or the earphones are removed from the case.
[0050] As can be seen, during the process of a user taking the earbuds out of the charging case and putting them on, the earbuds can simultaneously obtain the scene detection results from the charging case and determine the audio parameters. This allows appropriate audio parameters to be determined before the user puts on the earbuds, thereby enabling the AHA function and allowing the user to immediately experience the best AHA user experience after putting on the earbuds.
[0051] In conjunction with the third aspect, in some embodiments, after the earphone box sends the sixth scene detection result to the earphone, the earphone box collects the tenth audio signal and performs scene detection based on the tenth audio signal to obtain the seventh scene detection result; the earphone box sends the seventh scene detection result to the earphone; the earphone adjusts the audio parameters used to process the audio collected by the earphone to the seventh audio parameters based on the seventh scene detection result; wherein, the seventh scene detection result is different from the sixth scene detection result, and the seventh audio parameters are different from the sixth audio parameters.
[0052] The detection results for the sixth scene include the sixth energy of the ninth audio, and the detection results for the seventh scene include the seventh energy of the tenth audio. The parameters for the sixth audio include the sixth gain, and the parameters for the seventh audio include the seventh gain. Among these parameters, the sixth energy is greater than the seventh energy, and the sixth gain is greater than the seventh gain.
[0053] Specifically, after adjusting the audio parameters to the seventh audio parameter, the headphones can use the seventh audio parameter to process the acquired audio and play the audio processed by the seventh audio parameter.
[0054] As can be seen, the charging case can continue to perform scene detection periodically after the earbuds are removed from the case. This means that if the environment surrounding the charging case changes after the earbuds are removed, the charging case can promptly update the scene detection results to the earbuds. The earbuds can then adjust their audio parameters accordingly to continuously provide users with the best possible AHA (Audio-Aided Harmony) experience.
[0055] In conjunction with the third aspect, in some embodiments, the earphone case stops scene detection after the earphones are removed from the case. After the earphone case stops scene detection, the earphones acquire an eleventh audio signal and perform scene detection based on the eleventh audio signal to obtain an eighth scene detection result. The earphones then adjust the audio parameters used to process the audio acquired by the earphones to the eighth audio parameters based on the eighth scene detection result. The eighth scene detection result differs from the sixth scene detection result, and the eighth audio parameters differ from the sixth audio parameters. When the earphones are put back into the case, the earphone case resumes scene detection.
[0056] Specifically, after adjusting the audio parameters to the eighth audio parameter, the headphones can use the eighth audio parameter to process the acquired audio and play the audio processed by the eighth audio parameter.
[0057] As can be seen, the charging case can stop scene detection after the earbuds are removed from the case, while the earbuds themselves can perform scene detection periodically. This is understandable, as the distance between the earbuds and the charging case may be considerable after removal, and their environments may differ. Therefore, the charging case can stop scene detection after removal, while the earbuds themselves can perform scene detection and adjust their audio parameters accordingly to match the current environment. This conserves the charging case's battery and ensures a consistently optimal AHA (Audio-Aided Response) experience for the user while wearing the earbuds.
[0058] Fourthly, this application provides an earphone. The earphone may include a memory and a processor. The memory may be used to store a computer program. The processor may be used to invoke the computer program to execute any of the possible implementation methods described in the first aspect.
[0059] Fifthly, this application provides a computer-readable storage medium storing instructions that, when executed by a processor, can implement any of the possible implementations described in the first aspect.
[0060] In a sixth aspect, this application provides a computer program product that may contain computer instructions that, when executed on a processor, can implement any of the possible implementation methods described in the first aspect.
[0061] In a seventh aspect, this application provides a chip for use in headphones, the chip including one or more processors for invoking computer instructions to cause the headphones to perform any of the possible implementation methods in the first aspect.
[0062] Understandably, the earphones provided in the fourth aspect, the computer-readable storage medium provided in the fifth aspect, the computer program product provided in the sixth aspect, and the chip provided in the seventh aspect are all used to execute the methods provided in the embodiments of this application. Therefore, the beneficial effects they can achieve can be referred to the beneficial effects in the corresponding methods, and will not be repeated here. Attached Figure Description
[0063] Figures 1A to 1D are schematic diagrams of some headphones provided in the embodiments of this application;
[0064] Figure 1E is a schematic diagram of a headphone management scenario provided in an embodiment of this application;
[0065] Figure 2 is a schematic diagram of a communication system 20 provided in an embodiment of this application;
[0066] Figure 3 is a structural schematic diagram of a TWS earphone and its earphone case provided in an embodiment of this application;
[0067] Figure 4 is a structural schematic diagram of an earphone provided in an embodiment of this application;
[0068] Figure 5 is a flowchart of a method for determining audio parameters provided in an embodiment of this application;
[0069] Figure 6 is a flowchart of a method for determining audio parameters provided in an embodiment of this application;
[0070] Figure 7 is a flowchart of a method for determining audio parameters provided in an embodiment of this application;
[0071] Figure 8 is a flowchart of a method for determining audio parameters provided in an embodiment of this application;
[0072] Figure 9 is a flowchart of a method for determining audio parameters provided in an embodiment of this application;
[0073] Figure 10 is a structural schematic diagram of an earphone provided in an embodiment of this application;
[0074] Figure 11 is a schematic diagram of a communication system provided in an embodiment of this application. Detailed Implementation
[0075] The technical solutions of the embodiments of this application are described below with reference to the accompanying drawings. In the description of the embodiments of this application, the terminology used in the following embodiments is for the purpose of describing specific embodiments only and is not intended to limit the application. As used in the specification and appended claims of this application, the singular expressions "a," "the," "the," "the," and "this" are intended to also include expressions such as "one or more," unless the context clearly indicates otherwise. It should also be understood that in the following embodiments of this application, "at least one" and "one or more" refer to one or more (including two). The term "and / or" is used to describe the relationship between related objects, indicating that three relationships can exist; for example, A and / or B can represent: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship.
[0076] References to "one embodiment" or "some embodiments" in this specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized. The term "connection" includes direct connections and indirect connections, unless otherwise stated. "First" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated.
[0077] In the embodiments of this application, the words "exemplarily" or "for example" are used to indicate examples, illustrations, or explanations. Any embodiment or design described as "exemplarily" or "for example" in the embodiments of this application should not be construed as being more preferred or advantageous than other embodiments or design solutions. Specifically, the use of the words "exemplarily" or "for example" is intended to present the relevant concepts in a specific manner.
[0078] This application provides a method for determining audio parameters. When true wireless stereo (TWS) earbuds are placed in their charging case, the method can detect whether the case is open. Upon detection of the case being open, the TWS earbuds can use their microphones to collect ambient sound for scene detection. This scene detection can be used to detect one or more environmental parameters, such as the noise level and scene type of the environment in which the TWS earbuds are located. The TWS earbuds can determine audio parameters based on the scene detection results and implement AHA (Active Audio Harmony) functionality based on these audio parameters. This allows for the determination of appropriate audio parameters before the user wears the earbuds, thereby providing the user with the optimal AHA experience immediately after wearing the earbuds.
[0079] The neckband headphones contain magnets in both the left and right earpieces, allowing them to magnetically attach together. When worn, the left and right earpieces are detached. The neckband headphones can detect whether the left and right earpieces are magnetically attached. Upon detecting separation, the headphones use a microphone to collect ambient sound for scene detection. Based on the scene detection results, the headphones determine audio parameters and implement AHA (Active Audio Harmony) functionality. This allows for the determination of appropriate audio parameters before the user puts on the headphones, providing the best AHA experience immediately after the user puts them on.
[0080] In some embodiments, devices such as mobile phones, tablets, and laptops can perform scene detection. These devices, excluding headphones, can be referred to as scene detection devices. The scene detection device can establish a communication connection with the headphones. After establishing this connection, the scene detection device can send the scene detection results to the headphones. The headphones can then determine audio parameters based on the scene detection results and implement the AHA (Audio-Aided Response) function based on these parameters. For example, after the charging case of TWS (True Wireless Stereo) headphones is opened, a mobile phone can establish a communication connection with the TWS headphones and send the scene detection results to them. As another example, after a neckband headset is powered on, a mobile phone can establish a communication connection with the neckband headset and send the scene detection results to the TWS headphones.
[0081] Understandably, when using headphones, users typically connect them to the aforementioned scene detection device to utilize the headphones for audio input / output services (e.g., playing music, making calls). The connection between the scene detection device and the headphones indicates that they are in the same environment. Immediately after connection, the scene detection device sends the scene detection results to the headphones, enabling them to promptly determine audio parameters and provide users with the best possible AHA (Audio-Aided Response) experience.
[0082] In some embodiments, the TWS earbuds' charging case can perform scene detection. When the TWS earbuds are placed inside the charging case, and the case is opened, the case can send the scene detection result to the TWS earbuds. The TWS earbuds can then determine the audio parameters based on the scene detection result and implement the AHA function based on these audio parameters. This allows appropriate audio parameters to be determined before the user wears the earbuds, thus providing the user with the best AHA experience immediately after wearing the earbuds.
[0083] The following is a description of some of the equipment involved in this application.
[0084] Figures 1A to 1D exemplarily show schematic diagrams of some headphones.
[0085] As shown in Figure 1A, the headphone case 101 is in a closed state. The headphone case 101 may include a lid 101A and a body 101B. When the headphone case 101 is in the closed state, the lid 101A and the body 101B are closed, and the lid 101A and the body 101B can form an accommodating space to accommodate the headphones 102. The recessed portion of the body 101B that forms the aforementioned accommodating space can be called the headphone compartment, specifically including a left headphone compartment and a right headphone compartment. The aforementioned headphone compartment can also be called the headphone slot.
[0086] As shown in Figure 1A, the earphone case 101 can accommodate earphones 102. Earphones 102 can be TWS earphones. Earphones 102 can include a left earphone and a right earphone. The left earphone can be placed in the left earphone compartment of the case 101B, and the right earphone can be placed in the right earphone compartment of the case 101B.
[0087] As shown in Figures 1B and 1C, the headphone case 101 is in the open state. This open state can also be referred to as the unopened state. When the headphone case 101 is open, the lid 101A can open at a certain angle relative to the case body 101B. In Figure 1B, the headphones 102 can still be placed in the headphone compartment of the headphone case 101. That is, after the user opens the headphone case 101, the headphones 102 have not yet been removed from the headphone case 101; the headphones are in the "closed" state. In Figure 1C, the headphones 102 are detached from the headphone case 101. That is, the user has removed the headphones 102 from the headphone case 101; the headphones are in the "out of case" state.
[0088] As shown in Figure 1D, the earphone 103 can be a neckband-style earphone. The earphone 103 may include a left earphone and a right earphone. There is a wired connection between the left and right earphones of the earphone 103. Neckband-style earphones can also be called neck-hook earphones, etc.
[0089] In some embodiments, the headphones 102 and 103 may provide one or more of the following functions: active noise cancellation, ambient sound pass-through, and hearing enhancement. Users can control the headphones 102 and 103 to turn the active noise cancellation, ambient sound pass-through, and hearing enhancement functions on or off.
[0090] Figure 1E illustrates an example of a headphone management scenario.
[0091] As shown in Figure 1E, the electronic device 200 may be a device that establishes a communication connection with headphones (e.g., headphones 102 or 103). The electronic device 200 may display a user interface 210. The user interface 210 may include noise cancellation controls 211, pass-through controls 212, pass-through voice controls 213, a turn-off control 214, a wearing detection control 215, a healthy headphone usage control 216, and a help control 217.
[0092] The noise cancellation control 211 can be used to enable the active noise cancellation function of the headphones. Active noise cancellation reduces interference from ambient noise outside the headphones to the user listening to audio. When the noise cancellation control 211 is not selected, in response to operation of the noise cancellation control 211, the electronic device 200 can send a command to the headphones to enable the active noise cancellation function. The headphones can then enable the active noise cancellation function according to the command. When active noise cancellation is enabled, the headphones can collect ambient noise through the microphone. The headphones can emit sound waves with the same amplitude but opposite phase to the ambient noise to cancel it out. The headphones can process the collected ambient noise using audio parameters to obtain the audio signal used to cancel the ambient noise. This application does not limit the implementation method of active noise cancellation in the headphones.
[0093] The pass-through control 212 can be used to enable the ambient sound pass-through function of the headphones. The ambient sound pass-through function allows users to hear ambient sounds outside the headphones while wearing them, improving user safety and convenience. When the pass-through control 212 is not selected, in response to an operation on the pass-through control 212, the electronic device 200 can send a command to the headphones to enable the ambient sound pass-through function. The headphones can then enable the ambient sound pass-through function according to this command. When the ambient sound pass-through function is enabled, the headphones can collect ambient sounds through the microphone, process the collected ambient sounds using audio parameters, and amplify the ambient sounds. The headphones can then play the processed ambient sounds. This reduces situations where users cannot hear ambient sounds due to physical isolation caused by wearing headphones. This application embodiment does not limit the implementation method of ambient sound pass-through in headphones.
[0094] The voice pass-through control 213 can be used to activate the headphone's auditory enhancement function. The auditory enhancement function allows the user to clearly hear target-type sounds in the ambient sound environment while wearing the headphones. For example, the target-type sound could be a human voice. This allows the user to communicate smoothly with those around them while wearing the headphones. When the voice pass-through control 213 is not selected, in response to an operation on the voice pass-through control 213, the electronic device 200 can send a command to the headphones to activate the auditory enhancement function. The headphones can then activate the auditory enhancement function according to the command. When the auditory enhancement function is activated, the headphones can collect ambient sound through the microphone and filter out the target-type sound (e.g., a human voice) from the ambient sound. The headphones can then process and play the target-type sound using audio parameters. This processing of the target-type sound using audio parameters may include amplifying the target-type sound. This application embodiment does not limit the method for implementing the voice pass-through of target-type sounds such as human voices through the headphones.
[0095] The close control 214 can be used to turn off the headphone's active noise cancellation, ambient sound pass-through, and hearing enhancement functions.
[0096] Understandably, within the same time period, only one of the noise reduction control 211, pass-through control 212, pass-through voice control 213, and close control 214 is selected.
[0097] The audio parameters used to implement AHA functionality can include gain. Gain represents the degree of amplification of the audio signal. Besides gain, audio parameters can also include EQ parameters such as frequency, phase, range, and gain mode. Frequency represents the audio frequency to be adjusted. Phase represents the amount of phase change used to adjust the audio. Range represents the width of the audio signal whose volume is being changed. Gain mode represents the trend of volume change at a specified audio frequency.
[0098] It should be noted that achieving AHA functionality can refer to achieving any one of the following functions: active noise cancellation, ambient sound pass-through, or hearing enhancement.
[0099] The wear detection control 215 can be used to enable or disable the wear detection function. The wear detection function refers to the function of detecting whether the headphones are being worn. For example, in response to the operation of enabling the wear detection function via the wear detection control 215, the electronic device 200 can send a command to the headphones to enable the wear detection function. The headphones can then enable the wear detection function according to the command. In some embodiments, when the wear detection function is enabled, the headphones can perform related controls based on whether the headphones are being worn. For example, when the headphones are not being worn, the headphones can pause music playback. When the headphones are being worn, the headphones can continue playing music.
[0100] The headphone health use control 216 can be used to toggle the headphone health use reminder function on or off. The headphone health use reminder function refers to reminding the user to use the headphones responsibly after the headphone has been worn for a preset period of time.
[0101] Help control 217 can be used to view more headphone usage instructions.
[0102] This application embodiment does not limit the controls provided by the electronic device 200 for controlling and managing the headphones.
[0103] It should be noted that the AHA function of the headphones is not limited to being controlled via electronic device 200; users can also control the AHA function by performing corresponding operations on the headphones themselves. For example, the headphones can detect user operations such as double-tap, triple-tap, and long-press operations. When a double-tap operation is detected on the left earpiece, the headphones can activate the active noise cancellation function. When a triple-tap operation is detected on the left earpiece, the headphones can activate the ambient sound pass-through function. When a long-press operation is detected on the left earpiece, the headphones can activate the hearing enhancement function. When a double-tap operation is detected on the right earpiece, the headphones can deactivate any of the active noise cancellation, ambient sound pass-through, or hearing enhancement functions that are currently active. The above operations are merely illustrative examples of this application and should not be construed as limiting this application.
[0104] Figure 2 illustrates a schematic diagram of the communication system 20 provided in this application.
[0105] As shown in Figure 2, the communication system 20 may include devices such as mobile phones, tablets, laptops, headphone cases, and headphones.
[0106] The headset can establish a communication connection with one or more devices, such as a mobile phone, tablet, or laptop. For example, the headset can establish a communication connection with a mobile phone. The headset can play audio from the mobile phone and send the audio it captures back to the mobile phone.
[0107] In some embodiments, the earphones can be paired when they first establish a wireless connection with a device such as a mobile phone, tablet, or laptop. After successful pairing, the device that has successfully paired with the earphones can save the earphones' connection data. The earphones can also save the connection data of the successfully paired devices. Thus, when the earphones are powered on or removed from their charging case, they can automatically pair and connect with previously successfully paired devices based on the saved connection data. This application does not limit the method by which the earphones establish a communication connection with devices such as mobile phones, tablets, or laptops.
[0108] If the earbuds are TWS earbuds, they come with a matching charging case. The charging case charges the earbuds when they are placed inside. In some embodiments, the earbuds can also establish a wireless communication connection with the charging case after they are removed from the case.
[0109] Figure 3 illustrates a schematic diagram of the structure of TWS earphones and their charging case.
[0110] As shown in Figure 3, the headphone case 310 can be the headphone case 101 shown in Figures 1A to 1C. The left earphone 320 and the right earphone 330 can be the left and right earphones of the headphone 102 shown in Figure 1A, respectively. The headphone case 310 can accommodate the left earphone 320 and the right earphone 330.
[0111] The earphone case 310 may include a processor 311, an interface 312, an interface 313, a magnet 314, and a magnet 315. The left earphone 320 may include a processor 321, an interface 322, and a magnetic field sensor 323. The right earphone 330 may include a processor 331, an interface 332, and a magnetic field sensor 333.
[0112] When the left earphone 320 is placed in the left earphone compartment of the earphone case 310, the interface 322 in the left earphone 320 can connect with the interface 312 in the earphone case 310. The interface 312 can be an electrical connector in the earphone case 310, such as a communication electrode or charging electrode in the left earphone compartment. The structure of the interface 312 can mate with or contact the interface 322 of the left earphone 320 to achieve an electrical connection (or physical connection) between the earphone case 310 and the left earphone 320. The interface 322 can be an electrical connector of the left earphone 320, such as a communication electrode or charging electrode at the end of the ear stem of the left earphone 320. The interface 322 can be a spring pin, spring contact, conductive block, conductive patch, conductive sheet, pin, plug, contact pad, jack, or socket, etc., in the electrical connector. This application embodiment does not limit the method of setting the interface 312 and interface 322.
[0113] The processor 311 of the earphone case 310 and the processor 321 of the left earphone 320 can transmit information or charge the battery in the left earphone 320 through interfaces 312 and 322.
[0114] The method by which the right earphone 330 is placed in the right earphone compartment of the earphone case 310 and electrically connected to the earphone case 310 can be referred to the method described above for electrically connecting the left earphone 320 to the earphone case 310. It will not be repeated here.
[0115] Magnets 314 in the earphone case 310 can be distributed on the lid of the earphone case 310 and / or near the left earphone compartment. The positions of magnets 314 correspond to the positions of the left earphone 320 when it is placed in the left earphone compartment, such that the magnitude of the magnetic induction intensity (e.g., magnetic flux) detected by the magnetic field sensor 323 in the left earphone 320 when the earphone case 310 is opened and when the left earphone 320 is removed or inserted is primarily generated by magnets 314. Similarly, magnets 315 in the earphone case 310 can be distributed on the lid of the earphone case 310 and / or near the right earphone compartment. The positions of magnets 315 correspond to the positions of the right earphone 330 when it is placed in the right earphone compartment, such that the magnitude of the magnetic induction intensity detected by the magnetic field sensor 333 in the right earphone 330 when the earphone case 310 is opened and when the right earphone 330 is removed or inserted is primarily generated by magnets 315.
[0116] In some embodiments, when the left earphone 320 and / or the right earphone 330 are placed in the earphone case 310, a magnetic field sensor can detect whether the earphone case 310 is open. The magnetic flux detected by the magnetic field sensor is proportional to the distance between the magnetic field sensor and the magnet. For example, a magnet may be provided on the lid of the earphone case 310. When the earphone case 310 is closed, the left earphone 320 and the right earphone 330 are close to the magnet on the lid. When the earphone case 310 is open, the left earphone 320 and the right earphone 330 are farther from the magnet on the lid. During the opening process of the earphone case 310, the magnetic flux detected by the left earphone 320 and the right earphone 330 changes. When the magnetic flux detected by the magnetic field sensor 323 of the left earphone 320 is less than a magnetic flux threshold of 1, the left earphone 320 can determine that the earphone case 310 is open. Similarly, when the right earphone 330 detects that the magnetic flux is less than the magnetic flux threshold 2 through the magnetic field sensor 333, the right earphone 330 can determine that the earphone case 310 has been opened. The aforementioned magnetic flux threshold 1 and magnetic flux threshold 2 can be the same or different. This application embodiment does not limit the values of magnetic flux threshold 1 and magnetic flux threshold 2.
[0117] In some embodiments, the headphone case 310 can detect whether it has been opened. For example, a magnet may be provided on the lid of the headphone case 310, and a magnetic field sensor may be provided on the case body. During the opening process of the headphone case 310, the distance between the magnet on the lid and the magnetic field sensor on the case body increases. The headphone case 310 can detect whether it has been opened by determining whether the magnetic flux detected by the magnetic field sensor on the case body is less than a magnetic flux threshold 3. This embodiment does not limit the value of the magnetic flux threshold 3. If the magnetic flux detected by the magnetic field sensor on the case body is less than the magnetic flux threshold 3, the headphone case 310 can determine that it has been opened.
[0118] The above method is merely an illustrative description of the method for detecting whether the headphone case is open, as described in this application, and should not be construed as limiting this application. The headphones and / or headphone case can also detect whether the headphone case is open using other methods. For example, pairs of infrared transmitters and receivers can be configured on the headphones and headphone case, or on the lid and body of the headphone case, to determine whether the headphone case is open based on the received signal strength.
[0119] In some embodiments, the left earphone 320 can determine its out-of-case and in-case states by the magnetic flux detected by the magnetic field sensor 323. Specifically, during the out-of-case process, the distance between the magnetic field sensor 323 in the left earphone 320 and the magnet 314 in the earphone case 310 gradually changes, and the magnetic flux detected by the magnetic field sensor 323 gradually decreases. During the in-case process, the distance between the magnetic field sensor 323 in the left earphone 320 and the magnet 314 in the earphone case 310 gradually increases, and the magnetic flux detected by the magnetic field sensor 323 gradually increases. When the magnetic flux detected by the magnetic field sensor 323 in the left earphone 320 is less than a magnetic flux threshold 4, it can be determined that the left earphone 320 is out of the case. When the magnetic flux detected by the magnetic field sensor 323 in the left earphone 320 is greater than a magnetic flux threshold 5, it can be determined that the left earphone 320 is in the case. This application embodiment does not limit the values of the magnetic flux thresholds 4 and 5. The method by which the right earphone 330 detects its out-of-case and in-case status using the magnetic field sensor 333 can be referenced from the method described above for detecting the left earphone 320's out-of-case and in-case status, and will not be repeated here.
[0120] In some embodiments, the earphone case 310 can detect the out-of-case and in-case states of the left earphone 320 and the right earphone 330. The earphone case 310 may be equipped with magnetic field sensors, specifically including a magnetic field sensor located at the left earphone compartment and a magnetic field sensor located at the right earphone compartment, which can be used to detect changes in the magnetic flux of the earphone magnets in the left earphone 320 and right earphone 330, respectively. The magnetic flux detected by the magnetic field sensors on the earphone case 310 may be proportional to the distance between the magnetic field sensors and the earphone magnets. When the magnetic flux detected by the magnetic field sensors is less than a magnetic flux threshold 6, the earphone case 310 can determine that the earphones are out of the case. When the magnetic flux detected by the magnet sensors is greater than a magnetic flux threshold 7, the earphone case 310 can determine that the earphones are in the case. This application embodiment does not limit the values of the magnetic flux thresholds 6 and 7.
[0121] The above method is merely an illustrative description of the method for detecting whether earphones are out of or inside the case, and should not be construed as limiting the scope of this application. Earphones and / or the earphone case can also detect whether earphones are out of or inside the case using other methods. For example, when earphones are placed inside the earphone case, the electrical connector on the earphones connects with the electrical connector inside the earphone case. Whether the earphones are inside the case can be determined based on whether the electrical connector on the earphones and the electrical connector inside the earphone case are connected.
[0122] Not shown, the headphone case 310 may also include a wireless communication module. This wireless communication module enables wireless data exchange between the headphone case 310 and other electronic devices (e.g., the left earphone 320 and the right earphone 330). The headphone case 310 may also include a power module. This power module provides power to the headphone case 310 and powers the various modules within it.
[0123] Not limited to the devices shown in Figure 3, the earphone case 310, left earphone 320, and right earphone 330 may include more or fewer devices than those shown in Figure 3.
[0124] In some embodiments, both the left and right earpieces of the earphone 103 shown in FIG. 1D can be provided with earphone magnets. The left and right earpieces can be magnetically attached together based on the earphone magnets. Optionally, a magnetic field sensor can also be provided in the left and / or right earpieces of the earphone 103 to detect whether the left and right earpieces are separated. For example, a magnetic field sensor is provided in the left earpiece of the earphone 103. The magnetic field sensor in the left earpiece can detect the magnetic flux of the earphone magnet in the right earpiece. The magnetic flux detected by the magnetic field sensor in the left earpiece can be proportional to the distance between the magnetic field sensor in the left earpiece and the earphone magnet in the right earpiece. When the magnetic flux detected by the magnetic field sensor in the left earpiece is less than the magnetic flux threshold 8, the earphone 103 can determine that the left and right earpieces are separated. When the magnetic flux detected by the magnetic field sensor in the left earpiece is greater than the magnetic flux threshold 9, the earphone 103 can determine that the left and right earpieces are magnetically attached together. The embodiments of this application do not limit the values of the above-mentioned magnetic flux thresholds 8 and 9.
[0125] Neckband headphones can detect whether the left and right earpieces are separated, not only by setting up magnets and magnetic field sensors.
[0126] Figure 4 illustrates a schematic diagram of the structure of an earphone.
[0127] As shown in Figure 4, the earphone 400 may include a processor 410, a memory 420, a wireless communication module 430, an audio input / output circuit 440, a power module 450, an interface 460, and a sensor module 470. The earphone 400 may be the left or right earphone of the TWS earphone 102 shown in Figures 1A-1C, or it may be the neckband earphone 103 shown in Figure 1D. This application embodiment does not limit the type of earphone 400.
[0128] The memory 420 can be used to store program code. For example, program code for scene detection, program code for implementing active noise cancellation / ambient sound pass-through / hearing enhancement functions, program code for detecting the opening of the headphone case, program code for detecting the out-of-case and in-case states of the headphones 400, program code for detecting whether the headphones 400 are being worn, program code for enabling the headphones 400 to establish communication connections with other electronic devices and conduct wireless communication, etc.
[0129] The processor 410 can be used to execute the program code stored in the memory 420 and call relevant modules to implement the functions of the earphone 400 in this embodiment. For example, functions include earphone case opening detection, earphone 400 removal and insertion detection, scene detection, active noise cancellation / ambient sound pass-through / hearing enhancement based on scene detection results, wear detection, audio playback, audio acquisition, wireless communication, etc. Specifically, the processor 410 can be an integrated control chip or a circuit comprising various active and / or passive components, configured to perform the functions of the processor 410 described in this embodiment. The processor 410 can be a microcontroller unit (MCU).
[0130] In some embodiments, the processor 410 may include one or more interfaces. The processor 410 may connect to other components of the headset 400 through these one or more interfaces.
[0131] The wireless communication module 430 can be used to support data exchange between the headset 400 and other electronic devices, including one or more wireless communication technologies such as Bluetooth, wireless local area networks (WLAN), frequency modulation (FM), near field communication (NFC), and infrared (IR). In some embodiments, the wireless communication module 430 can be a Bluetooth chip.
[0132] In addition, the wireless communication module 430 can also be connected to an antenna. The wireless communication module 430 receives electromagnetic waves via the antenna, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to the processor 410. The wireless communication module 430 can also receive signals to be transmitted from the processor 410, perform frequency modulation and amplification, and then convert them into electromagnetic waves for radiation via the antenna.
[0133] The audio input / output circuit 440 can be connected to a microphone or other sound acquisition device to process the sound and convert it into an audio signal, which is then transmitted to the processor 410 for further processing. The audio input / output circuit 440 can also be connected to a speaker, earpiece, or other sound playback device to convert the audio signal from the processor into sound output. This enables functions such as answering phone calls, playing music, and using voice assistants via the headset 400.
[0134] The power module 450 can be used to provide power to the headset 400, power the various modules in the headset 400, and support the headset 400 to receive charging input, etc.
[0135] Interface 460 can be used to connect a charger to charge the earphones 400, and can also be used for data transmission between the earphones 400 and other devices. In some embodiments, the earphones 400 are TWS earphones, and interface 460 can be used to provide a wired connection for charging or communication between the earphones 400 and the earphone case. Interface 460 can be interface 322 or interface 332 as shown in FIG. 3 above. For example, interface 460 may include an electrical connector. When the earphones 400 are placed in the earphone compartment of the earphone case, the earphones 400 can establish an electrical connection with the electrical connector in the earphone case through the electrical connector in interface 460. After the electrical connection is established, the earphone case can charge the earphones 400 through the current transmission function of the low-end electrical connector in interface 460 and the electrical connector in the earphone case. Optionally, after the electrical connection is established, the earphones 400 and the earphone case can also communicate data through the electrical connection, for example, the earphone case sends the scene detection result to the earphones 400.
[0136] The sensor module 470 may include one or more sensors such as a proximity light sensor 471, a bone conduction sensor 472, a touch sensor 473, and a magnetic field sensor 474.
[0137] The proximity sensor 471 may include, for example, a light-emitting diode (LED) and a light detector, such as a photodiode. The LED may be an infrared LED. The earphone 400 emits infrared light outward through the LED. The earphone 400 uses a photodiode to detect infrared reflected light from nearby objects. In some embodiments, the processor 410 may utilize the proximity sensor 471 for wear detection to determine whether the earphone 400 is being worn by a user.
[0138] The bone conduction sensor 472 can acquire vibration signals. In some embodiments, the processor 410 can use the bone conduction sensor 472 to acquire vibration signals from the vibrating bone block of the vocal cord, parse out the speech signal, and realize the speech function.
[0139] Touch sensor 473 is used to detect touch operations applied to or near it. Touch sensor 473 can transmit the detected touch operation to processor 410 to determine the type of touch event.
[0140] The magnetic field sensor 474 may include a Hall sensor or a magnetometer, etc. In some embodiments, the processor 410 may use the magnetic field sensor 474 to detect changes in magnetic induction intensity to determine whether the headphone case has been opened and whether the headphones 400 have been removed from or placed in the case.
[0141] In some embodiments, the earphone 400 may further include an earphone magnet. The outer surface of the earphone 400 may also include components such as buttons, indicator lights (which can indicate battery level, pairing mode, etc.), and a dustproof mesh (which can be used with the earpiece). The buttons on the outer surface of the earphone 400 may be physical buttons or touch buttons (used in conjunction with a touch sensor), and can be used to trigger power on / off, pause, play, AHA function control, etc.
[0142] The structure shown in Figure 4 is merely an illustrative example of this application and should not be construed as limiting the scope of this application. The earphone 400 may include more or fewer components than those shown in Figure 4.
[0143] Figure 5 illustrates an exemplary flowchart of a method for determining audio parameters.
[0144] As shown in Figure 5, the headphones can perform wear detection. After a user puts on the headphones, the headphones can determine that they are in a wearing state based on wear detection. In some embodiments, the headphones have one of the following functions enabled: active noise cancellation, ambient sound pass-through, and hearing enhancement. After determining that the headphones are in a wearing state, the headphones can perform scene detection and determine audio parameters based on the scene detection results. Then, the headphones can process the audio to be played based on the audio parameters and play it.
[0145] When active noise cancellation or ambient sound pass-through is enabled, the audio to be played can refer to the ambient sound audio captured by the headphones through the microphone. When hearing enhancement is enabled, the audio to be played can refer to the target type of audio (e.g., human voice audio) filtered from the ambient sound captured by the headphones.
[0146] In addition to the audio processed using audio parameters as described above, the headphones can also play audio sent from devices connected to the headphones (such as mobile phones, tablets, etc.).
[0147] This section introduces scene detection and the determination of audio parameters based on the results of scene detection.
[0148] Headphones generate background noise during operation. This background noise can be understood as the overall noise level of the headphone's internal system. It originates from the operating noise of the acoustic components, such as the electrical noise of the chip itself, interference from Bluetooth transmissions, and coupling between wired and wireless devices. In some embodiments, when one of the following functions—active noise cancellation, ambient sound pass-through, or hearing enhancement—is enabled, inappropriate audio parameters (such as excessive gain) may amplify the background noise, negatively impacting the user's headphone experience.
[0149] For example, when active noise cancellation is enabled, the headphones can collect ambient sound through the microphone and process the ambient sound signal using audio parameters. For instance, audio parameters may include gain, and the aforementioned ambient sound signal processing may include gain amplification. Audio parameters may also include phase, and the aforementioned ambient sound signal processing may further include phase adjustment. Specifically, the headphones can reverse the phase of the ambient sound (i.e., reverse the phase by 180°) to obtain and play a noise-canceling frequency with a phase opposite to the ambient sound, thus canceling out the ambient sound entering the user's ear and achieving a noise reduction effect.
[0150] If the headphones are in a noisy environment and the gain in the audio parameters is too low, the noise reduction frequency obtained by the headphones through signal processing of the ambient sound using the audio parameters will be insufficient to cancel out the ambient sound entering the user's ears. The noise reduction effect of the headphones will be poor.
[0151] If the headphones are in a quiet environment and the gain in the audio parameters is too high, the amplitude of the noise-canceling frequency (DCF) obtained by the headphones from processing the ambient sound signal in the audio parameters will be greater than the amplitude of the ambient sound entering the user's ear. Besides canceling out the ambient sound entering the user's ear, the DCF will also generate additional noise (i.e., background noise). This will result in excessive background noise in the headphones, affecting the user's experience.
[0152] Furthermore, when the ambient sound pass-through or hearing enhancement function is enabled, if the headphones are in a quiet environment and the gain in the audio parameters is too high, the background noise of the headphones will also be amplified, thus affecting the user's use of the headphones.
[0153] Therefore, the headphones can perform scene detection and determine the appropriate audio parameters for active noise cancellation, ambient sound pass-through, and hearing enhancement in the current environment. When the headphones are in environments with varying levels of noise, they can use different audio parameters to achieve these functions. This reduces the likelihood of insufficient noise cancellation or amplified background noise due to inappropriate audio parameters.
[0154] In some embodiments, scene detection may include ambient sound energy detection. Specifically, the headphones can collect ambient sound through a microphone and calculate the ambient sound energy. The noisier the environment in which the headphones are located, the greater the ambient sound energy detected by the headphones. Conversely, the quieter the environment in which the headphones are located, the lower the ambient sound energy detected by the headphones. The headphones may store audio parameters corresponding to different ambient sound energy ranges. For example, the correspondence between ambient sound energy ranges and audio parameters can be referred to in Table 1 below:
[0155] Table 1
[0156] Among them, Energy 1 > Energy 2 > Energy 3.
[0157] As shown in Table 1 above, when active noise cancellation is enabled, if the ambient sound energy detected by the microphone is greater than or equal to energy 1, the headphones can process the ambient sound signal using audio parameter 11. If the ambient sound energy detected by the microphone is less than energy 1 but greater than or equal to energy 2, the headphones can process the ambient sound signal using audio parameter 12. If the ambient sound energy detected by the microphone is less than energy 3 but greater than or equal to 0, the headphones can process the ambient sound signal using audio parameter 13. Audio parameter 11 may include gain 11a. Audio parameter 12 may include gain 12a. Audio parameter 13 may include gain 13a. Gain 11a > Gain 12a > Gain 13a. That is to say, the quieter the environment in which the headphones are located, the smaller the gain can be for ambient sound during active noise cancellation. This reduces the possibility of excessive gain amplifying the headphone's background noise in quiet environments.
[0158] Similarly, when the ambient sound pass-through function is enabled, if the ambient sound energy is greater than or equal to energy 1, the headphones can process the ambient sound signal using audio parameter 21; if the ambient sound energy is less than energy 1 but greater than or equal to energy 2, the headphones can process the ambient sound signal using audio parameter 22; if the ambient sound energy is less than energy 2 but greater than or equal to 0, the headphones can process the ambient sound signal using audio parameter 23. Audio parameter 21 may include gain 21a. Audio parameter 22 may include gain 22a. Audio parameter 23 may include gain 23a. Gain 21a > Gain 22a > Gain 23a.
[0159] When the hearing enhancement function is enabled, if the ambient sound energy is greater than or equal to energy 1, the headphones can use audio parameter 31 to process the target type audio filtered from the ambient sound; if the ambient sound energy is less than energy 1 but greater than or equal to energy 2, the headphones can use audio parameter 32 to process the target type audio filtered from the ambient sound; if the ambient sound energy is less than energy 2 but greater than or equal to 0, the headphones can use audio parameter 33 to process the target type audio filtered from the ambient sound. Audio parameter 31 may include gain 31a. Audio parameter 32 may include gain 32a. Audio parameter 33 may include gain 33a. Gain 31a > Gain 32a > Gain 33a.
[0160] The embodiments of this application do not limit the values of the above-mentioned energy 1 to energy 3, audio parameters 11 to 13, audio parameters 21 to 23, and audio parameters 31 to 33.
[0161] In some embodiments, scene detection may include scene type detection. Specifically, the headphones can collect ambient sound through a microphone, input the ambient sound into a scene type detection model, and use the scene type detection model to determine the type of scene in which the headphones are located. The types of scenes in which the headphones are located may include, but are not limited to: walking scene, running scene, quiet scene, multi-person conversation scene, coffee shop scene, subway scene, train scene, car scene, waiting room scene, conversation scene, office scene, outdoor scene, driving scene, strong wind scene, airplane scene, etc. The headphones may store audio parameters corresponding to different scene types. The headphones can perform audio signal processing according to the audio parameters corresponding to the current scene type to achieve AHA (Action-Ahead-Side) functionality.
[0162] The methods for scene detection and determination of specific audio parameters described above are merely illustrative examples of this application and should not be construed as limiting this application.
[0163] As can be seen from the above embodiments, scene detection and determining audio parameters based on the scene detection results require a certain amount of time. The headphones perform scene detection only after detecting that the user is wearing them. Before scene detection and audio parameter determination are completed, the audio parameters used by the headphones may not be compatible with the current scene. This results in a poor user experience for the AHA function for a period of time immediately after wearing the headphones. For example, the user may perceive louder ambient noise or background noise, or even with the hearing enhancement function enabled, they may still be unable to clearly hear surrounding voices while wearing the headphones.
[0164] Figure 6 illustrates an exemplary flowchart of a method for determining audio parameters.
[0165] As shown in Figure 6, for headphones equipped with a headphone case, when the headphones are placed in the headphone case, the user's headphone usage process may include: opening the headphone case (i.e., opening the headphone case), taking the headphones out of the headphone case (i.e., taking the headphones out of the case), and then wearing the headphones to listen to the audio played by the headphones.
[0166] When the earphones are placed inside the charging case, the earphones can detect whether the charging case is open. The method for detecting whether the charging case is open can be found in the description of the preceding embodiments. When the opening of the charging case is detected, the earphones can perform scene detection and determine audio parameters based on the scene detection result. Then, the earphones can process the audio to be played based on the audio parameters and play it. The methods for scene detection, determining audio parameters based on the scene detection result, and processing the audio to be played based on the audio parameters can be found in the description of the preceding embodiments. They will not be repeated here.
[0167] As shown in Figure 6, during the process of a user taking the earphones out of the charging case and putting them on, the earphones can simultaneously perform scene detection and determine audio parameters. This allows appropriate audio parameters to be determined before the user puts on the earphones, thereby enabling the AHA function and allowing the user to immediately experience the best AHA user experience after putting on the earphones.
[0168] It should be noted that the headphones may specifically include a left earphone and a right earphone. In some embodiments, both the left and right earphones can independently perform the aforementioned headphone case opening detection, scene detection, determine audio parameters based on the scene detection results, and process and play the audio to be played based on the audio parameters. In some embodiments, only one of the left and right earphones may perform the aforementioned headphone case opening detection, scene detection, and determine audio parameters based on the scene detection results. For example, the left earphone can perform headphone case opening detection, and after detecting that the headphone case is open, it can perform scene detection and determine audio parameters based on the scene detection results. The left earphone can send the audio parameters to the right earphone. Then, the left earphone can process the ambient sound collected by the microphone in the left earphone or the target type audio filtered from the ambient sound based on the aforementioned audio parameters, and the right earphone can process the ambient sound collected by the microphone in the right earphone or the target type audio filtered from the ambient sound based on the aforementioned audio parameters.
[0169] In some embodiments, the earphones can also begin scene detection and determine audio parameters based on the scene detection results after detecting that the earphones have been removed from the charging case. Understandably, removing the earphones from the case indicates a greater likelihood that the user will use the earphones compared to the case being opened. Performing scene detection when the earphones are removed from the case saves battery power and reduces the frequency of scene detection caused by the case being opened and closed repeatedly without the earphones being removed. The above embodiments can advance the time for scene detection and the determination of audio parameters based on the scene detection results, reducing the likelihood of a poor user experience with the AHA function immediately after wearing the earphones.
[0170] In some embodiments, after the headphone case is opened or the headphones are removed from the case, the headphones can perform scene detection at regular intervals. If the scene detection result changes, the headphones can adjust the audio parameters according to the current scene detection result. This application embodiment does not limit the duration of the interval between two consecutive scene detections by the headphones. Thus, if the scene in which the headphones are located changes after the headphone case is opened or the headphones are removed from the case (e.g., from a noisy environment to a quiet environment), the headphones can adjust the audio parameters in a timely manner to continuously provide the user with the best experience of the AHA function.
[0171] Figure 7 illustrates an exemplary flowchart of a method for determining audio parameters.
[0172] As shown in Figure 7, for a neckband headphone where the left and right earpieces can be magnetically attached together, the user's workflow may include: separating the left and right earpieces, and then wearing the earpieces to listen to the audio played by the earpieces.
[0173] When the left and right earbuds are magnetically attached together, the neckband headphones can detect whether the left and right earbuds are separated. The method for detecting whether the magnetically attached left and right earbuds are separated can be found in the description of the preceding embodiments. When separation of the left and right earbuds is detected, the neckband headphones can perform scene detection and determine audio parameters based on the scene detection results. Then, the neckband headphones can process the audio to be played based on the audio parameters and play it.
[0174] The processor in the neckband headphones can process ambient sound captured by the microphone in the left earpiece, or target type audio filtered from that ambient sound, based on audio parameters, and then play the processed audio through the left earpiece. Similarly, the processor in the neckband headphones can process ambient sound captured by the microphone in the right earpiece, or target type audio filtered from that ambient sound, based on audio parameters, and then play the processed audio through the right earpiece.
[0175] As shown in Figure 7, during the process of the user separating the left and right earbuds and wearing them, the neckband headphones can simultaneously perform scene detection and determine audio parameters. This allows appropriate audio parameters to be determined before the user puts on the headphones, thereby enabling the AHA function and allowing the user to immediately experience the best AHA user experience after wearing the headphones.
[0176] In some embodiments, after the left and right earbuds are separated, the neckband headphones can perform scene detection at regular intervals. If the scene detection result changes, the neckband headphones can adjust the audio parameters according to the current scene detection result. This application embodiment does not limit the duration of the interval between two consecutive scene detections by the neckband headphones. After the left and right earbuds are separated, if the scene in which the neckband headphones are located changes (e.g., from a noisy environment to a quiet environment), the neckband headphones can adjust the audio parameters in a timely manner to continuously provide the user with the best experience of the AHA function.
[0177] Figure 8 illustrates an exemplary flowchart of a method for determining audio parameters.
[0178] As shown in Figure 8, multiple devices, including the first device, the second device, and the third device, can perform scene detection. These devices can be mobile phones, tablets, laptops, or other devices capable of establishing a communication connection with the headphones. The first device, the second device, and the third device can perform scene detection at regular intervals. The method for scene detection by these devices can refer to the aforementioned description of scene detection for headphones. This application embodiment does not limit the duration of the interval between two consecutive scene detections by the first device, the second device, and the third device.
[0179] Understandably, the noise level or scene type of the first, second, and third devices may change (e.g., from a noisy environment to a quiet environment). The first device performing scene detection periodically ensures that its scene detection results are updated promptly after changes in its environment. This ensures that the most recent scene detection result of the first device matches its current scene. Similarly, the second, third, and other devices performing scene detection periodically ensures that their most recent scene detection results match their current scene.
[0180] This explanation uses the connection between headphones and the first device as an example.
[0181] The process of a user playing audio from a first device using headphones with a charging case may include: opening the charging case (i.e., opening the charging case), taking the headphones out of the charging case (i.e., taking the headphones out of the charging case), wearing the headphones, and then playing audio on the first device.
[0182] In some embodiments, the first device and the earphones have previously been paired and connected. When the earphone case is opened, the first device and the earphones can automatically connect. A connection between the first device and the earphones indicates that they are close to each other, i.e., in the same scene. After the first device and earphones are connected, the first device can send the scene detection result to the earphones. The scene detection result can be the result of the first device's most recent scene detection. The earphones can determine audio parameters based on the scene detection result from the first device, and then process and play the audio to be played based on these audio parameters.
[0183] In some embodiments, if the first device and the earphones are connecting for the first time, the steps the user performs after opening the earphone case may further include: keeping the earphones in the case, pressing and holding (e.g., pressing and holding for 3 seconds) the pairing button on the earphone case to trigger the earphones to enter pairing mode, and searching for the earphone name on the first device and clicking to connect. That is, during the initial connection process between the first device and the earphones, the earphones need to be in the case with the case open and the earphones in the case to complete the pairing connection with the first device. After the initial pairing connection between the first device and the earphones is completed, the user can remove the earphones from the case and wear them. After the initial connection between the first device and the earphones, the first device can send the results of the most recent scene detection to the earphones. The earphones can determine the audio parameters based on the scene detection results from the first device, and then process and play the audio to be played based on the audio parameters.
[0184] Furthermore, once the first device and the headphones are connected, the device can send audio from the first device to the headphones in response to a user's audio playback request. The headphones can also play audio from the first device.
[0185] As shown in Figure 8, during the process of a user taking the earphones out of the charging case and putting them on, the earphones can simultaneously obtain the scene detection results from the first device and determine the audio parameters. This allows appropriate audio parameters to be determined before the user puts on the earphones, thereby enabling the AHA function and allowing the user to immediately experience the best AHA user experience after putting on the earphones.
[0186] It should be noted that, not limited to the first device, the device connected to the earphones after the charging case is opened can also be a second or third device. After connecting to the earphones, the second or third device can send the scene detection results to the earphones. For details, please refer to the introduction on connecting the first device to the earphones and sending the scene detection results to the earphones.
[0187] In some embodiments, when the first device is connected to the earphones, the first device can send the most recent scene detection result to the earphones after the earphones have been removed from their charging case. The earphones can detect whether they have been removed from their charging case. When the earphones are removed from their charging case, they can send a message to the first device to notify it that they have been removed. Upon receiving the message indicating that the earphones have been removed from their charging case, the first device can send the most recent scene detection result to the earphones.
[0188] In some embodiments, besides headphones equipped with a charging case, the first device may connect to headphones without a charging case. For example, headphones without a charging case may include neckband headphones. After the neckband headphones are powered on, the first device may connect to the neckband headphones and send the result of the most recent scene detection to the neckband headphones. The neckband headphones can determine audio parameters based on the scene detection result from the first device. The neckband headphones can then process and play the audio to be played based on the audio parameters.
[0189] The processor in the neckband headphones can process ambient sound captured by the microphone in the left earpiece, or target type audio filtered from that ambient sound, based on audio parameters, and then play the processed audio through the left earpiece. Similarly, the processor in the neckband headphones can process ambient sound captured by the microphone in the right earpiece, or target type audio filtered from that ambient sound, based on audio parameters, and then play the processed audio through the right earpiece.
[0190] Understandably, before using neckband headphones, users typically power them on and connect them to a device that requires audio input / output (e.g., the first device). Once connected, the first device immediately sends the scene detection results to the neckband headphones, allowing them to quickly determine suitable audio parameters and reducing the likelihood of a poor AHA (Audio Harmony Assist) experience due to unsuitable audio parameters.
[0191] In some embodiments, after the first device is connected to the headphones, it can continue to perform scene detection at regular intervals. When the first device is connected to the headphones, it can send the result of each scene detection to the headphones. Alternatively, the first device can determine whether the current scene detection result is different from the previous scene detection result. If the current scene detection result is the same as the previous scene detection result, the first device does not need to send the current scene detection result to the headphones. If the current scene detection result is different from the previous scene detection result, the first device can send the current scene detection result to the headphones so that the headphones can adjust the audio parameters. Differences between two adjacent scene detection results may include: the ambient sound energy ranges of the two adjacent scene detections being different, or the scene types of the two adjacent scene detections being different. Thus, after the first device is connected to the headphones, if the scene in which the first device is located (i.e., the scene in which the headphones are located) changes, the first device can promptly update the scene detection result to the headphones, and the headphones can adjust the audio parameters accordingly to continuously provide the user with the best AHA (Audio-Aided Harmony) experience.
[0192] In some embodiments, after the first device is connected to the headphones, the headphones can perform scene detection periodically, and the first device can stop scene detection. The headphones can adjust audio parameters based on the results of their scene detection. Thus, after the first device is connected to the headphones, if the environment in which the headphones are located changes (e.g., from a noisy environment to a quiet environment), the headphones can adjust their audio parameters promptly to continuously provide the user with the best experience of the AHA function. If the first device is disconnected from the headphones, the first device can resume scene detection.
[0193] In some embodiments, after the first device is connected to the headphones, other devices such as the second and third devices can still continue to perform scene detection at regular intervals. That is, scene detection by the first, second, and third devices can be performed independently. If the first device is connected to headphones, the second and third devices may connect to other headphones. The second and third devices can send the scene detection results to their respective connected headphones.
[0194] Figure 9 illustrates an exemplary flowchart of the method for determining audio parameters.
[0195] As shown in Figure 9, the earphone case can perform scene detection. Specifically, when the earphones are placed inside the case and the case is closed, the earphone case can perform scene detection periodically. The method for scene detection by the earphone case can be found in the previous description of earphone scene detection. This embodiment does not limit the duration of the interval between two consecutive scene detections by the earphone case. It is understood that the noise level or scene type of the environment in which the earphone case is located may change (e.g., from a noisy environment to a quiet environment). Performing scene detection periodically by the earphone case ensures that the result of the most recent scene detection matches the current scene in which the earphone case is located.
[0196] When the earphones are placed in the earphone case, the user's earphone usage process may include: opening the earphone case (i.e., opening the earphone case), taking the earphones out of the earphone case (i.e., taking the earphones out of the case), and then wearing the earphones to listen to the audio played by the earphones.
[0197] The headphone case can detect whether it has been opened. The method for detecting whether the headphone case is open can be found in the description of the preceding embodiments. When the headphone case is opened, it can send the result of its most recent scene detection to the headphones. The headphones can determine audio parameters based on the scene detection result from the headphone case, and then process and play the audio to be played based on these audio parameters.
[0198] It should be noted that the earphone case can send scene detection results to the earphones paired with it. The earphone case may store identification information of the earphones paired with it (e.g., the earphones' Bluetooth address). This application embodiment does not limit the method of pairing the earphones with the earphone case.
[0199] In some embodiments, after the earphone case is opened but the earphones are still inside the case, a wired connection can be established between the earphone case and the earphones via corresponding interfaces (refer to interfaces 312, 322, 313, and 332 shown in Figure 3 above). The earphone case can then send scene detection results to the earphones based on this wired connection.
[0200] In some embodiments, after the earphone case is opened, it can establish a wireless communication connection with the earphones. The earphone case can then send the scene detection result to the earphones based on this wireless communication connection. This application does not limit the method by which the earphone case sends the scene detection result to the earphones.
[0201] In some embodiments, the opening of the headphone case can also be performed by the headphones. The method for the headphones to detect that the headphone case is open can be referred to the description in the foregoing embodiments. When the headphone case is detected to be open, the headphones can send a message to the headphone case to notify that the headphone case is currently in an open state. Upon receiving the aforementioned message indicating that the headphone case is open, the headphone case can send the result of the most recent scene detection to the headphones.
[0202] It should be noted that the earphones may specifically include a left earphone and a right earphone. The aforementioned sending of scene detection results from the earphone case to the earphones can refer to the earphone case sending the scene detection results to both the left and right earphones. The left earphone can process and play back ambient sound captured by its microphone or target type audio filtered from that ambient sound, based on audio parameters. The right earphone can process and play back ambient sound captured by its microphone or target type audio filtered from that ambient sound, based on audio parameters.
[0203] As shown in Figure 9, during the process of a user taking the earphones out of the charging case and putting them on, the earphones can simultaneously obtain the scene detection results from the charging case and determine the audio parameters. This allows appropriate audio parameters to be determined before the user puts on the earphones, thereby enabling the AHA function and allowing the user to immediately experience the best AHA user experience after putting on the earphones.
[0204] In some embodiments, the earphone case can detect whether the earphones have been removed from the case. The method for the earphone case to detect whether the earphones have been removed from the case can be found in the description of the foregoing embodiments. When the earphone case detects that the earphones have been removed from the case, it can send the result of the most recent scene detection to the earphones. Optionally, the detection of whether the earphones have been removed from the case can also be performed by the earphones themselves. When the earphones detect that the earphones have been removed from the case, they can send a message to the earphone case to notify it that the earphones are currently out of the case. Upon receiving the message indicating that the earphones have been removed from the case, the earphone case can send the result of the most recent scene detection to the earphones.
[0205] In some embodiments, after the charging case is opened or the earbuds are removed from the case, the charging case can continue to perform scene detection at regular intervals. The charging case can send the result of each scene detection to the earbuds. Alternatively, the charging case can determine whether the current scene detection result is different from the previous scene detection result. If the current scene detection result is the same as the previous scene detection result, the charging case does not need to send the current scene detection result to the earbuds. If the current scene detection result is different from the previous scene detection result, the charging case can send the current scene detection result to the earbuds so that the earbuds can adjust their audio parameters.
[0206] In some embodiments, after the earbuds are removed from the charging case, the earbuds can perform scene detection periodically, while the charging case can stop scene detection. The earbuds can adjust their audio parameters based on the results of their scene detection. This way, if the environment in which the earbuds are located changes after being removed from the charging case (e.g., from a noisy environment to a quiet environment), the earbuds can adjust their audio parameters promptly to continuously provide the user with the best experience for the AHA function. If the earbuds are put back into the charging case, the charging case can resume scene detection.
[0207] Figure 10 illustrates a schematic diagram of the structure of an earphone provided in this application.
[0208] As shown in Figure 10, the earphone 1000 may include an opening detection module, an insertion / exit detection module, a scene detection module, an audio parameter determination module, an audio output module, an audio input module, a storage module, a processing module, and a communication module. These modules can be coupled via a bus.
[0209] The earphones 1000 can be placed in an earphone case. The earphone case can be referred to in the description of the earphone case 101 shown in Figure 1C above.
[0210] The unboxing detection module can be used to detect whether the headphone case has been opened.
[0211] The in-and-out detection module can be used to detect whether the earphones are in or out of the case, that is, to detect whether the earphones 1000 are out of or in the case.
[0212] The scene detection module can be used to detect the noise level or scene type of the scene in which the headphones 1000 are located.
[0213] The audio parameter determination module can be used to determine the audio parameters used to implement the AHA function based on the scene detection results performed by the scene detection module. The audio parameter determination module can then send the determined audio parameters to the processing module.
[0214] The specific methods for headphone case opening detection, headphone insertion / exit detection, scene detection, and audio parameter determination described above can be found in the foregoing embodiments. They will not be repeated here.
[0215] An audio output module can be used to play audio. An audio output module may include devices such as speakers. For example, an audio output module can play audio from a processing module.
[0216] An audio input module can be used to acquire sound signals. The audio input module may include devices such as a microphone. For example, the headphones 1000 can acquire ambient sound through the audio input module. The audio input module can then send the acquired ambient sound to the processing module.
[0217] The storage module can be used to store computer programs. It can also be used to store data such as the correspondence between ambient sound energy ranges and audio parameters shown in Table 1 above, or the correspondence between different scene types and audio parameters.
[0218] The processing module can be used to execute computer programs stored in the storage module. For example, the processing module can process the ambient sound collected by the audio input module based on the audio parameters from the audio parameter determination module, and send the processed audio to the audio output module for playback, thereby realizing active noise reduction, ambient sound pass-through, or hearing enhancement functions.
[0219] The communication module can be used by the headset 1000 to establish communication connections with other devices. For example, the headset 1000 can receive audio from other devices through the communication module. The communication module can then send the received audio to the processing module. The processing module can then pass the audio from other devices to the audio output module for playback.
[0220] The structure shown in Figure 10 does not constitute a specific limitation on the headset 1000. In practical applications, the headset 1000 may include more or fewer modules than those shown in Figure 10, or combine some modules, or separate some modules. The modules shown in Figure 10 may be implemented in hardware, software, or a combination of software and hardware.
[0221] Figure 11 illustrates a schematic diagram of a communication system provided in this application.
[0222] As shown in Figure 11, the communication system 1100 may include an earphone 1110 and a device 1120. A communication connection can be established between the earphone 1110 and the device 1120. This application embodiment does not limit the manner of the communication connection between the earphone 1110 and the device 1120.
[0223] The earphone 1110 may include an opening detection module, an insertion / exit detection module, a scene detection module, an audio parameter determination module, an audio output module, an audio input module, a storage module, a processing module, and a communication module. These modules can be referred to the description in Figure 10 above.
[0224] Device 1120 may include a scene detection module, a processing module, and a communication module. The scene detection module in device 1120 can be used to perform scene detection to detect the noise level or scene type of the scene in which device 1120 is located. Specifically, when device 1120 is connected to headset 1110, the scene in which device 1120 is located is the same as the scene in which headset 1110 is located.
[0225] After being connected to the headset 1110, device 1120 can send the result of the most recent scene detection performed by the scene detection module to the headset. The audio parameter determination module in the headset 1110 can use the audio parameters to implement the AHA function based on the result of the most recent scene detection from device 1120.
[0226] In other words, the earphone 1110 can obtain the scene detection results from the device 1120. Therefore, the scene detection module in the earphone 1110 is optional. That is, the earphone 1110 may also not include a scene detection module. In addition, the opening detection module and the insertion / removal detection module in the earphone 1110 are also optional.
[0227] Device 1120 can be the first device shown in Figure 8 above, or it can be the earphone case shown in Figure 9 above. The method by which the earphone 1110 obtains the scene detection results from device 1120 can refer to the method shown in Figure 8 or Figure 9 above. It will not be described again here.
[0228] This application also provides a computer-readable storage medium storing a computer program, which, when executed by a processor, can implement the steps in the above-described method embodiments.
[0229] This application also provides a computer program product, including a computer program that, when run on a processor, can implement the steps in the various method embodiments described above.
[0230] This application also provides a chip system, which includes a processing circuit and an interface circuit. The interface circuit receives code instructions and transmits them to the processing circuit. The processing circuit executes the code instructions to enable the chip system to implement the steps of any method embodiment of this application. The chip system can be a single chip or a chip module composed of multiple chips.
[0231] It should be noted that, without causing contradictions or conflicts, any feature in any embodiment of this application, or any part of any feature, can be combined, and the combined technical solution is also within the scope of the embodiments of this application.
[0232] The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit it. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.
Claims
1. A method of audio parameter determination, characterized by, The method is applied to an earphone, and the method comprises: When a first condition is met, the earphone collects first audio and performs scene detection according to the first audio to obtain a first scene detection result, and the first condition occurs before the earphone is worn. The earphone determines a first audio parameter according to the first scene detection result, and the first audio parameter is used for processing audio collected by the earphone.
2. The method of claim 1, wherein, The earphone is configured with an earphone box, and the first condition is that the earphone box is opened when the earphone is placed in the earphone box or the earphone is taken out; or the earphone is a neck-wearing earphone, and the first condition is that a left earphone and a right earphone of the neck-wearing earphone are separated.
3. The method according to claim 1 or 2, characterized in that, After the earphone determines the first audio parameter according to the first scene detection result, the method further comprises: The earphone collects second audio and processes the second audio using the first audio parameter to obtain third audio. The earphone plays the third audio.
4. The method according to any one of claims 1-3, characterized in that, After the earphone determines the first audio parameter according to the first scene detection result, the method further comprises: The earphone collects fourth audio and performs scene detection according to the fourth audio to obtain a second scene detection result. The earphone adjusts an audio parameter used for processing audio collected by the earphone to a second audio parameter according to the second scene detection result. The second scene detection result is different from the first scene detection result, and the second audio parameter is different from the first audio parameter.
5. The method of claim 4, wherein, The first scene detection result comprises a first energy of the first audio, the second scene detection result comprises a second energy of the fourth audio, the first audio parameter comprises a first gain, and the second audio parameter comprises a second gain. The first energy is greater than the second energy, and the first gain is greater than the second gain.
6. The method according to any one of claims 1-5, characterized in that, An active noise reduction function or an ambient sound transmission function or a hearing enhancement function of the earphone is in an open state.
7. An audio parameter determination method, characterized by, The method is applied to a communication system comprising a first device and an earphone, and the method comprises: The first device collects fifth audio and performs scene detection according to the fifth audio to obtain a third scene detection result. The first device establishes a communication connection with the earphone. The first device sends the third scene detection result to the earphone. The earphone determines a third audio parameter according to the third scene detection result, and the third audio parameter is used for processing audio collected by the earphone.
8. The method of claim 7, wherein, The earphone is configured with an earphone box, and before the first device establishes the communication connection with the earphone, the method further comprises: The earphone box is opened when the earphone is placed in the earphone box.
9. The method of claim 8, wherein, Before the first device sends the third scene detection result to the earphone, the method further comprises: When the earphone is taken out, the earphone sends a first message to the first device, and the first message is used for indicating that the earphone is taken out.
10. The method of claim 7, wherein, The earphone is a neck-wearing earphone, and before the first device establishes the communication connection with the earphone, the method further comprises: The neck-wearing earphone is powered on.
11. The method according to any one of claims 1-10, characterized in that, After the first device sends the third scene detection result to the earphone, the method further includes: The first device collects sixth audio, and performs scene detection according to the sixth audio to obtain a fourth scene detection result; The first device sends the fourth scene detection result to the earphone; The earphone adjusts the audio parameter used for processing the audio collected by the earphone to a fourth audio parameter according to the fourth scene detection result; The fourth scene detection result is different from the third scene detection result, and the fourth audio parameter is different from the third audio parameter.
12. The method of claim 11, wherein, The third scene detection result includes a third energy of the fifth audio, the fourth scene detection result includes a fourth energy of the sixth audio, the third audio parameter includes a third gain, and the fourth audio parameter includes a fourth gain; The third energy is greater than the fourth energy, and the third gain is greater than the fourth gain.
13. The method according to any one of claims 7-10, characterized in that, After the first device sends the third scene detection result to the earphone, the method further includes: The first device stops performing the scene detection.
14. The method of claim 13, wherein, After the first device stops performing the scene detection, the method further includes: The earphone collects seventh audio, and performs scene detection according to the seventh audio to obtain a fifth scene detection result; The earphone adjusts the audio parameter used for processing the audio collected by the earphone to a fifth audio parameter according to the fifth scene detection result; The fifth scene detection result is different from the third scene detection result, and the fifth audio parameter is different from the third audio parameter.
15. The method according to claim 13 or 14, characterized in that, After the first device stops performing the scene detection, the method further includes: The first device disconnects from the earphone; The first device resumes the scene detection.
16. The method of any one of claims 1-15, wherein, The method further includes: The first device sends eighth audio to the earphone; The earphone plays the eighth audio.
17. A method of audio parameter determination, the method comprising: The method is applied to a communication system including an earphone and an earphone box, the earphone box is used to accommodate the earphone, and the method includes: The earphone box collects ninth audio, and performs scene detection according to the ninth audio to obtain a sixth scene detection result; When the earphone box is opened with the earphone accommodated therein, or when the earphone is taken out, the earphone box sends the sixth scene detection result to the earphone; The earphone determines a sixth audio parameter according to the sixth scene detection result, and the sixth audio parameter is used for processing the audio collected by the earphone.
18. The method of claim 17, wherein, After the earphone box sends the sixth scene detection result to the earphone, the method further includes: The earphone box collects tenth audio, and performs scene detection according to the tenth audio to obtain a seventh scene detection result; The earphone box sends the seventh scene detection result to the earphone; The earphone adjusts the audio parameter used for processing the audio collected by the earphone to a seventh audio parameter according to the seventh scene detection result; The seventh scene detection result is different from the sixth scene detection result, and the seventh audio parameter is different from the sixth audio parameter.
19. The method of claim 18, wherein, The sixth scene detection result includes sixth energy of the ninth audio, the seventh scene detection result includes seventh energy of the tenth audio, the sixth audio parameter includes a sixth gain, and the seventh audio parameter includes a seventh gain. The sixth energy is greater than the seventh energy, and the sixth gain is greater than the seventh gain.
20. The method of claim 17, wherein, The method further includes: After the earphone is taken out of the earphone case, the earphone case stops the scene detection.
21. The method of claim 20, wherein, After the earphone case stops the scene detection, the method further includes: The earphone collects an eleventh audio and performs scene detection according to the eleventh audio to obtain an eighth scene detection result; The earphone adjusts the audio parameter for processing the audio collected by the earphone to an eighth audio parameter according to the eighth scene detection result; The eighth scene detection result is different from the sixth scene detection result, and the eighth audio parameter is different from the sixth audio parameter.
22. The method of claim 20 or 21, wherein, After the earphone case stops the scene detection, the method further includes: When the earphone is put into the earphone case, the earphone case resumes the scene detection.
23. An earphone, characterized by The earphone includes a memory and a processor, wherein the memory is configured to store a computer program; and the processor is configured to execute the computer program to implement the method in any one of claims 1-6.
24. A computer readable storage medium storing instructions, the instructions comprising: The instructions, when executed by the processor, implement the method in any one of claims 1-6.
25. A computer program product, characterised in that, The computer program product includes computer instructions, which, when executed by the processor, implement the method in any one of claims 1-6.
Citation Information
Patent Citations
Earphone noise processing method and device and earphone
CN113873378A
Mode control method and device and terminal equipment
CN113873379A
Audio signal processing method and device and electronic equipment
CN114125639A
Method for determining parameters corresponding to earphone mode, earphone, terminal and system
CN114466278A
Ambient sound enhancement based on hearing profile and acoustic noise cancellation
US20200382859A1