Headphone playback control method, device, electronic device and storage medium

Abstract

The embodiment of the present invention provides a headphone playback control method, device, electronic device and storage medium. The method detects the first anti-noise reduction operation on the headphone in advance, and obtains the scene parameters corresponding to the headphone when the first anti-noise reduction operation is detected. Since the scene in which the user performs the first anti-noise reduction operation on the headphone is usually the scene in which the user needs to listen to the ambient sound, the electronic device can automatically summarize the scenes to be controlled in which the user needs to listen to the ambient sound based on the user operation and the current scene parameters of the headphone, and automatically perform the second anti-noise reduction on the headphone in these scenes to be controlled in the subsequent process, so as to prevent the user from missing the important sounds in the environment. The summary of the scenes to be controlled is based on the user's historical operations and conforms to the user's habits, which is equivalent to "personalized scenes to be controlled customization" for the user, and improves the intelligence level of the headphone playback control.

Description

Technical Field

[0001] The embodiments of the present invention relate to, but are not limited to, the field of computers, and specifically, to, but are not limited to, a headphone playback control method, device, electronic device, and storage medium. Background Art

[0002] With the development of computer technology, people can entertain themselves anytime and anywhere through terminal devices such as laptops, tablets, mobile phones and even wearable devices. For example, in their spare time, terminal users can listen to music and watch videos through terminal devices to relax. In order to get a better auditory experience and avoid affecting other people in the same space, users will choose to wear headphones. Headphones can effectively isolate noise from the external environment, thereby providing users with better audio playback services, especially when the headphones are noise-reducing headphones with noise reduction function, they can reduce environmental noise in real time and maximize their own audio output, presenting the best listening effect.

[0003] However, headphones, especially noise-canceling headphones, not only block out ambient noise, but also block out sounds in the environment that are important to the user, which can easily cause the user to miss important sound information in the environment. For example, when a user takes public transportation, the presence of noise-canceling headphones may prevent the user from hearing the public transportation station announcements, which may cause great inconvenience to the user in some scenarios. Summary of the invention

[0004] The headphone playback control method, device, electronic device and storage medium provided by the embodiments of the present invention mainly solve the technical problem of being unable to know the external environment sound isolated by the headphone in a specific scene.

[0005] In order to solve the above technical problems, an embodiment of the present invention provides a headphone playback control method, comprising:

[0006] Detect the current scene parameters of the scene the headset is currently in;

[0007] Matching the current scene parameter with a scene parameter to be controlled in a parameter library, wherein at least one scene parameter to be controlled in the parameter library is a scene parameter of the scene in which the headset is located that is learned when the first anti-noise reduction operation is performed on the headset;

[0008] After the current scene parameter successfully matches any to-be-controlled scene parameter in the parameter library, a second anti-noise reduction operation is performed.

[0009] The embodiment of the present invention further provides an earphone playback control device, comprising:

[0010] A detection unit, used to detect current scene parameters of the scene in which the headset is currently located;

[0011] a matching unit, configured to match the current scene parameter with a scene parameter to be controlled in a parameter library, wherein at least one scene parameter to be controlled in the parameter library is a scene parameter of the scene in which the headset is located, which is learned when the headset is subjected to a first anti-noise reduction operation;

[0012] The anti-noise reduction unit is used to perform a second anti-noise reduction operation after the current scene parameter successfully matches any scene parameter to be controlled in the parameter library.

[0013] An embodiment of the present invention further provides an electronic device, the electronic device comprising a processor, a memory and a communication bus;

[0014] The communication bus is used to realize the connection and communication between the processor and the memory;

[0015] The processor is used to execute one or more computer programs stored in the memory to implement the steps of the above-mentioned headphone playback control method.

[0016] An embodiment of the present invention further provides a storage medium, which stores one or more computer programs. The one or more computer programs can be executed by one or more processors to implement the steps of the above-mentioned headphone playback control method.

[0017] According to the headphone playback control method, device, electronic device and storage medium provided by the embodiments of the present invention, by pre-detecting the first anti-noise reduction operation and obtaining the scene parameters corresponding to the headphone when the first anti-noise reduction operation is detected, the scenarios in which the user needs to increase the probability of the ambient sound being received and heard are identified, and the scenarios in which the user needs to listen to the ambient sound are determined, and these scenes are used as scenes to be controlled, and the scene parameters corresponding to these scenes are stored in the parameter library as scene parameters to be controlled. In the subsequent process, the current scene parameters of the scene currently located by the headphone are detected, and the current scene parameters are matched with the scene parameters to be controlled pre-stored in the parameter library to determine whether the current scene is a scene in which the ambient sound needs to be increased, that is, whether it is a scene to be controlled in which the second anti-noise reduction operation needs to be performed on the headphone. If the current scene parameters successfully match a scene parameter to be controlled in the parameter library, the second anti-noise reduction operation is automatically performed, and the probability of the user hearing the ambient sound is increased by the second anti-noise reduction operation. It is understandable that the scenarios in which users perform the first anti-noise reduction operation on headphones are usually scenarios in which users need to listen to ambient sounds. Therefore, based on the user's manual operation and the current scene parameters of the headphones, the electronic device can automatically learn and summarize the scenes to be controlled in which the user needs to listen to ambient sounds, so as to automatically and accurately identify the scenes to be controlled with sound energy limitations in the subsequent process, and automatically perform the second anti-noise reduction operation on the headphones in these scenes to be controlled, so as to prevent users from missing important sounds in the environment. The summary of scenes to be controlled is based on the user's historical operations and conforms to the user's habits, which is equivalent to "personalized scenes to be controlled customization" for the user, thereby improving the intelligence of the headphone playback control and allowing the external environmental sounds isolated by the headphones in specific scenarios to be known.

[0018] Other features and corresponding beneficial effects of the present invention are described in the latter part of the specification, and it should be understood that at least part of the beneficial effects become obvious from the description in the specification of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1 A flow chart of a headphone playback control method provided by an embodiment of the present invention;

[0020] Figure 2 A flow chart for identifying a scene to be controlled and storing parameters of the scene to be controlled provided by an embodiment of the present invention;

[0021] Figure 3 A flow chart for verifying whether the associated scene parameters are suitable as the scene parameters to be controlled provided by an embodiment of the present invention;

[0022] Figure 4 A control flow chart after the second anti-noise reduction operation is implemented by automatically reducing the output sound energy of the earphone provided in an embodiment of the present invention;

[0023] Figure 5 A schematic diagram of a structure of earphone playback control provided by an embodiment of the present invention;

[0024] Figure 6 A schematic diagram of a hardware structure of an electronic device provided by an embodiment of the present invention;

[0025] Figure 7 A schematic diagram of a hardware structure of a headset provided by an embodiment of the present invention;

[0026] Figure 8 A schematic diagram of a terminal structure of a headset provided by an embodiment of the present invention;

[0027] Fig. 9 A schematic diagram of the structure of a headphone playback control system provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0028] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the following is a further detailed description of the embodiments of the present invention through specific implementation methods combined with the accompanying drawings. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0029] Embodiment 1:

[0030] In order to prevent users from missing important sounds in the external environment while wearing headphones, the main approach in the relevant technology is: before the headphones leave the factory, some sounds are pre-set, and the audio data of these sounds are stored in the memory of the headphones; when the user uses the headphones, the audio acquisition unit collects environmental sound signals and matches the collected environmental sound signals with the preset audio data. If the match is successful, the collected environmental sound signals are played to the user through the headphones, so that the user can hear the environmental sounds. However, in this solution, whether the user can hear the environmental sounds that are important to him depends on whether the headphone manufacturer can store the audio data of the sounds that are more important to the user in the headphones. However, for different users, the important sounds in the same environment are different, and for a user, the important sounds in different environments are also different. Therefore, it is difficult for headphone manufacturers to take into account every user and every scene. Therefore, in this solution, it is impossible for the headphones to recognize all the important sounds for the user, and the user is still very likely to encounter embarrassing situations due to missing important sounds in the environment.

[0031] In this regard, this embodiment provides an earphone playback control method, which can be implemented by one electronic device, or by two or more electronic devices working together to implement it. Figure 1 The flowchart of the headphone playback control method is shown as follows:

[0032] S102: Detect current scene parameters of the scene in which the headset is currently located.

[0033] The so-called current scene parameter refers to the current scene parameter. In this embodiment, the current scene parameter of the headset can characterize the scene in which the headset is currently located. It is understandable that the sounds in the environment are different in different scenes. For example, when the user is working in the office, there will be keyboard tapping sounds; when the user is on public transportation, there will be station announcement sounds in the environment; when the user is walking on the roadside, there will basically be car engines and horns. So in some examples, the scene in which the headset is located can be reflected by detecting the environmental sound signal.

[0034] In some other examples of this embodiment, the scene in which the headset is located can be reflected by its state information, for example, whether the headset is in a worn state or not worn state, whether it is in a moving state or a stationary state, etc. If the headset is in a worn state and in a moving state at the same time, then the user should be wearing the headset and moving. It can be understood that in some other examples of this embodiment, the headset state information may include other state information, such as temperature state information, humidity state information, etc., in addition to at least one of the wearing state information and the moving state information. Moreover, even the moving state information can be further refined into multiple levels according to the size of the moving speed.

[0035] It is understandable that the ambient sound signal can be collected by an audio acquisition unit, which can be set on the headset, or on a terminal connected to the headset, or the audio acquisition unit can also exist independently of the headset and the terminal. Usually, the audio acquisition unit can be located on the terminal or the headset, and considering that the ambient sound signal collected by the terminal, especially the mobile terminal, such as a mobile phone, a wearable device, etc., in some scenarios does not match the actual ambient sound signal of the user, for example, when the mobile phone is placed in the pocket of the clothes by the user, it will produce friction sound with the pocket of the clothes, and this friction sound will be collected by the audio acquisition unit of the mobile phone, and because the pocket blocks the external sound, the friction sound will be made to be the main ambient sound collected by the audio acquisition unit of the mobile phone. But in fact, even if the user does not wear headphones, he cannot hear this friction sound. Therefore, in this case, there is a big difference between the ambient sound of the user's environment and the ambient sound of the mobile phone's environment. Therefore, the ambient sound signal collected by the audio acquisition unit on the mobile phone cannot be used as the sound signal of the user's environment. However, usually, when a user wears headphones, the ambient sound of the environment in which the headphones are located is consistent with the ambient sound of the environment in which the user is located. Therefore, in this embodiment, the electronic device can use the audio collection unit on the headphones to collect ambient sound signals.

[0036] The headset status information can be collected by a sensor, such as at least one of a pressure sensor, a temperature sensor, an infrared sensor, a gravity sensor (gyroscope), etc. The sensor for detecting the headset wearing status information is arranged on the headset. In this embodiment, the sensor for detecting the headset motion status information can be located on the headset. In other examples, considering that the headset moves with the user's movement, and the mobile terminal is usually carried by the user, the sensor deployed on the mobile terminal can also be used to detect the headset motion status information. In some other examples, sensors for collecting headset motion status information are deployed on both the headset and the terminal, and the electronic device can collect the headset status information through the sensor on the headset and the sensor on the terminal.

[0037] In some examples, the current scene parameter of the headset may include only the ambient sound signal, and in other examples, the current scene parameter of the headset may include only the status information of the headset. However, in this embodiment, the current scene parameter of the headset may include both the ambient sound signal and the status information of the headset.

[0038] S104: Match the current scene parameters with the scene parameters to be controlled in the parameter library.

[0039] In this embodiment, after the electronic device obtains the current scene parameters of the headset, it can match the current scene parameters with the scene parameters to be controlled pre-stored in the parameter library to determine whether the current scene parameters match any scene parameters to be controlled in the parameter library. The scene to be controlled refers to a scene in which the probability of receiving ambient sound needs to be increased. Therefore, the scene parameters to be controlled are actually the current scene parameters of the headset corresponding to the scene to be controlled.

[0040] It is understandable that one or more scene parameters to be controlled can be stored in the parameter library, and each scene parameter to be controlled corresponds to a scene to be controlled. In this embodiment, in this embodiment, at least one scene to be controlled is automatically identified by the electronic device, and correspondingly, at least one scene parameter to be controlled in the parameter library is also automatically determined by the electronic device, without the need for manual setting by the programmer or the user: at least one scene parameter to be controlled pre-stored in the parameter library is the scene parameter of the scene in which the headset is located when the headset is detected to be performing the first anti-noise reduction operation. It should be understood that the "noise reduction operation" is an operation that reduces the probability of the user hearing the ambient sound, so the "anti-noise reduction operation" is an operation that can increase the probability of the user hearing the ambient sound. In order to increase the probability of the ambient sound being heard by the user's ear, at least two approaches can be adopted: first, the operation of reducing the sound energy output by the headset to the user's ear; second, collecting the ambient sound signal and outputting the ambient sound signal through the headset. In this embodiment, the "first anti-noise reduction operation" refers to manually increasing the probability of the ambient sound being received. Corresponding to the first anti-noise reduction operation is a second anti-noise reduction operation, where the second anti-noise reduction operation refers to an anti-noise reduction operation that is automatically performed without manual operation by the user.

[0041] In this embodiment, the first anti-noise reduction operation may include a manual sound energy limiting operation and an operation of manually controlling the earphone to output the ambient sound signal.

[0042] It is understandable that the manual sound energy limiting operation is a user operation, which is an operation by the user to reduce the sound energy of the earphone received by the ear. For example, the manual sound energy limiting operation can be an operation in which the user manually reduces the output volume of the earphone, or it can also be an operation in which the user manually controls the audio playback to stop. In some examples, the manual sound energy limiting operation can be an operation in which the user takes off the earphones that are in a worn state during the earphone playback. Of course, it can be understood by those skilled in the art that in some examples, the manual sound energy limiting operation can be a combination of several of the above three operations: for example, the user takes off the earphones that were originally worn while manually reducing the output volume of the earphones, which is also considered a manual sound energy limiting operation; in other examples, the user manually controls the audio playback to stop and then immediately takes off the earphones that were originally worn, which is also considered a manual sound energy limiting operation.

[0043] The operation of manually controlling the headset to output the ambient sound signal may include the user issuing an instruction to instruct the electronic device to collect the ambient sound signal, and then playing the ambient sound signal through the headset. For example, in one example of the present embodiment, an ambient sound collection control button is provided on the headset. If the user wants to hear the ambient sound, the button can be pressed. After the headset receives the user's instruction, the ambient sound signal can be collected and the collected sound signal can be output to the user. Of course, in some other examples of the present embodiment, the ambient sound signal can also be collected by a terminal connected to the headset in communication according to the user's instruction.

[0044] Combine the following Figure 2 The process shown is to explain the process of an electronic device identifying a scene to be controlled and storing parameters of the scene to be controlled:

[0045] S202: Detect current scene parameters of the scene in which the earphone is currently located and monitor a first anti-noise reduction operation for the earphone.

[0046] In this embodiment, after detecting that the terminal establishes a communication connection with the headset, the electronic device can detect the scene parameters of the scene in which the headset is located in real time and monitor the first anti-noise reduction operation for the headset. The process of detecting the current scene parameters and the process of detecting the first anti-noise reduction operation can be performed periodically, but the detection periods of the two detection processes can be the same or different.

[0047] S204: Determine whether a first anti-noise reduction operation is detected.

[0048] If the detection result is yes, execute S206, otherwise continue to execute S202.

[0049] S206: Determine a scene parameter corresponding to the first anti-noise reduction operation in time as an associated scene parameter of the first anti-noise reduction operation.

[0050] It should be understood that if the first anti-noise reduction operation is detected, the electronic device needs to determine the current scene parameters corresponding to the first anti-noise reduction operation. Moreover, usually, the user will perform the first anti-noise reduction operation because a sound that is important to him / her has appeared in the environment. Therefore, the electronic device determines the current scene parameters corresponding to the detected first anti-noise reduction operation, which is actually tracing back the scene parameters of the headphones before and when the first anti-noise reduction operation occurs. Therefore, after detecting the first anti-noise reduction operation, the electronic device can associate the scene parameters corresponding to the first anti-noise reduction operation in time with the first anti-noise reduction operation as the associated scene parameters of the first anti-noise reduction operation.

[0051] S208: storing the associated scene parameters as the scene parameters to be controlled in the parameter library.

[0052] After determining the associated scene parameters of the first anti-noise reduction operation, the electronic device can directly store the associated scene parameters as the scene parameters to be controlled. Because the user recently has the need to limit the sound energy of the headphones in the scene corresponding to the associated scene parameters, the user is also very likely to have the need to limit the sound energy of the headphones in the corresponding scene in the future. Therefore, the scene corresponding to the associated scene parameters can be used as the scene to be controlled. On this basis, the associated scene parameters are also the scene parameters to be controlled.

[0053] Considering that some of the user's first anti-noise reduction operations are sporadic and do not have a regular pattern, for example, at a certain moment, a stranger stopped a user walking on the sidewalk to ask for directions. In order to hear the other party's question and out of courtesy, the user took off his headphones. In this case, the electronic device can detect the first anti-noise reduction operation, and can also determine the associated scene parameters corresponding to the first anti-noise reduction operation based on the detection of the current scene parameters. But in fact, the associated scene parameters are not suitable as the scene parameters to be controlled, because the user will not be stopped to ask for directions every time in the usual scene. Therefore, if the electronic device stores the associated scene parameters as the scene parameters to be controlled, it will result in some subsequent scenes. Environmental sounds that are important to the user do not originally exist, but because the current scene parameters of the headphones match the stored scene parameters to be controlled, the corresponding scenes will also be identified as scenes to be controlled. In order to avoid the occurrence of this problem, this embodiment provides a process for learning the scene parameters of the scene in which the headphones are located and obtaining the scene parameters to be controlled:

[0054] S302: When a first anti-noise reduction operation is detected, determine a scene parameter corresponding to the first anti-noise reduction operation in time as an associated scene parameter of the first anti-noise reduction operation.

[0055] In the process of learning the scene parameters of the scene in which the headphones are located as the scene parameters to be controlled, if a first anti-noise reduction operation is detected, the electronic device determines the current scene parameters corresponding to the first anti-noise reduction operation, and the determined current scene parameters are the associated scene parameters corresponding to the first anti-noise reduction operation.

[0056] S304: Continue to detect the current scene parameters of the scene where the headset is located, and match the detected current scene parameters with the associated scene parameters.

[0057] Since it is sporadic for the user to perform the first anti-noise reduction operation in the scene corresponding to the associated scene parameter, in order to avoid using the scene parameter corresponding to the sporadic first anti-noise reduction operation as the scene parameter to be controlled, the electronic device in this embodiment will continue to detect the current scene parameter of the scene in which the headset is located after obtaining the associated scene parameter, so as to verify the associated scene parameter. It can be understood that the electronic device verifies the associated scene parameter to determine whether the user will perform the first anti-noise reduction operation again when the scene corresponding to the associated scene parameter appears again. If the user performs the first anti-noise reduction operation again, it means that the user's first anti-noise reduction operation in this scene is not accidental, and the user is very likely to have a need to reduce the sound energy of the headset in this scene. Therefore, the corresponding associated scene parameter can be used as the scene parameter to be controlled. On the contrary, if the user does not perform the first anti-noise reduction operation again, it means that the user's previous first anti-noise reduction operation is accidental, and the corresponding associated scene parameter should naturally not be stored as the scene parameter to be controlled.

[0058] Therefore, after determining the associated scene parameters, the electronic device will obtain the current scene parameters of the headset, match the current scene parameters with the associated scene parameters, and determine whether the scene corresponding to the associated scene parameters is reproduced. Optionally, because the electronic device is not sure whether the associated scene parameters will be detected again after detecting the first anti-noise reduction operation and determining the associated scene parameters corresponding to the first anti-noise reduction operation, the electronic device can store the associated scene parameters first after determining an associated scene parameter, but the associated scene parameters need to be stored separately from the scene parameters to be controlled in the electronic device.

[0059] S306: When the current scene parameter matches the associated scene parameter successfully, monitoring a first anti-noise reduction operation on the headset within a first preset time period.

[0060] If the current scene parameters subsequently detected by the electronic device successfully match the associated scene parameters, the electronic device monitors the first anti-noise reduction operation for the headphones within the first preset duration. It should be understood that the electronic device monitors the first anti-noise reduction operation for the headphones, which is actually to monitor whether the user will manually reduce the sound energy output by the headphones to their ears or manually control the headphones to output ambient sound signals in the reproduced associated scene. The first preset duration can be calculated from the time the electronic device determines that the current scene parameters successfully match the associated scene parameters. The first preset duration can be set by the programmer or customized by the user.

[0061] S308: After the first anti-noise reduction operation is detected within the first preset time period, the associated scene parameters are stored in the parameter library as the scene parameters to be controlled.

[0062] If the electronic device detects the user's first anti-noise reduction operation within the first preset time period, it means that the user's execution of the first anti-noise reduction operation in the same associated scene is not accidental. Therefore, the associated scene should be identified and the scene to be controlled, and the associated scene parameters corresponding to the associated scene have been used as the scene parameters to be controlled. Therefore, in this case, the electronic device will store the associated scene parameters as the scene parameters to be controlled. It can be understood that the first anti-noise reduction operation performed by the user in the associated scene for the first time may be different from the first anti-noise reduction operation performed in the reproduced associated scene. For example, the user first implements the first anti-noise reduction operation in the associated scene by taking off the headphones in the wearing state, but in the reproduced associated scene, the user can complete the first anti-noise reduction operation by controlling the audio playback to stop.

[0063] If the electronic device fails to detect the user's first anti-noise reduction operation within the first preset time period, it means that the user's previous execution of the first anti-noise reduction operation in the associated scene was accidental. Therefore, the associated scene should not be identified and controlled, and the electronic device can discard the corresponding associated scene parameters.

[0064] S106: After the current scene parameter successfully matches any scene parameter to be controlled in the parameter library, a second anti-noise reduction operation is performed.

[0065] If the current scene parameters obtained by the electronic device successfully match the pre-stored parameters of a scene to be controlled, it means that the corresponding scene to be controlled has been reproduced, and there are sounds in the external environment that are important to the user. In order to prevent the user from missing the sound, the electronic device can automatically perform a second anti-noise reduction operation.

[0066] In some examples of this embodiment, the second anti-noise reduction operation may be to reduce the output sound energy of the earphone, such as reducing the output volume of the earphone, or pausing audio playback. Because the output sound energy of the earphone itself is reduced, the output sound energy of the earphone received by the user's ear is reduced. In this case, the user's ear can hear more other sounds, including the sounds in the external environment.

[0067] In some other examples of this embodiment, the second anti-noise reduction operation can be achieved by the electronic device collecting the ambient sound signal, and then outputting the collected ambient sound signal to the user's ear through the earphone. In this case, the output sound energy of the earphone itself does not need to be reduced, but because the content played by the earphone itself contains the ambient sound, the probability of the user hearing the ambient sound is greatly increased. In some examples of this embodiment, when the earphone plays the ambient sound signal to the user, the audio originally being played can be paused, or the two can be played together. In one example, when the earphone superimposes the audio originally being played with the ambient sound signal, the volume of the original audio can be appropriately reduced.

[0068] The headphone playback control method provided by the embodiment of the present invention can automatically learn and determine the scenes that require the user to pay attention to the ambient sounds based on the user's historical operations without relying on manually set scenes or audio, and identify these scenes based on the real-time scene data of the scenes in which the headphones are located, and then automatically limit the sound energy of the headphones in these scenes, thereby preventing the user from missing important sounds in the environment, thereby improving the user experience.

[0069] Embodiment 2:

[0070] It is understandable that the user's habits will keep changing. When the scene parameters of a scene are stored by the electronic device as the scene parameters to be controlled, it does not mean that at any time in the future, as long as the current scene parameters matching the scene parameters to be controlled are detected, it means that there must be important sounds that the user is concerned about in the environment. For example, in the t1-t2 period, there are sounds that the user is concerned about in a scene, so as long as the electronic device recognizes the scene parameters that characterize the reproduction of the scene, it can be determined that there are sounds that the user is concerned about in the environment; but after the t2 period, the user is no longer concerned about the sounds in the scene, then the second anti-noise reduction operation automatically performed by the electronic device in the scene is not what the user expects. After the electronic device performs the automatic second anti-noise reduction operation on the earphone, the user may manually eliminate the impact of the second anti-noise reduction operation. For example, if the second anti-noise reduction operation performed by the electronic device is an operation to limit the output sound energy of the earphone, the user may perform the first sound energy enhancement operation to control the earphone to enhance the sound energy output to the user's ear. This situation indicates that the user's habits may have changed, and the corresponding scene parameters to be controlled may have become invalid. Therefore, the electronic device needs to determine whether the user's habits have changed based on detection and whether the pre-stored scene parameters to be controlled need to be adjusted.

[0071] Combine the following Figure 4 The process shown is used to illustrate the control process after the electronic device implements the second anti-noise reduction operation by reducing the output sound energy of the earphone:

[0072] S402: Monitoring a first sound energy boosting operation on the earphone within a second preset time period.

[0073] The "first sound energy boosting operation" is an operation to boost the sound energy output by the earphones to the user's ears, which is detected by a sensor or input unit. It is an operation in which the user manually boosts the sound energy output by the earphones to the user's ears. Based on the introduction to the manual sound energy limiting operation, the first sound energy boosting operation may include: putting on earphones that were originally taken off during headphone playback, manually boosting the output volume of the earphones, and manually controlling the start of audio playback.

[0074] Here, the second preset time length can be calculated from when the electronic device automatically performs the second anti-noise reduction operation. The second preset time length can be set by a programmer or customized by a user.

[0075] S404: Determine whether a first sound energy boosting operation is detected within a second preset time period.

[0076] If the judgment result is yes, execute S406, if the judgment result is no, execute S412.

[0077] S406: Record the cumulative number of times the first sound energy enhancement operation is performed on the target scene parameter to be controlled.

[0078] The "target scene parameter to be controlled" mentioned here refers to the scene parameter to be controlled that was previously matched from the pre-stored scene parameters to be controlled. For example, assuming that the electronic device has pre-stored scene parameter a to be controlled, scene parameter b to be controlled and scene parameter c to be controlled, and the current scene parameter of the earphone obtained by the electronic device at a certain moment successfully matches the scene parameter a to be controlled, then the scene parameter a to be controlled is the target scene parameter to be controlled. After the electronic device automatically executes the second anti-noise reduction operation according to the matching result, it will determine whether the first sound energy enhancement operation is detected within the second preset time length. If the judgment result is yes, the electronic device will increase the cumulative number of times the scene parameter a to be controlled executes the first sound energy enhancement operation by "1".

[0079] S408: Determine whether the accumulated number of times corresponding to the target scene parameter to be controlled has reached a preset number of times.

[0080] If the judgment result is yes, then execute S410 , and if the judgment result is no, then execute S412 .

[0081] In this embodiment, the preset number of times can be set by the programmer or customized by the user. It can be understood that the size of the preset number of times reflects the difficulty of determining a parameter of a scene to be controlled by the electronic device as invalid: the larger the value of the preset number of times, the more difficult it is to determine the parameter of the scene to be controlled as invalid; conversely, the smaller the value of the preset number of times, the easier it is to determine the parameter of the scene to be controlled as invalid.

[0082] S410: Delete the target scene parameter to be controlled.

[0083] If it is determined through judgment that under the target scene parameters to be controlled, the number of times the user manually performs sound energy enhancement after the electronic device performs the second anti-noise reduction operation has exceeded the preset number, it means that the target scene parameters to be controlled have become invalid, and the electronic device can delete the target scene parameters to be controlled.

[0084] S412: Determine whether the current scene parameters of the headset match the target scene parameters to be controlled.

[0085] If the judgment result is yes, then continue to execute S412, and if the judgment result is no, then execute S414.

[0086] S414: Execute a second sound energy enhancement operation to enhance the output sound energy of the earphone.

[0087] Since the current scene parameters of the headphones do not match the target scene parameters to be controlled, it means that the scene in which the headphones are located has changed, and they are no longer in the controlled scene corresponding to the target scene parameters to be controlled. Therefore, the sound that the user is concerned about may no longer exist in the environment. Therefore, the electronic device can automatically perform a sound energy boosting operation, that is, perform a second sound energy boosting operation, so as to increase the output sound energy of the headphones. For example, in some examples of this embodiment, when the electronic device performs the second sound energy boosting operation, the secondary output sound energy can be restored to the level before the second anti-noise reduction operation is performed.

[0088] For example, assuming that at time t1, the user is wearing headphones, and the original output volume of the headphones is k1. In this case, the electronic device determines that the scene parameter corresponding to the headphones successfully matches the scene parameter b to be controlled, then the electronic device will reduce the output volume of the headphones, for example, to k2; then after the electronic device determines that the scene parameter corresponding to the headphones no longer matches the scene parameter b to be controlled, the electronic device can control the headphones to play audio at the output volume of k1 again. For another example, assuming that after the electronic device determines that the scene parameter corresponding to the headphones successfully matches the scene parameter b to be controlled, it controls the audio playback to stop, then after determining that the scene parameter corresponding to the headphones no longer matches the scene parameter b to be controlled, the electronic device can control the headphones to continue audio playback at the previous output volume k1.

[0089] It is understandable that if the electronic device detects that the user is speaking, there is a high probability that there are important sounds that the user is concerned about in the external environment. Therefore, in some examples of this embodiment, the electronic device may also pre-store the user's voice feature information, and then collect the environmental sound signal and identify whether the environmental sound signal contains the user's voice based on the pre-stored sound feature information. If the user's voice is recognized, the electronic device may automatically perform the second anti-noise reduction operation.

[0090] It is understandable that the electronic device in this embodiment can be the headset itself, or a terminal connected to the headset, or even other devices independent of the headset and the terminal. For example, in one example, the headset is connected to the mobile phone for communication, and the electronic device is a wearable device connected to the headset and the mobile phone respectively. Undoubtedly, the functions of the aforementioned electronic device can also be implemented by two or even more physical devices. For example, part of the process of the aforementioned headset playback control method can be implemented by the headset, and the other part of the process can be implemented by the terminal connected to the headset for communication. For example, in some examples of this embodiment, the headset can detect the current scene parameters of the scene in which the headset is currently located. Then the collected current scene parameters are transmitted to the terminal. After receiving the current scene parameters, the terminal matches the current scene parameters with the pre-stored scene parameters to be controlled. If the current scene parameters match a certain scene parameter to be controlled successfully, the second anti-noise reduction operation is performed to increase the probability of the user hearing the ambient sound.

[0091] In this embodiment, the electronic device can monitor the validity of pre-stored parameters of the scene to be controlled based on user operations, and promptly clear invalid parameters of the scene to be controlled, so as to avoid erroneous sound energy limitation of the headphones based on these parameters of the scene to be controlled, thereby improving the accuracy of identifying the scene to be controlled and helping to enhance the user experience.

[0092] Embodiment three:

[0093] This embodiment first provides an earphone playback control device. Figure 5 The headphone playback control device 50 includes a detection unit 502, a matching unit 504 and an anti-noise reduction unit 506, wherein the detection unit 502 is used to detect the current scene parameter of the scene in which the headphone is currently located; the matching unit 504 is used to match the current scene parameter with the scene parameter to be controlled in the parameter library, at least one scene parameter to be controlled in the parameter library is a scene parameter of the scene in which the headphone is located that is learned when the headphone is subjected to the first anti-noise reduction operation; the anti-noise reduction unit 506 is used to perform a second anti-noise reduction operation after the current scene parameter successfully matches any scene parameter to be controlled in the parameter library, and both the first anti-noise reduction operation and the second anti-noise reduction operation are used to increase the probability of ambient sound being received.

[0094] The headphone playback control device 50 can implement the process of the aforementioned headphone playback control method. For the specific details of its execution of the headphone playback control method, please refer to the introduction of the aforementioned embodiment, which will not be repeated here. It can be understood by those skilled in the art that the headphone playback control device 50 can be deployed on the headphone, or it can be deployed on a terminal that is connected to the headphone in communication and serves as the headphone audio source. Even in some other examples, the headphone playback control device 50 can also be deployed on a device independent of the headphone and the terminal, and the device can be connected to the headphone and the terminal in communication.

[0095] The present embodiment provides a storage medium, which includes volatile or non-volatile, removable or non-removable media implemented in any method or technology for storing information (such as computer-readable instructions, data structures, computer program modules or other data). The storage medium includes, but is not limited to, RAM (Random Access Memory), ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable read only memory), flash memory or other memory technology, CD-ROM (Compact Disc Read-Only Memory), digital versatile disk (DVD) or other optical disk storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage device, or any other medium that can be used to store the desired information and can be accessed by a computer.

[0096] The storage medium may store one or more computer programs that can be read, compiled and executed by one or more processors. In this embodiment, the storage medium may store an earphone playback control program. The earphone playback control program can be executed by one or more processors to implement any of the earphone playback control processes described in the above embodiments.

[0097] This embodiment also provides a computer program product, including a computer readable device, on which the computer program as shown above is stored. In this embodiment, the computer readable device may include the computer readable storage medium as shown above. For example, the computer program product includes an electronic device, for example, this embodiment provides an electronic device, such as Figure 6 As shown, the electronic device 6 includes a processor 61, a memory 62, and a communication bus 63 for connecting the processor 61 and the memory 62, wherein the memory 62 may be the storage medium storing the earphone playback control program. In some examples, the processor 61 may read the earphone playback control program, compile and execute the process of implementing the earphone playback control method described in the above embodiments.

[0098] This embodiment further provides an earphone and a terminal. In an optional case, the earphone and the terminal cooperate with each other to implement the earphone playback control method provided in this embodiment:

[0099] See also Figure 7 , Figure 7The headset 70 shown includes a detection unit 71, an audio output unit 72, a first communication unit 73 and a controller 74, wherein the detection unit 71, the audio output unit 72 and the first communication unit 73 are all communicatively connected to the controller 74. In addition, the headset 70 is communicatively connected to the terminal via the first communication unit 73. It can be understood by those skilled in the art that the communication connection between the headset 70 and the terminal can be a wired connection or a wireless connection.

[0100] The audio output unit 72 is used to output audio data received from the terminal by the first communication unit 73 under the control of the controller 74, such as the sound of playing a song or a video.

[0101] The detection unit 71 is used to detect the current scene parameters of the scene currently located by the earphone 70 under the control of the controller 74. In some examples of this embodiment, the detection unit 71 may include at least one of a sound detection unit and a state detection unit. In some examples, the detection unit 71 may include both a sound detection unit and a state detection unit, wherein the sound detection unit is used to collect the ambient sound signal of the environment in which the earphone 70 is located. For example, the sound detection unit may be a microphone deployed on the earphone 70. The state detection unit may include various types of sensors deployed on the earphone, including at least one of a pressure sensor, a temperature sensor, a humidity sensor, an infrared sensor, a gravity sensor, an acceleration sensor, and the like.

[0102] In addition to receiving audio data from the terminal side, the first communication unit 73 can also transmit the current scene parameters collected by the detection unit 71 to the terminal, so that the terminal can match the current scene parameters with pre-stored scene parameters to be controlled.

[0103] Please see further Figure 8 : The terminal 80 includes a second communication unit 81, a processor 82, and a memory 83. The processor 82 is communicatively connected to the second communication unit 81 and the memory 83 respectively, and the terminal 80 is communicatively connected to the headset through the second communication unit 81.

[0104] The second communication unit 81 is used to transmit audio data to the earphone under the control of the processor 82 to realize audio playback through the earphone; in addition, the second communication unit 81 is also used to receive the current scene parameter transmitted by the earphone that represents the current scene of the earphone.

[0105] The processor 82 is used to match the current scene parameters with the scene parameters to be controlled pre-stored in the memory 83. The scene parameters to be controlled are the scene parameters corresponding to the headphones when the first anti-noise reduction operation was previously detected. The first anti-noise reduction operation is an operation of manually reducing the sound energy output by the headphones to the user's ears; if the current scene parameters successfully match a certain scene parameter to be controlled, the processor 82 automatically executes the second anti-noise reduction operation, which can increase the probability of the user hearing ambient sounds.

[0106] It can be understood that in some examples, the current scene parameters obtained by the processor 82 may be partly from the earphone and partly from the collection unit of the terminal 80 itself. For example, the terminal 80 is also provided with an audio collection unit, such as a microphone, and various sensors. The processor 82 can combine the current scene parameters collected by the collection unit on the terminal 80 with the current scene parameters received from the earphone to obtain a comprehensive scene parameter. The comprehensive scene parameter is obtained by combining the current scene parameters from two different sources, and can more accurately determine the current scene of the earphone.

[0107] In some examples of this embodiment, the processor 82 may monitor a first anti-noise reduction operation for the headset. When the first anti-noise reduction operation is detected, the processor 82 determines a scene parameter corresponding to the first anti-noise reduction operation in time as an associated scene parameter of the first anti-noise reduction operation, and then stores the associated scene parameter in the memory 83 as a scene parameter to be controlled.

[0108] Optionally, after the processor 82 determines the scene parameter corresponding to the first anti-noise reduction operation in time as the associated scene parameter of the first anti-noise reduction operation, the current scene parameter can also be matched with the associated scene parameter. If the current scene parameter matches the associated scene parameter successfully, the processor 82 monitors the first anti-noise reduction operation for the headset within the first preset time length; if the first anti-noise reduction operation is detected within the first preset time length, the processor 82 stores the associated scene parameter as the scene parameter to be controlled in the memory 83.

[0109] In some examples of this embodiment, the memory 83 also stores the user's voice feature information, and the processor 82 can collect the ambient sound signal through the microphone of the terminal 80 itself or the microphone on the headset, and then identify the user's voice in the collected ambient sound signal according to the sound feature information stored in the memory 83. After identifying the user's voice, the processor 82 automatically performs the second anti-noise reduction operation.

[0110] In some examples of this embodiment, when the processor 82 automatically performs the second anti-noise reduction operation, a control instruction can be transmitted to the headset through the second communication unit 81 to instruct the headset to reduce its output sound energy. For example, instruct the headset to lower its output volume. Or the processor 82 can directly control the audio to stop playing, so that the second communication unit 81 temporarily stops transmitting audio data to the headset. In some other examples, the processor 82 can collect ambient sound signals through the microphone of the terminal 80 itself, or the microphone on the headset, and control the second communication unit 81 to transmit the collected ambient sound signals to the headset, so that the headset outputs the collected ambient sound signals.

[0111] In some examples, assuming that the scene parameter to be controlled that successfully matches the current scene parameter is the target scene parameter to be controlled, the processor 82 can monitor the manual sound energy boost operation within the second preset time after automatically reducing the output sound energy of the headset. The manual sound energy boost operation is an operation of manually increasing the sound energy output by the headset to the user's ear. If the processor 82 detects the manual sound energy boost operation within the second preset time, the cumulative number of manual sound energy boost operations performed under the target scene parameter to be controlled is recorded; if the cumulative number corresponding to the target scene parameter to be controlled exceeds the preset number, the processor 82 deletes the target scene parameter to be controlled from the memory 83.

[0112] If no manual sound energy boost operation is detected within the second preset time period, and it is determined that the current scene parameters of the headset do not match the target scene parameters to be controlled, the processor 82 automatically restores the output sound energy of the headset to the level before performing the second anti-noise reduction operation.

[0113] It can be seen that the aforementioned earphone 70 and terminal 80 can cooperate with each other to implement the earphone playback control method in the aforementioned embodiment. As for the details of the earphone 70 and terminal 80 implementing the earphone playback control method, please refer to the introduction of the aforementioned embodiment, which will not be repeated here.

[0114] This embodiment also provides a headphone playback control system, see Fig. 9 As shown, the headset playback control system 9 includes a headset 70 and a terminal 80 connected to the headset 70 for communication, wherein the headset 70 is Figure 7 The corresponding earphone in the terminal 80 is Figure 8 The corresponding terminal.

[0115] Fig. 9 It is only used to illustrate the connection between the headset 70 and the terminal 80. The headset 70 is not limited to Fig. 9 The wired headset shown may also be other types of headsets that are communicatively connected to the terminal 80. Optionally, the headset 70 may be a wireless headset, such as a Bluetooth headset.

[0116] The headphone playback control system, headphones, terminals, electronic devices, and storage media provided in this embodiment can automatically summarize the scenes to be controlled in which the user needs to listen to the ambient sound based on the user's manual operation combined with the current scene parameters of the headphones, so as to automatically and accurately identify the scenes to be controlled with sound energy restrictions in the subsequent process, and automatically limit the sound energy of the headphones in these scenes to be controlled, so as to prevent the user from missing the important sounds in the environment. The summary of the scenes to be controlled is based on the user's historical operations and conforms to the user's habits, which is equivalent to "personalized scenes to be controlled customization" for the user, thereby improving the intelligence of the headphone playback control and enhancing the user experience.

[0117] It can be seen that those skilled in the art should understand that all or some of the steps, systems, and functional modules / units in the above disclosed methods can be implemented as software (which can be implemented with computer program code executable by a computing device), firmware, hardware, and appropriate combinations thereof. In hardware implementations, the division between the functional modules / units mentioned in the above description does not necessarily correspond to the division of physical components; for example, a physical component can have multiple functions, or a function or step can be performed by several physical components in cooperation. Some or all physical components can be implemented as software executed by a processor, such as a central processing unit, a digital signal processor, or a microprocessor, or implemented as hardware, or implemented as an integrated circuit, such as an application-specific integrated circuit.

[0118] In addition, it is well known to those skilled in the art that communication media generally contain computer readable instructions, data structures, computer program modules or other data in modulated data signals such as carrier waves or other transmission mechanisms, and may include any information delivery media. Therefore, the present invention is not limited to any specific hardware and software combination.

[0119] The above contents are further detailed descriptions of the embodiments of the present invention in combination with specific implementation methods, and it cannot be determined that the specific implementation of the present invention is limited to these descriptions. For ordinary technicians in the technical field to which the present invention belongs, several simple deductions or substitutions can be made without departing from the concept of the present invention, which should be regarded as falling within the protection scope of the present invention.

Claims

1. A headphone playback control method, comprising: Detect the real-time scene parameters of the scene the headset is currently in; Matching the real-time scene parameter with a scene parameter to be controlled in a parameter library, wherein at least one scene parameter to be controlled in the parameter library is a scene parameter of the scene in which the headset is located that is learned when the headset is subjected to a first anti-noise reduction operation; After the real-time scene parameter successfully matches any scene parameter to be controlled in the parameter library, performing a second anti-noise reduction operation, wherein the performing of the second anti-noise reduction operation includes reducing the output sound energy of the earphone; Monitoring a first sound energy enhancement operation within a second preset time period, wherein the first sound energy enhancement operation is an operation detected by a sensor or an input unit to increase the sound energy output by the earphone to the user's ear; When the first sound energy enhancement operation is detected within the second preset time period, the accumulated number of times the first sound energy enhancement operation is performed under the target scene parameters to be controlled is recorded; When the first sound energy enhancement operation is detected within the second preset time period, the cumulative number of times the first sound energy enhancement operation is performed under the target scene parameter to be controlled is recorded, and after determining that the cumulative number of times corresponding to the target scene parameter to be controlled exceeds the preset number, the target scene parameter to be controlled is deleted; When the cumulative number of times the first sound energy boosting operation is performed under the target scene parameters to be controlled does not exceed the preset number and it is determined that the real-time scene parameters of the headphones do not match the target scene parameters to be controlled, or when the first sound energy boosting operation is not detected within the second preset time length and it is determined that the real-time scene parameters of the headphones do not match the target scene parameters to be controlled, a second sound energy boosting operation is performed to enhance the output sound energy of the headphones.

2. The headphone playback control method according to claim 1, characterized in that: The process of learning the scene parameters of the scene in which the headset is located to obtain the scene parameters to be controlled includes: When a first anti-noise reduction operation is detected, determining a scene parameter corresponding to the first anti-noise reduction operation in time as an associated scene parameter of the first anti-noise reduction operation; Continue to detect the real-time scene parameters of the scene where the headset is located, and match the detected real-time scene parameters with the associated scene parameters; When the real-time scene parameter matches the associated scene parameter successfully, monitoring a first anti-noise reduction operation on the headset within a first preset time period; After the first anti-noise reduction operation is detected within the first preset time period, the associated scene parameters are stored in the parameter library as scene parameters to be controlled.

3. The headphone playback control method according to claim 2, characterized in that: The first anti-noise reduction operation includes at least one of the following: an operation of controlling the headset to change from a wearing state to a non-wearing state, an operation of reducing the output volume of the headset, and an operation of controlling audio playback to stop.

4. The headphone playback control method according to claim 1, characterized in that: The method of detecting the real-time scene parameters of the headset includes at least one of the following two methods: Collecting an ambient sound signal of the environment in which the headset is located; Detecting status information of the earphone, where the status information includes at least one of wearing status information and motion status information.

5. The headphone playback control method according to claim 4, characterized in that: After collecting the ambient sound signal of the environment where the earphone is located, the method further includes: Identify the user's characteristic voice in the collected environmental sound signal; After the characteristic voice of the user is recognized, the second anti-noise reduction operation is performed.

6. The headphone playback control method according to any one of claims 1 to 5, characterized in that: The method of reducing the output sound energy of the earphone includes at least one of lowering the output volume of the earphone and controlling the audio playback to stop.

7. An electronic device, comprising a processor, a memory and a communication bus; The communication bus is used to realize the connection and communication between the processor and the memory; The processor is used to execute one or more computer programs stored in the memory to implement the steps of the headphone playback control method according to any one of claims 1 to 6.

8. A storage medium, characterized in that: The storage medium stores one or more computer programs, and the one or more computer programs can be executed by one or more processors to implement the steps of the headphone playback control method according to any one of claims 1 to 6.

Images