Wireless earphone control method and system

Abstract

The invention provides a wireless earphone control method and system, and the method comprises the steps: obtaining the position coordinates of a user when a wireless earphone is in a noise reduction mode, so as to judge the type of an environment where the user is located; if the user is in the outdoor environment, collecting environment audio data to obtain a plurality of audio features, and judging whether a close vehicle exists around the user based on the audio features; if the approaching vehicle exists around the user, collecting a plurality of environment images to obtain a vehicle moving track, and obtaining a user moving track based on the position coordinates; and comparing the vehicle moving track with the user moving track to judge whether a collision risk exists or not, and if the collision risk exists, closing the noise reduction mode and sending a collision early warning. According to the invention, based on the audio features, the user is assisted to complete the judgment of vehicle approaching in the noise reduction mode, and the collision risk is predicted in combination with the vehicle movement track and the user movement track, so that the outdoor use safety of the wireless earphone in the noise reduction mode is improved.

Description

Technical Field

[0001] The present invention relates to the field of earphone technology, and in particular to a wireless earphone control method and system. Background Art

[0002] The electroacoustic industry has developed rapidly in recent years, and corresponding audio products such as headphones have also been continuously updated and iterated. Nowadays, wireless headphones have become more and more popular in people's daily lives. Wireless headphones refer to headphones whose connection cables to the terminal are replaced by radio waves, allowing users to avoid the entanglement of annoying connection cables.

[0003] The emergence of noise suppression technology has further improved the user experience of headphones. By using noise suppression technology in wireless headphones, users can reduce the impact of external environmental noise on users when wearing wireless headphones, allowing users to be more immersed in the content played by wireless headphones.

[0004] However, when users use wireless headphones outdoors, noise suppression will significantly reduce the user's perception of the surrounding environment, making it difficult for the user to detect the approach of a vehicle, resulting in increased risks for users in outdoor environments. Summary of the invention

[0005] In view of the deficiencies in the prior art, the purpose of the present invention is to provide a wireless headset control method and system, aiming to solve the technical problem in the prior art that when a user uses wireless headsets outdoors, noise suppression will significantly reduce the user's perception of the surrounding environment, making it difficult for the user to notice the approach of a vehicle, resulting in an increased risk of use for the user in an outdoor environment.

[0006] In order to achieve the above-mentioned object, in a first aspect, an embodiment of the present application provides a wireless headset control method for controlling a wireless headset, wherein the wireless headset comprises an external sound acquisition unit and an external image acquisition unit, and the wireless headset is connected to a terminal for communication, and the wireless headset control method comprises the following steps:

[0007] When the wireless headset is in a noise reduction mode, the terminal obtains the location coordinates of the user, and determines the type of environment in which the user is located by the location coordinates, where the environment type includes an indoor environment and an outdoor environment;

[0008] If the user is in an outdoor environment, the external sound collection unit collects ambient audio data, extracts a number of audio features from the ambient audio data, and determines whether there is an approaching vehicle around the user based on the audio features;

[0009] If there is a vehicle approaching the user, a plurality of environment images are acquired through the external image acquisition unit, a vehicle movement trajectory is acquired from the plurality of environment images, and a user movement trajectory is acquired based on the position coordinates;

[0010] The vehicle movement trajectory is compared with the user movement trajectory to determine whether there is a collision risk. If there is a collision risk, the noise reduction mode is turned off and a collision warning is sent to the user through the wireless headset.

[0011] Compared with the prior art, the beneficial effects of the present invention are: by obtaining the type of environment in which the user is located through the position coordinates, it is automatically determined whether it is necessary to obtain the environmental audio data and the environmental image in the future, thereby saving the energy consumption of the wireless headset to a certain extent; when the user is in an outdoor environment, by combining the environmental audio data and taking the audio features as a basis, it assists the user in completing the judgment of the approaching vehicle in the noise reduction mode, thereby improving the safety of outdoor use in the noise reduction mode to a certain extent; by obtaining the vehicle movement trajectory and the user movement trajectory, the collision risk between the user and the vehicle is predicted, thereby further improving the safety of outdoor use of the wireless headset in the noise reduction mode.

[0012] Further, the step of determining the type of environment in which the user is located by using the location coordinates is specifically as follows:

[0013] The user's location information is obtained on a map based on the location coordinates, and the type of environment in which the user is located is determined through the location information.

[0014] Furthermore, the indoor environment includes an indoor quiet environment and an indoor noisy environment, and the outdoor environment includes an outdoor quiet environment and an outdoor noisy environment.

[0015] Furthermore, the step of extracting a plurality of audio features from the environmental audio data includes:

[0016] Performing data segmentation on the environmental audio data to obtain audio segments in a plurality of continuous time windows, and generating a frequency-time curve graph through the audio segments;

[0017] Audio features are obtained based on the frequency-time graph.

[0018] Furthermore, the formula for obtaining the audio feature is:

[0019]

[0020] Wherein, T represents the audio feature, P(n, f) represents the power of the signal at frequency f and time window n, argmax(·) represents the function of finding the maximum independent variable, and max{·} represents the function of finding the maximum value.

[0021] Furthermore, the step of determining whether there is a vehicle approaching the user based on the audio feature includes:

[0022] Determine whether the audio feature is greater than a feature threshold, and if the audio feature is greater than the feature threshold, select the audio feature as a reference feature;

[0023] Selecting the audio feature in a subsequent time window of the benchmark feature as a reference feature, and obtaining a feature difference between the reference feature and the benchmark feature;

[0024] If the characteristic difference value gradually increases, it is determined that there are approaching vehicles around the user.

[0025] Furthermore, the step of obtaining the vehicle movement trajectory from the plurality of environment images includes:

[0026] Preprocessing the environment image to obtain a binary image, and obtaining a vehicle contour corresponding to the vehicle in the binary image;

[0027] The vehicle center of mass is obtained based on the vehicle outline, and a vehicle movement trajectory is constructed through the vehicle center of mass in a plurality of the environment images.

[0028] Furthermore, after the step of obtaining the location coordinates of the user based on the terminal when the wireless headset is in the noise reduction mode, and determining the type of environment in which the user is located by the location coordinates, wherein the environment types include indoor quiet environment, indoor noisy environment, outdoor quiet environment, and outdoor noisy environment, the method further includes:

[0029] The noise reduction level of the wireless headset is adjusted according to the environment type.

[0030] In a second aspect, an embodiment of the present application provides a wireless headset control system, which is applied to the wireless headset control method as described in the first aspect above, and the system includes:

[0031] A positioning module, configured to obtain the user's location coordinates based on the terminal when the wireless headset is in a noise reduction mode, and determine the type of environment the user is in through the location coordinates, wherein the environment type includes an indoor environment and an outdoor environment;

[0032] A first acquisition module is used for collecting ambient audio data through the external sound collection unit if the user is in an outdoor environment, extracting a plurality of audio features from the ambient audio data, and judging whether there is an approaching vehicle around the user based on the audio features;

[0033] A second acquisition module is used to acquire a plurality of environmental images through the external image acquisition unit if there is a vehicle approaching the user, acquire a vehicle movement trajectory from the plurality of environmental images, and acquire a user movement trajectory based on the position coordinates;

[0034] The analysis module is used to compare the vehicle movement trajectory with the user movement trajectory to determine whether there is a collision risk. If there is a collision risk, the noise reduction mode is turned off and a collision warning is sent to the user through the wireless headset.

[0035] In a third aspect, an embodiment of the present application provides a computer, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the wireless headset control method as described in the first aspect above is implemented.

[0036] In a fourth aspect, an embodiment of the present application provides a storage medium on which a computer program is stored. When the computer program is executed by a processor, the wireless headset control method as described in the first aspect above is implemented. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] Figure 1 This is a flow chart of a wireless headset control method according to a first embodiment of the present invention;

[0038] Figure 2 This is a structural block diagram of a wireless headset control system in a second embodiment of the present invention;

[0039] The following specific implementation manner will further illustrate the present invention in conjunction with the above-mentioned drawings. DETAILED DESCRIPTION

[0040] In order to facilitate the understanding of the present invention, the present invention will be described more fully below with reference to the relevant drawings. Several embodiments of the present invention are given in the drawings. However, the present invention can be implemented in many different forms and is not limited to the embodiments described herein. On the contrary, the purpose of providing these embodiments is to make the disclosure of the present invention more thorough and comprehensive.

[0041] It should be noted that when an element is referred to as being "fixed to" another element, it may be directly on the other element or there may be a central element. When an element is considered to be "connected to" another element, it may be directly connected to the other element or there may be a central element at the same time. The terms "vertical", "horizontal", "left", "right" and similar expressions used herein are for illustrative purposes only.

[0042] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art of the present invention. The terms used herein in the specification of the present invention are only for the purpose of describing specific embodiments and are not intended to limit the present invention. The term "and / or" used herein includes any and all combinations of one or more related listed items.

[0043] See also Figure 1 The wireless headset control method provided in the first embodiment of the present invention is used to control the wireless headset, the wireless headset includes an external sound collection unit and an external image collection unit, and the wireless headset is connected to a communication terminal. In this embodiment, the terminal is a mobile phone, the external sound collection unit is a microphone, and the external image collection unit is a miniature camera. It can be understood that a processing chip is provided in the wireless headset to analyze and process the data collected by the external sound collection unit and the external image collection unit. The wireless headset control method includes the following steps:

[0044] S10: when the wireless headset is in a noise reduction mode, obtaining the location coordinates of the user based on the terminal, and determining the type of environment in which the user is located through the location coordinates, where the environment type includes an indoor environment and an outdoor environment;

[0045] It can be understood that the wireless headset includes a transparency mode and a noise reduction mode. When the wireless headset is in the transparency mode, the user can still receive the external ambient sound normally. When the wireless headset is in the noise reduction mode, the wireless headset will filter the external ambient sound. Therefore, subsequent processing is only performed when the wireless headset is in the noise reduction mode.

[0046] The step of determining the type of environment in which the user is located by the location coordinates is specifically as follows: obtaining the location information of the user on the map based on the location coordinates, and determining the type of environment in which the user is located by the location information. That is, the location of the user is determined by the corresponding area of ​​the location coordinates on the map. In this embodiment, the indoor environment includes a quiet indoor environment and a noisy indoor environment, and the outdoor environment includes a quiet outdoor environment and a noisy outdoor environment. It can be understood that the quiet indoor environment includes an office building environment and a community environment; the noisy indoor environment includes a supermarket environment and a station environment; the quiet outdoor environment includes a park environment; and the noisy outdoor environment includes a street environment.

[0047] Preferably, after step S10, the method further includes:

[0048] S50: adjusting the noise reduction level of the wireless headset according to the environment type;

[0049] In this embodiment, the noise reduction level includes a first level, a second level, a third level and a fourth level, in which the noise reduction effects increase in sequence. When the user is in the indoor quiet environment, the noise reduction level is adjusted to the first level; when the user is in the indoor noisy environment, the noise reduction level is adjusted to the third level; when the user is in the outdoor quiet environment, the noise reduction level is adjusted to the second level; when the user is in the outdoor noisy environment, the noise reduction level is adjusted to the fourth level.

[0050] S20: if the user is in an outdoor environment, collecting ambient audio data through the external sound collection unit, extracting a number of audio features from the ambient audio data, and determining whether there is an approaching vehicle around the user based on the audio features;

[0051] The step S20 comprises:

[0052] S210: Segmenting the environmental audio data to obtain audio segments in a plurality of continuous time windows, and generating a frequency-time curve graph through the audio segments;

[0053] In this embodiment, the time window is 0.5s. Within a certain time window, the audio segment can form a number of feature points corresponding to the time and the audio, and connect the several feature points to form the frequency-time curve graph.

[0054] S220: Acquire audio features based on the frequency-time curve graph;

[0055] The formula for obtaining the audio feature is:

[0056]

[0057] Wherein, T represents the audio feature, P(n, f) represents the power of the signal at frequency f and time window n, argmax(·) represents the function of finding the maximum independent variable, and max{·} represents the function of finding the maximum value.

[0058] S230: Determine whether the audio feature is greater than a feature threshold, and if the audio feature is greater than the feature threshold, select the audio feature as a reference feature;

[0059] S240: Selecting the audio feature in the subsequent time window of the benchmark feature as a reference feature, and obtaining a feature difference between the reference feature and the benchmark feature;

[0060] It can be understood that there are multiple reference features, and multiple feature differences can be formed, and multiple reference features are feature quantities under continuous time windows.

[0061] S250: If the characteristic difference value gradually increases, it is determined that there is a vehicle approaching the user;

[0062] S30: if there is a vehicle approaching the user, a plurality of environment images are acquired through the external image acquisition unit, a vehicle movement trajectory is acquired from the plurality of environment images, and a user movement trajectory is acquired based on the position coordinates;

[0063] Specifically, the step S30 includes:

[0064] S310: Preprocessing the environment image to obtain a binary image, and obtaining a vehicle contour corresponding to the vehicle in the binary image;

[0065] The environment image is subjected to grayscale processing and threshold segmentation to form the binary image, and the binary image is subjected to edge detection to obtain the vehicle contour. The grayscale processing, the threshold segmentation and the edge detection have been widely used in image processing technology and will not be described in detail here. In some embodiments, the vehicle contour can also be directly extracted through a trained neural network model.

[0066] S320: Acquire the center of mass of the vehicle based on the vehicle outline, and construct a vehicle movement trajectory through the center of mass of the vehicle in a plurality of the environment images;

[0067] Since the position of the vehicle is constantly changing, if the vehicle's moving trajectory is constructed using the vehicle contour, the uncertainty in the area of ​​the vehicle contour at different positions may easily lead to errors in obtaining the vehicle's moving trajectory. Therefore, by obtaining the vehicle's center of mass based on the vehicle contour, the vehicle's moving speed and direction can be more accurately grasped, thereby completing the prediction of the vehicle's moving trajectory.

[0068] It can be understood that based on the terminal corresponding to the wireless headset, the user's position coordinates can be continuously obtained, and the user's movement trajectory can be predicted by connecting different position coordinates.

[0069] S40: comparing the vehicle movement trajectory with the user movement trajectory to determine whether there is a collision risk. If there is a collision risk, turning off the noise reduction mode and sending a collision warning to the user through the wireless headset;

[0070] By obtaining the type of environment in which the user is located through the location coordinates, it is automatically determined whether it is necessary to obtain the environmental audio data and the environmental image in the future, thereby saving the energy consumption of the wireless headset to a certain extent; when the user is in an outdoor environment, by combining the environmental audio data and taking the audio features as a basis, it assists the user in completing the judgment of the approaching vehicle in the noise reduction mode, thereby improving the safety of outdoor use in the noise reduction mode to a certain extent; by obtaining the vehicle movement trajectory and the user movement trajectory, the collision risk between the user and the vehicle is predicted, thereby further improving the safety of outdoor use of the wireless headset in the noise reduction mode.

[0071] See also Figure 2The second embodiment of the present invention provides a wireless headset control system, which is applied to the wireless headset control method described in the above embodiment, and will not be repeated here. As used below, the terms "module", "unit", "subunit", etc. can be a combination of software and / or hardware that implements a predetermined function. Although the device described in the following embodiments is preferably implemented in software, the implementation of hardware, or a combination of software and hardware, is also possible and conceivable.

[0072] The system comprises:

[0073] A positioning module 10, configured to obtain the user's location coordinates based on the terminal when the wireless headset is in a noise reduction mode, and determine the type of environment in which the user is located by using the location coordinates, wherein the environment type includes an indoor environment and an outdoor environment;

[0074] The positioning module 10 includes:

[0075] A first unit is used to obtain the user's location information on the map based on the location coordinates, and determine the type of environment where the user is located through the location information;

[0076] A first acquisition module 20 is used for collecting ambient audio data through the external sound collection unit if the user is in an outdoor environment, extracting a plurality of audio features from the ambient audio data, and determining whether there is an approaching vehicle around the user based on the audio features;

[0077] The first acquisition module 20 includes:

[0078] The second unit is used to segment the environmental audio data to obtain audio segments under a plurality of continuous time windows, and generate a frequency-time curve graph through the audio segments;

[0079] A third unit is used to obtain audio features based on the frequency-time curve graph;

[0080] A fourth unit is used to determine whether the audio feature is greater than a feature threshold, and if the audio feature is greater than the feature threshold, select the audio feature as a reference feature;

[0081] A fifth unit, configured to select the audio feature in a subsequent time window of the benchmark feature as a reference feature, and obtain a feature difference between the reference feature and the benchmark feature;

[0082] A sixth unit, configured to determine that there is an approaching vehicle around the user if the characteristic difference gradually increases;

[0083] The second acquisition module 30 is used to acquire a plurality of environment images through the external image acquisition unit if there is a vehicle approaching the user, acquire the vehicle movement trajectory from the plurality of environment images, and acquire the user movement trajectory based on the position coordinates;

[0084] The second acquisition module 30 includes:

[0085] A seventh unit is used to pre-process the environment image to obtain a binary image, and obtain a vehicle contour corresponding to the vehicle in the binary image;

[0086] An eighth unit is used to obtain a vehicle center of mass based on the vehicle outline, and construct a vehicle movement trajectory through the vehicle center of mass in a plurality of the environment images;

[0087] An analysis module 40 is used to compare the vehicle movement trajectory with the user movement trajectory to determine whether there is a collision risk. If there is a collision risk, the noise reduction mode is turned off and a collision warning is sent to the user through the wireless headset;

[0088] Preferably, the system further comprises:

[0089] The adjustment module 50 is used to adjust the noise reduction level of the wireless headset according to the environment type.

[0090] The present invention also provides a computer, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the wireless headset control method as described in the above technical solution when executing the computer program.

[0091] The present invention also provides a storage medium on which a computer program is stored. When the computer program is executed by a processor, the wireless headset control method as described in the above technical solution is implemented.

[0092] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "examples", "specific examples", or "some examples" means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner.

[0093] The above-mentioned embodiments only express several implementation methods of the present invention, and the description thereof is relatively specific and detailed, but it cannot be understood as limiting the scope of the patent of the present invention. It should be pointed out that, for ordinary technicians in this field, several variations and improvements can be made without departing from the concept of the present invention, which all belong to the protection scope of the present invention. Therefore, the protection scope of the patent of the present invention shall be subject to the attached claims.

Claims

1. A wireless headset control method for controlling a wireless headset, wherein the wireless headset comprises an external sound collection unit and an external image collection unit, and the wireless headset is connected to a communication terminal, characterized in that: The wireless headset control method comprises the following steps: When the wireless headset is in a noise reduction mode, the terminal obtains the location coordinates of the user, and determines the type of environment in which the user is located by the location coordinates, where the environment type includes an indoor environment and an outdoor environment; If the user is in an outdoor environment, the external sound collection unit collects ambient audio data, extracts a number of audio features from the ambient audio data, and determines whether there is an approaching vehicle around the user based on the audio features; If there is a vehicle approaching the user, a plurality of environment images are acquired through the external image acquisition unit, a vehicle movement trajectory is acquired from the plurality of environment images, and a user movement trajectory is acquired based on the position coordinates; The vehicle movement trajectory is compared with the user movement trajectory to determine whether there is a collision risk. If there is a collision risk, the noise reduction mode is turned off and a collision warning is sent to the user through the wireless headset.

2. The wireless headset control method according to claim 1, characterized in that: The step of determining the type of environment in which the user is located by using the location coordinates is specifically as follows: The user's location information is obtained on a map based on the location coordinates, and the type of environment in which the user is located is determined through the location information.

3. The wireless headset control method according to claim 1, characterized in that: The indoor environment includes an indoor quiet environment and an indoor noisy environment, and the outdoor environment includes an outdoor quiet environment and an outdoor noisy environment.

4. The wireless headset control method according to claim 1, characterized in that: The step of extracting a plurality of audio features from the environmental audio data comprises: Performing data segmentation on the environmental audio data to obtain audio segments in a plurality of continuous time windows, and generating a frequency-time curve graph through the audio segments; Audio features are obtained based on the frequency-time graph.

5. The wireless headset control method according to claim 4, characterized in that: The formula for obtaining the audio feature is: Wherein, T: represents the audio feature, P(n, f) represents the power of the signal at frequency f and time window n, argmax(·) represents the function of finding the maximum independent variable, and max{·} represents the function of taking the maximum value.

6. The wireless headset control method according to claim 1, characterized in that: The step of determining whether there is a vehicle approaching the user based on the audio feature comprises: Determine whether the audio feature is greater than a feature threshold, and if the audio feature is greater than the feature threshold, select the audio feature as a reference feature; Selecting the audio feature in a subsequent time window of the benchmark feature as a reference feature, and obtaining a feature difference between the reference feature and the benchmark feature; If the characteristic difference value gradually increases, it is determined that there are approaching vehicles around the user.

7. The wireless headset control method according to claim 1, characterized in that: The step of obtaining the vehicle movement trajectory from the plurality of environment images comprises: Preprocessing the environment image to obtain a binary image, and obtaining a vehicle contour corresponding to the vehicle in the binary image; The vehicle center of mass is obtained based on the vehicle outline, and a vehicle movement trajectory is constructed through the vehicle center of mass in a plurality of the environment images.

8. The wireless headset control method according to claim 3, characterized in that: After the step of obtaining the location coordinates of the user based on the terminal when the wireless headset is in the noise reduction mode, and determining the type of environment in which the user is located by the location coordinates, wherein the environment types include an indoor quiet environment, an indoor noisy environment, an outdoor quiet environment, and an outdoor noisy environment, the step further includes: The noise reduction level of the wireless headset is adjusted according to the environment type.

9. A wireless headset control system, applied to the wireless headset control method according to any one of claims 1 to 8, characterized in that: The system comprises: A positioning module, configured to obtain the user's location coordinates based on the terminal when the wireless headset is in a noise reduction mode, and determine the type of environment the user is in through the location coordinates, wherein the environment type includes an indoor environment and an outdoor environment; A first acquisition module is used for collecting ambient audio data through the external sound collection unit if the user is in an outdoor environment, extracting a plurality of audio features from the ambient audio data, and judging whether there is an approaching vehicle around the user based on the audio features; A second acquisition module is used to acquire a plurality of environmental images through the external image acquisition unit if there is a vehicle approaching the user, acquire a vehicle movement trajectory from the plurality of environmental images, and acquire a user movement trajectory based on the position coordinates; The analysis module is used to compare the vehicle movement trajectory with the user movement trajectory to determine whether there is a collision risk. If there is a collision risk, the noise reduction mode is turned off and a collision warning is sent to the user through the wireless headset.

10. A computer comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the wireless headset control method according to any one of claims 1 to 8 is implemented.

Images