Headphone-based danger warning method, headphone device and storage medium

Abstract

The present invention discloses a headset-based danger warning method, a headset device, and a storage medium, the method comprising: collecting environmental sound information around the headset device through a sound collection device in the headset device; obtaining the user's location information; comparing the environmental sound information and the location information with the scene parameters of a preset danger scene to determine whether the user is in the danger scene; if it is determined that the user is in the danger scene, outputting prompt information to prompt the user. The present invention implements an earphone warning solution that helps users perceive external risks, avoids users from being unable to avoid the hazards caused by danger in time due to not being able to hear the external danger sounds clearly when wearing headphones, and improves the safety of users using headphones.

Description

Technical Field

[0001] The present invention relates to the field of earphone technology, and in particular to an earphone-based danger warning method, an earphone device and a storage medium. Background Art

[0002] Currently, most headphones have noise reduction functions such as ANC (Active Noise Cancellation), which allows us to hear clearly in noisy environments. However, this brings another problem: the better the noise reduction performance, the less we can perceive external risks. Many people wear headphones in public places and often cannot hear the sound of horns, shouts or vehicles approaching. How to improve the safety of users when using headphones is an urgent problem to be solved. Summary of the invention

[0003] The main purpose of the present invention is to provide a headphone-based danger warning method, a headphone device and a storage medium, aiming to provide a headphone warning solution that helps users perceive external risks and improves the safety of users using headphones.

[0004] To achieve the above object, the present invention provides a danger warning method based on earphones, the method is applied to an earphone device, and the method comprises:

[0005] Collecting environmental sound information around the headphone device through a sound collection device in the headphone device;

[0006] Get the user's location information;

[0007] Comparing the ambient sound information and the positioning information with preset scene parameters of a dangerous scene to determine whether the user is in the dangerous scene;

[0008] If it is determined that the user is in the dangerous scene, a prompt message is output to prompt the user.

[0009] Optionally, the positioning information includes first position information of the user, the scene parameters include second position information of a dangerous place and first audio information of a dangerous sound, and the step of comparing the ambient sound information and the positioning information with the scene parameters of a preset dangerous scene to determine whether the user is in the dangerous scene includes:

[0010] Comparing the second audio information in the environmental sound information with the first audio information, and comparing the first position information with the second position information;

[0011] If it is determined that the second audio information is consistent with the first audio information, and the first location information is consistent with the second location information, it is determined that the user is in the dangerous scene.

[0012] Optionally, the positioning information further includes a moving speed of the user, and the scene parameter further includes a speed limit for the user. If it is determined that the second audio information is consistent with the first audio information, and the first location information is consistent with the second location information, the step of determining that the user is in the dangerous scene includes:

[0013] If it is determined that the second audio information is consistent with the first audio information, and the first location information is consistent with the second location information, then the moving speed is compared with the speed limit;

[0014] If it is determined that the moving speed is consistent with the speed limit, it is determined that the user is in the dangerous scene.

[0015] Optionally, the scene parameter further includes a limited distance between the user and the danger source, and if it is determined that the second audio information is consistent with the first audio information, and the first position information is consistent with the second position information, the step of determining that the user is in the dangerous scene includes:

[0016] If it is determined that the second audio information is consistent with the first audio information, and the first location information is consistent with the second location information, the distance between the danger source and the user is calculated according to the volume information in the ambient sound information;

[0017] If it is determined that the separation distance is consistent with the limit distance, it is determined that the user is in the dangerous scene.

[0018] Optionally, the step of obtaining the user's location information includes:

[0019] Sending an activation instruction for activating the positioning and navigation function to a user terminal connected to the headset device, so that the user terminal activates the positioning and navigation function according to the activation instruction;

[0020] Receiving positioning information acquired and fed back by the user terminal based on the positioning navigation function;

[0021] The method further comprises:

[0022] When receiving the navigation voice sent by the user terminal based on turning on the positioning and navigation function, determining whether the user terminal turns on the positioning and navigation function based on the turning-on instruction sent by the earphone device;

[0023] If yes, pausing the output of the navigation voice;

[0024] If not, the navigation voice is output.

[0025] Optionally, after the step of outputting a prompt message to prompt the user if it is determined that the user is in the dangerous scene, the step further includes:

[0026] Detecting whether a danger confirmation instruction triggered by the user in response to the prompt information is received;

[0027] If the danger confirmation instruction is received, the output of the prompt information is stopped.

[0028] Optionally, before the step of collecting environmental sound information around the headphone device through the sound collecting device in the headphone device, the method further includes:

[0029] Detecting whether the noise reduction mode of the headphone device is turned on;

[0030] If the noise reduction mode of the earphone device is turned on, the step of collecting environmental sound information around the earphone device through the sound collection device in the earphone device is performed.

[0031] Optionally, before the step of collecting environmental sound information around the headphone device through the sound collecting device in the headphone device, the method further includes:

[0032] Detecting whether the audio output volume of the headphone device is greater than a preset volume threshold;

[0033] If the audio output volume is greater than the preset volume threshold, the step of collecting environmental sound information around the headphone device through the sound collecting device in the headphone device is performed.

[0034] To achieve the above object, the present invention further provides a danger warning device based on earphones, the device is deployed in an earphone device, and the device includes:

[0035] A collection module, used for collecting environmental sound information around the headphone device through a sound collection device in the headphone device;

[0036] An acquisition module is used to obtain the user's location information;

[0037] A comparison module, used to compare the ambient sound information and the positioning information with the scene parameters of a preset dangerous scene to determine whether the user is in the dangerous scene;

[0038] The output module is used to output prompt information to prompt the user if it is determined that the user is in the dangerous scene.

[0039] To achieve the above-mentioned purpose, the present invention also provides an earphone device, which includes: a memory, a processor, and an earphone-based danger warning program stored in the memory and executable on the processor, wherein the earphone-based danger warning program, when executed by the processor, implements the steps of the earphone-based danger warning method as described above.

[0040] In addition, to achieve the above-mentioned purpose, the present invention also proposes a computer-readable storage medium, on which a headphone-based danger warning program is stored. When the headphone-based danger warning program is executed by a processor, the steps of the headphone-based danger warning method as described above are implemented.

[0041] In the present invention, the sound collection device in the headphone device collects the environmental sound information around the headphone device, obtains the user's positioning information, compares the environmental sound information and the positioning information with the scene parameters of the preset dangerous scene, and determines whether the user is in the dangerous scene. If it is determined that the user is in the dangerous scene, a prompt message is output to prompt the user, thereby realizing an headphone early warning solution that helps the user perceive external risks, thereby preventing the user from being unable to avoid the harm caused by the danger in time due to not being able to hear the external dangerous sounds clearly while wearing headphones, and improving the safety of the user using headphones. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] Figure 1 It is a flowchart of a first embodiment of the earphone-based danger warning method of the present invention;

[0043] Figure 2 Schematic diagram of functional modules of a preferred embodiment of the earphone-based danger warning device of the present invention.

[0044] The realization of the purpose, functional features and advantages of the present invention will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0045] It should be understood that the specific embodiments described herein are only used to explain the present invention, and are not used to limit the present invention.

[0046] Reference Figure 1 , Figure 1 It is a flowchart diagram of the first embodiment of the earphone-based danger warning method of the present invention.

[0047] The embodiment of the present invention provides an embodiment of a danger warning method based on headphones. It should be noted that although the logical order is shown in the flow chart, in some cases, the steps shown or described can be performed in a different order than here. The danger warning method based on headphones in the embodiment of the present invention is applied to a headphone device. When the headphone device includes two headphones, the event reminder method can be used for any one of the headphones. In this embodiment, the danger warning method based on headphones includes:

[0048] Step S10, collecting environmental sound information around the headphone device through a sound collection device in the headphone device;

[0049] At least one sound collection device may be provided in the headset device to collect ambient sound information in the environment around the headset device. The sound collection device may be a device capable of collecting sound information, such as a microphone or a sound sensor, which is not limited in this embodiment. The ambient sound information may include audio information and / or volume information of the ambient sound, which may be specifically set according to the type of information required to identify the dangerous scene. The frequency and time span of collecting ambient sound information may be set in the headset device. For example, it may be set to collect once per minute, with a time span of half a minute. Then, the ambient sound information collected once includes the sound information generated by the environment around the headset device for half a minute. In some embodiments, the headset device may set the frequency and time span according to the power saving mode set in the headset device. The greater the power saving intensity corresponding to the power saving mode, the slower the frequency is set and the shorter the time span is set. In other embodiments, the headset device may also set the frequency and time span according to the accuracy of the danger warning set in the headset device. The higher the accuracy of the danger warning, the faster the frequency is set and the longer the time span is set.

[0050] Furthermore, in order to avoid disturbing the user by issuing a danger warning prompt when the user does not need or can hear the external environmental sounds clearly, thereby affecting the user's experience of using the headphones, in some embodiments, the headphone device can turn on the danger warning function in the headphone device according to instructions triggered by the user or a custom scene; when the danger warning function is turned on, the headphone device collects environmental sound information and the user's positioning information, and then issues a danger warning; when the danger warning function is turned off, the environmental sound information and the user's positioning information are not collected, and no danger warning is issued.

[0051] Furthermore, in one embodiment, before step S10, the method further includes:

[0052] Step a, detecting whether the noise reduction mode of the headphone device is turned on;

[0053] The headphone device can detect whether the noise reduction mode is turned on when it is turned on. The noise reduction mode is a mode in which the headphone actively reduces the external environmental noise heard by the user. It can be implemented using conventional headphone noise reduction methods and is not limited here. Detecting whether the noise reduction mode is turned on can be actively monitoring the noise reduction mode on event at a certain frequency, or it can be passively receiving a reported noise reduction mode on event to determine that the headphone device has turned on the noise reduction mode.

[0054] Step b: if the noise reduction mode of the headphone device is turned on, executing step S10;

[0055] If the headphone device determines that the noise reduction mode is turned on, it can perform an operation of collecting environmental sound information through a sound collection device, and perform an operation of obtaining the user's location information through a connected user terminal. That is, when the headphone device determines that the noise reduction mode is turned on, the danger warning function in the headphone device can be turned on. By automatically turning on the danger warning function when the headphone device turns on the noise reduction mode, and automatically prompting when a dangerous scene is detected, it can be prevented that the user cannot or has difficulty hearing the dangerous sounds of the external environment when the noise reduction mode is turned on when wearing the headphones, resulting in the user being unable to avoid the danger. If the headphone device determines that the noise reduction mode is not turned on, it means that the user can hear some external sounds when wearing the headphones. In one embodiment, for a headphone device with strong transparency, it can be set that the headphone device does not turn on the danger warning function when the noise reduction mode is not turned on, that is, the collection of environmental sound information and user location information is not performed.

[0056] Furthermore, in another embodiment, before step S10, the method further includes:

[0057] Step c, detecting whether the audio output volume of the headphone device is greater than a preset volume threshold;

[0058] For some headphone devices with weak transparency, the headphone device can be set to detect whether the audio output volume of the headphone device is greater than a preset volume threshold when the headphone device is turned on, or further detect whether the audio output volume of the headphone device is greater than a preset volume threshold when it is detected that the noise reduction mode of the headphone device is not turned on. Among them, the preset volume threshold can be selected according to the test results through testing, that is, when the user wears the headphones, the audio output volume reaches a certain level at which the user will not be able to hear the external environment sound clearly.

[0059] Step d: If the audio output volume is greater than the preset volume threshold, execute step S10.

[0060] If the headphone device detects that the audio output volume is greater than a preset volume threshold, it can perform operations to collect environmental sound information through a sound collection device, and perform operations to obtain the user's location information through a connected user terminal. That is, when the headphone device determines that the audio output volume is greater than the preset volume threshold, the danger warning function in the headphone device can be turned on. By automatically turning on the danger warning function when the audio output volume of the headphone device is greater than the preset volume threshold, and automatically prompting when a dangerous scene is detected, it can prevent users from being unable or having difficulty hearing dangerous sounds in the external environment due to the excessive volume of the audio played by the headphones when wearing headphones, resulting in failure to avoid danger.

[0061] Furthermore, in one embodiment, if the earphone device detects that the audio output volume is not greater than a preset volume threshold, the danger warning function is not enabled, that is, the collection of ambient sound information and user location information is not performed.

[0062] Step S20, obtaining the user's location information;

[0063] The headset device can obtain the user's positioning information through a positioning device provided in the headset device or from a user terminal connected to the headset device. The headset device and the user terminal can be connected wirelessly or wired, for example, through a Bluetooth connection. The user terminal can be a user terminal that can establish a connection with the headset device, such as a smart phone (Android phone, iOS phone, etc.), a smart phone watch, a tablet computer, a PDA, and a mobile Internet device (Mobile Internet Devices, MID), which is not limited in the embodiments of the present invention. A positioning device is provided in the user terminal, and the user terminal can obtain positioning information through the positioning device, and the positioning information can be used as the user's positioning information. In a specific embodiment, the positioning information may include the user's location information and / or the user's moving speed. The location information may be the coordinate information of the user's location in the map, or the geographical name information of the user's location, which can be specifically set according to the type of information required to identify dangerous scenes.

[0064] Step S30, comparing the ambient sound information and the positioning information with the scene parameters of the preset dangerous scene to determine whether the user is in the dangerous scene;

[0065] After obtaining the ambient sound information and positioning information, the headphone device can compare the ambient sound information and positioning information with the scene parameters of the dangerous scene to determine whether the user is in the dangerous scene according to the comparison result. Among them, the scene parameters of the dangerous scene can be set in advance as needed, and can include parameters set for the ambient sound information and parameters set for the positioning information; when comparing, the ambient sound information is compared with the corresponding parameters, and the positioning information is compared with the corresponding parameters to obtain a result of whether the two types of information are consistent with the corresponding parameters; according to the specific scene, it can be set to determine that the user is in the dangerous scene when both comparison results are consistent, or when at least one of the comparison results is consistent, the user is determined to be in the dangerous scene. In a specific implementation, the parameters set for the ambient sound information and the parameters set for the positioning information can be set according to the type of parameters required to identify the dangerous scene. For example, the parameters set for the ambient sound information can be a volume range. When the volume mean calculated according to the volume information in the ambient sound information is within the volume range, it can be determined that the ambient sound information is consistent with the corresponding parameter.

[0066] In one embodiment, there may be multiple danger scenes set in the headphone device, representing multiple different danger scenes. For example, a danger scene may be defined in which the sound of surrounding vehicles is loud when the user is crossing the road, or a danger scene may be defined in which a "fire" sound is heard around the user when the user is out. Different scene parameters are set for different danger scenes, and the headphone device compares the ambient sound information and positioning information with the scene parameters of various danger scenes to determine whether the user is in any of the danger scenes.

[0067] Step S40: If it is determined that the user is in the dangerous scene, a prompt message is output to prompt the user.

[0068] If the headphone device determines that the user is in a dangerous scene, it can output a prompt message to prompt the user. The prompt message can be pre-set in the headphone device, which can be a prompt ringtone or a prompt voice, without specific limitation. In one embodiment, when multiple dangerous scenes are set in the headphone device, different prompt messages can be set to help users distinguish between various dangerous scenes. For example, for a dangerous scene where a "fire" sound occurs around the user when the user is out, a prompt voice message can be output, "Please pay attention to whether there is a fire near you, please avoid it in time."

[0069] Furthermore, in one embodiment, if it is determined that the user is not in a dangerous scene (when there are multiple dangerous scenes, it is determined that the user is not in any dangerous scene), no danger prompt may be given, that is, no prompt information is output, and information collection continues.

[0070] Furthermore, in one embodiment, scene parameters corresponding to the safety scene can also be set in the headphone device, and the ambient sound information and positioning information can be compared with the scene parameters corresponding to the safety scene to determine whether the user is in a safe scene. If it is determined that the user is in a safe scene, no danger prompt may be given.

[0071] In this embodiment, the sound collection device in the headphone device collects the ambient sound information around the headphone device, obtains the user's positioning information, and compares the ambient sound information and the positioning information with the scene parameters of the preset dangerous scene to determine whether the user is in the dangerous scene. If it is determined that the user is in the dangerous scene, a prompt message is output to prompt the user, thereby realizing an earphone warning solution that helps the user perceive external risks, thereby preventing the user from being unable to avoid the harm caused by the danger in time due to not being able to hear the external dangerous sounds clearly while wearing headphones, thereby improving the safety of the user using headphones.

[0072] Further, based on the above first embodiment, a second embodiment of the earphone-based danger warning method of the present invention is proposed. In this embodiment, step S30 includes:

[0073] Step S301, comparing the second audio information in the environmental sound information with the first audio information, and comparing the first position information with the second position information;

[0074] In this embodiment, the positioning information may include the location information of the user (hereinafter referred to as the first location information for distinction), and the parameters set for the first location information in the scene parameters may include the location information of the dangerous place (hereinafter referred to as the second location information for distinction). The first location information and the second location information may specifically be coordinate information or geographic name information, etc., which are not limited in this embodiment.

[0075] The ambient sound information may include audio information of ambient sound (hereinafter referred to as second audio information for distinction), and the parameters set for the second audio information in the scene parameters may include audio information of dangerous sound (hereinafter referred to as first audio information for distinction).

[0076] The headphone device can compare the second audio information with the first audio information, and different comparison methods can be set according to the type of dangerous scene; for example, when the dangerous scene is a scene where a "fire" sound occurs around the user when the user is out, it is necessary to compare whether the ambient sound contains the word "fire", and the first audio information can be audio information recorded in advance containing a human voice shouting "fire", and the comparison method can be to perform voice recognition on the second audio information and the first audio information respectively, and compare the voice recognition results. If the similarity reaches a certain threshold, it can be determined that the second audio information is consistent with the first audio information; for another example, when the dangerous scene is a scene where the sound of surrounding vehicles is loud when the user is crossing the road, it is necessary to compare whether the ambient sound contains vehicle sounds, and the first audio information can be audio information recorded in advance containing the sound of vehicle driving, and the comparison method can be to directly compare the audio similarity of the second audio information with the first audio information. If the similarity reaches a certain threshold, it can be determined that the second audio information is consistent with the first audio information.

[0077] The headphone device can compare the first location information with the second location information, and different comparison methods can be set according to the type of dangerous scene; for example, when the dangerous scene is a scene where a "fire" cry occurs around the user when the user is out, it is necessary to compare whether the user is in an area outside the user's home. The second location information can be a pre-set coordinate range of the area outside the user's home. The comparison method can be to determine whether the first location information (the coordinate position of the user) is within the coordinate range corresponding to the second location information. If so, it can be determined that the first location information is consistent with the second location information. For another example, when the dangerous scene is a scene where the sound of surrounding vehicles is loud when the user is crossing the road, it is necessary to compare whether the user is near a zebra crossing. The second location information can be the name of the geographical area where the zebra crossing is located, which can be set in advance, or directly set to the name "zebra crossing". The comparison method can be to compare the first location information (the geographical name information of the user's location) with the name corresponding to the second location information. If the names are the same, it can be determined that the first location information is consistent with the second location information.

[0078] Step S302: If it is determined that the second audio information is consistent with the first audio information, and the first location information is consistent with the second location information, it is determined that the user is in the dangerous scene.

[0079] In one implementation, it can be configured, based on the type of dangerous scene, that when it is determined that the second audio information is consistent with the first audio information and the first location information is consistent with the second location information, it is determined that the user is in a dangerous scene.

[0080] In another embodiment, it can also be set according to the type of dangerous scene that when at least one of the second audio information and the first audio information, and the first position information and the second position information, is consistent with each other, it can be determined that the user is in a dangerous scene.

[0081] In this embodiment, by comparing the second audio information in the ambient sound information with the first audio information in the scene parameters, and comparing the first position information in the positioning information with the second position information in the scene parameters, it is determined whether the user is in a dangerous scene based on the comparison result, and the dangerous scene is defined and identified from two dimensions of audio and position, thereby improving the accuracy of identifying dangerous scenes, thereby improving the accuracy of the headset in providing danger warnings, and improving the safety of users using headsets.

[0082] Further, in one embodiment, step S302 includes:

[0083] Step S3021: if it is determined that the second audio information is consistent with the first audio information, and the first location information is consistent with the second location information, then the moving speed is compared with the speed limit;

[0084] In one embodiment, the positioning information may further include the user's moving speed, and the scene parameters may further include a speed limit set for the user's moving speed. According to the type of dangerous scene, when the second audio information is consistent with the first audio information, and the first location information is consistent with the second location information, the user's moving speed is further compared with the speed limit. The comparison method varies according to the type of dangerous scene. It may be set to determine that the moving speed is consistent with the speed limit when the moving speed is greater than the speed limit, and it may also be set to determine that the moving speed is consistent with the speed limit when the moving speed is less than the speed limit.

[0085] Step S3022: If it is determined that the moving speed is consistent with the speed limit, it is determined that the user is in the dangerous scene.

[0086] If the headphone device determines that the moving speed is consistent with the speed limit, it can be determined that the user is in a dangerous situation.

[0087] Furthermore, in one embodiment, if the headphone device determines that the moving speed is inconsistent with the speed limit, it can be determined that the user is not in a dangerous situation. Alternatively, in other embodiments, if the headphone device determines that the moving speed is inconsistent with the speed limit, other information items can be further compared, so that the user is considered to be in a dangerous situation only when the other information items are consistent.

[0088] In this embodiment, by comparing the second audio information in the ambient sound information with the first audio information in the scene parameters, and comparing the first position information in the positioning information with the second position information in the scene parameters, the user's moving speed in the positioning information is further compared with the speed limit for the user in the scene parameters, and whether the user is in a dangerous scene is determined based on the comparison result. The dangerous scene is defined and identified from three dimensions of audio, position and speed, thereby further improving the accuracy of identifying dangerous scenes, thereby improving the accuracy of the headset's danger warning, and improving the safety of users using headsets.

[0089] Further, in one embodiment, step S302 includes:

[0090] Step S3023: if it is determined that the second audio information is consistent with the first audio information, and the first location information is consistent with the second location information, then the distance between the danger source and the user is calculated according to the volume information in the ambient sound information;

[0091] Step S3024: If it is determined that the distance between the two is consistent with the limit distance, it is determined that the user is in the dangerous scene.

[0092] In one embodiment, the ambient sound information may also include volume information of the ambient sound, so as to calculate the distance between the danger source and the user based on the volume information. The scene parameters may also include a limit distance between the danger source and the user. According to the type of dangerous scene, when the second audio information is consistent with the first audio information, and the first position information is consistent with the second position information, the distance between the danger source and the user is further compared with the limit distance. The comparison method can be set to determine that the distance is consistent with the limit distance when the distance is less than the limit distance. If the headphone device determines that the distance is consistent with the limit distance, it is determined that the user is in a dangerous scene. Specifically, calculating the distance between the danger source and the user based on the volume information can be performed by pre-testing in the laboratory to obtain the volume that can be reached when the sound emitted by the sound source at different distances is collected by the sound collection device of the headphone device, and calculating the corresponding relationship between the distance and the volume. The headphone device converts the volume value in the volume information (if the headphone device obtains the ambient sound information that lasts for a period of time, the volume information may include volume values ​​corresponding to multiple time points) into the distance according to the corresponding relationship to obtain the distance (if multiple distance values ​​are obtained by conversion, the average value or the maximum value can be taken as the distance).

[0093] Furthermore, in one embodiment, if the headphone device determines that the distance between the two devices is inconsistent with the limit distance, it can be determined that the user is not in a dangerous scene. Alternatively, in other embodiments, if the headphone device determines that the distance between the two devices is inconsistent with the limit distance, other information items can be further compared, so that the user is considered to be in a dangerous scene only when the other information items are consistent.

[0094] In this embodiment, by comparing the second audio information in the ambient sound information with the first audio information in the scene parameters, and comparing the first position information in the positioning information with the second position information in the scene parameters, the distance between the danger source and the user is further compared with the restricted distance between the danger source and the user in the scene parameters, and determining whether the user is in a dangerous scene based on the comparison result, limiting and identifying dangerous scenes from three dimensions of audio, position and distance, further improving the accuracy of identifying dangerous scenes, thereby improving the accuracy of danger warnings provided by the headphones, and improving the safety of users using headphones.

[0095] Further, based on the above-mentioned first and / or second embodiments, a third embodiment of the earphone-based danger warning method of the present invention is proposed. In this embodiment, step S20 includes:

[0096] Step S201, sending an activation instruction for activating the positioning and navigation function to a user terminal connected to the headset device, so that the user terminal activates the positioning and navigation function according to the activation instruction;

[0097] When the earphone device needs to obtain the user's location information from the user terminal, it can send an instruction to the user terminal to enable the positioning and navigation function, for example, when the danger warning function is enabled, the instruction is sent to the user terminal. After receiving the instruction to enable the positioning and navigation function, the user terminal can enable the positioning and navigation function. The positioning and navigation function can be implemented based on a positioning device (such as GPS) or map navigation software in the user terminal, which is not limited in this embodiment.

[0098] Step S202, receiving positioning information obtained and fed back by the user terminal based on the positioning navigation function;

[0099] After the positioning navigation function is turned on, the user terminal obtains the positioning information of the user terminal and sends the positioning information to the earphone device, which receives the positioning information.

[0100] The method further comprises:

[0101] Step S50, when receiving the navigation voice sent by the user terminal based on turning on the positioning and navigation function, determining whether the user terminal turns on the positioning and navigation function based on the turning-on instruction sent by the earphone device;

[0102] Furthermore, in one embodiment, if the user terminal generates and plays a navigation voice when the positioning and navigation function is turned on, when the user terminal sends the navigation voice to the earphone device, the earphone device can determine whether the navigation voice is obtained based on the positioning and navigation function turned on by the turn-on instruction sent by the earphone device, that is, in layman's terms, whether the earphone device allows the user terminal to navigate. In one embodiment, when the user terminal turns on the positioning and navigation function based on the turn-on instruction sent by the earphone device, the user terminal can carry an indication flag in the navigation voice data packet sent to the earphone device to indicate that the positioning and navigation function is turned on based on the turn-on instruction sent by the earphone device; the earphone device determines whether the user terminal turns on the positioning and navigation function based on the turn-on instruction sent by the earphone device according to whether the indication flag is carried in the navigation voice data packet.

[0103] Step S60: If yes, suspend outputting the navigation voice;

[0104] Step S70: if not, output the navigation voice.

[0105] If the headset device determines that the user terminal turns on the positioning and navigation function based on the turn-on instruction sent by the headset device, it means that the user has no navigation needs at this time, and the headset device needs to issue a danger warning. At this time, the headset device can suspend the output of the navigation voice to avoid disturbing the user. If the headset device determines that the user terminal does not turn on the positioning and navigation function based on the turn-on instruction sent by the headset device, it means that the user needs the navigation function of the user terminal at this time. At this time, the headset device can output the navigation voice to meet the user's navigation needs.

[0106] Furthermore, in one embodiment, after step S40, the following steps are further included:

[0107] Step S80, detecting whether a danger confirmation instruction triggered by the user in response to the prompt information is received;

[0108] After outputting the prompt information, the headphone device can detect whether a danger confirmation instruction triggered by the user in response to the prompt information is received. The headphone device can enter a state of waiting for the output of the confirmation instruction after outputting the prompt information, and when a confirmation operation by the user through a key, a touch key or voice input in the headphone device is detected within a certain period of time, it can be determined that the danger confirmation instruction triggered by the prompt information is received.

[0109] Step S90: If the danger confirmation instruction is received, stop outputting the prompt information.

[0110] If it is confirmed that the danger confirmation instruction has been received, it means that the user has noticed the dangerous situation around him. At this time, the headphone device can stop outputting prompt information to avoid continuously affecting the user's normal use of the headphones.

[0111] In addition, the embodiment of the present invention also provides a danger warning device based on earphones, wherein the device is deployed in an earphone device, referring to Figure 2 , the device comprises:

[0112] A collection module 10, configured to collect environmental sound information around the headphone device through a sound collection device in the headphone device;

[0113] An acquisition module 20 is used to acquire the user's location information;

[0114] A comparison module 30, used to compare the ambient sound information and the positioning information with a preset scene parameter of a dangerous scene to determine whether the user is in the dangerous scene;

[0115] The output module 40 is used to output prompt information to prompt the user if it is determined that the user is in the dangerous scene.

[0116] Further, the positioning information includes first position information of the user, the scene parameters include second position information of the dangerous place and first audio information of the dangerous sound, and the comparison module 30 is further used for:

[0117] Comparing the second audio information in the environmental sound information with the first audio information, and comparing the first position information with the second position information;

[0118] If it is determined that the second audio information is consistent with the first audio information, and the first location information is consistent with the second location information, it is determined that the user is in the dangerous scene.

[0119] Furthermore, the positioning information further includes the moving speed of the user, the scene parameter further includes a speed limit for the user, and the comparison module 30 is further used for:

[0120] If it is determined that the second audio information is consistent with the first audio information, and the first location information is consistent with the second location information, then the moving speed is compared with the speed limit;

[0121] If it is determined that the moving speed is consistent with the speed limit, it is determined that the user is in the dangerous scene.

[0122] Furthermore, the scene parameters also include a limited distance between the user and the danger source, and the comparison module 30 is further used to: if it is determined that the second audio information is consistent with the first audio information, and the first position information is consistent with the second position information, then calculate the distance between the danger source and the user according to the volume information in the ambient sound information;

[0123] If it is determined that the separation distance is consistent with the limit distance, it is determined that the user is in the dangerous scene.

[0124] Furthermore, the acquisition module 20 is also used for:

[0125] Sending an activation instruction for activating the positioning and navigation function to a user terminal connected to the headset device, so that the user terminal activates the positioning and navigation function according to the activation instruction;

[0126] Receiving positioning information acquired and fed back by the user terminal based on the positioning navigation function;

[0127] The device also includes:

[0128] A determination module, configured to determine whether the user terminal turns on the positioning and navigation function based on the turn-on instruction sent by the earphone device when receiving the navigation voice sent by the user terminal based on turning on the positioning and navigation function;

[0129] The output module 40 is further configured to pause outputting the navigation voice if yes, and output the navigation voice if no.

[0130] Furthermore, the device also includes:

[0131] A first detection module is used to detect whether a danger confirmation instruction triggered by the user in response to the prompt information is received;

[0132] The output module 40 is further configured to stop outputting the prompt information if the danger confirmation instruction is received.

[0133] Furthermore, the device also includes:

[0134] A second detection module, used to detect whether the noise reduction mode of the headphone device is turned on;

[0135] The collection module 10 is also used for executing the operation of collecting the environmental sound information around the headphone device through the sound collection device in the headphone device if the noise reduction mode of the headphone device is turned on.

[0136] Furthermore, the device also includes:

[0137] A third detection module, used to detect whether the audio output volume of the headphone device is greater than a preset volume threshold;

[0138] The collection module 10 is further configured to, if the audio output volume is greater than the preset volume threshold, execute the operation of collecting environmental sound information around the headphone device through the sound collection device in the headphone device.

[0139] The expanded contents of the specific implementation manner of the earphone-based danger warning device of the present invention are basically the same as the above-mentioned embodiments of the earphone-based danger warning method, and will not be elaborated here.

[0140] The earphone device of the present invention includes a structural shell, a communication module, a main control module (such as a microcontroller unit MCU), a speaker, a microphone, a memory, etc. The main control module may include a microprocessor, an audio decoding unit, a power supply and a power management unit, sensors required by the system, and other active or passive devices (which may be replaced, deleted or added according to actual functions) to realize the reception and playback functions of wireless audio. The earphone device can establish a communication connection with the user terminal through the communication module. The memory of the earphone may store an earphone-based danger warning program, and the microprocessor may be used to call the earphone-based danger warning program stored in the memory, and perform the following operations:

[0141] Collecting environmental sound information around the headphone device through a sound collection device in the headphone device;

[0142] Get the user's location information;

[0143] Comparing the ambient sound information and the positioning information with preset scene parameters of a dangerous scene to determine whether the user is in the dangerous scene;

[0144] If it is determined that the user is in the dangerous scene, a prompt message is output to prompt the user.

[0145] Further, the positioning information includes first position information of the user, the scene parameters include second position information of the dangerous place and first audio information of the dangerous sound, and the operation of comparing the ambient sound information and the positioning information with the scene parameters of the preset dangerous scene to determine whether the user is in the dangerous scene includes:

[0146] Comparing the second audio information in the environmental sound information with the first audio information, and comparing the first position information with the second position information;

[0147] If it is determined that the second audio information is consistent with the first audio information, and the first location information is consistent with the second location information, it is determined that the user is in the dangerous scene.

[0148] Further, the positioning information also includes a moving speed of the user, the scene parameter also includes a speed limit for the user, and if it is determined that the second audio information is consistent with the first audio information, and the first location information is consistent with the second location information, the operation of determining that the user is in the dangerous scene includes:

[0149] If it is determined that the second audio information is consistent with the first audio information, and the first location information is consistent with the second location information, then the moving speed is compared with the speed limit;

[0150] If it is determined that the moving speed is consistent with the speed limit, it is determined that the user is in the dangerous scene.

[0151] Furthermore, the scene parameter also includes a limited distance between the user and the danger source, and if it is determined that the second audio information is consistent with the first audio information, and the first location information is consistent with the second location information, the operation of determining that the user is in the dangerous scene includes:

[0152] If it is determined that the second audio information is consistent with the first audio information, and the first location information is consistent with the second location information, the distance between the danger source and the user is calculated according to the volume information in the ambient sound information;

[0153] If it is determined that the separation distance is consistent with the limit distance, it is determined that the user is in the dangerous scene.

[0154] Furthermore, the operation of obtaining the user's location information includes:

[0155] Sending an activation instruction for activating the positioning and navigation function to a user terminal connected to the headset device, so that the user terminal activates the positioning and navigation function according to the activation instruction;

[0156] Receiving positioning information acquired and fed back by the user terminal based on the positioning navigation function;

[0157] The microprocessor may also be used to call up a headset-based hazard warning program stored in the memory to perform the following operations:

[0158] When receiving the navigation voice sent by the user terminal based on turning on the positioning and navigation function, determining whether the user terminal turns on the positioning and navigation function based on the turning-on instruction sent by the earphone device;

[0159] If yes, pausing the output of the navigation voice;

[0160] If not, the navigation voice is output.

[0161] Furthermore, if it is determined that the user is in the dangerous scene, after outputting the prompt information to prompt the user, the microprocessor can also be used to call the headset-based danger warning program stored in the memory to perform the following operations:

[0162] Detecting whether a danger confirmation instruction triggered by the user in response to the prompt information is received;

[0163] If the danger confirmation instruction is received, the output of the prompt information is stopped.

[0164] Furthermore, before the operation of collecting the ambient sound information around the headphone device through the sound collection device in the headphone device, the microprocessor can also be used to call the headphone-based danger warning program stored in the memory to perform the following operations:

[0165] Detecting whether the noise reduction mode of the headphone device is turned on;

[0166] If the noise reduction mode of the earphone device is turned on, performing the operation of collecting environmental sound information around the earphone device through the sound collection device in the earphone device;

[0167] Furthermore, before the operation of collecting the ambient sound information around the headphone device through the sound collection device in the headphone device, the microprocessor can also be used to call the headphone-based danger warning program stored in the memory to perform the following operations:

[0168] Detecting whether the audio output volume of the headphone device is greater than a preset volume threshold;

[0169] If the audio output volume is greater than the preset volume threshold, the operation of collecting environmental sound information around the headphone device through the sound collecting device in the headphone device is performed.

[0170] The various embodiments of the earphone device and the computer-readable storage medium of the present invention may refer to the various embodiments of the earphone-based danger warning method of the present invention, which will not be described in detail here.

[0171] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0172] The serial numbers of the above embodiments of the present invention are only for description and do not represent the advantages or disadvantages of the embodiments.

[0173] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, a magnetic disk, or an optical disk), and includes a number of instructions for enabling a terminal device (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods described in each embodiment of the present invention.

[0174] The above are only preferred embodiments of the present invention, and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.

Claims

1. A danger warning method based on earphones, characterized in that: The method is applied to a headphone device, and the method comprises: Collecting environmental sound information around the headphone device through a sound collection device in the headphone device; Sending an activation instruction for activating the positioning and navigation function to a user terminal connected to the headset device, so that the user terminal activates the positioning and navigation function according to the activation instruction; Receiving positioning information acquired and fed back by the user terminal based on the positioning navigation function; Comparing the ambient sound information and the positioning information with scene parameters of a preset dangerous scene to determine whether the user is in the dangerous scene, wherein different scene parameters are set for different dangerous scenes; If it is determined that the user is in the dangerous scene, outputting a prompt message to prompt the user; The positioning information includes first position information of the user, the scene parameters include second position information of the dangerous place and first audio information of the dangerous sound, and the step of comparing the ambient sound information and the positioning information with the scene parameters of the preset dangerous scene to determine whether the user is in the dangerous scene includes: Performing speech recognition on the second audio information in the environmental sound information and the first audio information respectively, and comparing the speech recognition results. If the similarity reaches a certain threshold, it is determined that the second audio information is consistent with the first audio information. Alternatively, performing audio similarity comparison on the second audio information in the environmental sound information and the first audio information. If the similarity reaches a certain threshold, it is determined that the second audio information is consistent with the first audio information. comparing the first location information with the second location information; If it is determined that the second audio information is consistent with the first audio information, and the first location information is consistent with the second location information, it is determined that the user is in the dangerous scene; The method further comprises: When receiving the navigation voice sent by the user terminal based on turning on the positioning and navigation function, determining whether the user terminal turns on the positioning and navigation function based on the turning-on instruction sent by the earphone device; If yes, pausing the output of the navigation voice; If not, the navigation voice is output.

2. The earphone-based danger warning method according to claim 1, characterized in that: The positioning information also includes the moving speed of the user, the scene parameter also includes a speed limit for the user, and if it is determined that the second audio information is consistent with the first audio information, and the first location information is consistent with the second location information, the step of determining that the user is in the dangerous scene includes: If it is determined that the second audio information is consistent with the first audio information, and the first location information is consistent with the second location information, then the moving speed is compared with the speed limit; If it is determined that the moving speed is consistent with the speed limit, it is determined that the user is in the dangerous scene.

3. The earphone-based danger warning method according to claim 1, characterized in that: The scene parameter also includes a limited distance between the user and the danger source. If it is determined that the second audio information is consistent with the first audio information, and the first location information is consistent with the second location information, the step of determining that the user is in the dangerous scene includes: If it is determined that the second audio information is consistent with the first audio information, and the first location information is consistent with the second location information, the distance between the danger source and the user is calculated according to the volume information in the ambient sound information; If it is determined that the separation distance is consistent with the limit distance, it is determined that the user is in the dangerous scene.

4. The earphone-based danger warning method according to claim 1, characterized in that: After the step of outputting a prompt message to prompt the user if it is determined that the user is in the dangerous scene, the method further includes: Detecting whether a danger confirmation instruction triggered by the user in response to the prompt information is received; If the danger confirmation instruction is received, the output of the prompt information is stopped.

5. The earphone-based danger warning method according to any one of claims 1 to 4, characterized in that: Before the step of collecting environmental sound information around the headphone device by the sound collecting device in the headphone device, the method further includes: Detecting whether the noise reduction mode of the headphone device is turned on; If the noise reduction mode of the earphone device is turned on, the step of collecting environmental sound information around the earphone device through the sound collection device in the earphone device is performed.

6. The earphone-based danger warning method according to any one of claims 1 to 4, characterized in that: Before the step of collecting environmental sound information around the headphone device through the sound collecting device in the headphone device, the method further includes: Detecting whether the audio output volume of the headphone device is greater than a preset volume threshold; If the audio output volume is greater than the preset volume threshold, the step of collecting environmental sound information around the headphone device through the sound collecting device in the headphone device is performed.

7. A headphone device, characterized in that: The headphone device comprises: a memory, a processor, and a headphone-based danger warning program stored in the memory and executable on the processor. When the headphone-based danger warning program is executed by the processor, the steps of the headphone-based danger warning method as described in any one of claims 1 to 5 are implemented.

8. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores an earphone-based danger warning program, which, when executed by a processor, implements the steps of the earphone-based danger warning method according to any one of claims 1 to 5.

Images