A method, device, wearable device and medium for processing sound information

Abstract

The present invention discloses a method, device, wearable device and medium for processing sound information, which are applicable to the technical field of wearable devices. The wearable device includes a sound pickup module, including: obtaining sound information collected by the sound pickup module; analyzing and processing the sound information to obtain characteristic parameters corresponding to preset parameters in preset conditions, wherein there is at least one preset condition; when the characteristic parameters meet the preset conditions, according to the relationship between the characteristic parameters and the preset conditions, executing a corresponding processing strategy. Setting a sound pickup module for existing wearable devices not only realizes the original single function, but also enriches the wearable device to execute the corresponding processing strategy function according to the relationship between the characteristic parameters that meet the preset conditions and the preset conditions, thereby improving the user's experience of the wearable device.

Description

Technical Field

[0001] The present invention relates to the technical field of wearable devices, and in particular to a method and apparatus for processing sound information, a wearable device and a medium. Background Art

[0002] With the development of technology, augmented reality (AR) glasses directly or indirectly observe real scenes, but their content is enhanced through computer-generated components. By directly or indirectly observing the real world, increasing the real-time understanding of scenes related to the scene, correctly identifying the content in the scene, and enhancing it, such as changing the color of the wall.

[0003] The existing AR glasses have a single function. Although multiple sound pickup modules are provided on the AR glasses to improve the quality of collecting the user's voice information, their functions are still concentrated on the user's visual experience, so the problem of single function remains unchanged.

[0004] Therefore, it is urgent for those skilled in the art to seek a method for processing sound information. Summary of the invention

[0005] The purpose of the present invention is to provide a method, device, wearable device and medium for processing sound information, so as to enrich the functions of the wearable device and enhance the user's experience of the wearable device.

[0006] In order to solve the above technical problems, the present invention provides a method for processing sound information, which is applied to a wearable device. The wearable device includes a sound pickup module. The method includes:

[0007] Get the sound information collected by the sound pickup module;

[0008] Analyzing and processing the sound information to obtain characteristic parameters corresponding to preset parameters in the preset conditions, wherein the preset conditions include at least one;

[0009] When the characteristic parameters meet the preset conditions, the corresponding processing strategy is executed according to the relationship between the characteristic parameters and the preset conditions.

[0010] Preferably, the preset parameters at least include frequency, and the sound information is analyzed and processed accordingly to obtain characteristic parameters corresponding to the preset parameters in the preset conditions, including:

[0011] The sound information is analyzed in the frequency domain to obtain the frequency corresponding to the preset parameters in the preset conditions.

[0012] Preferably, the preset condition is that the frequency is less than the lowest frequency in the audible frequency range of the human ear. When the characteristic parameter meets the preset condition, a corresponding processing strategy is executed according to the relationship between the characteristic parameter and the preset condition, including:

[0013] Determine whether the frequency is less than the lowest frequency within the audible frequency range of the human ear;

[0014] If it is less than, the sound information corresponding to the frequency is analyzed and processed to obtain the infrasound energy value;

[0015] Determine whether the infrasound energy value is within the danger threshold range;

[0016] If so, a warning message is sent through the reminder device of the wearable device to remind the user.

[0017] Preferably, the preset condition is that the frequency is the same as the frequency corresponding to the preset characteristic parameter, wherein the frequency corresponding to the preset characteristic parameter is pre-stored in the wearable device, and when the characteristic parameter meets the preset condition, the corresponding processing strategy is executed according to the relationship between the characteristic parameter and the preset condition, including:

[0018] Determine whether the frequency is the same as the frequency corresponding to the preset characteristic parameter;

[0019] If yes, the sound information corresponding to the frequency is analyzed and processed to obtain the sound wave energy value;

[0020] Sort the multiple sound wave energy values ​​from large to small, and select the target frequency corresponding to the maximum sound wave energy value to determine the target direction of the target frequency;

[0021] The sound waves are restored according to the target frequency and the corresponding target direction to realize the positioning of the corresponding sound information.

[0022] Preferably, performing sound wave restoration according to the target frequency and the corresponding target direction includes:

[0023] Determine the corresponding sound wave propagation mode according to the target frequency;

[0024] Determine the path information between the sound source object corresponding to the target frequency and the wearable device according to the sound wave propagation mode;

[0025] Sound wave restoration is performed based on the relationship between the sound wave propagation mode, path information and target direction;

[0026] The restored sound wave propagation mode and path information are displayed through the display device of the wearable device.

[0027] Preferably, issuing a warning message through a reminder device of the wearable device to remind the user includes:

[0028] Determine a current wearing state of the wearable device, where the current wearing state is a wearing state or a non-wearing state;

[0029] When the current wearing state is the wearing state, a first warning message is output through a reminder device of the wearable device;

[0030] When the current wearing state is the non-wearing state, the second warning information is output through the reminder device of the wearable device.

[0031] Preferably, after displaying the restored sound wave propagation mode and path information through the display device of the wearable device, the method further includes:

[0032] Output prompt information based on the restored sound wave propagation mode and path information to remind the user.

[0033] In order to solve the above technical problems, the present invention further provides a sound information processing device, which is applied to a wearable device. The wearable device includes a sound pickup module, including:

[0034] An acquisition module is used to acquire the sound information collected by the sound pickup module;

[0035] An analysis and processing module, used for analyzing and processing the sound information to obtain characteristic parameters corresponding to preset parameters in the preset conditions, wherein there is at least one preset condition;

[0036] The execution module is used to execute the corresponding processing strategy according to the relationship between the characteristic parameters and the preset conditions when the characteristic parameters meet the preset conditions.

[0037] In order to solve the above technical problems, the present invention further provides a wearable device, comprising:

[0038] Memory for storing computer programs;

[0039] A processor is used to implement the steps of the above-mentioned sound information processing method when executing a computer program.

[0040] In order to solve the above technical problem, the present invention also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the sound information processing method as described above are implemented.

[0041] The present invention provides a method for processing sound information, which is applied to a wearable device, wherein the wearable device includes a sound pickup module, and the method includes: obtaining sound information collected by the sound pickup module; analyzing and processing the sound information to obtain characteristic parameters corresponding to preset parameters in preset conditions, wherein there is at least one preset condition; when the characteristic parameters meet the preset conditions, executing a corresponding processing strategy according to the relationship between the characteristic parameters and the preset conditions. Setting a sound pickup module for an existing wearable device not only realizes the original single function, but also enriches the wearable device to execute a corresponding processing strategy function according to the relationship between the characteristic parameters that meet the preset conditions and the preset conditions, thereby improving the user's experience of the wearable device.

[0042] In addition, the present invention also provides a sound information processing device, a wearable device and a medium, which have the same beneficial effects as the above-mentioned sound information processing method. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] In order to more clearly illustrate the embodiments of the present invention, the following briefly introduces the drawings required for use in the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0044] Figure 1 A flowchart of a method for processing sound information provided by an embodiment of the present invention;

[0045] Figure 2 A structural diagram of a sound information processing device provided by an embodiment of the present invention;

[0046] Figure 3 A structural diagram of a wearable device provided in an embodiment of the present invention. DETAILED DESCRIPTION

[0047] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0048] The core of the present invention is to provide a method, device, wearable device and medium for processing sound information, enrich the functions of wearable devices and enhance the user's experience of wearable devices.

[0049] In order to enable those skilled in the art to better understand the scheme of the present invention, the present invention is further described in detail below in conjunction with the accompanying drawings and specific implementation methods.

[0050] It should be noted that the wearable device may include a Bluetooth headset, AR glasses, virtual reality (VR) glasses, a smart bracelet or a smart sports watch. Due to the method for processing sound information provided by the present invention, the wearable device needs to have a sound pickup module for collecting the sound of the user or the external environment. The type of the corresponding specific wearable device is not limited, as long as it can meet the requirements of collecting sound through the sound pickup module and then processing the sound information. This method can be applied to scenarios where users input the sound characteristics to be located according to their own needs to realize the location of specific sounds, and can also be applied to the location of special insects and animals, thereby presenting the scene of the sound wave propagation mode in a visual way. It can also be applied to the sound within the frequency range that is inaudible to the human ear, identifying the existing infrasound sound data, and carrying out early warning of natural disasters such as earthquakes and tsunamis.

[0051] Figure 1 A flowchart of a method for processing sound information provided by an embodiment of the present invention is applied to a wearable device, wherein the wearable device includes a sound pickup module, such as Figure 1 As shown, the method includes:

[0052] S11: Acquiring sound information collected by the sound pickup module;

[0053] Specifically, the sound pickup module is arranged inside the wearable device. In order to receive sounds from different directions, multiple sound pickup modules are arranged inside the wearable device. For example, AR glasses of wearable devices can be provided with sound pickup modules on both sides of the frame, in the middle of the frame, at the end of the frame, in the middle of the temples, etc. Different sound pickup modules collect data from different directions.

[0054] The specific position of the sound pickup module is not specifically limited. It should be noted that the sound pickup module of this embodiment is not limited to collecting sound information of fixed frequencies, but collects all sound information of the current environment, including sounds that cannot be heard by the human ear. It should be noted that the sound information collected by the sound pickup module provided by the present invention does not pass through the user's human ear, but only realizes the collection function, or only the sound information with a frequency within the audible range of the human ear enters the human ear, etc., and excludes the inaudible frequency range to ensure the health of the user.

[0055] S12: Analyze and process the sound information to obtain characteristic parameters corresponding to preset parameters in the preset conditions, wherein there is at least one preset condition;

[0056] The sound information is analyzed and processed to extract sound feature information. Correspondingly, the sound feature information is based on the sound characteristics to be collected according to the user's custom input, which includes preset parameters such as frequency, loudness, pitch, and timbre. Therefore, there is at least one preset condition, which is a preset condition for the frequency preset parameter, or a preset condition for the loudness preset parameter, etc. The preset condition can also be set in the form of a combination of multiple preset parameters. The present invention does not make specific limitations and can be set in combination with specific scenarios.

[0057] It is understandable that the sound information is not processed after being collected. In order to facilitate subsequent analysis and extraction, it needs to be denoised and amplified, and screened according to the preset parameters in the preset conditions. Sound information includes different parameters, such as length, amplitude, frequency, energy value, spectrum value, power value, etc., as well as timbre, pitch, loudness, etc. of different dimensions. Therefore, in order to better distinguish and extract, the preset parameter settings corresponding to different schemes can be single, and only the frequency parameter can be used as a preset condition.

[0058] When there are multiple preset conditions, multiple preset conditions can correspond to one preset parameter. For example, when the preset parameter is a frequency parameter, there are multiple sound feature information extracted for different frequencies, and the preset conditions satisfied correspond to multiple applicable scenarios. The frequency range audible to the human ear is 20HZ-20KHZ, and there is also a frequency range that is inaudible to the human ear. Different frequencies correspond to different recognition objects and recognition scenarios, so there are multiple preset conditions corresponding to one frequency preset parameter.

[0059] S13: When the characteristic parameter meets the preset condition, a corresponding processing strategy is executed according to the relationship between the characteristic parameter and the preset condition.

[0060] When the feature parameters meet the preset conditions, as mentioned above, the sound information corresponding to a feature parameter that meets the preset conditions can have multiple recognition scenarios or recognition objects. Therefore, when the preset conditions are met, there is not necessarily only one strategy, but multiple strategies can be targeted. Therefore, it is necessary to execute the corresponding processing strategy based on the relationship between the feature parameters and the preset conditions.

[0061] Specifically, when the characteristic parameters meet the preset conditions, different processing strategies are further determined based on the relationship between the characteristic parameters and the preset conditions. The characteristic parameters meeting the preset conditions is only a preliminary screening process. Continuing to obtain a certain parameter based on the relationship between the characteristic parameters and the preset conditions continues to determine the execution of different processing strategies.

[0062] For example, the characteristic parameters extracted from the sound information collected by the sound pickup module of the wearable device include the characteristic parameters of the sound of a certain special insect. Therefore, after preliminary screening, a certain parameter value is continued to be obtained for further positioning or reminder mechanism. The positioning strategy is not just about processing when the characteristic parameters of the sound of a special insect meet the preset conditions.

[0063] The present invention provides a method for processing sound information, which is applied to a wearable device, wherein the wearable device includes a sound pickup module, and the method includes: obtaining sound information collected by the sound pickup module; analyzing and processing the sound information to obtain characteristic parameters corresponding to preset parameters in preset conditions, wherein there is at least one preset condition; when the characteristic parameters meet the preset conditions, executing a corresponding processing strategy according to the relationship between the characteristic parameters and the preset conditions. Setting a sound pickup module for an existing wearable device not only realizes the original single function, but also enriches the wearable device to execute a corresponding processing strategy function according to the relationship between the characteristic parameters that meet the preset conditions and the preset conditions, thereby improving the user's experience of the wearable device.

[0064] On the basis of the above embodiment, the preset parameters at least include frequency, and the sound information is analyzed and processed accordingly to obtain characteristic parameters corresponding to the preset parameters in the preset conditions, including:

[0065] The sound information is analyzed in the frequency domain to obtain the frequency corresponding to the preset parameters in the preset conditions.

[0066] Specifically, the preset parameters at least include frequency, so the characteristic parameter corresponding to the preset parameters in the preset conditions obtained by analyzing and processing the sound information is frequency. The sound collected by the sound pickup module is in the time domain form, and there is a relationship between time and amplitude. The preset parameter of the embodiment of the present invention is frequency, so it is necessary to process the sound information in the time domain form in the frequency domain to obtain the frequency domain form, and there is a relationship between frequency and amplitude.

[0067] It should be noted that there is no specific limitation on the specific analysis method used in frequency domain analysis. It can be analyzed for common spectrum, energy spectrum, power spectrum, inverse spectrum, wavelet analysis, etc. Frequency domain analysis can observe signal characteristics according to frequency. Generally speaking, time domain analysis is more intuitive and frequency domain representation is more concise. Observing signals in the frequency domain makes the analysis of problems more profound and convenient. Common frequency domain characteristic parameters include centroid frequency domain, average frequency, root mean square frequency, and frequency standard deviation.

[0068] The preset parameters provided in the embodiment of the present invention at least include frequency. The sound information is analyzed in the frequency domain to obtain the frequency corresponding to the preset parameters in the preset conditions, which facilitates the feature extraction of the sound information and provides convenience for subsequent sound information extraction and frequency recognition.

[0069] On the basis of the above embodiment, the preset condition is that the frequency is less than the lowest frequency in the audible frequency range of the human ear. When the characteristic parameter meets the preset condition in step S13, the corresponding processing strategy is executed according to the relationship between the characteristic parameter and the preset condition, including:

[0070] Determine whether the frequency is less than the lowest frequency within the audible frequency range of the human ear;

[0071] If it is less than, the sound information corresponding to the frequency is analyzed and processed to obtain the infrasound energy value;

[0072] Determine whether the infrasound energy value is within the danger threshold range;

[0073] If so, a warning message is sent through the reminder device of the wearable device to remind the user.

[0074] Specifically, it is determined whether the frequency is less than the lowest frequency in the audible frequency range of the human ear. If it is less than, it is determined that the characteristic parameter meets the preset conditions. The audible frequency range of the human ear is 20HZ-20KHZ. If it is lower than the lowest frequency in the audible frequency range of the human ear, it means that the frequency is the frequency of the infrasound wave, and there is an infrasound component. It is further determined what kind of infrasound wave is the infrasound wave. In nature, sea storms, volcanic eruptions, large meteorites falling, tsunamis, lightning and thunder, waves hitting the shore, whirlpools in the water, turbulence in the air, tornadoes, magnetic storms, auroras, earthquakes, etc. may be accompanied by the occurrence of infrasound waves. In human activities, such as nuclear explosions, missile flights, artillery firing, ship sailing, car racing, high-rise buildings and bridges shaking, even blowers, mixers, loudspeakers, etc. can also generate infrasound waves while making sounds. Animals can also produce infrasound waves, for example, elephants emit infrasound waves by stepping on the ground with their feet, crocodiles emit infrasound waves by vibrating their backs on the water surface, and tigers roar with the power of infrasound waves.

[0075] Therefore, when it is determined that the frequency is the frequency of infrasound, the sound information corresponding to the frequency is analyzed and processed to obtain the infrasound energy value. Sound waves are generated by the vibration of the sound source in the air. Sound waves can transfer energy, and the energy value is obtained through the amplitude of the sound information.

[0076] It is determined whether the infrasound energy value is within the danger threshold range. If so, it means that there is dangerous infrasound in the current environment. The danger threshold range can be the infrasound energy range when a natural disaster occurs. At this time, it is necessary to send an early warning message through the reminder device of the wearable device to remind the user to move to a safe environment or escape.

[0077] In addition, the present invention does not specifically limit the content of the early warning mechanism. Reminders can be made through the inherent functions of the wearable device itself, through the display of the interface, the vibration of the vibration module, the flashing of the light or the prompt of the voice message, etc. Reminders can also be made through the wearable device and other devices associated with it.

[0078] According to the relationship between the characteristic parameters and the preset conditions, when the characteristic parameters meet the preset conditions, the infrasound energy value is further obtained through the sound information corresponding to the frequency, and it is judged whether the infrasound energy value is within the dangerous threshold range, so as to determine the corresponding processing strategy for early warning information reminder. It can be seen that after the characteristic parameters meet the preset conditions, the processing strategy of the preset conditions is not executed, but the infrasound energy value is further obtained according to the relationship between the characteristic parameters and the preset conditions for subsequent judgment, so as to execute the processing strategy of the corresponding relationship.

[0079] The preset condition provided by the embodiment of the present invention is that the frequency is less than the lowest frequency within the audible frequency range of the human ear, and whether the frequency is less than the lowest frequency within the audible frequency range of the human ear is judged; if it is, the sound information corresponding to the frequency is analyzed and processed to obtain the infrasound energy value; and whether the infrasound energy value is within the danger threshold range is judged; if so, an early warning message is issued through the reminder device of the wearable device to remind the user, so as to realize the identification of the existing infrasound sound data and implement an early warning mechanism for natural disasters.

[0080] On the basis of the above embodiment, the preset condition is that the frequency is the same as the frequency corresponding to the preset characteristic parameter, wherein the frequency corresponding to the preset characteristic parameter is pre-stored in the wearable device, and when the characteristic parameter meets the preset condition in step S13, the corresponding processing strategy is executed according to the relationship between the characteristic parameter and the preset condition, including:

[0081] Determine whether the frequency is the same as the frequency corresponding to the preset characteristic parameter;

[0082] If yes, the sound information corresponding to the frequency is analyzed and processed to obtain the sound wave energy value;

[0083] Sort the multiple sound wave energy values ​​from large to small, and select the target frequency corresponding to the maximum sound wave energy value to determine the target direction of the target frequency;

[0084] Sound wave restoration is performed according to the target frequency and the corresponding target direction to achieve the positioning of the corresponding sound information.

[0085] Specifically, it is determined whether the frequency is the same as the frequency corresponding to the preset characteristic parameter. If the frequency is the same, it is determined that the characteristic parameter meets the preset condition, indicating that there is a characteristic of the user's specific sound, and then the positioning is performed according to the sound information corresponding to the frequency. According to the relationship between the characteristic parameter and the preset condition, when it is determined that the frequency is the same as the frequency corresponding to the preset characteristic parameter, the sound information corresponding to the frequency is analyzed and processed to obtain the sound wave energy value. Since there may be multiple pickup modules in the wearable device, the sound source object of the sound information collected at the same time is the same. Since the pickup modules are located at different positions of the wearable device, they may represent different directions. Therefore, the target direction of the sound source object is determined according to the sound information, that is, at the same frequency, the other parameter values ​​of the sound information collected by the nearest pickup module are higher, so other parameter values ​​are compared.

[0086] The comparative sound wave energy values ​​selected in the embodiment of the present invention process the sound information corresponding to the frequencies that meet the preset conditions collected by different pickup modules to obtain multiple sound wave energy values, sort them, and select the target frequency corresponding to the maximum sound wave energy value, so as to determine the target direction. Similarly, the sound information corresponding to the frequencies that meet the preset conditions can also be processed to obtain the corresponding amplitudes, sorted according to the amplitudes, and the target frequency corresponding to the maximum amplitude can be selected. The target direction can also be determined based on the priority relationship between the two, the sound wave energy value and the amplitude, and then the sound wave restoration can be performed according to the frequency and the target direction to realize the positioning of the corresponding sound information.

[0087] It can be understood that according to the restoration and positioning of the frequency and target direction, the wearable device can first locate the sound source object, and then visualize its sound information, or restore it to achieve the positioning of the sound source object, which is not specifically limited in the present invention.

[0088] The embodiment of the present invention provides a method for determining whether a frequency is the same as a frequency corresponding to a preset characteristic parameter; if so, analyzing and processing the sound information corresponding to the frequency to obtain a sound wave energy value; sorting multiple sound wave energy values ​​from large to small, and selecting a target frequency corresponding to the maximum sound wave energy value to determine a target direction of the target frequency; performing sound wave restoration according to the target frequency and the corresponding target direction to achieve restoration and positioning of a specific sound.

[0089] On the basis of the above embodiment, sound wave restoration is performed according to the target frequency and the corresponding target direction, including:

[0090] Determine the corresponding sound wave propagation mode according to the target frequency;

[0091] Determine the path information between the sound source object corresponding to the target frequency and the wearable device according to the sound wave propagation mode;

[0092] Perform sound wave restoration based on the relationship between sound wave propagation mode, path information and target direction;

[0093] The restored sound wave propagation mode and path information are displayed through the display device of the wearable device.

[0094] Specifically, the corresponding sound wave propagation mode is determined according to the target frequency. When the sound wave propagates in the free sound field, the sound energy radiates on the spherical wave vibration surface. The farther away from the sound source, the larger the wave vibration surface, the less sound energy per unit area, and the sound intensity is manifested as attenuation. At the same time, sound waves usually encounter obstacles such as objects or boundaries, which will reflect part of the sound energy back. When the sound wave passes through an obstacle or a pore, the propagation direction changes and bypasses the obstacle, forming a diffraction of the wave. When the sound wave propagates in a uniform medium, the direction of propagation will not change. If there is a rigid obstacle smaller than the wavelength of the sound wave in the propagation direction, or when there is an obstacle with different elasticity and density in the medium, a part of the sound wave will deviate from the original direction, and the sound wave will be irregularly reflected, refracted or diffracted in many directions, forming a scattering of the wave. Therefore, the present embodiment does not specifically limit how to determine the corresponding sound wave propagation mode.

[0095] The path information between the corresponding sound source object and the wearable device is determined according to the sound wave propagation mode, and then restored according to the relationship between the sound wave propagation mode, path information and target direction. The algorithm used is not specifically limited, and different positioning algorithms can be used according to actual conditions.

[0096] After the sound waves are restored, the restored sound wave propagation mode and path information are displayed through a display device to provide the user with a visual positioning interface.

[0097] The embodiments of the present invention provide a method for determining the corresponding sound wave propagation mode according to the target frequency; determining the path information between the sound source object corresponding to the target frequency and the wearable device according to the sound wave propagation mode; restoring the sound wave according to the relationship between the sound wave propagation mode, the path information and the target direction; and displaying the restored sound wave propagation mode and the path information through the display device of the wearable device. The sound source object is located by restoration, and restored in a visual form, thereby enhancing the user experience.

[0098] On the basis of the above embodiment, when the infrasound energy value corresponding to the sound information is within the dangerous threshold range, a warning message is issued through a reminder device of the wearable device to remind the user, including:

[0099] Determine a current wearing state of the wearable device, where the current wearing state is a wearing state or a non-wearing state;

[0100] When the current wearing state is the wearing state, a first warning message is output through a reminder device of the wearable device;

[0101] When the current wearing state is the non-wearing state, the second warning information is output through the reminder device of the wearable device.

[0102] Specifically, the purpose of the warning information is to remind the user to evacuate to a safe place. If the user is not wearing a wearable device during sleep at night, the warning information is issued at this time. Since the user is in a sleeping state, the corresponding warning sound is small and still does not serve as a reminder. Therefore, it is necessary to determine the current wearing state of the wearable device. If the user is currently wearing a wearable device, the first warning information is output. If the user is not currently wearing a wearable device, the second warning information is output.

[0103] It should be noted that the reminder function of the second warning information is stronger than that of the first warning information, such as the output frequency and output intensity of the reminder information. The vibration intensity of the vibration module may be increased, the vibration frequency may be increased, etc., and there is no specific limitation on this, as long as the user can be reminded in time.

[0104] An embodiment of the present invention provides a method for determining a current wearing state of a wearable device, wherein the current wearing state is a wearing state or a non-wearing state; when the current wearing state is a wearing state, a first warning message is output through a reminder device of the wearable device; when the current wearing state is a non-wearing state, a second warning message is output through a reminder device of the wearable device, so as to promptly remind the user to evacuate to a safe place.

[0105] On the basis of the above embodiment, after the restored sound wave propagation mode and path information are displayed by the display device of the wearable device, the method further includes:

[0106] Output prompt information based on the restored sound wave propagation mode and path information to remind the user.

[0107] According to the restored sound wave propagation mode and path information, prompt information is output to assist the user in locating the sound source object. There is no specific limitation on the form of prompt information, which can be voice information or a prompt display on the interface of the wearable device.

[0108] The embodiment of the present invention provides a method of outputting prompt information based on the restored sound wave propagation mode and path information to remind the user and assist the user in locating the sound source object.

[0109] The above describes in detail various embodiments corresponding to the method for processing sound information. On this basis, the present invention also discloses a sound information processing device corresponding to the above method, which is applied to a wearable device. The wearable device includes a sound pickup module. Figure 2 FIG. 1 is a structural diagram of a sound information processing device provided by an embodiment of the present invention. Figure 2 As shown, the sound information processing device includes:

[0110] An acquisition module 11 is used to acquire sound information collected by the sound pickup module;

[0111] An analysis and processing module 12, configured to analyze and process the sound information to obtain characteristic parameters corresponding to preset parameters in the preset conditions, wherein the preset conditions include at least one;

[0112] The execution module 13 is used to execute a corresponding processing strategy according to the relationship between the characteristic parameters and the preset conditions when the characteristic parameters meet the preset conditions.

[0113] Since the embodiments of the device part correspond to the above embodiments, please refer to the description of the embodiments of the method part for the embodiments of the device part, and will not be repeated here.

[0114] The present invention provides a sound information processing device, which is applied to a wearable device, wherein the wearable device includes a sound pickup module, and the device includes: obtaining sound information collected by the sound pickup module; analyzing and processing the sound information to obtain characteristic parameters corresponding to preset parameters in preset conditions, wherein there is at least one preset condition; when the characteristic parameters meet the preset conditions, executing a corresponding processing strategy according to the relationship between the characteristic parameters and the preset conditions. Setting a sound pickup module for an existing wearable device not only realizes the original single function, but also enriches the wearable device to execute the corresponding processing strategy function according to the relationship between the characteristic parameters meeting the preset conditions and the preset conditions, thereby improving the user's experience of the wearable device.

[0115] Figure 3 A structural diagram of a wearable device provided by an embodiment of the present invention, such as Figure 3 As shown, the device includes:

[0116] A memory 21, used for storing computer programs;

[0117] The processor 22 is used to implement the steps of the sound information processing method when executing the computer program.

[0118] The wearable device provided in this embodiment may include but is not limited to headphones, AR glasses, VR glasses, smart bracelets or smart sports watches, etc.

[0119] Among them, the processor 22 may include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 22 can be implemented in at least one hardware form of a digital signal processor (DSP), a field-programmable gate array (FPGA), and a programmable logic array (PLA). The processor 22 may also include a main processor and a coprocessor. The main processor is a processor for processing data in the awake state, also known as a central processing unit (CPU); the coprocessor is a low-power processor for processing data in the standby state. In some embodiments, the processor 22 may be integrated with a graphics processing unit (GPU), which is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 22 may also include an artificial intelligence (AI) processor, which is used to process computing operations related to machine learning.

[0120] The memory 21 may include one or more computer-readable storage media, which may be non-transitory. The memory 21 may also include a high-speed random access memory, and a non-volatile memory, such as one or more disk storage devices, flash memory storage devices. In this embodiment, the memory 21 is at least used to store the following computer program 211, wherein, after the computer program is loaded and executed by the processor 22, it can implement the relevant steps of the sound information processing method disclosed in any of the aforementioned embodiments. In addition, the resources stored in the memory 21 may also include an operating system 212 and data 213, etc., and the storage method may be temporary storage or permanent storage. Among them, the operating system 212 may include Windows, Unix, Linux, etc. The data 213 may include but is not limited to data involved in the sound information processing method, etc.

[0121] In some embodiments, the sound information processing device may further include a display screen 23 , an input / output interface 24 , a communication interface 25 , a power supply 26 , and a communication bus 27 .

[0122] Those skilled in the art can understand that Figure 3 The structure shown in the figure does not constitute a limitation on the wearable device and may include more or fewer components than shown in the figure.

[0123] The processor 22 implements the sound information processing method provided by any of the above embodiments by calling the instructions stored in the memory 21.

[0124] The present invention provides a wearable device, the wearable device includes a sound pickup module, which obtains sound information collected by the sound pickup module; analyzes and processes the sound information to obtain characteristic parameters corresponding to preset parameters in preset conditions, wherein there is at least one preset condition; when the characteristic parameters meet the preset conditions, a corresponding processing strategy is executed according to the relationship between the characteristic parameters and the preset conditions. Setting a sound pickup module for an existing wearable device not only realizes the original single function, but also enriches the wearable device to execute the corresponding processing strategy function according to the relationship between the characteristic parameters that meet the preset conditions and the preset conditions, thereby improving the user's experience of the wearable device.

[0125] Furthermore, the present invention also provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by the processor 22, the steps of the above-mentioned sound information processing method are implemented.

[0126] It is understandable that if the method in the above embodiment is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program code.

[0127] For an introduction to a computer-readable storage medium provided by the present invention, please refer to the above method embodiment, which will not be described in detail herein. The computer-readable storage medium has the same beneficial effects as the above method for processing sound information.

[0128] The above is a detailed introduction to a method for processing sound information, a device for processing sound information, a wearable device and a medium provided by the present invention. The various embodiments in the specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same and similar parts between the embodiments can refer to each other. For the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant parts can be referred to the method part description. It should be pointed out that for ordinary technicians in this technical field, without departing from the principle of the present invention, the present invention can also be improved and modified in several ways, and these improvements and modifications also fall within the scope of protection of the claims of the present invention.

[0129] It should also be noted that, in this specification, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "comprises", "comprising" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprising a ..." does not exclude the presence of other identical elements in the process, method, article or device including the element.

Claims

1. A method for processing sound information, characterized in that: Applied to a wearable device, the wearable device includes a sound pickup module, and the method includes: Acquiring the sound information collected by the sound pickup module; Analyzing and processing the sound information to obtain characteristic parameters corresponding to preset parameters in the preset conditions, wherein the preset conditions are at least one; the preset parameters at least include frequency; When the characteristic parameter satisfies the preset condition, executing a corresponding processing strategy according to the relationship between the characteristic parameter and the preset condition; Wherein, the preset condition is that the frequency is the same as the frequency corresponding to the preset characteristic parameter, wherein the frequency corresponding to the preset characteristic parameter is pre-stored in the wearable device, and when the characteristic parameter meets the preset condition, the corresponding processing strategy is executed according to the relationship between the characteristic parameter and the preset condition, including: Determining whether the frequency is the same as the frequency corresponding to the preset characteristic parameter; If yes, the sound information corresponding to the frequency is analyzed and processed to obtain the sound wave energy value; Sort the multiple sound wave energy values ​​from large to small, and select the target frequency corresponding to the maximum sound wave energy value to determine the target direction of the target frequency; Performing sound wave restoration according to the target frequency and the corresponding target direction to achieve the positioning of the corresponding sound information; Correspondingly, performing sound wave restoration according to the target frequency and the corresponding target direction includes: Determining a corresponding sound wave propagation mode according to the target frequency; Determining path information between the sound source object corresponding to the target frequency and the wearable device according to the sound wave propagation mode; Performing sound wave restoration according to the relationship between the sound wave propagation mode, the path information and the target direction; The restored sound wave propagation mode and the path information are displayed through the display device of the wearable device.

2. The method for processing sound information according to claim 1, characterized in that: Correspondingly, the sound information is analyzed and processed to obtain characteristic parameters corresponding to the preset parameters in the preset conditions, including: The sound information is analyzed in the frequency domain to obtain the frequency corresponding to the preset parameter in the preset condition.

3. The method for processing sound information according to claim 2, characterized in that: After displaying the restored sound wave propagation mode and the path information through the display device of the wearable device, the method further includes: Output prompt information according to the restored sound wave propagation mode and the path information to remind the user.

4. A sound information processing device, characterized in that: Applied to a wearable device, the wearable device includes a sound pickup module, including: An acquisition module, used to acquire the sound information collected by the sound pickup module; An analysis and processing module, used for analyzing and processing the sound information to obtain characteristic parameters corresponding to preset parameters in preset conditions, wherein the preset conditions are at least one; the preset parameters at least include frequency; An execution module, configured to execute a corresponding processing strategy according to a relationship between the characteristic parameter and the preset condition when the characteristic parameter meets the preset condition; Wherein, the preset condition is that the frequency is the same as the frequency corresponding to the preset characteristic parameter, wherein the frequency corresponding to the preset characteristic parameter is pre-stored in the wearable device, and when the characteristic parameter meets the preset condition, the corresponding processing strategy is executed according to the relationship between the characteristic parameter and the preset condition, including: Determining whether the frequency is the same as the frequency corresponding to the preset characteristic parameter; If yes, the sound information corresponding to the frequency is analyzed and processed to obtain the sound wave energy value; Sort the multiple sound wave energy values ​​from large to small, and select the target frequency corresponding to the maximum sound wave energy value to determine the target direction of the target frequency; Performing sound wave restoration according to the target frequency and the corresponding target direction to achieve the positioning of the corresponding sound information; Correspondingly, performing sound wave restoration according to the target frequency and the corresponding target direction includes: Determining a corresponding sound wave propagation mode according to the target frequency; Determining path information between the sound source object corresponding to the target frequency and the wearable device according to the sound wave propagation mode; Performing sound wave restoration according to the relationship between the sound wave propagation mode, the path information and the target direction; The restored sound wave propagation mode and the path information are displayed through the display device of the wearable device.

5. A wearable device, characterized in that: include: Memory for storing computer programs; A processor is used to implement the steps of the sound information processing method as claimed in any one of claims 1 to 3 when executing the computer program.

6. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the method for processing sound information according to any one of claims 1 to 3 are implemented.

Images