Sound signal processing method and device, electronic equipment and storage medium

Abstract

The invention discloses a sound signal processing method and device, electronic equipment and a storage medium, and the method comprises the steps: carrying out the modulation and demodulation processing of a received sound wave signal, obtaining a corresponding original digital signal, carrying out the recognition processing of the original digital signal, so as to determine a first digital signal with first semantic information in the original digital signal, and carrying out the recognition processing of the first digital signal. Performing conversion processing on the first digital signal to obtain a second digital signal, first semantic information corresponding to the first digital signal being similar to second semantic information corresponding to the second digital signal, replacing the first digital signal in the original digital signal with the second digital signal to obtain a target digital signal, and outputting a sound signal corresponding to the target digital signal. By adopting the embodiment of the invention, the sound signal of the specific semantic information can be replaced, so that the user experience of using the audio equipment is improved.

Description

Technical Field

[0001] The present invention relates to the field of signal processing technology, and in particular to a sound signal processing method, device, electronic equipment and storage medium. Background Art

[0002] Headphones are a conversion unit that converts received electrical signals into audible audio signals. Headphones are popular among users because they are easy to carry and allow users to listen to audio alone without disturbing others. Nowadays, as people's quality of life continues to improve, users have higher requirements for the sound quality of headphones.

[0003] At present, many headphones are equipped with microphones to realize the call function, especially as accessories for mobile phones and other communication devices, headphones are indispensable for microphones. When the headphone microphone is used outdoors, due to the influence of wind, it will generate a lot of wind noise during the call, making it difficult for the other party to hear the call content, seriously affecting the user experience, which has given rise to headphones with noise reduction function.

[0004] In related technologies, people usually use passive noise reduction and active noise reduction (ANC) to achieve noise reduction for headphones. Among them, passive noise reduction refers to surrounding the ear or ear canal into a closed space through physical isolation, or using sound insulation materials such as silicone earplugs to block external noise. Since the noise is not processed by the noise reduction circuit chip, it can generally only block high-frequency noise, and the noise reduction effect on low-frequency noise is not obvious. Active noise reduction (ANC) refers to picking up environmental noise from the outside world through the noise reduction system, and generating reverse sound waves equal to the external noise after algorithm processing, neutralizing the noise to achieve the effect of noise reduction.

[0005] However, the noise reduction methods in the related technologies are unable to process unhealthy content or specific semantic information in the audio, thereby affecting the user's mood and reducing the user's experience of using the audio device. Summary of the invention

[0006] The purpose of the embodiments of the present invention is to provide a sound signal processing method, device, electronic device and storage medium to solve the technical problem that the audio device cannot process the content of specific semantic information in the audio.

[0007] In a first aspect, an embodiment of the present invention provides a sound signal processing method, comprising:

[0008] Performing modulation and demodulation on the received sound wave signal to obtain the corresponding original digital signal;

[0009] Performing identification processing on the original digital signal to determine a first digital signal containing first semantic information in the original digital signal;

[0010] Converting the first digital signal to obtain a second digital signal, wherein first semantic information corresponding to the first digital signal is similar to second semantic information corresponding to the second digital signal;

[0011] The first digital signal in the original digital signal is replaced by the second digital signal to obtain a target digital signal, and a sound signal corresponding to the target digital signal is output.

[0012] In a second aspect, an embodiment of the present invention provides a sound signal processing device, including:

[0013] The modulation and demodulation module is used to perform modulation and demodulation processing on the received sound wave signal to obtain the corresponding original digital signal;

[0014] An identification module, used for performing identification processing on the original digital signal to determine a first digital signal containing first semantic information in the original digital signal;

[0015] a conversion module, configured to convert the first digital signal to obtain a second digital signal, wherein first semantic information corresponding to the first digital signal is similar to second semantic information corresponding to the second digital signal;

[0016] The replacement module is used to replace the first digital signal in the original digital signal with the second digital signal to obtain a target digital signal, and output a sound signal corresponding to the target digital signal.

[0017] In a third aspect, an embodiment of the present invention provides an electronic device, comprising a processor, a memory, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of any of the above-mentioned sound signal processing methods when executing the computer program.

[0018] In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps in any of the above-mentioned sound signal processing methods are implemented.

[0019] An embodiment of the present invention provides a sound signal processing method, device, electronic device and storage medium. The method identifies and processes a received original digital signal to determine a first digital signal belonging to first semantic information, then replaces the first digital signal in the original digital signal with a second digital signal with the same semantic information and outputs a corresponding sound signal, thereby replacing the sound signal of specific semantic information, thereby improving the user experience of using an audio device. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Figure 1 It is a flow chart of a sound signal processing method provided by an embodiment of the present invention;

[0021] Figure 2 It is a schematic diagram of a flow chart of the identification process provided by an embodiment of the present invention;

[0022] Figure 3 is another flow chart of the sound signal processing method provided by an embodiment of the present invention;

[0023] Figure 4 It is a schematic diagram of a flow chart of applying the sound signal processing method provided by an embodiment of the present invention to headphones;

[0024] Figure 5 is a structural schematic diagram of a sound signal processing device provided by an embodiment of the present invention;

[0025] Figure 6 is a structural schematic diagram of an electronic device provided by an embodiment of the present invention;

[0026] Figure 7 This is another structural schematic diagram of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0027] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0028] It should be understood that the various steps described in the method embodiments of the present disclosure may be performed in different orders and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this respect.

[0029] The term "including" and its variations used herein are open inclusions, i.e., "including but not limited to". The term "based on" means "based at least in part on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". The relevant definitions of other terms will be given in the following description.

[0030] In related technologies, people usually use passive noise reduction and active noise reduction (ANC) to achieve noise reduction for headphones. Among them, passive noise reduction refers to surrounding the ear or ear canal into a closed space through physical isolation, or using sound insulation materials such as silicone earplugs to block external noise. Since the noise is not processed by the noise reduction circuit chip, it can generally only block high-frequency noise, and the noise reduction effect on low-frequency noise is not obvious. Active noise reduction (ANC) refers to picking up environmental noise from the outside world through the noise reduction system, and generating reverse sound waves equal to the external noise after algorithm processing, neutralizing the noise to achieve the effect of noise reduction.

[0031] However, the noise reduction methods in the related technologies are unable to process unhealthy content or specific semantic information in the audio, thereby affecting the user's mood and reducing the user's experience of using the audio device.

[0032] In order to solve the technical problems existing in the related art, the embodiment of the present invention provides a sound signal processing method. For details, please refer to Figure 1 , Figure 1 is a flow chart of a sound signal processing method provided by an embodiment of the present invention, the method comprising steps 101 to 104;

[0033] Step 101, performing modulation and demodulation processing on the received sound wave signal to obtain a corresponding original digital signal.

[0034] In this embodiment, the modulation and demodulation processing provided in this embodiment is a process in which a modulator and a demodulator jointly modulate and demodulate a signal. The modulation processing in this process mainly converts various received digital baseband signals into digital modulation signals (modulated signals or frequency band signals) suitable for channel transmission; the demodulation processing mainly restores the received digital modulation signals into digital baseband signals. The modulation and demodulation processing provided in this embodiment is mainly a modulation process, specifically, modulating the received sound wave signal into a digital signal that can be transmitted, so as to facilitate the transmission and processing of the digital signal.

[0035] In some embodiments, the sound signal processing method provided in this embodiment can be applied to an audio device. Therefore, the sound wave signal provided in this embodiment is mainly received by a sound wave receiver in the audio device, and then the sound wave signal can be modulated and processed by a modem in the audio device to convert the sound wave signal into a corresponding original digital signal.

[0036] Step 102: perform recognition processing on the original digital signal to determine a first digital signal containing first semantic information in the original digital signal.

[0037] In this embodiment, the noise reduction scheme in the related art is mainly to process noise. However, it is not only noise that will affect the user. There are also specific sounds corresponding to unhealthy content or content with specific semantics, which will also affect the user, resulting in affecting the user's mood and reducing the user's experience. Therefore, after receiving the original digital signal, this embodiment can identify and process the original digital signal to determine whether there is a specific sound that affects the user's experience in the sound corresponding to the original digital signal. Specifically, this embodiment defines the semantic information corresponding to the specific sound that affects the user's mood and reduces the user's experience as the first semantic information. In this way, this embodiment can identify and process the original digital signal to determine whether there is a first digital signal corresponding to the first semantic information that affects the user's mood and reduces the user's experience in the original digital signal.

[0038] Among them, the first semantic information provided by this embodiment can be semantic information such as insults, violence and terrorism involving politics, violations of laws and regulations, low quality, and immorality, or other specific semantic information that can affect different users. These specific semantic information can be added and set by users themselves. Therefore, the first semantic information provided by this embodiment is not specifically limited.

[0039] Optionally, the recognition processing process provided in this embodiment may be a speech recognition technology, which detects whether specific audio data containing the first semantic information exists in the audio data corresponding to the original digital signal through the speech recognition technology, and after detecting the existence of the specific audio data, uses the digital signal corresponding to the specific audio data as the first digital signal.

[0040] For example, when the first semantic information provided by this embodiment is the semantic information of insult, the original digital signal can be first converted into corresponding audio data, and then the audio data can be recognized by a pre-trained speech recognition model to output text data corresponding to the audio data, and then the text data can be detected according to a dictionary composed of insulting texts of the pre-constructed semantic information about insults, and after detecting the same insulting text in the dictionary, the specific audio data corresponding to the insulting text is marked and output. Then, the digital signal corresponding to the specific audio data is used as the first digital signal.

[0041] In one implementation, in order to realize the recognition and processing of the original digital signal, for details, see Figure 2 , Figure 2 is a flow chart of the identification process provided by an embodiment of the present invention, such as Figure 2 As shown, the step of performing identification processing on the original digital signal provided in this embodiment to determine the first digital signal containing the first semantic information in the original digital signal may include steps 201 to 203;

[0042] Step 201 : performing recognition processing on the original digital signal to obtain original semantic information corresponding to the original digital signal.

[0043] In this embodiment, the original digital signal can be first converted into corresponding audio data, and then the audio data can be recognized by a pre-trained speech recognition model to output text data corresponding to the audio data, and then the original semantic information corresponding to the original digital signal can be determined based on the text data.

[0044] Step 202: search the original semantic information according to the target semantic table to obtain a search result.

[0045] In this embodiment, the target semantic table provided in this embodiment is a pre-constructed semantic table that stores the correspondence between multiple semantic information, wherein the semantic information with corresponding relationships is similar, but the semantic properties of the semantic information with corresponding relationships are different. Specifically, the semantic properties provided in this embodiment refer to the semantic information represented by the positive semantic information and the negative semantic information that can be fed back to the user. Although the contents represented by these two types of semantic information are similar, they can bring different user experiences. For example, positive semantic information can be semantic information such as praise that can improve the user's experience, and negative semantic information can be semantic information such as insult that can reduce the user's experience, and no specific limitation is made here.

[0046] In this way, the original semantic information can be searched through the pre-constructed target semantic table containing the corresponding relationship to determine whether there is negative semantic information in the original semantic information, thereby generating corresponding search results. The search results can be the results of the presence of negative semantic information or the results of the absence of negative semantic information.

[0047] Step 203: When the search result indicates that the original semantic information contains the first semantic information, determine a first digital signal containing the first semantic information in the original digital signal.

[0048] In this embodiment, negative semantic information is defined as the first semantic information. Therefore, when the search result indicates the presence of negative semantic information, that is, the presence of the first semantic information, it can be determined that the original digital signal contains semantic information that will reduce the user experience. Then, the digital signal corresponding to the first semantic information is determined as the first digital signal that will reduce the user experience.

[0049] In another embodiment, in order to improve the recognition and processing efficiency of the original digital signal, the step of performing recognition and processing on the original digital signal provided in this embodiment to determine the first digital signal containing the first semantic information in the original digital signal can be: calling the trained recognition model to perform recognition and processing on the original digital signal to output the first digital signal containing the first semantic information of a specific nature in the original digital signal.

[0050] In this embodiment, the preset recognition model to be trained can be trained directly according to multiple groups of training data consisting of training digital signals and first digital signals corresponding to specific properties in the training digital signals, using the training digital signals as the input of the model and the first digital signals as the output of the model until the recognition model converges, thereby obtaining the trained recognition model provided in this embodiment. In this way, the trained recognition model can be directly used in the audio device, so that the original digital signal in the audio device can be recognized in real time, so as to quickly and accurately output the first digital signal of the first semantic information belonging to the characteristic property content in the original digital signal.

[0051] Among them, content of a specific nature may be content corresponding to negative semantic information, such as insults, violence, terrorism, politics, violations of laws and regulations, low quality, and immorality.

[0052] In some embodiments, the method of training the preset recognition model to be trained until the recognition model converges can be: training the preset recognition model to be trained until the preset number of training times is reached, and then determining that the recognition model converges. Among them, the preset number of training times provided in this embodiment can be 50,000 times, or 100,000 times, etc., which is not specifically limited here.

[0053] In other embodiments, the method of training the preset recognition model to be trained until the recognition model converges may also be: training the preset recognition model to be trained, and detecting the accuracy of the training result, and determining that the recognition model converges when the accuracy of the training result reaches a preset value. The preset value provided in this embodiment may be 90%, or 95%, etc., which is not specifically limited here.

[0054] Specifically, the recognition model provided in this embodiment can be a lightweight model such as SqueezeNet, MobileNet, ShuffleNet, Xception, etc., so that it can be easily deployed in audio devices, reduce the amount of calculation required for signal processing by the audio device, and improve the signal processing efficiency of the audio device.

[0055] Step 103: convert the first digital signal to obtain a second digital signal.

[0056] In some embodiments, the step of converting the first digital signal to obtain the second digital signal provided in this embodiment may be: determining the second semantic information corresponding to the first semantic information according to the target semantic table, the first semantic information is negative semantic information, and the second semantic information is positive semantic information; converting the first digital signal to the second digital signal, the second digital signal is a digital signal corresponding to the second semantic information.

[0057] Among them, the first semantic information corresponding to the first digital signal is similar to the second semantic information corresponding to the second digital signal. This embodiment mainly converts the semantic properties of the semantic information corresponding to the digital signal, so as to convert the negative digital signal (first digital signal) corresponding to the semantic information that will reduce the user's experience into a positive digital signal (second digital signal) corresponding to the implied information that can improve the user's experience, but does not change the content expressed by the semantic information corresponding to the digital signal, so as not to affect the user's normal reception of the sound signal, and can also ensure that the user is in a good mood when using the audio device, thereby improving the user's experience.

[0058] In this embodiment, the target semantic table provided in this embodiment stores the correspondence between different first digital signals and corresponding second digital signals. The correspondence may be pre-set during the manufacturing process of the audio device or may be a correspondence added by the user before use.

[0059] As an optional embodiment, in order to further improve the user experience, before the step of converting the first digital signal into the second digital signal provided in this embodiment, the sound signal processing method provided in this embodiment may also include: determining the target sound type.

[0060] Among them, this embodiment can pre-set a sound type library, and the sound type library stores a plurality of sound types corresponding to different timbres. Therefore, the target sound type provided by this embodiment can be one of the sound types corresponding to the plurality of preset timbres.

[0061] It should be noted that the sound types included in the sound type library provided in this embodiment can be pre-set during the manufacturing process of the audio device, or can be added by the user according to his or her preferences. In this way, personalized audio devices can be provided to users, further improving the user experience of using the audio device.

[0062] In some embodiments, after selecting the target sound type determined by the user, the step of converting the first digital signal to the second digital signal provided in this embodiment can be: converting the first digital signal to the second digital signal of the target sound type. In this way, the user's experience of using the audio device can be further improved.

[0063] It should be noted that this embodiment is not limited to setting only the sound type corresponding to the second digital signal as the target sound type. Digital signals other than the second digital signal in the original digital signal can also be set as the target sound type. Specific digital signals in the original digital signal can also be selected to set the target sound type for the specific digital signal, and so on. No specific limitation is made here.

[0064] Step 104: Replace the first digital signal in the original digital signal with the second digital signal to obtain a target digital signal, and output a sound signal corresponding to the target digital signal.

[0065] In this embodiment, after obtaining the second digital signal, the second digital signal can be used to replace the first digital signal in the original digital signal to obtain the target digital signal, and then the target digital signal is modulated and demodulated to output a modulated and demodulated sound signal.

[0066] The modulation and demodulation processing provided in this embodiment mainly demodulates the target digital signal, and specifically converts the target digital signal into a sound signal recognizable by the human ear.

[0067] As an optional embodiment, the sound signal processing method provided in this embodiment can also be applied to private application scenarios such as headphones or car speakers. Specifically, in this private application scenario, please refer to Figure 3 , Figure 3 is another flow chart of the sound signal processing method provided by an embodiment of the present invention. Figure 3 As shown, before the step of performing recognition processing on the original digital signal provided in the present embodiment to determine the first digital signal containing the first semantic information in the original digital signal, the sound signal processing method provided in the present embodiment may further include steps 301 to 303;

[0068] Step 301: When it is detected that the user is wearing headphones, the microphone unit in the headphones is controlled to collect ambient noise from the external environment.

[0069] Among them, the microphone unit in the headset can collect low-frequency noise in the environment that can be heard by the ear, such as noise of 100-3000Hz, or noise of other frequencies, which is not limited here.

[0070] Step 302: Generate a reverse sound wave signal equal to the ambient noise according to the ambient noise.

[0071] In this embodiment, a preset sound wave generation algorithm may be used to generate a reverse sound wave signal with a phase opposite to that of the ambient noise and the same amplitude, so as to be used to cancel the ambient noise later.

[0072] Step 303: Add the reverse sound wave signal to the original digital signal to offset the environmental noise in the original digital signal.

[0073] By adding the reverse sound wave signal to the original data signal and then playing it through the speaker, the ambient noise can be offset by the reverse sound wave signal, achieving the purpose of active noise reduction for the headphones, and further improving the user experience.

[0074] In order to better illustrate the sound signal processing method provided by the embodiment of the present invention, this embodiment is described by taking the earphone application scenario as an example.

[0075] See also Figure 4 , Figure 4 FIG. 1 is a flow chart of the sound signal processing method provided by an embodiment of the present invention applied to headphones. Figure 4 As shown, first, when the sound wave signal is transmitted to the earphone, part of the external noise can be isolated through the passive noise reduction method of the earphone itself, and then the sound wave signal is received by the sound wave receiver of the earphone, and the sound wave signal is converted into a digital signal through the modem. At this time, the digital signal can be actively reduced to offset the low-frequency noise in the environment and achieve further noise reduction purpose.

[0076] After completing the active noise reduction, the user can choose whether to turn on the recognition model to process the digital signal of semantic information of specific nature in the digital signal, such as the digital signal of abusive semantic information.

[0077] If the user chooses not to turn on the recognition model, the digital signal after active noise reduction is directly converted into a sound signal through the modem, and then the sound signal is output.

[0078] If the user chooses to turn on the recognition model, the digital signal after active noise reduction is recognized by the recognition model to identify the first digital signal of semantic information belonging to a specific nature of content. After that, a query can be performed in the preset target semantic table to find the second signal corresponding to the first digital signal, and the first digital signal can be converted into the second digital signal.

[0079] Afterwards, the target sound type that the user likes can be selected as the sound type of the second digital signal according to the user's preference, so that the target digital signal containing the second digital signal can be converted into a sound signal through the modem and then output.

[0080] In summary, an embodiment of the present invention provides a method for processing a sound signal, the method comprising performing modulation and demodulation processing on a received sound wave signal to obtain a corresponding original digital signal, performing recognition processing on the original digital signal to determine that a first digital signal having first semantic information exists in the original digital signal, performing conversion processing on the first digital signal to obtain a second digital signal, the first semantic information corresponding to the first digital signal is similar to the second semantic information corresponding to the second digital signal, replacing the first digital signal in the original digital signal with the second digital signal to obtain a target digital signal, and outputting a sound signal corresponding to the target digital signal. By adopting an embodiment of the present invention, a sound signal of specific semantic information can be replaced, thereby improving the user experience of using an audio device.

[0081] According to the method described in the above embodiment, this embodiment will be further described from the perspective of a sound signal processing device, which can be implemented as an independent entity or integrated into an electronic device, such as a terminal, which can include a mobile phone, a tablet computer, etc.

[0082] See also Figure 5 , Figure 5 is a structural diagram of a sound signal processing device provided by an embodiment of the present invention, such as Figure 5 As shown, the sound signal processing device 500 provided in the embodiment of the present invention includes: a modulation and demodulation module 501, a recognition module 502, a conversion module 503, and a replacement module 504;

[0083] The acquisition module 501 is used to perform modulation and demodulation processing on the received sound wave signal to obtain the corresponding original digital signal.

[0084] The identification module 502 is used to perform identification processing on the original digital signal to determine a first digital signal containing first semantic information in the original digital signal.

[0085] The conversion module 503 is used to convert the first digital signal to obtain a second digital signal, and the first semantic information corresponding to the first digital signal is similar to the second semantic information corresponding to the second digital signal.

[0086] The replacement module 504 is used to replace the first digital signal in the original digital signal with the second digital signal to obtain a target digital signal, and output a sound signal corresponding to the target digital signal.

[0087] In some embodiments, the identification module 502 provided in this embodiment includes: an identification unit, a retrieval unit, and a first determination unit;

[0088] Among them, the identification unit is used to identify and process the original digital signal to obtain the original semantic information corresponding to the original digital signal; the retrieval unit is used to retrieve the original semantic information according to the target semantic table to obtain the retrieval result; the first determination unit is used to determine the first digital signal containing the first semantic information in the original digital signal when the retrieval result indicates that the original semantic information contains the first semantic information.

[0089] In some embodiments, the conversion module 503 provided in this embodiment includes: a second determination unit and a conversion unit;

[0090] Among them, the second determination unit is used to determine the second semantic information corresponding to the first semantic information according to the target semantic table, the first semantic information is negative semantic information, and the second semantic information is positive semantic information; the conversion unit is used to convert the first digital signal into the second digital signal, and the second digital signal is a digital signal corresponding to the second semantic information.

[0091] In some embodiments, the conversion module 503 provided in this embodiment further includes: a third determination unit;

[0092] Wherein, the third determination unit is used to determine the target sound type.

[0093] In this embodiment, the conversion module 503 provided in this embodiment is specifically used to convert the first digital signal into a second digital signal of the target sound type.

[0094] In some embodiments, the recognition module 502 provided in this embodiment is specifically used to: call the trained recognition model to perform recognition processing on the original digital signal to output a first digital signal containing first semantic information of specific nature in the original digital signal.

[0095] In some embodiments, the sound signal processing device provided in this embodiment may further include: a control module, a generation module and an addition module

[0096] The control module is used to control the microphone unit in the earphone to collect ambient noise from the external environment when it is detected that the user is wearing earphones.

[0097] The generating module is used to generate a reverse sound wave signal equal to the environmental noise according to the environmental noise.

[0098] The adding module is used for adding the reverse sound wave signal to the original digital signal to offset the environmental noise existing in the original digital signal.

[0099] During specific implementation, the above modules and / or units can be implemented as independent entities, or can be arbitrarily combined to be implemented as the same or several entities. The specific implementation of the above modules and / or units can refer to the previous method embodiments. The specific beneficial effects that can be achieved can also refer to the beneficial effects in the previous method embodiments, which will not be repeated here.

[0100] Also, see Figure 6 , Figure 6 1 is a schematic diagram of a structure of an electronic device provided by an embodiment of the present invention, and the electronic device may be a mobile terminal such as a smart phone, a tablet computer, or the like. Figure 6 As shown, the electronic device 600 includes a processor 601 and a memory 602. The processor 601 is electrically connected to the memory 602.

[0101] The processor 601 is the control center of the electronic device 600. It uses various interfaces and lines to connect various parts of the entire electronic device. It executes various functions of the electronic device 600 and processes data by running or loading applications stored in the memory 602 and calling data stored in the memory 602, thereby monitoring the electronic device 600 as a whole.

[0102] In this embodiment, the processor 601 in the electronic device 600 will load the instructions corresponding to the processes of one or more applications into the memory 602 according to the following steps, and the processor 601 will run the application stored in the memory 602, thereby implementing any step in the sound signal processing method provided in the above embodiment.

[0103] The electronic device 600 can implement the steps in any embodiment of the sound signal processing method provided in the embodiments of the present invention, and therefore can achieve the beneficial effects that can be achieved by any sound signal processing method provided in the embodiments of the present invention. For details, please refer to the previous embodiments and will not be repeated here.

[0104] See also Figure 7 , Figure 7 is another structural schematic diagram of an electronic device provided by an embodiment of the present invention, such as Figure 7 As shown, Figure 7 The electronic device 700 is a block diagram of a specific structure of an electronic device provided by an embodiment of the present invention, and the electronic device can be used to implement the sound signal processing method provided in the above embodiment. The electronic device 700 can be a mobile terminal such as a smart phone or a laptop computer.

[0105] The RF circuit 710 is used to receive and send electromagnetic waves, realize the mutual conversion between electromagnetic waves and electrical signals, and thus communicate with a communication network or other devices. The RF circuit 710 may include various existing circuit elements for performing these functions, such as antennas, radio frequency transceivers, digital signal processors, encryption / decryption chips, user identity module (SIM) cards, memories, etc. The RF circuit 710 can communicate with various networks such as the Internet, corporate intranets, wireless networks, or communicate with other devices through wireless networks. The above-mentioned wireless networks may include cellular telephone networks, wireless local area networks, or metropolitan area networks. The above-mentioned wireless networks can use various communication standards, protocols and technologies, including but not limited to Global System for Mobile Communication (GSM), Enhanced Data GSM Environment (EDGE), Wideband Code Division Multiple Access (WCDMA), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Wireless Fidelity (Wi-Fi) (such as Institute of Electrical and Electronics Engineers standards IEEE 802.11a, IEEE 802.11b, IEEE802.11g and / or IEEE802.11n), Voice over Internet Protocol (VoIP), Worldwide Interoperability for Microwave Access (Wi-Max), other protocols for email, instant messaging and short messages, and any other suitable communication protocols, even those that have not yet been developed.

[0106] The memory 720 can be used to store software programs and modules, such as program instructions / modules corresponding to the sound signal processing method in the above-mentioned embodiment. The processor 780 executes various functional applications and the sound signal processing method by running the software programs and modules stored in the memory 720.

[0107] The memory 720 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 720 may further include a memory remotely arranged relative to the processor 780, and these remote memories may be connected to the electronic device 700 via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0108] The input unit 730 can be used to receive input digital or character information, and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control. Specifically, the input unit 730 may include a touch-sensitive surface 731 and other input devices 732. The touch-sensitive surface 731, also known as a touch display screen or touch pad, can collect user touch operations on or near it (such as operations performed by users using fingers, styluses, or any other suitable objects or accessories on or near the touch-sensitive surface 731), and drive corresponding connection devices according to a pre-set program. Optionally, the touch-sensitive surface 731 may include a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into touch point coordinates, and then sends it to the processor 780, and can receive and execute commands sent by the processor 780. In addition, the touch-sensitive surface 731 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch-sensitive surface 731, the input unit 730 may further include other input devices 732. Specifically, the other input devices 732 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like.

[0109] The display unit 740 can be used to display information input by the user or information provided to the user and various graphical user interfaces of the electronic device 700, which can be composed of graphics, text, icons, videos and any combination thereof. The display unit 740 may include a display panel 741, and optionally, the display panel 741 may be configured in the form of LCD (Liquid Crystal Display), OLED (Organic Light-Emitting Diode), etc. Further, the touch-sensitive surface 731 may cover the display panel 741, and when the touch-sensitive surface 731 detects a touch operation on or near it, it is transmitted to the processor 780 to determine the type of the touch event, and then the processor 780 provides corresponding visual output on the display panel 741 according to the type of the touch event. Although in the figure, the touch-sensitive surface 731 and the display panel 741 are implemented as two independent components to implement input and output functions, in some embodiments, the touch-sensitive surface 731 and the display panel 741 can be integrated to implement input and output functions.

[0110] The electronic device 700 may also include at least one sensor 750, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 741 according to the brightness of the ambient light, and the proximity sensor may generate an interrupt when the flip cover is closed or closed. As a type of motion sensor, the gravity acceleration sensor can detect the magnitude of acceleration in each direction (generally three axes), and can detect the magnitude and direction of gravity when stationary, which can be used for applications that identify the posture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for other sensors such as gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc. that can also be configured in the electronic device 700, they will not be repeated here.

[0111] The audio circuit 760, the speaker 761, and the microphone 762 can provide an audio interface between the user and the electronic device 700. The audio circuit 760 can transmit the electrical signal converted from the received audio data to the speaker 761, which is converted into a sound signal for output; on the other hand, the microphone 762 converts the collected sound signal into an electrical signal, which is received by the audio circuit 760 and converted into audio data, and then the audio data is output to the processor 780 for processing, and then sent to another terminal through the RF circuit 710, or the audio data is output to the memory 720 for further processing. The audio circuit 760 may also include an earplug jack to provide communication between an external headset and the electronic device 700.

[0112] The electronic device 700 can help the user receive requests, send information, etc. through the transmission module 770 (such as a Wi-Fi module), which provides the user with wireless broadband Internet access. Although the transmission module 770 is shown in the figure, it is understandable that it is not a necessary component of the electronic device 700 and can be omitted as needed without changing the essence of the invention.

[0113] The processor 780 is the control center of the electronic device 700. It uses various interfaces and lines to connect various parts of the entire mobile phone. By running or executing software programs and / or modules stored in the memory 720, and calling data stored in the memory 720, it executes various functions of the electronic device 700 and processes data, thereby monitoring the electronic device as a whole. Optionally, the processor 780 may include one or more processing cores; in some embodiments, the processor 780 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, etc., and the modem processor mainly processes wireless communications. It can be understood that the above-mentioned modem processor may not be integrated into the processor 780.

[0114] The electronic device 700 also includes a power supply 790 (such as a battery) for supplying power to various components. In some embodiments, the power supply can be logically connected to the processor 780 through a power management system, so that the power management system can manage charging, discharging, and power consumption management. The power supply 790 can also include any components such as one or more DC or AC power supplies, recharging systems, power failure detection circuits, power converters or inverters, and power status indicators.

[0115] Although not shown, the electronic device 700 also includes a camera (such as a front camera, a rear camera), a Bluetooth module, etc., which will not be described in detail here. Specifically in this embodiment, the display unit of the electronic device is a touch screen display, and the mobile terminal also includes a memory, and one or more programs, wherein one or more programs are stored in the memory, and are configured to be executed by one or more processors to implement any step in the sound signal processing method provided in the above embodiment.

[0116] In specific implementation, the above modules can be implemented as independent entities, or can be arbitrarily combined and implemented as the same or several entities. The specific implementation of the above modules can be found in the previous method embodiments, which will not be repeated here.

[0117] Those skilled in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructions, or by controlling related hardware through instructions, and the instructions can be stored in a computer-readable storage medium and loaded and executed by a processor. To this end, an embodiment of the present invention provides a storage medium, which stores multiple instructions, and the instructions can be executed by the processor to implement any step of the sound signal processing method provided in the above embodiments.

[0118] The storage medium may include: a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0119] Since the instructions stored in the storage medium can execute the steps in any embodiment of the sound signal processing method provided in the embodiments of the present invention, the beneficial effects that can be achieved by any sound signal processing method provided in the embodiments of the present invention can be achieved. Please refer to the previous embodiments for details and will not be repeated here.

[0120] The above is a detailed introduction to a sound signal processing method, device, electronic device and storage medium provided in the embodiments of the present application. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method and its core idea of ​​the present application. At the same time, for those skilled in the art, according to the idea of ​​the present application, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present application. Moreover, for those of ordinary skill in the art, without departing from the principles of the present invention, several improvements and modifications can be made, and these improvements and modifications are also regarded as the protection scope of the present invention.

Claims

1. A sound signal processing method, characterized in that: include: Performing modulation and demodulation on the received sound wave signal to obtain the corresponding original digital signal; Performing identification processing on the original digital signal to determine a first digital signal containing first semantic information in the original digital signal; Converting the first digital signal to obtain a second digital signal, wherein first semantic information corresponding to the first digital signal is similar to second semantic information corresponding to the second digital signal; The first digital signal in the original digital signal is replaced by the second digital signal to obtain a target digital signal, and a sound signal corresponding to the target digital signal is output.

2. The method according to claim 1, characterized in that The identifying process of the original digital signal to determine a first digital signal containing first semantic information in the original digital signal includes: Performing recognition processing on the original digital signal to obtain original semantic information corresponding to the original digital signal; Retrieving the original semantic information according to the target semantic table to obtain a retrieval result; In a case where the search result indicates that the original semantic information contains the first semantic information, it is determined that the original digital signal contains the first digital signal containing the first semantic information.

3. The method according to claim 2, characterized in that The converting and processing the first digital signal to obtain a second digital signal includes: Determining, according to the target semantic table, second semantic information corresponding to the first semantic information, wherein the first semantic information is negative semantic information and the second semantic information is positive semantic information; The first digital signal is converted into a second digital signal, where the second digital signal is a digital signal corresponding to the second semantic information.

4. The method according to claim 3, characterized in that Before the step of converting the first digital signal into a second digital signal, the method further includes: Identify the target sound type; The converting the first digital signal into a second digital signal accordingly comprises: The first digital signal is converted into a second digital signal of the target sound type.

5. The method according to claim 1, characterized in that The identifying process of the original digital signal to determine a first digital signal containing first semantic information in the original digital signal includes: The trained recognition model is called to perform recognition processing on the original digital signal to output a first digital signal containing first semantic information of specific nature in the original digital signal.

6. The method according to claim 1, characterized in that Before the step of performing identification processing on the original digital signal to determine the first digital signal containing the first semantic information in the original digital signal, the method further includes: When it is detected that the user is wearing headphones, controlling the microphone unit in the headphones to collect ambient noise from the external environment; According to the environmental noise, generating a reverse sound wave signal equal to the environmental noise; The reverse sound wave signal is added to the original digital signal to cancel the environmental noise existing in the original digital signal.

7. A sound signal processing device, characterized in that: include: The modulation and demodulation module is used to perform modulation and demodulation processing on the received sound wave signal to obtain the corresponding original digital signal; An identification module, used for performing identification processing on the original digital signal to determine a first digital signal containing first semantic information in the original digital signal; a conversion module, configured to convert the first digital signal to obtain a second digital signal, wherein first semantic information corresponding to the first digital signal is similar to second semantic information corresponding to the second digital signal; The replacement module is used to replace the first digital signal in the original digital signal with the second digital signal to obtain a target digital signal, and output a sound signal corresponding to the target digital signal.

8. The device according to claim 7, characterized in that The identification module includes: an identification unit, a retrieval unit and a first determination unit; The recognition unit is used to perform recognition processing on the original digital signal to obtain original semantic information corresponding to the original digital signal; The retrieval unit is used to retrieve the original semantic information according to the target semantic table to obtain a retrieval result; The first determining unit is configured to determine that the first digital signal containing the first semantic information exists in the original digital signal when the search result indicates that the first semantic information exists in the original semantic information.

9. An electronic device, characterized in that: The electronic device comprises a processor, a memory, and a computer program stored in the memory and executable on the processor, and the processor implements the steps in the method according to any one of claims 1 to 6 when executing the computer program.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps in the method according to any one of claims 1 to 6 are implemented.

Images