Audio processing method, electronic equipment and storage medium

Abstract

The invention discloses an audio processing method, electronic equipment and a storage medium, and the method comprises the steps: obtaining a target audio signal in a current scene, and carrying out the sound processing of the target audio signal according to a preset corresponding relation between the scene and a sound processing strategy, and the current scene; and determining a target sound processing strategy comprising a processing mode for the at least one type of sub-audio signals, and processing the target audio signal according to the target sound processing strategy to obtain a processed audio signal. Compared with the prior art, the method and the device have the advantages that at least one type of sub-audio signals in the multiple types of sub-audio signals in the current scene can be processed in a targeted manner, so that part of audio signals can be amplified in a targeted manner, and a hearing impaired person can distinguish effective sound information in the current environment.

Description

Technical Field

[0001] The embodiments of the present application relate to audio processing technology, and relate to but are not limited to an audio processing method, an electronic device, and a storage medium. Background Art

[0002] In order to help the hearing-impaired meet their daily needs, most hearing-assistive devices currently amplify audio signals after collecting them. However, these devices only amplify the sounds indiscriminately when amplifying audio signals, which ultimately leads to increased noise and distortion in the amplified sounds. The hearing-impaired cannot distinguish the effective sound information in the current environment, resulting in missing important information or even accidents. Summary of the invention

[0003] In view of this, the audio processing method, electronic device, and storage medium provided in the embodiments of the present application can specifically amplify part of the audio signal so that the hearing-impaired can distinguish the effective sound information in the current environment.

[0004] In a first aspect, an audio processing method provided by an embodiment of the present application is applied to an electronic device, and the method comprises: obtaining a target audio signal in a current scene, the target audio signal comprising multiple types of sub-audio signals, and different types of sub-audio signals correspond to different sound-emitting objects; determining a target sound processing strategy according to a correspondence between a preset scene and a sound processing strategy, and the current scene, the sound processing strategy comprising a processing method for at least one type of sub-audio signal, the processing method comprising audio parameter adjustment and / or filtering processing, and different scenes correspond to different sound processing strategies; processing the target audio signal according to the target sound processing strategy to obtain a processed audio signal.

[0005] In the above audio processing method, after obtaining the target audio signal in the current scene, according to the correspondence between the preset scene and the sound processing strategy, and the current scene, a target sound processing strategy including a processing method for at least one type of sub-audio signal is determined, and then the target audio signal is processed according to the target sound processing strategy to obtain a processed audio signal. Compared with the prior art, the present application can perform targeted processing on at least one type of multiple types of sub-audio signals in the current scene to perform targeted amplification on part of the audio signal, so that the hearing-impaired can distinguish the effective sound information in the current environment.

[0006] In some embodiments, the current scene includes a commuting scene, the target sound processing strategy includes increasing the amplitude of background audio other than human voices, and processing the target audio signal according to the target sound processing strategy to obtain a processed audio signal includes: identifying the background audio from the target audio signal and increasing the amplitude of the background audio; and obtaining the processed audio signal based on the processed background audio and the human voice in the target audio signal.

[0007] In some embodiments, the current scene includes a dining scene, the target sound processing strategy includes filtering out background audio other than human voices, and processing the target audio signal according to the target sound processing strategy to obtain a processed audio signal includes: identifying the background audio from the target audio signal; filtering out the background audio from the target audio signal to obtain the processed audio signal.

[0008] In some embodiments, filtering out the background audio from the target audio signal includes: collecting ambient audio in the current environment; obtaining, based on the ambient audio, a cancellation audio corresponding to the ambient audio; and superimposing the cancellation audio and the target audio signal to obtain the processed audio signal.

[0009] In some embodiments, the current scene includes a purchasing scene, the target sound processing strategy includes adjusting the frequency of human voice to a preset frequency, the preset frequency being the optimal frequency of human voice that can be recognized by a user of the electronic device, and processing the target audio signal according to the target sound processing strategy to obtain a processed audio signal includes: identifying the human voice from the target audio signal, adjusting the frequency of the human voice to the preset frequency; and obtaining the processed audio signal based on the processed human voice and background audio other than the human voice in the target audio signal.

[0010] In some embodiments, identifying the human voice from the target audio signal includes: determining a target sub-audio signal whose audio features are consistent with preset semantic features from the target audio signal through semantic recognition; and using the target sub-audio signal as the audio signal corresponding to the human voice.

[0011] In some embodiments, before obtaining the target audio signal in the current scene, the method also includes: collecting target scene information, the target scene information including current environmental information and user motion status, the current environmental information including one or more of current position and current time; determining the current scene based on the correspondence between the target scene information and preset scene information and the scene.

[0012] In some embodiments, the electronic device is an audio receiving device, and the method further includes: when a communication connection is established between the audio receiving device and an audio playing device, sending the processed audio signal to the audio playing device so that the audio playing device plays the processed audio signal.

[0013] In some embodiments, the audio receiving device includes a wearable device, and the audio playing device includes a hearing aid headset.

[0014] In a second aspect, an electronic device is provided by an embodiment of the present application, and the electronic device includes: an audio signal acquisition module, used to acquire a target audio signal in a current scene, the target audio signal includes multiple types of sub-audio signals, and different types of sub-audio signals correspond to different sound-emitting objects; a processing strategy determination module, used to determine the target sound processing strategy according to the correspondence between preset scenes and sound processing strategies, and the current scene, the sound processing strategy including a processing method for at least one type of sub-audio signal, the processing method including audio parameter adjustment and / or filtering processing, and different scenes correspond to different sound processing strategies; a processing strategy execution module, used to process the target audio signal according to the target sound processing strategy to obtain a processed audio signal.

[0015] In a third aspect, a computer device provided in an embodiment of the present application includes a memory and a processor, wherein the memory stores a computer program executable on the processor, and the processor implements the method described in the embodiment of the present application when executing the program.

[0016] In a fourth aspect, the computer-readable storage medium provided in the embodiments of the present application has a computer program stored thereon, and when the computer program is executed by a processor, the method provided in the embodiments of the present application is implemented.

[0017] It should be understood that the second to fourth aspects of the embodiments of the present application are consistent with the technical solutions of the first aspect of the embodiments of the present application, and the beneficial effects achieved by each aspect and the corresponding feasible implementation methods are similar and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] The drawings herein are incorporated into the specification and constitute a part of the specification. These drawings illustrate embodiments consistent with the present application and are used together with the specification to illustrate the technical solution of the present application.

[0019] Figure 1 An exemplary structural diagram of an electronic device provided in an embodiment of the present application;

[0020] Figure 2 A flowchart of an audio processing method provided in an embodiment of the present application;

[0021] Figure 3 A flowchart of another audio processing method provided in an embodiment of the present application;

[0022] Figure 4 A flowchart of another audio processing method provided in an embodiment of the present application;

[0023] Figure 5 A schematic diagram of a scenario of an audio processing system provided in an embodiment of the present application;

[0024] Figure 6 A schematic diagram of an implementation flow of an audio processing method provided in an embodiment of the present application;

[0025] Figure 7 A schematic diagram of the structure of another electronic device provided in an embodiment of the present application;

[0026] Figure 8 A schematic diagram of the structure of a computer device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0027] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the specific technical solution of the present application will be further described in detail below in conjunction with the drawings in the embodiments of the present application. The following embodiments are used to illustrate the present application, but are not used to limit the scope of the present application.

[0028] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used herein are only for the purpose of describing the embodiments of this application and are not intended to limit this application.

[0029] In the following description, reference is made to “some embodiments”, which describe a subset of all possible embodiments, but it will be understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0030] It should be pointed out that the terms "first\second\third" involved in the embodiments of the present application are used to distinguish similar or different objects, and do not represent a specific ordering of the objects. It can be understood that "first\second\third" can be interchanged in a specific order or sequence where permitted, so that the embodiments of the present application described here can be implemented in an order other than that illustrated or described here.

[0031] The embodiment of the present application provides an audio processing method, which is applied to an electronic device, which can be various types of devices with information processing capabilities during implementation. For example, the electronic device can include a personal computer, a laptop computer, a PDA or a server, etc.; the electronic device can also be a mobile terminal, for example, the mobile terminal can include a mobile phone, a car computer, a tablet computer or a projector, etc. The function implemented by the method can be implemented by calling the program code by the processor in the electronic device, and of course the program code can be stored in a computer storage medium. It can be seen that the electronic device at least includes a processor and a storage medium.

[0032] For example, Figure 1 As shown, the electronic device 10 may include a processor 101 , an external memory interface 102 , an internal memory 103 , a universal serial bus (USB) interface 104 , a camera module 105 , a display screen 106 and buttons 107 .

[0033] It is to be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 10. In other embodiments of the present application, the electronic device 10 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0034] The processor 101 may include one or more processing units, for example: the processor 101 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller, a video codec, a digital signal processor (digital signal processor, DSP), a baseband processor, and / or a neural network processor (neural-network processing unit, NPU), etc. Among them, different processing units can be independent devices or integrated into one or more processors. Exemplarily, the processor 101 can be a smart terminal CPU, such as a Snapdragon series processor, etc. In some embodiments, the processor 101 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0035] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present application is only a schematic illustration and does not constitute a structural limitation on the electronic device 10. In other embodiments of the present application, the electronic device 10 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0036] The electronic device 10 implements the display function through a GPU, a display screen 106, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 106 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 101 may include one or more GPUs, which execute program instructions to generate or change display information. The display screen 106 is used to display images, videos, etc.

[0037] The electronic device 10 can realize the shooting function through ISP, shooting module 105, video codec, GPU, display screen 106 and application processor. ISP is used to process the data fed back by the shooting module 105. The shooting module 105 is used to capture static images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. The digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals. In some embodiments, the shooting module 105 can be a camera or a scanner.

[0038] The external memory interface 102 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 10. The external memory card communicates with the processor 101 through the external memory interface 102 to implement a data storage function, such as storing music, video and other files in the external memory card.

[0039] The internal memory 103 can be used to store computer executable program codes, which include instructions. The internal memory 103 can include a program storage area and a data storage area. The program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area can store data created during the use of the electronic device 10 (such as audio data, a phone book, etc.), etc.

[0040] The key 107 includes a power key, a volume key, etc. The key 107 can be a mechanical key or a touch key. The electronic device 10 can receive key input and generate key signal input related to user settings and function control of the electronic device 10.

[0041] In addition, the electronic device involved in the embodiments of the present application may also be installed with an operating system, and application programs may be installed and run on the operating system, which is not limited in the embodiments of the present application.

[0042] Figure 2 A flowchart of an audio processing method provided in an embodiment of the present application is shown in FIG. Figure 2 As shown, the method may include the following steps:

[0043] Step S101, obtaining a target audio signal in a current scene, where the target audio signal includes multiple types of sub-audio signals, and different types of sub-audio signals correspond to different sound objects;

[0044] Step S102, determining a target sound processing strategy according to a correspondence between a preset scene and a sound processing strategy and a current scene, wherein the sound processing strategy includes a processing method for at least one type of sub-audio signal, and the processing method includes audio parameter adjustment and / or filtering processing, and different scenes correspond to different sound processing strategies;

[0045] Step S103: Process the target audio signal according to the target sound processing strategy to obtain a processed audio signal.

[0046] It should be understood that the above-mentioned multiple types of sub-audio signals refer to audio signals of different frequencies and / or different amplitudes emitted by different sound-emitting objects, and the sound-emitting objects include but are not limited to people, vehicles or other objects that can make sounds. The electronic device can receive the audio signal corresponding to the sound-emitting object through an audio collection device such as a microphone. In the process of object 1, object 2 and object 3 making sounds at the same time, the electronic device will not only collect the audio signal of object 1, but also collect the audio signals of object 2 and object 3 at the same time. Therefore, the target audio signal will include multiple types of sub-audio signals at the same time, and different types of sub-audio signals correspond to different sound-emitting objects.

[0047] Optionally, when the above-mentioned target audio signal is obtained, the target audio signal can be firstly subjected to noise elimination, so as to avoid the noise in the target audio signal interfering with the determination process of multiple types of sub-audio signals. Taking the dining scene as an example, common equipment such as air conditioners will continuously emit the sound of blowing, but the sound itself does not have any indicative meaning, so the sound emitted by the air conditioner will form noise in the target audio signal. At this time, the target audio signal can be subjected to noise reduction processing to eliminate the sound of the air conditioner, and the process of step S102 is executed on the target audio signal after the noise is eliminated. In some embodiments, because the duration of the noise itself is long and the volume of the audio signal is low, the sub-audio signal in the target audio signal with a long duration and an amplitude value of the audio signal below the threshold can be determined as noise, and the noise is filtered out.

[0048] Optionally, the correspondence between the above scenarios and the sound processing strategies can be set by those skilled in the art according to actual conditions. For example, in a commuting scenario, background audio other than human voices needs to be highlighted, or in a purchasing scenario, human voices need to be highlighted, etc. This application does not impose any restrictions, and is based on helping users extract valid information in the scenario. In some embodiments, the above correspondence can be pre-stored in the electronic device, or can be obtained by the electronic device through downloading, which is not limited by this application.

[0049] Optionally, the current scene may be obtained by analyzing data collected by various sensors at the current location, or may be obtained by reading information indicating the current scene input by the electronic device. In some embodiments, the electronic device may be provided with a control for inputting the current scene, and the user triggers the control and inputs information indicating the current scene, so that the electronic device uses the information indicating the current scene input by the user as the current scene.

[0050] Optionally, the above method can be applied to a scene including multiple sound objects, and the sound objects that need to be paid attention to in different types of scenes are different, thereby forming a corresponding relationship between the scene and the sound processing strategy. In some embodiments, the current scene is, for example, a commuting scene, a dining scene, and / or a purchasing scene. In the commuting scene, due to safety issues, it is necessary to pay more attention to the background audio to prevent traffic accidents, such as the need to pay more attention to the sound of vehicles. In the dining scene, it is necessary to talk to people, so it is necessary to pay more attention to the human voice. In the purchasing scene, it is necessary to talk to people, so it is necessary to pay more attention to the human voice. In each scene, the volume of the sound that needs to be paid attention to in the scene can be increased, or other sounds except the sound that needs to be paid attention to can be filtered out to highlight the sound that needs to be paid attention to. The specific sound highlighting means can be set by a technician in this field according to the actual situation, such as increasing the volume of the sound that needs to be paid attention to in the scene, or filtering out other sounds except the sound that needs to be paid attention to, etc., and this application is not limited.

[0051] Optionally, if the current scene includes a commuting scene, that is, the corresponding target sound processing strategy includes increasing the amplitude of background audio other than human voice, the above step S103 may include the following steps 1 to 2:

[0052] Step 1, identifying background audio from the target audio signal and increasing the amplitude of the background audio;

[0053] Step 2: Obtain a processed audio signal according to the processed background audio and the human voice in the target audio signal.

[0054] It should be understood that the above-mentioned increase in the amplitude of the background audio is for increasing the volume of the background audio so as to highlight the background audio from the target audio signal.

[0055] Optionally, the above-mentioned method of identifying the background audio may be to determine, from the target audio signal, a sub-audio signal whose audio features are consistent with the audio features of the background audio, wherein the audio features include amplitude, frequency and duration of the audio signal.

[0056] Optionally, the above-mentioned method of identifying background audio can also be to determine the human voice audio from the target audio signal, and determine other sub-audio signals except the human voice audio as background audio. The method of identifying the human voice audio can be through semantic recognition, or the audio features of the target audio signal can be compared with the audio features of the human voice audio, and the sub-audio signal whose audio features are consistent with the audio features of the human voice audio is determined as the human voice audio.

[0057] Optionally, the processed audio signal may be obtained by directly increasing the amplitude of the background audio in the target audio signal without processing other audios, and the processed target audio signal is the processed audio signal.

[0058] Exemplarily, if the target audio signal includes audio 1, audio 2 and audio 3, where audio 2 is a human voice and audio 1 and audio 3 are background audios, then after the target audio signal is processed according to the target sound processing strategy, the volume of audio 1 and audio 3 increases, but the volume of audio 2 does not change, thereby highlighting audio 1 and audio 3 as background audios, thereby ensuring the safety of users in commuting scenarios.

[0059] It can be understood that by increasing the amplitude of background audio other than human voices in commuting scenarios, the safety of users in commuting scenarios can be ensured and traffic accidents can be prevented.

[0060] Optionally, if the current scenario includes a purchasing scenario, that is, the corresponding target sound processing strategy includes adjusting the frequency of human voice to a preset frequency, the above step S103 may include the following steps a to b:

[0061] Step a, identifying human voice from the target audio signal, and adjusting the frequency of the human voice to a preset frequency;

[0062] Step b: obtaining a processed audio signal according to the processed human voice and the background audio other than the human voice in the target audio signal.

[0063] It should be understood that the above-mentioned preset frequency is the frequency that the user can hear most clearly, and the above-mentioned adjustment of the frequency of the human voice to the preset frequency is to adjust the audio signal of the human voice part to a frequency that the user can hear more clearly, so as to highlight the human voice from the target audio signal in the user's hearing. In some embodiments, the specific value of the above-mentioned preset frequency can be set by receiving a specific frequency input by the user, or can be obtained after analysis based on the user's historical audio adjustment data, wherein the historical audio adjustment data records the user's manual adjustment of the audio playback parameters of the electronic device in the current scene, so that the user can hear the sound that needs to be heard more clearly in the current scene. For example, in the procurement scene, the user wants to hear the human voice clearly, but because all audio includes other sounds in addition to the human voice, the human voice needs to be manually adjusted to a frequency that is different from other sounds to distinguish the human voice. At this time, the electronic device can record the user's manually adjusted frequency parameters and the corresponding procurement scene scene identifier as the historical audio adjustment data corresponding to the procurement scene, so that the human voice in the procurement scene can be adjusted to the corresponding frequency according to the historical audio adjustment data.

[0064] Optionally, the above method of identifying human voice audio can be through semantic recognition, or the audio features of the target audio signal can be compared with the audio features of the human voice audio, and the sub-audio signal whose audio features are consistent with the audio features of the human voice audio can be used as the human voice audio.

[0065] Optionally, the processed audio signal may be obtained by directly adjusting the frequency of human voice to a preset frequency in the target audio signal, without processing other audios, and the target audio signal after processing is the processed audio signal.

[0066] Exemplarily, if the target audio signal includes audio 1, audio 2 and audio 3, where audio 2 is a human voice, audio 1 and audio 3 are background audio, and the audio frequency range that the user can hear most clearly in the current scenario is A1~A2, then after the target audio signal is processed according to the target sound processing strategy, audio 1 and audio 3 are not processed, but the frequency of audio 2 is adjusted from the original frequency to A1~A2, thereby highlighting audio 2 corresponding to the human voice, thereby ensuring the communication integrity of the user in the procurement scenario.

[0067] It can be understood that by adjusting the frequency of the human voice to the preset frequency in the purchasing scenario, the audio of the human voice part can be adjusted to a frequency that is easier for the user to hear, thereby ensuring the integrity of the user's communication in the purchasing scenario.

[0068] Optionally, if the current scene includes a dining scene, that is, the corresponding target sound processing strategy includes filtering out background audio except human voices, the above step S103 may include the following steps (1) to (2):

[0069] Step (1), identifying background audio from the target audio signal;

[0070] Step (2), filtering out background audio from the target audio signal to obtain a processed audio signal.

[0071] It should be understood that the above-mentioned filtering out of the background audio is to completely eliminate the background audio from the target audio signal so that only the human voice remains in the processed audio signal.

[0072] Optionally, the above-mentioned method of identifying the background audio may be to determine, from the target audio signal, a sub-audio signal whose audio features are consistent with the audio features of the background audio, wherein the audio features include amplitude, frequency and duration of the audio signal.

[0073] Optionally, the above-mentioned method of identifying background audio can also be to determine the human voice audio from the target audio signal, and determine other sub-audio signals except the human voice audio as background audio. The method of identifying the human voice audio can be through semantic recognition, or the audio features of the target audio signal can be compared with the audio features of the human voice audio, and the sub-audio signal whose audio features are consistent with the audio features of the human voice audio is determined as the human voice audio.

[0074] Exemplarily, if the target audio signal includes audio 1, audio 2 and audio 3, where audio 2 is a human voice and audio 1 and audio 3 are background audios, then after the target audio signal is processed according to the target sound processing strategy, audio 1 and audio 3 are eliminated from the target audio signal, leaving only audio 2, so that only audio 2 as a human voice is present in the target audio signal, thereby ensuring the communication integrity of the user in the dining scenario.

[0075] Optionally, the above-mentioned background audio filtering method may include: collecting ambient audio in the current environment; obtaining a cancellation audio corresponding to the ambient audio based on the ambient audio; and superimposing the cancellation audio and the target audio signal to obtain a processed audio signal.

[0076] It should be understood that the above-mentioned ambient audio refers to audio signals other than human voices, that is, the electronic device will simultaneously collect the target audio signal including the human voice and the ambient audio without the human voice, and when filtering the background audio in a dining scene, it will generate a cancellation audio based on the ambient audio, thereby superimposing the cancellation audio with the target audio signal to obtain an audio signal after eliminating the background audio.

[0077] Among them, the background audio and the ambient audio in the target audio signal coincide with each other, that is, the background audio and the ambient audio have the same amplitude and frequency, and the cancellation audio is generated by inverting the amplitude of the ambient audio, that is, the cancellation audio generated according to the ambient audio has the opposite amplitude and the same frequency as the background audio, that is, if the amplitude of the background audio is A and the frequency is B, then the amplitude of the cancellation audio is -A and the frequency is B. Therefore, when the cancellation audio is superimposed on the target audio signal, the audio signal belonging to the background audio in the target audio signal will be canceled out. After the processing is completed, only the audio signal of the human voice part remains in the target audio signal.

[0078] It can be understood that by filtering out background audio other than human voice in a dining scene, only the audio that is the human voice part can be left in the processed audio signal, thereby ensuring the integrity of the user's communication in the dining scene.

[0079] In the above audio processing method, after obtaining the target audio signal in the current scene, according to the correspondence between the preset scene and the sound processing strategy, and the current scene, a target sound processing strategy including a processing method for at least one type of sub-audio signal is determined, and then the target audio signal is processed according to the target sound processing strategy to obtain a processed audio signal. Compared with the prior art, the present application can perform targeted processing on at least one type of multiple types of sub-audio signals in the current scene to perform targeted amplification on part of the audio signal, so that the hearing-impaired can distinguish the effective sound information in the current environment.

[0080] Figure 3 FIG. 1 is a schematic diagram of another implementation flow of an audio processing method according to an embodiment of the present application. Figure 3 As shown, the method may include the following steps:

[0081] Step S201, collecting target scene information, the target scene information includes current environment information and user motion status, the current environment information includes one or more of current location and current time;

[0082] Step S202, determining the current scene according to the target scene information and the correspondence between the preset scene information and the scenes;

[0083] Step S203, obtaining a target audio signal in the current scene, where the target audio signal includes multiple types of sub-audio signals, and different types of sub-audio signals correspond to different sound objects;

[0084] Step S204, determining a target sound processing strategy according to the correspondence between the preset scene and the sound processing strategy and the current scene, wherein the sound processing strategy includes a processing method for at least one type of sub-audio signal, and the processing method includes audio parameter adjustment and / or filtering processing, and different scenes correspond to different sound processing strategies;

[0085] Step S205: Process the target audio signal according to the target sound processing strategy to obtain a processed audio signal.

[0086] It should be noted that the execution method of the above steps S203 to S205 can be consistent with the execution method of the above steps S101 to S103, which will not be repeated here.

[0087] It should be understood that the above-mentioned environmental information and user motion status are all collected by sensors of electronic devices, such as positioning sensors, motion sensors, etc.

[0088] Optionally, the correspondence between the above scene information and the scene can be pre-stored in the electronic device, and the electronic device determines the current scene corresponding to the target scene information by reading the correspondence. For example, in the commuting scene, the user will move on the commuting route during the commuting time. The specific content of the commuting time and the commuting route can be designed as needed, and this application does not impose any restrictions; in the dining scene, the user will always be in the same position and in motion during the dining time period. The dining time period can be specifically designed as needed, and this application does not impose any restrictions; in the purchasing scene, the user's position will always change, but the position change range will not exceed the preset distance range. The distance range can be specifically designed as needed, and this application does not impose any restrictions.

[0089] For example, if the electronic device detects that the user is currently on a commuting route and the current time is commuting time, the current scene is judged to be a commuting scene; if the electronic device detects that the user's position has not changed but has been in motion, and the current time is during the meal time period, the current scene is judged to be a dining scene; if the electronic device detects that the position has been changing but the range of position changes has not exceeded a preset distance range, the current scene is judged to be a purchasing scene.

[0090] In the above audio processing method, the current environment is determined by collecting environmental information and user motion status, so that the electronic device can accurately determine the current environment, and then determine the audio processing strategy according to the current environment, thereby ensuring that the user can extract effective sound information related to the current scene.

[0091] Figure 4 A flowchart of another audio processing method according to an embodiment of the present application is shown in FIG. Figure 4 As shown, the electronic device is an audio receiving device, and the method may include the following steps:

[0092] Step S301, obtaining a target audio signal in a current scene, where the target audio signal includes multiple types of sub-audio signals, and different types of sub-audio signals correspond to different sound objects;

[0093] Step S302, determining a target sound processing strategy according to a correspondence between a preset scene and a sound processing strategy and a current scene, wherein the sound processing strategy includes a processing method for at least one type of sub-audio signal, and the processing method includes audio parameter adjustment and / or filtering processing, and different scenes correspond to different sound processing strategies;

[0094] Step S303, processing the target audio signal according to the target sound processing strategy to obtain a processed audio signal;

[0095] Step S304: When a communication connection is established between the audio receiving device and the audio playing device, the processed audio signal is sent to the audio playing device, so that the audio playing device plays the processed audio signal.

[0096] It should be noted that the execution method of the above steps S301 to S303 may be consistent with the execution method of the above steps S101 to S103, which will not be repeated here.

[0097] Optionally, the above-mentioned audio playback device can be a device that can play audio, such as headphones and speakers, which is not limited in this application; the communication connection between the audio receiving device and the audio playback device can be a wired connection or a wireless connection, which is not limited in this application.

[0098] In the above audio processing method, after obtaining the processed audio signal, the processed audio signal is sent to the audio playback device so that the audio playback device plays the processed audio signal, which can ensure that the user can hear the processed audio signal in time and ensure the timely transmission of information.

[0099] The following describes an exemplary application of the embodiments of the present application in a practical application scenario.

[0100] Figure 5 A schematic diagram of a scenario of an audio processing system provided in an embodiment of the present application. Figure 5As shown, the audio processing system may include an audio receiver 50 and an audio playback device 60. The audio receiver 50 may exchange data with the audio playback device 60 after establishing a communication connection with the audio playback device 60. The communication connection may be a wired connection or a wireless connection. The audio receiver 50 may generate an audio signal processed according to a target sound processing strategy in accordance with the audio processing method provided in an embodiment of the present application, thereby outputting a selectively amplified portion of the audio, and then sending the processed audio signal to the audio playback device 60 so that the audio playback device 60 plays the processed audio signal.

[0101] It should be understood that the above-mentioned audio receiver 50 includes a first communication module, a microphone and a processor, the microphone is used to collect target audio information in the target scene, the processor is used to execute the execution process corresponding to the above-mentioned audio processing method, and the first communication module is used to send the processed audio signal to the audio playback device 60. In some embodiments, the audio receiver 50 may also include a touch screen, a positioning module and / or a motion sensor, etc., to obtain the target scene information, so as to determine the current scene according to the target scene information. The above-mentioned audio playback device 60 includes a second communication module, a speaker and a processor, the second communication module is used to receive the processed audio signal, and the processor is used to transmit the processed audio signal to the speaker for playback.

[0102] Optionally, the audio playback device 60 can be stored in the audio receiver 50, that is, the audio receiver 50 has a storage cavity inside, and the storage cavity is used to place the audio playback device 60. When the audio playback device 60 is needed, the audio playback device 60 can be taken out of the storage cavity of the audio receiver 50, and a connection between the audio playback device 60 and the audio receiver 50 is established so that the audio playback device 60 plays the processed audio signal. In some embodiments, the audio receiving device 50 can include a wearable device, a personal computer, a laptop computer, a PDA, a server or a mobile terminal, etc., wherein the wearable device can be a bracelet, a watch or smart glasses, etc., and the audio playback device 60 can include a speaker, an earphone, a Bluetooth earphone or a hearing aid earphone, etc.

[0103] For example, taking the audio receiving device 50 as a watch and the audio playing device 60 as a hearing-aid headset, the hearing-aid headset is usually stored in the watch. When the user needs to use the hearing-aid headset to hear the audio in the current environment, the user needs to take the hearing-aid headset out of the watch and wear it on the ear. After the watch obtains the processed audio signal, the watch sends the processed audio signal to the hearing-aid headset, and the hearing-aid headset plays the processed audio signal to complete the hearing assistance.

[0104] Figure 6 The following is a flow chart of the audio processing method provided in the embodiment of the present application. Figure 6As shown, this method can be applied to Figure 5 The audio processing system shown in the figure comprises the following steps:

[0105] Step S401, the audio receiver determines whether the current scene is a commuting scene, a shopping scene, or a dining scene based on information such as location, time, and user motion status;

[0106] Step S402, the audio receiver determines the type of sound that needs to be processed and the corresponding processing method according to the correspondence between the preset scene and the sound processing strategy and the current scene, for example, the background sound needs to be enhanced in the commuting scene, the background audio other than the human voice needs to be filtered out in the dining scene, and the human voice needs to be enhanced in the purchasing scene;

[0107] Step S403, the audio receiver processes the sound type according to the processing method to obtain a processed audio signal, and sends the processed audio signal to the audio playback device;

[0108] Step S404: the audio playback device receives and plays the processed audio signal.

[0109] It should be understood that although Figure 1-6 The steps in the flowchart are shown in sequence as indicated by the arrows, but these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise specified in this document, there is no strict order restriction for the execution of these steps, and these steps can be executed in other orders. Moreover, Figure 1-6 At least part of the steps may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily executed at the same time, but can be executed at different times. The execution order of these sub-steps or stages is not necessarily sequential, but can be executed in turn or alternately with other steps or at least part of the sub-steps or stages of other steps.

[0110] Based on the foregoing embodiments, an embodiment of the present application provides an electronic device, which includes the modules included and the units included in the modules, which can be implemented by a processor; of course, it can also be implemented by a specific logic circuit; in the implementation process, the processor can be a central processing unit (CPU), a microprocessor (MPU), a digital signal processor (DSP) or a field programmable gate array (FPGA), etc.

[0111] Figure 7 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application is shown in FIG. Figure 7 As shown, the electronic device includes an audio signal acquisition module 701, a processing strategy determination module 702 and a processing strategy execution module 703, wherein:

[0112] The audio signal acquisition module 701 is used to acquire a target audio signal in the current scene, where the target audio signal includes multiple types of sub-audio signals, and different types of sub-audio signals correspond to different sound objects;

[0113] A processing strategy determination module 702 is used to determine a target sound processing strategy according to a correspondence between a preset scene and a sound processing strategy and a current scene. The sound processing strategy includes a processing method for at least one type of sub-audio signal. The processing method includes audio parameter adjustment and / or filtering processing. Different scenes correspond to different sound processing strategies.

[0114] The processing strategy execution module 703 is used to process the target audio signal according to the target sound processing strategy to obtain a processed audio signal.

[0115] In some embodiments, if the current scene includes a commuting scene, the target sound processing strategy includes increasing the amplitude of background audio other than human voices, and the processing strategy execution module 703 may include:

[0116] A background processing submodule, used to identify background audio from the target audio signal and increase the amplitude of the background audio;

[0117] The first processing submodule is used to obtain a processed audio signal according to the processed background audio and the human voice in the target audio signal.

[0118] In some embodiments, if the above scene includes a dining scene, the target sound processing strategy includes filtering out background audio except for human voices, and the above processing strategy execution module 703 may include:

[0119] A background recognition submodule, used to recognize background audio from a target audio signal;

[0120] The second processing submodule is used to filter out background audio from the target audio signal to obtain a processed audio signal.

[0121] In some embodiments, the second processing submodule may include:

[0122] An ambient audio collection unit, used to collect ambient audio in the current environment;

[0123] The cancellation audio obtaining unit is used to obtain the cancellation audio corresponding to the ambient audio according to the ambient audio;

[0124] The audio superposition unit is used to superimpose the cancellation audio and the target audio signal to obtain a processed audio signal.

[0125] In some embodiments, if the current scenario includes a purchasing scenario, the target sound processing strategy includes adjusting the frequency of the human voice to a preset frequency, and the processing strategy execution module 703 may include:

[0126] A human voice recognition submodule, used to recognize human voice from the target audio signal and adjust the frequency of the human voice to a preset frequency;

[0127] The third processing submodule is used to obtain a processed audio signal according to the processed human voice and the background audio other than the human voice in the target audio signal.

[0128] In some embodiments, the above-mentioned human voice recognition submodule may include:

[0129] A semantic recognition unit, used for determining a target sub-audio signal whose audio feature is consistent with a preset semantic feature from the target audio signal through semantic recognition;

[0130] The human voice audio determination unit is used to use the target sub audio signal as the audio signal corresponding to the human voice.

[0131] In some embodiments, the electronic device may further include:

[0132] An information collection module, used to collect target scene information before acquiring the target audio signal in the current scene, the target scene information including current environment information and user motion state, the current environment information including one or more of current position and current time;

[0133] The scene determination module is used to determine the current scene according to the target scene information and the correspondence between the preset scene information and the scene.

[0134] In some embodiments, if the electronic device is an audio receiving device, the electronic device may further include:

[0135] The audio sending module is used to send the processed audio signal to the audio playing device when a communication connection is established between the audio receiving device and the audio playing device, so that the audio playing device plays the processed audio signal.

[0136] The description of the above device embodiment is similar to the description of the above method embodiment, and has similar beneficial effects as the method embodiment. For technical details not disclosed in the device embodiment of the present application, please refer to the description of the method embodiment of the present application for understanding.

[0137] It should be noted that in the embodiments of this application Figure 7The division of modules in the electronic device shown is schematic and is only a logical function division. There may be other division methods in actual implementation. In addition, each functional unit in each embodiment of the present application may be integrated into a processing unit, or may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of a software functional unit. It may also be implemented in the form of a combination of software and hardware.

[0138] It should be noted that in the embodiment of the present application, if the above method is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of the embodiment of the present application can be essentially or partly embodied in the form of a software product that contributes to the relevant technology. The computer software product is stored in a storage medium, including several instructions to enable an electronic device to execute all or part of the methods described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a U disk, a mobile hard disk, a read-only memory (ROM), a magnetic disk or an optical disk. In this way, the embodiment of the present application is not limited to any specific combination of hardware and software.

[0139] The embodiment of the present application provides a computer device, which may be a server, and its internal structure diagram may be as follows: Figure 8 As shown. The computer device includes a processor, a memory and a network interface connected through a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store data. The network interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, an audio processing method is implemented.

[0140] An embodiment of the present application provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the steps in the method provided in the above embodiment are implemented.

[0141] An embodiment of the present application provides a computer program product including instructions, which, when executed on a computer, enables the computer to execute the steps of the method provided in the above method embodiment.

[0142] Those skilled in the art will understand that Figure 8The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0143] In one embodiment, the audio processing method provided by the present application can be implemented in the form of a computer program. The computer program can be Figure 8 The computer device shown in the figure can be run on the computer device. The memory of the computer device can store various program modules constituting the electronic device. The computer program composed of various program modules enables the processor to execute the steps of the audio processing method of each embodiment of the present application described in this specification.

[0144] In one embodiment, a computer device is provided, including a memory and a processor, wherein the memory stores a computer program, and the processor implements the steps of the above audio processing method when executing the computer program.

[0145] It should be noted here that the description of the above storage medium and device embodiments is similar to the description of the above method embodiments, and has similar beneficial effects as the method embodiments. For technical details not disclosed in the storage medium, storage medium and device embodiments of this application, please refer to the description of the method embodiments of this application for understanding.

[0146] It should be understood that "one embodiment" or "an embodiment" or "some embodiments" mentioned throughout the specification means that specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present application. Therefore, "in one embodiment" or "in one embodiment" or "in some embodiments" appearing throughout the specification may not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. It should be understood that in various embodiments of the present application, the size of the sequence number of the above-mentioned processes does not mean the order of execution, and the execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present application. The above-mentioned sequence numbers of the embodiments of the present application are only for description and do not represent the advantages and disadvantages of the embodiments. The above description of each embodiment tends to emphasize the differences between the various embodiments, and the same or similar aspects can be referenced to each other. For the sake of brevity, this article will not repeat them.

[0147] The term "and / or" in this article is only a description of the association relationship of associated objects, indicating that there may be three relationships. For example, object A and / or object B can represent three situations: object A exists alone, object A and object B exist at the same time, and object B exists alone.

[0148] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0149] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. The embodiments described above are only schematic. For example, the division of the modules is only a logical function division. There may be other division methods in actual implementation, such as: multiple modules or components can be combined, or can be integrated into another system, or some features can be ignored, or not executed. In addition, the coupling, direct coupling, or communication connection between the components shown or discussed can be through some interfaces, and the indirect coupling or communication connection of devices or modules can be electrical, mechanical or other forms.

[0150] The modules described above as separate components may or may not be physically separated, and the components displayed as modules may or may not be physical modules; they may be located in one place or distributed on multiple network units; some or all of the modules may be selected according to actual needs to achieve the purpose of the present embodiment.

[0151] In addition, all functional modules in the embodiments of the present application may be integrated into one processing unit, or each module may be a separate unit, or two or more modules may be integrated into one unit; the above-mentioned integrated modules may be implemented in the form of hardware or in the form of hardware plus software functional units.

[0152] A person skilled in the art can understand that all or part of the steps of implementing the above method embodiment can be completed by hardware related to program instructions, and the aforementioned program can be stored in a computer-readable storage medium. When the program is executed, it executes the steps of the above method embodiment; and the aforementioned storage medium includes: mobile storage devices, read-only memories (ROM), magnetic disks or optical disks, etc., various media that can store program codes.

[0153] Alternatively, if the above-mentioned integrated unit of the present application is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application can essentially or in other words, the part that contributes to the relevant technology can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for enabling an electronic device to execute all or part of the methods described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as mobile storage devices, ROMs, magnetic disks, or optical disks.

[0154] The methods disclosed in several method embodiments provided in this application can be arbitrarily combined without conflict to obtain new method embodiments.

[0155] The features disclosed in several product embodiments provided in this application can be arbitrarily combined without conflict to obtain new product embodiments.

[0156] The features disclosed in several method or device embodiments provided in this application can be arbitrarily combined without conflict to obtain new method embodiments or device embodiments.

[0157] The above is only an implementation method of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. An audio processing method, characterized in that: Applied to electronic equipment, the method comprises: Acquire a target audio signal in a current scene, where the target audio signal includes multiple types of sub-audio signals, where different types of sub-audio signals correspond to different sound objects; Determining a target sound processing strategy according to a correspondence between a preset scene and a sound processing strategy and the current scene, wherein the sound processing strategy includes a processing method for at least one type of sub-audio signal, wherein the processing method includes audio parameter adjustment and / or filtering processing, and different scenes correspond to different sound processing strategies; According to the target sound processing strategy, the target audio signal is processed to obtain a processed audio signal.

2. The method according to claim 1, characterized in that The current scene includes a commuting scene, the target sound processing strategy includes increasing the amplitude of background audio other than human voice, and processing the target audio signal according to the target sound processing strategy to obtain a processed audio signal includes: identifying the background audio from the target audio signal, and increasing the amplitude of the background audio; The processed audio signal is obtained according to the processed background audio and the human voice in the target audio signal.

3. The method according to claim 1, characterized in that The current scene includes a dining scene, the target sound processing strategy includes filtering out background audio except human voices, and processing the target audio signal according to the target sound processing strategy to obtain a processed audio signal includes: identifying the background audio from the target audio signal; The background audio is filtered out from the target audio signal to obtain the processed audio signal.

4. The method according to claim 3, characterized in that The filtering out the background audio from the target audio signal comprises: Collecting ambient audio in the current environment; According to the ambient audio, obtaining a cancellation audio corresponding to the ambient audio; The cancellation audio signal and the target audio signal are superimposed to obtain the processed audio signal.

5. The method according to claim 1, characterized in that The current scene includes a purchasing scene, the target sound processing strategy includes adjusting the frequency of human voice to a preset frequency, the preset frequency being an optimal frequency of human voice recognizable by a user of the electronic device, and processing the target audio signal according to the target sound processing strategy to obtain a processed audio signal, including: Identify the human voice from the target audio signal, and adjust the frequency of the human voice to the preset frequency; The processed audio signal is obtained according to the processed human voice and the background audio other than the human voice in the target audio signal.

6. The method according to claim 5, characterized in that The identifying the human voice from the target audio signal comprises: Determining, from the target audio signal through semantic recognition, a target sub-audio signal whose audio feature is consistent with a preset semantic feature; The target sub audio signal is used as an audio signal corresponding to the human voice.

7. The method according to any one of claims 1 to 6, characterized in that: Before acquiring the target audio signal in the current scene, the method further includes: Collecting target scene information, wherein the target scene information includes current environment information and user motion status, wherein the current environment information includes one or more of current location and current time; The current scene is determined according to the target scene information and the correspondence between the preset scene information and the scenes.

8. The method according to any one of claims 1 to 6, characterized in that: The electronic device is an audio receiving device, and the method further includes: When a communication connection is established between the audio receiving device and the audio playing device, the processed audio signal is sent to the audio playing device so that the audio playing device plays the processed audio signal.

9. The method according to claim 8, characterized in that The audio receiving device includes a wearable device, and the audio playing device includes a hearing-aid headset.

10. An electronic device, characterized in that: The electronic device comprises: An audio signal acquisition module, used to acquire a target audio signal in a current scene, wherein the target audio signal includes multiple types of sub-audio signals, and different types of sub-audio signals correspond to different sound-emitting objects; A processing strategy determination module, used to determine a target sound processing strategy according to a correspondence between a preset scene and a sound processing strategy and the current scene, wherein the sound processing strategy includes a processing method for at least one type of sub-audio signal, wherein the processing method includes audio parameter adjustment and / or filtering processing, and different scenes correspond to different sound processing strategies; The processing strategy execution module is used to process the target audio signal according to the target sound processing strategy to obtain a processed audio signal.

11. A computer device comprising a memory and a processor, wherein the memory stores a computer program that can be run on the processor, characterized in that: When the processor executes the program, the steps of the method according to any one of claims 1 to 9 are implemented.

12. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 9 is implemented.

Images