Audio processing method and device, storage medium and electronic equipment

Abstract

The embodiment of the invention discloses an audio processing method and device, a storage medium and electronic equipment. An effect setting interface corresponding to a voice changing effect plug-in is displayed in an audio processing application in response to a selection operation on the voice changing effect plug-in, the voice changing effect plug-in is configured with a plurality of voice changing effect files for realizing different voice changing effects, and each voice changing effect file is configured to correspond to an indication parameter value; obtaining a target indication parameter value input through the effect setting interface; in the voice changing effect files, determining a target voice changing effect file indicated by the target indication parameter value; and generating a target audio with a voice changing effect corresponding to the target voice changing effect file through the voice changing effect plug-in and the target voice changing effect file. Therefore, various voice changing effects can be flexibly, conveniently and efficiently realized through one voice changing effect plug-in, and the audio processing efficiency is effectively improved.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to an audio processing method, device, storage medium, and electronic device. Background Art

[0002] With the development of gaming applications, virtual characters in games often require different timbres. Existing audio processing methods based on game audio design usually perform voice effects processing in some audio design applications, and then use third-party audio plug-ins to achieve voice changing effects.

[0003] In the process of research and practice of existing technologies, it was found that in existing audio processing methods, achieving a voice changing effect often requires superimposing multiple effector plug-ins, which occupies more processing resources and makes the audio processing efficiency poor. Summary of the Invention

[0004] The embodiments of the present application provide an audio processing method, device, storage medium and electronic device, which can flexibly, conveniently and efficiently realize multiple voice changing effects through a voice changing effect plug-in without occupying a large amount of processing resources, thereby effectively improving audio processing efficiency.

[0005] The present invention provides an audio processing method, including:

[0006] In response to a selection operation of a voice changing effect plug-in, an effect setting interface corresponding to the voice changing effect plug-in is displayed in the audio processing application, wherein the voice changing effect plug-in is configured with a plurality of voice changing effect files for implementing different voice changing effects, and each voice changing effect file is configured to correspond to an indication parameter value;

[0007] Obtaining a target indication parameter value input through the effect setting interface;

[0008] Determining, in the voice changing effect file, a target voice changing effect file indicated by the target indication parameter value;

[0009] A target audio with the voice changing effect corresponding to the target voice changing effect file is generated through the voice changing effect plug-in and the target voice changing effect file.

[0010] Accordingly, an embodiment of the present application provides an audio processing device, comprising:

[0011] A selection unit is configured to, in response to a selection operation on a voice changing effect plug-in, display an effect setting interface corresponding to the voice changing effect plug-in in the audio processing application, wherein the voice changing effect plug-in is configured with a plurality of voice changing effect files for implementing different voice changing effects, and each voice changing effect file is configured to correspond to an indication parameter value;

[0012] an acquiring unit, configured to acquire a target indication parameter value input through the effect setting interface;

[0013] A determining unit, configured to determine, from the voice changing effect file, a target voice changing effect file indicated by the target indication parameter value;

[0014] The generating unit is used to generate a target audio with the voice changing effect corresponding to the target voice changing effect file through the voice changing effect plug-in and the target voice changing effect file.

[0015] In addition, an embodiment of the present application further provides a computer-readable storage medium, which stores a computer program. The computer program is suitable for loading by a processor to execute the steps in any audio processing method provided in the embodiment of the present application.

[0016] In addition, an embodiment of the present application also provides an electronic device, including a processor and a memory, wherein the memory stores an application program, and the processor is configured to run the application program in the memory to implement the audio processing method provided in the embodiment of the present application.

[0017] An embodiment of the present application also provides a computer program product, which includes a computer program, and the computer program is stored in a computer-readable storage medium; when a processor of an electronic device reads the computer program from the computer-readable storage medium, the processor executes the computer program, so that the electronic device performs the steps in the audio processing method provided in the embodiment of the present application.

[0018] In an embodiment of the present application, in response to a selection operation on a voice changing effect plug-in, an effect setting interface corresponding to the voice changing effect plug-in is displayed in an audio processing application. The voice changing effect plug-in is configured with multiple voice changing effect files for implementing different voice changing effects, and each voice changing effect file is configured to correspond to an indication parameter value; a target indication parameter value input through the effect setting interface is obtained; in the voice changing effect file, a target voice changing effect file indicated by the target indication parameter value is determined; and a target audio having a voice changing effect corresponding to the target voice changing effect file is generated through the voice changing effect plug-in and the target voice changing effect file. In this way, by deploying a voice changing effect plug-in configured with multiple voice changing effects in an audio processing application, and the voice changing effect file corresponding to each voice changing effect is configured to correspond to an indication parameter value, when using the voice changing effect plug-in, the effect setting interface corresponding to the voice changing effect plug-in can be displayed, and the target indication parameter value indicating the desired voice changing effect is obtained through the effect setting interface, and the target voice changing effect file corresponding to the desired voice changing effect is determined according to the target indication parameter value, so that the target audio with the desired voice changing effect is generated based on the target voice changing effect file through the voice changing effect plug-in, and multiple voice changing effects can be flexibly, conveniently and efficiently realized through a voice changing effect plug-in without occupying a large amount of processing resources, thereby effectively improving the audio processing efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0020] Figure 1 This is a schematic diagram of an implementation scenario of an audio processing method provided in an embodiment of the present application;

[0021] Figure 2 This is a flowchart of an audio processing method provided by an embodiment of the present application;

[0022] Figure 3a This is a schematic diagram of the high-pass filter principle of an audio processing method provided by an embodiment of the present application;

[0023] Figure 3b This is a schematic diagram of the principle of a low-pass filter in an audio processing method provided in an embodiment of the present application;

[0024] Figure 3c This is a schematic diagram of the principle of a reverberation effector of an audio processing method provided in an embodiment of the present application;

[0025] Figure 3dThis is a schematic diagram of the principle of a vibrato effector of an audio processing method provided by an embodiment of the present application;

[0026] Figure 3e This is another schematic diagram of the principle of a vibrato effector according to an audio processing method provided by an embodiment of the present application;

[0027] Figure 3f This is a schematic diagram of the principle of a ring modulator in an audio processing method provided by an embodiment of the present application;

[0028] Figure 3g This is a schematic diagram of the principle of a pitch conversion effector of an audio processing method provided in an embodiment of the present application;

[0029] Figure 3h This is a schematic diagram of the principle of a dry-wet ratio effector of an audio processing method provided in an embodiment of the present application;

[0030] Figure 4 This is a schematic diagram of parameter allocation of a voice changing effect plug-in in an audio processing method provided in an embodiment of the present application;

[0031] Figure 5 is a structural diagram of an audio processing device provided in an embodiment of the present application;

[0032] Figure 6 It is a structural diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0033] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without making creative efforts are within the scope of protection of this application.

[0034] The embodiments of the present application provide an audio processing method, device, storage medium, and electronic device. The audio processing device can be integrated into an electronic device, which can be a server, a terminal, or other device.

[0035] Among them, the server can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, network acceleration services (Content Delivery Network, CDN), as well as basic cloud computing services such as big data and artificial intelligence platforms. Terminals may include but are not limited to mobile phones, computers, intelligent voice interaction devices, smart home appliances, vehicle-mounted terminals, aircraft, etc. Terminals and servers can be directly or indirectly connected through wired or wireless communication, and this application does not impose any restrictions on this.

[0036] See also Figure 1 , taking the audio processing device integrated into the electronic device as an example, Figure 1 A schematic diagram of an implementation scenario of the audio processing method provided in an embodiment of the present application, wherein the electronic device can display an effect setting interface corresponding to the voice changing effect plug-in in an audio processing application in response to a selection operation on the voice changing effect plug-in, the voice changing effect plug-in being configured with multiple voice changing effect files for implementing different voice changing effects, each voice changing effect file being configured to correspond to an indication parameter value; obtaining a target indication parameter value input through the effect setting interface; determining a target voice changing effect file indicated by the target indication parameter value in the voice changing effect file; and generating a target audio having a voice changing effect corresponding to the target voice changing effect file through the voice changing effect plug-in and the target voice changing effect file.

[0037] It should be noted that Figure 1 The illustrated schematic diagram of the implementation environment scenario of the audio processing method is merely an example. The implementation environment scenario of the audio processing method described in the embodiments of this application is intended to more clearly illustrate the technical solutions of the embodiments of this application and does not constitute a limitation on the technical solutions provided by the embodiments of this application. Persons skilled in the art will appreciate that with the evolution of data processing and the emergence of new business scenarios, the technical solutions provided in this application are equally applicable to similar technical problems.

[0038] The solutions provided in the embodiments of the present application are specifically described by the following embodiments. It should be noted that the description order of the following embodiments does not limit the preferred order of the embodiments.

[0039] This embodiment will be described from the perspective of an audio processing device. The audio processing device may be integrated into an electronic device, which may be a terminal and / or a server. This application does not impose any restrictions thereon.

[0040] See also Figure 2 , Figure 2 : is a flowchart of an audio processing method provided in an embodiment of the present application. The audio processing method includes:

[0041] In step 101, in response to a selection operation on a voice changing effect plug-in, an effect setting interface corresponding to the voice changing effect plug-in is displayed in an audio processing application.

[0042] The voice changing effect plug-in is configured with a plurality of voice changing effect files for realizing different voice changing effects, and each voice changing effect file is configured to correspond to an indication parameter value.

[0043] Among them, the voice changing effect plug-in can be a plug-in designed in the embodiment of the present application, used to realize multiple voice changing effects. The voice changing effect can refer to changing the pitch, timbre, speed of sound and other characteristics of the audio, thereby producing different sound effects. The selection operation can be an operation of selecting the voice changing effect plug-in for use. The audio processing application can be an application program for audio processing. The effect setting interface can be an interface for selecting the required voice changing effect from the voice changing effects provided by the voice changing effect plug-in. The voice changing effect file can be a patch file for realizing the voice changing effect, and can include a patch code for realizing the corresponding voice changing effect. The indication parameter value can be a parameter value configured for each voice changing effect file, and the corresponding voice changing effect file can be determined based on the indication parameter value, so that based on the indication parameter value, the voice changing effect required to be realized can be quickly and conveniently determined from the multiple voice changing effects configured by the voice changing effect plug-in.

[0044] Optionally, the voice changing effect may include original effect, robot voice changing effect, alien voice changing effect, echo effect, hoarse effect, distortion effect and other voice changing effects.

[0045] Optionally, each voice changing effect may use at least one effector, and the effector may include at least one of a high-pass filter, a low-pass filter, a reverb effector, a tremolo effector, a ring modulator, a pitch conversion effector, and a dry-wet ratio effector.

[0046] The effector may be a module for audio signals and may be implemented based on at least one audio signal processing method, which may include signal processing methods such as spectrum conversion, time domain processing, harmonic synthesis, and vocoder technology.

[0047] Among them, the high-pass filter can be an effector for implementing high-pass filtering processing, the low-pass filter can be an effector for implementing low-pass filtering processing, the reverb effector can be an effector for implementing reverberation processing, the tremolo effector can be an effector for implementing tremolo effect, the ring modulator can be an effector for modulating two audio signals to generate a new composite audio signal, the pitch conversion effector can be an effector for changing the pitch of an audio signal, and the dry-wet ratio effector can be an effector for controlling the ratio of dry sound (Dry Signal) and wet sound (Wet Signal) in the mix.

[0048] The high-pass filter is an audio processing tool used to eliminate low-frequency signals and pass high-frequency signals. It allows signals above a certain frequency to pass through and attenuates signals below that frequency. This filter is often used in audio engineering to remove low-frequency noise or control the frequency range of audio signals. There are many optional design methods for this effector, for example, please refer to Figure 3a , Figure 3a This is a schematic diagram of the high-pass filter principle of an audio processing method provided in an embodiment of the present application. Various effectors can be designed in the graphical audio processing software (Pure Data, abbreviated as PD). Specifically, the high-pass filter effect can be achieved by setting the cutoff frequency parameter (Cut-off_frequency) of the high-pass filter module [hip~]. In addition, a bypass setting can be added, which allows the use or shielding of the effector when used in combination with multiple effectors.

[0049] The lowpass filter is an audio processing tool that allows signals below a certain frequency to pass through and attenuates signals above that frequency. This filter is often used in audio engineering to remove high-frequency noise or control the frequency range of audio signals. There are many ways to design this effect. For example, please refer to Figure 3b , Figure 3b This is a schematic diagram of the low-pass filter principle of an audio processing method provided in an embodiment of the present application. The low-pass filter effect can be achieved by setting the cutoff frequency parameter Cut-off_frequency of the low-pass filter module [lop~]. In addition, the bypass setting can be added, which can be used to control or shield the effector when used in combination with multiple effectors.

[0050] The reverberation effect can refer to the effect of sound reflection, attenuation and mixing in the environment. In audio processing, reverberation is usually added to the sound through digital signal processing or analog effects to simulate the sound reflection and attenuation in different environments, so as to make the sound sound more natural or create a specific audio effect. Figure 3c , Figure 3c This is a schematic diagram of the reverberation effector principle of an audio processing method provided by an embodiment of the present application, wherein the Delay parameter can control the start time of the reverberation, that is, the time it takes for the sound to reach the reverberation space after leaving the source. By adjusting the time parameter of the delay, the reverberation effect produced by the sound in spaces of different sizes and shapes can be simulated. The feedback control of the Feedback parameter can determine the duration and intensity of the reverberation. Increasing the feedback will make the reverberation last longer, and the sound will reverberate repeatedly to produce a thicker effect. Reducing the feedback will make the reverberation effect clearer and shorter. In addition, since the delay time is always at least one sample and at most the length of the delay line (specified by [delwrite~]). In addition, if [delwrite~] runs later than [vd~] in the digital signal processing (DSP) loop, the delay will be limited by a vector length (64 samples).

[0051] Among them, delwrite~ is an object that allocates memory for the delay line and writes the audio signal to it. [delread~] is used to read the object of the same name from the delay line. [vd~] is used to implement a four-point interpolated delay tap from the corresponding delwrite~ object. The delay (in milliseconds) of the tap is specified by the input signal, which can be the input audio to be processed. The processed audio is used to generate the audio with the voice-changing effect.

[0052] The tremolo effector can include a Vibrato tremolo effector and a Tremolo tremolo effector. The Vibrato tremolo effector is an audio effector that produces a trembling pitch effect by rapidly and periodically changing the pitch. This is usually achieved by fine-tuning the pitch so that the pitch fluctuates rapidly within a small range. Optionally, there are many ways to design the effector. For example, please refer to Figure 3d , Figure 3dThis is a schematic diagram of the principle of a tremolo effector of an audio processing method provided in an embodiment of the present application, wherein the depth parameter (Depth) can be used to control the amplitude of the vibration, that is, the range of variation of the pitch. The speed parameter (Speed) can be used to control the speed of the vibration, that is, how fast the pitch changes. The periodic frequency parameter (Frequency) can be used to control the frequency of the vibration, that is, the transformation form of the pitch. In addition, since [Hilbert~] cannot be recognized by the audio compiler (Heavy), the Hilbert transform can be disassembled here, and a pair of fourth-order all-pass filters are used to change the output in a certain way so that they differ by about 90 degrees from each other. Among them, [Hilbert~] can be an object in Pure Data for performing the Hilbert transform.

[0053] Tremolo is an audio effect that can produce a trembling volume effect by rapidly and periodically adjusting the volume. This effect can be achieved by adjusting the amplitude of the audio signal to produce rapid volume changes, thereby giving the sound a trembling or vibrating feeling. There are many ways to design this effect, for example, please refer to Figure 3e , Figure 3e This is another schematic diagram of the principle of a tremolo effector according to an audio processing method provided by an embodiment of the present application, wherein the depth parameter (Depth) can be used to control the amplitude of the amplitude modulation, that is, the range of volume change, and the speed parameter (Speed) can be used to control the speed of the amplitude modulation, that is, the speed of volume change.

[0054] The Ring Modulator can be an audio effector that generates a new composite audio signal by modulating two audio signals. This effector produces a very unique sound and is often used to create science fiction, exotic styles, or specific sound effects. Optionally, there are many ways to design this effector. For example, please refer to Figure 3f , Figure 3f This is a schematic diagram of the ring modulator principle of an audio processing method provided by an embodiment of the present application. The depth parameter (Depth) can be used to control the amplitude of the phase change, that is, the intensity or breadth of the effect. The speed parameter (Speed) can be used to control the speed of the phase shift, that is, the speed of the modulation effect.

[0055] The pitch shifter can change the pitch of an audio signal, making it sound higher or lower than the original pitch. This effector is often used in music production, sound design, and speech processing. The pitch shifter can be used to create specific musical effects, change the timbre of a sound, or achieve a voice-changing effect. Optionally, there are many ways to design this effector. For example, please refer to Figure 3g , Figure 3g This is a schematic diagram of the pitch conversion effector principle of an audio processing method provided by an embodiment of the present application, wherein the frequency parameter (Frequency) can be used to control the pitch conversion effect of the audio signal. Generally speaking, the higher the frequency, the higher the pitch, and the lower the frequency, the lower the pitch. In addition, since [Hilbert~] cannot be recognized by the Heavy compiler, the Hilbert transform can be disassembled here, and the output is changed in some way through a pair of fourth-order all-pass filters to make them differ by about 90 degrees.

[0056] The wet-dry ratio effector can be an effector for controlling the wet-dry ratio in audio mixing. In audio processing, the wet-dry ratio can refer to the ratio of dry signal to wet signal in the mix. The dry signal is the original audio signal, while the wet signal is the audio signal after processing (such as adding effects or reverb). Adjusting the wet-dry ratio can control the proportion of the processed effect in the final mix. A higher dry ratio will make the original audio clearer and cleaner, while a higher wet ratio will make the effect of the effects or reverb more significant. Optionally, there are many ways to design the effector. For example, please refer to Figure 3h , Figure 3h This is a schematic diagram of the principle of a dry-wet ratio effector of an audio processing method provided in an embodiment of the present application. The dry-wet ratio parameter (Mixer) can be used to control the percentage of dry sound signal and wet sound signal at output based on mathematical operation parameters to achieve the dry-wet ratio of the voice signal output.

[0057] Optionally, each voice changing effect file can be obtained by setting parameters of at least one effector based on the voice changing effect to be achieved.

[0058] For example, the voice changing effect provided by the voice changing effect plug-in may include an original effect (reset), or called an original sound effect, that is, the output signal is equal to the input signal, and the audio is output without modification.

[0059] Optionally, the voice changing effect provided by the voice changing effect plug-in may include a robot voice changing effect. Generally, the robot voice changing effect can be achieved through pitch shifting and distortion effects. Pitch shifting raises or lowers the pitch of the signal to make it sound more mechanical. Distortion, displacement, or waveform processing can be used to make it sound more like a synthesized sound. Optionally, a pitch shifter can be used, and its frequency parameter can be set to 250 to obtain a voice changing effect file corresponding to the robot voice changing effect, so that the original audio signal can be input and the sound with the robot voice changing effect can be output.

[0060] Optionally, the voice changing effect provided by the voice changing effect plug-in can include an alien voice changing effect, which can come from a certain alien character (such as Dalek), and their voice is usually achieved through special audio processing. This sound effect is usually manifested as a mechanized, distorted and echo-effected tone. Achieving this effect usually requires combining technologies such as pitch conversion, audio synthesis and filtering to produce a voice changing effect similar to that of Dalek. Optionally, a ring modulator (RingModulator) can be used to achieve this, by setting the speed parameter of the effector to 30 and the depth parameter to 1 to achieve the voice changing effect, and based on the effector after adjusting the settings, a voice changing effect file corresponding to the voice changing effect is obtained.

[0061] Optionally, the voice changing effect provided by the voice changing effect plug-in may include an echo (Echo) voice changing effect. Generally speaking, the echo effect can be achieved through two dimensions: delay effect and feedback. Specifically, the delay time of the audio can be increased so that it is played repeatedly after a certain period of time, thereby producing an echo effect. The feedback parameters of the echo effect can also be adjusted to control the volume and duration of each echo to achieve the echo effect. Optionally, a reverb effector can be used to achieve this voice changing effect. Specifically, the delay parameter of the reverb effector can be set to 500, and the feedback parameter can be set to 0.5 to obtain a voice changing effect file corresponding to the voice changing effect. Based on the voice changing effect file, the original signal is passed through the reverb effector after parameter adjustment to achieve the voice changing effect.

[0062] In one embodiment, the voice changing effects provided by the voice changing effect plug-in may include a demon voice changing effect, which may refer to processing a voice to have a majestic, deep, hoarse, or terrifying effect. Specifically, a pitch shifter may be used to change the pitch of the input audio to achieve a deep sound effect. A reverb effector may also be used to add a sense of space and resonance to the sound, making it sound more immersive and mysterious. A tremolo effector may also be used to produce a tremolo effect through rapid volume changes, which can be used to simulate strange or unusual sounds, adding trembling or vibrato characteristics to the sound, thereby making the sound sound more hoarse or terrifying.

[0063] For example, the pitch conversion effector, the Tremolo tremolo effector and the reverb effector can be used in combination to achieve the Demon voice changing effect. Specifically, the frequency parameter of the pitch conversion effector can be set to -250, the tremolo speed parameter of the Tremolo tremolo effector can be set to 30, the tremolo depth parameter can be set to 1, and the delay parameter of the reverb effector can be set to 1, the feedback parameter can be set to -0.8, and the dry-wet ratio can be set to 90%. In this way, based on the multiple effectors after parameter adjustment, a voice changing effect file of the voice changing effect can be obtained.

[0064] In this way, the original signal can be pitch-converted by passing it through a pitch conversion effector with adjusted parameters, then processed by a Tremolo effector with adjusted parameters, and finally processed by a reverb effector with adjusted parameters to obtain an output with a Demon voice-changing effect.

[0065] Optionally, the voice changing effect provided by the voice changing effect plug-in may include another robot (C3PO) voice changing effect, where C3PO may be a robot character whose voice is metallic, slightly hissing, and has a specific tone. Optionally, a reverb effector and a wet-dry ratio effector may be used in combination to achieve the voice changing effect, specifically. The delay parameter of the reverb effector may be set to 10, the feedback parameter may be set to 0.9, and the wet-dry ratio of the wet-dry ratio effector may be set to 90%. Based on the multiple effectors after parameter adjustment, a voice changing effect file for the voice changing effect may be obtained. In this way, the original signal may be processed by the reverb effector after the voice changing effect parameters are adjusted, and then processed by the wet-dry ratio effector after the voice changing effect parameters are adjusted to achieve the voice changing effect.

[0066] Optionally, the voice changing effect provided by the voice changing effect plug-in may also include a voice changing effect for realizing the voice of a certain film or television character (Gollum). For example, if the character's voice has a unique hoarse, raspy, and distorted sound effect, the voice changing effect may be realized by using a Vibrato tremolo effector. Specifically, based on the voice changing effect, the speed parameter of the Vibrato tremolo effector may be set to 50, and the depth parameter may be set to 350 to realize the voice changing effect.

[0067] After designing a variety of voice changing effect files for various voice changing effects based on various effectors, the various voice changing effect files can be integrated to obtain a voice changing effect plug-in that can be used to implement various voice changing effects. Specifically, the voice changing effect files for various voice changing effects can be integrated through a routing module, wherein the routing module can be a module for defining the transmission path of an audio signal. For example, please refer to Figure 4 , Figure 4This is a schematic diagram of the parameter allocation of a voice changing effect plug-in of an audio processing method provided in an embodiment of the present application. Assuming that the voice changing effect plug-in parameters include seven voice changing effects (robot, dalek, echo, demon, C3P0, Gollum, reset), an indication parameter value can be assigned to each of the seven voice changing effects. The indication parameter value can be an integer in the range of 0-6, that is, including seven indication parameter values of 0, 1, 2, 3, 4, 5, and 6. Each indication parameter value corresponds to a voice changing effect. The effect setting interface can be displayed, and information for indicating the indication parameter value of the user input indication parameter (VoiceChangerType) can be displayed in the effect setting interface. In this way, the user can input the corresponding parameter value through the indication parameter in the effect setting interface according to the required voice changing effect, so that the input audio signal can be transmitted to the path of the corresponding voice changing effect through the route module, and the input audio signal is processed by the corresponding voice changing effect file to output audio with the voice changing effect. In this way, seven types of voice changing effects can be integrated into one voice changing effect plug-in. Users can select different input parameters, i.e., indicate parameter values, to output audio signals with the desired voice changing effects, thereby improving audio processing efficiency.

[0068] In one embodiment, various effectors can be designed in Pure Data to obtain patches for each effector, and then the parameters of the various effectors can be adjusted and set based on the desired voice changing effect and the patch code of the effector to obtain the patch code corresponding to the various voice changing effects, i.e., the voice changing effect file, and then a voice changing effect plug-in for realizing a variety of voice changing effects can be obtained. In this way, by analyzing the generation principles of voice changing effects for a variety of voices, a general effector implementation is designed and developed, including but not limited to spectrum conversion, time domain processing, harmonic synthesis, vocoder technology, etc., to obtain a variety of general effectors. Then, based on the desired voice changing effect, the above-mentioned design principles are used to use different effectors alone or in combination, and the corresponding parameter values are designed to achieve a variety of realistic voice changing effects.

[0069] Among them, Pure Data is an open source graphical audio processing software that can be used for audio, video and Musical Instrument Digital Interface (MIDI) processing. It is a programmable digital signal processing tool. Pure Data uses graphical programming methods to allow users to create complex audio effects, synthesizers and musical works.

[0070] In one embodiment, the audio processing application may include audio middleware (Wave Works Interactive Sound Engine, referred to as Wwise) and digital audio workstation (DAW) applications. Wwise is a professional audio engine and toolset that allows game and media developers to create and implement complex audio designs. Wwise provides a complete set of tools, including audio encoders, audio mixers, audio effects, etc., which can help developers achieve high-quality audio effects in various media applications such as games, virtual reality, and augmented reality. A DAW is a software application used to record, edit, and create audio files. It typically includes multi-track recording, audio editing, audio effects processing, and music production tools.

[0071] In step 102, the target indication parameter value input through the effect setting interface is obtained.

[0072] The target indication parameter value may be an indication parameter value input through an effect setting interface.

[0073] Among them, there can be multiple ways to obtain the target indication parameter value input through the effect setting interface. For example, the effect setting interface may include a parameter adjustment control, so that the parameter value entered through the parameter adjustment control can be obtained; if the parameter value is of integer type and the parameter value is within the numerical range composed of all indication parameter values, the parameter value is determined as the target voice changing parameter value; if not, an input error prompt message is generated, and the parameter value entered through the parameter adjustment control continues to be obtained until the target voice changing parameter value is obtained.

[0074] Wherein, the parameter adjustment control can be used to adjust the input parameter value. For example, the parameter adjustment control may include a slider, which can be used to adjust the input parameter value by sliding the slider. The numerical range constituted by all the indicated parameter values may refer to the range constituted by the indicated parameter values corresponding to all voice changing effects. For example, seven voice changing effects can be realized in the voice changing effect plug-in, and each voice changing effect is configured with a corresponding indicated parameter value, which is 0, 1, 2, 3, 4, 5, and 6 respectively. Then, the numerical range constituted by all the indicated parameter values is [0, 6]. The input error prompt information can be information that prompts the user that the parameter value currently input is incorrect. Based on the input error prompt information, the user can be prompted to enter the correct indicated parameter value, thereby achieving the required voice changing effect through the voice changing effect plug-in.

[0075] In step 103, a target voice changing effect file indicated by the target indication parameter value is determined in the voice changing effect file.

[0076] Among them, the target voice changing effect file can be a voice changing effect file corresponding to the target indication parameter value.

[0077] In this way, based on the correspondence between the voice changing effect files and the indicated parameter values pre-configured for the voice changing effect plug-in, and the input target indicated parameter value, the voice changing effect file corresponding to the voice changing effect currently required to be implemented can be determined. For example, please continue to refer to Figure 4 When the input target indication parameter value is 2, since the indication parameter value of the echo voice changing effect is configured as 2, the voice changing effect file corresponding to the echo voice changing effect can be determined as the target voice changing effect file.

[0078] In step 104, a target audio with a voice changing effect corresponding to the target voice changing effect file is generated through the voice changing effect plug-in and the target voice changing effect file.

[0079] The target audio may be an audio having a voice changing effect corresponding to the target voice changing effect file.

[0080] Among them, there are many ways to generate target audio with the voice changing effect corresponding to the target voice changing effect file through the voice changing effect plug-in and the target voice changing effect file. For example, the voice changing effect plug-in can be used to specify the input audio to be processed as the input to the effector corresponding to the target voice changing effect file for processing, thereby outputting the target audio with the voice changing effect corresponding to the target voice changing effect file.

[0081] Optionally, in order to apply the voice changing effect plug-in designed based on Pure Data to multiple platforms, the voice changing effect plug-in can be compiled before using the voice changing effect plug-in provided by the embodiment of the present application in platforms such as audio processing software. Specifically, the command line tool can be opened in the directory where the audio compiler is located; the plug-in compilation information input through the command line tool is obtained, the plug-in compilation information includes the name of the voice changing effect plug-in, the file path and the target platform information of the voice changing effect plug-in, the file path includes the voice changing effect file configured for the voice changing effect plug-in, the target platform information indicates the target platform for applying the voice changing effect plug-in, and the target platform includes the audio processing application; based on the plug-in compilation information, the voice changing effect plug-in is compiled by the audio compiler to deploy the voice changing effect plug-in in the audio processing application.

[0082] The audio compiler may be a compiler for compiling a patch for the voice changing effect plug-in, for example, a target compiler (Heavy), which is a Pure Data-based audio engine and audio programming language that can be used to implement high-quality audio effects and synthesizers. The plug-in compilation information may be information for compiling the voice changing effect plug-in.

[0083] Optionally, there are multiple ways to open the command line tool in the directory where the audio compiler is located. For example, the command line tool can be opened by entering "CMD" in the directory where the audio compiler is located.

[0084] In one embodiment, in order to make the designed voice changing effect plug-in patch able to be compiled normally by the Heavy compiler, the embodiment of this application only uses some objects in Pure Data, otherwise an error will be reported during compilation. In order to make the development parameters of the voice changing effect plug-in available to the target platform, taking the target platform as Wwise as an example, please continue to refer to Figure 4 , you can follow Figure 4 Format for parameter declaration. The first parameter "r" is a common parameter declaration, indicating that the voice changing effect plug-in can receive parameter values from the outside. The second parameter "VoiceChangerType" is the parameter name of the voice changing effect plug-in on the Wwise platform's graphical user interface (GUI). The input parameter value indicates the parameter value. The third parameter "@hv_param" represents the parameter output. The embodiment of the present application changes the sound synthesis effect through parameter input. The fourth parameter is the minimum, maximum, and default value of the input parameter value. For example, Figure 4 The "0 6 0" in the text represents that the minimum value of the parameter "VoiceChangerType" is 0, the maximum value is 6, and the default value is 0, which corresponds to seven different voice changing effects.

[0085] When using the Heavy Compiler to compile a voice changer plug-in deployed on the Wwise platform, you can enter "CMD" in the address bar of the Heavy Compiler directory to open the command line tool and enter the plug-in compilation information: "python hvcc.py E:\HenryPlugin\HenryVoiceChanger.pd -nHenryVoiceChanger -o E:\HenryPlugin\ -g wwise".

[0086] Among them, E:\HenryPlugin\HenryVoiceChanger.pd is the file path of the voice changer plug-in. The file path is the path to the Pure Data Patch of the voice changer plug-in, that is, the path to the voice changer effect file of the voice changer plug-in. -n HenryVoiceChanger is the name of the output voice changer plug-in "HenryVoiceChanger", -o E:\HenryPlugin\ is the path to the output resource of the voice changer plug-in after compilation, and -gwwise indicates that the target platform for compilation is Wwise.

[0087] Optionally, after the voice changing effect plug-in is compiled, the parameter adjustment control in the effect setting page corresponding to the voice changing effect plug-in defaults to a non-integer that can input positive and negative values. In order to allow the user to input parameter values that conform to the indicated parameter values corresponding to each voice changing effect, the voice changing effect plug-in needs to be recompiled so that in the voice changing effect plug-in after the recompilation, the parameter value input through the parameter adjustment control is an integer value within the range constituted by all indicated parameter values. Specifically, the voice changing effect plug-in is configured with a parameter adjustment control, and the voice changing effect plug-in can be recompiled. The voice changing effect plug-in is deployed on the audio processing application based on the file obtained by the recompilation, wherein, during the recompilation process, the parameter attribute type of the parameter adjustment control is adjusted to an integer type, and the step size of the parameter adjustment control is adjusted to a preset value, so that the parameter value input through the parameter adjustment control is of integer type and belongs to the numerical range constituted by all indicated parameter values.

[0088] Among them, the parameter attribute type can be the attribute type (Type) of the parameter adjustment control, the integer type can be a 16-bit integer type (int16), and the step size can be the change in the input value when controlling the parameter adjustment control. For example, when the parameter adjustment control includes a slider, the step size can be the change in the value when the slider is moved. This value can be an integer or a decimal, depending on the attribute type bound to the control. The preset value can be determined based on the value of each indicated parameter value configured by the voice changing effect plug-in. For example, when the indicated parameter values are separated by a value of 1, the step size can be 1, and when the indicated parameter values are separated by a value of 2, the step size can be 2, etc., and can be set specifically according to actual conditions.

[0089] Among them, there are many ways to deploy the voice changing effect plug-in on the audio processing application based on the files obtained by recompilation. For example, the target file of the target file type in the files obtained by recompilation can be added to the directory where the audio processing application is located to deploy the voice changing effect plug-in in the audio processing application.

[0090] The target file type may be a file type with a suffix of .dll or .xml. The target file may be a file with a suffix of .dll or .xml in the plug-in file obtained after recompilation, that is, a plug-in file of a voice changing effect plug-in.

[0091] In one embodiment, a voice changing effect plug-in configured with seven different voice changing effects, a parameter adjustment control as a slider, and deployed in Wwise is used as an example. Since the voice changing effect plug-in implemented in this embodiment of the application only has one parameter, namely a parameter value input of 0 to 6, corresponding to the seven different voice changing effects. However, since the input parameter value of the parameter adjustment control of the voice changing effect plug-in compiled based on Pure Data ranges from a linear interval of 0 to 6, which is not the required integer value, the voice changing effect plug-in needs to be recompiled. For example, please refer to the following recompilation code:

[0092]

[0093] "VoiceChangerType" is the parameter corresponding to the voice changer plug-in. The parameter adjustment control retrieves the input parameter value, indicating the parameter value. Type (attribute type) describes different attribute types and their corresponding values, including Boolean (bool), 16-bit integer (int16), 32-bit integer (int32), 32-bit single-precision floating-point number (Real32), 64-bit double-precision floating-point number (Real64), and string (string). Step defines the amount by which the input value changes when moving the slider. Fine defines the amount by which the value changes when holding the SHIFT key while moving the slider. This value can be an integer or decimal, depending on the parameter property type bound to the control. Decimals defines the number of digits displayed after the decimal point. This value must be a non-negative integer. If set to 0, no decimals or decimal point are displayed. Therefore, based on the recompiled voice changer plug-in, when users enter parameter values for the voice changer through the effect settings interface, the plug-in will only take effect if the input parameter value is an integer. Therefore, it is necessary to recompile the parameter value range preset by the voice changing effect plug-in so that the input parameter value is a controllable positive integer value. Based on the recompiled voice changing effect plug-in, a parameter adjustment control with a range of 0 to 6 and a step size of 1 can be obtained.

[0094] After recompiling the Voice Changer plug-in, you can place the generated files with .dll and .xml extensions in the Wwise directory to deploy the plug-in in Wwise. Similarly, you can deploy the plug-in in a DAW.

[0095] With the development of gaming applications, in-game characters often require different voices. Typically, voice-changing effects are achieved through digital signal processing and sound synthesis technologies, including but not limited to spectral processing, time-domain processing, harmonic synthesis, vocoder technology, and machine learning and neural network technologies. The combination of these technologies enables voice-changing plug-ins to achieve a variety of interesting and practical voice effects with high quality and low latency. However, developing audio effect plug-ins generally requires developers to be able to write code and have a background in digital signal processing and acoustics. In game audio design, voice-changing effects are typically implemented in two ways. For example, voice-changing effects can be implemented within a DAW using third-party commercial audio processing plug-ins. Users apply these plug-ins to audio tracks or audio objects to change the timbre, pitch, or other characteristics of the sound in real time. The pre-selected audio samples are then implemented in-game through the audio engine. Alternatively, voice-changing effects can be implemented within Wwise using built-in audio effect plug-ins to achieve real-time voice-changing effects. Users adjust various parameters within the Wwise effect plug-in's graphical interface to achieve the desired effect.

[0096] However, after processing in the DAW, only fixed voice effect resources are obtained, the effect is single, and the voice changing effect cannot be changed in real time within the game. Different voice changing effects need to be output multiple times, which lacks reusability. In addition, the game audio engine Wwise's built-in plug-ins lack presets, requiring a certain amount of time and manpower to create and implement complex voice changing effect designs. In Wwise, achieving a voice changing effect often requires stacking multiple effect plug-ins, which takes up a lot of computing resources. At the same time, the voice changing effect cannot be changed in real time within the game, making the voice changing effect implementation inefficient.

[0097] To this end, the embodiment of the present application provides an audio processing method for implementing a voice changing effect plug-in based on Pure Data and Heavy, breaking down the barriers between game audio designers and technical audio engineers, and providing game audio designers with a method for implementing voice changing effects that replaces traditional game voices. Specifically, the embodiment of the present application deeply analyzes and decomposes the common voice changing effect implementation principles, changes the timbre and characteristics of the sound by modifying the spectral information of the sound signal, modifies the sound signal in the time domain, changes the pitch by time stretching or compression, and changes the tone and timbre of the sound by controlling the harmonic components of the sound signal, thereby involving a variety of effectors, thereby implementing seven preset voice changing effects in PureData by using at least one effector, and then compiling it through the Heavy compiler to convert the voice changing effect file (PureData Patch) into C / C++ code, recompile the C / C++ code, bind general controls to properties, and rearrange the plug-in dialog panel to obtain the effect setting interface. This allows the generated voice-changing effect plug-in with multiple voice-changing effects to be deployed in DAW and Wwise. This reduces the learning and production costs of creating complex voice-changing effects to a certain extent. At the same time, the seven preset effects in one plug-in can greatly reduce the central processing unit (CPU) computing power loss caused by the superposition of different effects. It can be widely used in audio processing software such as DAW and Wwise, and can be reused in any project, effectively improving the efficiency of voice-changing effect implementation.

[0098] From the above, it can be seen that the embodiment of the present application displays the effect setting interface corresponding to the voice changing effect plug-in in the audio processing application in response to the selection operation of the voice changing effect plug-in. The voice changing effect plug-in is configured with multiple voice changing effect files for realizing different voice changing effects, and each voice changing effect file is configured to correspond to an indication parameter value; obtains the target indication parameter value input through the effect setting interface; determines the target voice changing effect file indicated by the target indication parameter value in the voice changing effect file; generates the target audio with the voice changing effect corresponding to the target voice changing effect file through the voice changing effect plug-in and the target voice changing effect file. In this way, by deploying a voice changing effect plug-in configured with multiple voice changing effects in an audio processing application, and the voice changing effect file corresponding to each voice changing effect is configured to correspond to an indication parameter value, when using the voice changing effect plug-in, the effect setting interface corresponding to the voice changing effect plug-in can be displayed, and the target indication parameter value indicating the desired voice changing effect is obtained through the effect setting interface, and the target voice changing effect file corresponding to the desired voice changing effect is determined according to the target indication parameter value, so that the target audio with the desired voice changing effect is generated based on the target voice changing effect file through the voice changing effect plug-in, and multiple voice changing effects can be flexibly, conveniently and efficiently realized through a voice changing effect plug-in without occupying a large amount of processing resources, thereby effectively improving the audio processing efficiency.

[0099] In order to better implement the above method, an embodiment of the present invention further provides an audio processing device, which can be integrated into an electronic device, and the electronic device can be a terminal or a server.

[0100] For example, Figure 5 , which is a schematic diagram of the structure of an audio processing device provided in an embodiment of the present application, the audio processing device may include a selection unit 201, an acquisition unit 202, a determination unit 203, and a generation unit 204, as follows:

[0101] A selection unit 201 is configured to display an effect setting interface corresponding to the voice changing effect plug-in in the audio processing application in response to a selection operation of the voice changing effect plug-in, wherein the voice changing effect plug-in is configured with multiple voice changing effect files for implementing different voice changing effects, and each voice changing effect file is configured to correspond to an indication parameter value;

[0102] An acquisition unit 202 is configured to acquire a target indication parameter value input through an effect setting interface;

[0103] The determining unit 203 is configured to determine a target voice changing effect file indicated by the target indicating parameter value in the voice changing effect file;

[0104] The generating unit 204 is configured to generate a target audio file having a voice changing effect corresponding to the target voice changing effect file through the voice changing effect plug-in and the target voice changing effect file.

[0105] In some embodiments, each voice changing effect uses at least one effector, and the effector includes at least one of a high-pass filter, a low-pass filter, a reverb effector, a tremolo effector, a ring modulator, a pitch conversion effector, and a dry-wet ratio effector.

[0106] In some embodiments, each voice changing effect file is obtained by setting parameters of at least one effector based on the voice changing effect to be achieved.

[0107] In some embodiments, the effect setting interface includes a parameter adjustment control, an acquisition unit 202, for:

[0108] Get the parameter value entered through the parameter adjustment control;

[0109] If the parameter value is of integer type and is within the numerical range formed by all indicated parameter values, the parameter value is determined as the target voice changing parameter value;

[0110] If not, an input error prompt message is generated, and the parameter value input through the parameter adjustment control is continuously obtained until the target voice changing parameter value is obtained.

[0111] In some embodiments, the audio processing device further includes a compiling unit configured to:

[0112] Open the command line tool in the directory where the audio compiler is located;

[0113] Obtain the plugin compilation information input through the command line tool. The plugin compilation information includes the name, file path, and target platform information of the voice changing effect plugin. The file path includes the voice changing effect file configured for the voice changing effect plugin. The target platform information indicates the target platform for applying the voice changing effect plugin. The target platform includes the audio processing application.

[0114] Based on the plug-in compilation information, the voice changing effect plug-in is compiled by an audio compiler to deploy the voice changing effect plug-in in an audio processing application.

[0115] In some embodiments, the voice changing effect plug-in is configured with parameter adjustment controls, an audio processing device, and a recompiling unit for:

[0116] The voice changing effect plug-in is recompiled, and the voice changing effect plug-in is deployed on the audio processing application based on the file obtained by the recompilation process. During the recompilation process, the parameter attribute type of the parameter adjustment control is adjusted to an integer type, and the step size of the parameter adjustment control is adjusted to a preset value, so that the parameter value input through the parameter adjustment control is of integer type and is within the numerical range composed of all indicated parameter values.

[0117] In some embodiments, the above-mentioned file obtained based on the recompilation process is deployed on the audio processing application as a voice changing effect plug-in, specifically for:

[0118] Add the target file of the target file type obtained from the recompilation process to the directory where the audio processing application is located, so as to deploy the voice changing effect plug-in in the audio processing application.

[0119] In specific implementation, the above units can be implemented as independent entities, or can be arbitrarily combined to be implemented as the same or several entities. The specific implementation of the above units can be found in the previous method embodiments and will not be repeated here.

[0120] From the above, it can be seen that in the embodiment of the present application, the selection unit 201 responds to the selection operation of the voice changing effect plug-in, and displays the effect setting interface corresponding to the voice changing effect plug-in in the audio processing application. The voice changing effect plug-in is configured with multiple voice changing effect files for realizing different voice changing effects, and each voice changing effect file is configured to correspond to an indication parameter value; the acquisition unit 202 obtains the target indication parameter value input through the effect setting interface; the determination unit 203 determines the target voice changing effect file indicated by the target indication parameter value in the voice changing effect file; the generation unit 204 generates the target audio with the voice changing effect corresponding to the target voice changing effect file through the voice changing effect plug-in and the target voice changing effect file. In this way, by deploying a voice changing effect plug-in configured with multiple voice changing effects in an audio processing application, and the voice changing effect file corresponding to each voice changing effect is configured to correspond to an indication parameter value, when using the voice changing effect plug-in, the effect setting interface corresponding to the voice changing effect plug-in can be displayed, and the target indication parameter value indicating the desired voice changing effect is obtained through the effect setting interface, and the target voice changing effect file corresponding to the desired voice changing effect is determined according to the target indication parameter value, so that the target audio with the desired voice changing effect is generated based on the target voice changing effect file through the voice changing effect plug-in, and multiple voice changing effects can be flexibly, conveniently and efficiently realized through a voice changing effect plug-in without occupying a large amount of processing resources, thereby effectively improving the audio processing efficiency.

[0121] The present application also provides an electronic device, such as Figure 6 , which shows a schematic diagram of the structure of an electronic device involved in an embodiment of the present application. The electronic device may be a terminal or a server. Specifically:

[0122] The electronic device 300 includes a processor 301 having one or more processing cores, a memory 302 having one or more computer-readable storage media, and a computer program stored in the memory 302 and executable on the processor. The processor 301 is electrically connected to the memory 302. Those skilled in the art will appreciate that the electronic device structure shown in the figures does not limit the electronic device and may include more or fewer components than shown, or combine certain components, or arrange the components differently.

[0123] The processor 301 is the control center of the electronic device 300. It uses various interfaces and lines to connect various parts of the entire electronic device 300. By running or loading software programs and / or modules stored in the memory 302 and calling data stored in the memory 302, it executes various functions of the electronic device 300 and processes data, thereby monitoring the electronic device 300 as a whole.

[0124] In the embodiment of the present application, the processor 301 in the electronic device 300 loads instructions corresponding to one or more application processes into the memory 302 according to the following steps, and the processor 301 runs the application stored in the memory 302 to implement various functions:

[0125] In response to the selection operation of the voice changing effect plug-in, the effect setting interface corresponding to the voice changing effect plug-in is displayed in the audio processing application, the voice changing effect plug-in is configured with multiple voice changing effect files for realizing different voice changing effects, and each voice changing effect file is configured to correspond to an indication parameter value; the target indication parameter value input through the effect setting interface is obtained; in the voice changing effect file, the target voice changing effect file indicated by the target indication parameter value is determined; through the voice changing effect plug-in and the target voice changing effect file, the target audio with the voice changing effect corresponding to the target voice changing effect file is generated.

[0126] This solution can display an effect setting interface corresponding to a voice changing effect plug-in in an audio processing application in response to a selection operation on the voice changing effect plug-in, wherein the voice changing effect plug-in is configured with multiple voice changing effect files for implementing different voice changing effects, and each voice changing effect file is configured to correspond to an indication parameter value; obtain a target indication parameter value input through the effect setting interface; determine a target voice changing effect file indicated by the target indication parameter value in the voice changing effect file; and generate a target audio having a voice changing effect corresponding to the target voice changing effect file through the voice changing effect plug-in and the target voice changing effect file. In this way, by deploying a voice changing effect plug-in configured with multiple voice changing effects in an audio processing application, and the voice changing effect file corresponding to each voice changing effect is configured to correspond to an indication parameter value, when using the voice changing effect plug-in, the effect setting interface corresponding to the voice changing effect plug-in can be displayed, and the target indication parameter value indicating the desired voice changing effect is obtained through the effect setting interface, and the target voice changing effect file corresponding to the desired voice changing effect is determined according to the target indication parameter value, so that the target audio with the desired voice changing effect is generated based on the target voice changing effect file through the voice changing effect plug-in, and multiple voice changing effects can be flexibly, conveniently and efficiently realized through a voice changing effect plug-in without occupying a large amount of processing resources, thereby effectively improving the audio processing efficiency.

[0127] The specific implementation of the above operations can be found in the previous embodiments and will not be repeated here.

[0128] Optional, such as Figure 6 As shown, the electronic device 300 further includes: a touch screen 303, a radio frequency circuit 304, an audio circuit 305, an input unit 306, and a power supply 307. Among them, the processor 301 is electrically connected to the touch screen 303, the radio frequency circuit 304, the audio circuit 305, the input unit 306, and the power supply 307 respectively. Those skilled in the art will understand that Figure 6 The electronic device structure shown in the figure does not constitute a limitation to the electronic device, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0129] The touch display screen 303 can be used to display a graphical user interface and receive user operations generated by the graphical user interface. The touch display screen 303 may include a display panel and a touch panel. Among them, the display panel can be used to display information input by the user or information provided to the user and various graphical user interfaces of the electronic device, and these graphical user interfaces can be composed of graphics, text, icons, videos and any combination thereof. Optionally, a liquid crystal display (LCD), an organic light emitting diode (OLED) or the like can be used to configure the display panel. The touch panel can be used to collect user touch operations on or near it (such as operations performed by the user using any suitable object or accessory such as a finger, stylus or the like on or near the touch panel), and generate corresponding operation instructions, and the operation instructions execute corresponding programs. Optionally, the touch panel may include two parts: a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch direction, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into the touch point coordinates, and then sends it to the processor 301, and can receive the command sent by the processor 301 and execute it. The touch panel can cover the display panel. When the touch panel detects a touch operation on or near it, it is transmitted to the processor 301 to determine the type of touch event, and then the processor 301 provides a corresponding visual output on the display panel according to the type of touch event. In an embodiment of the present application, the touch panel and the display panel can be integrated into the touch display screen 303 to realize the input and output functions. However, in some embodiments, the touch panel and the touch panel can be used as two independent components to realize the input and output functions. That is, the touch display screen 303 can also be used as part of the input unit 306 to realize the input function.

[0130] The RF circuit 304 may be used to transmit and receive RF signals, so as to establish wireless communication with a network device or other electronic devices through wireless communication, and to transmit and receive signals with the network device or other electronic devices.

[0131] The audio circuit 305 can be used to provide an audio interface between the user and the electronic device through a speaker and microphone. The audio circuit 305 can convert the received audio data into an electrical signal and transmit it to the speaker, which then converts it into a sound signal for output. On the other hand, the microphone converts the collected sound signal into an electrical signal, which is received by the audio circuit 305 and converted into audio data. The audio data is then output to the processor 301 for processing, and then sent to another electronic device through the radio frequency circuit 304, or the audio data is output to the memory 302 for further processing. The audio circuit 305 may also include an earphone jack to provide communication between external headphones and the electronic device.

[0132] The input unit 306 may be configured to receive input digital, character information, or user feature information (such as fingerprint, iris, or facial information), and to generate keyboard, mouse, joystick, optical, or trackball signal inputs related to user settings and function control.

[0133] Power supply 307 is used to supply power to various components of electronic device 300. Optionally, power supply 307 can be logically connected to processor 301 via a power management system, thereby enabling the power management system to manage charging, discharging, and power consumption. Power supply 307 can also include one or more DC or AC power supplies, a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator, and other arbitrary components.

[0134] although Figure 6 Not shown in the figure, the electronic device 300 may further include a camera, a sensor, a wireless fidelity module, a Bluetooth module, etc., which will not be described in detail here.

[0135] In the above embodiments, the descriptions of each embodiment have their own emphasis. For parts not described in detail in a particular embodiment, please refer to the relevant descriptions of other embodiments. It should be noted that the electronic device provided in the embodiments of this application and the audio processing method in the above embodiments are based on the same concept. The specific implementation process is detailed in the above method embodiments and will not be repeated here.

[0136] From the above, it can be seen that the electronic device provided in the embodiment of the present application can display the effect setting interface corresponding to the voice changing effect plug-in in the audio processing application in response to the selection operation of the voice changing effect plug-in, and the voice changing effect plug-in is configured with multiple voice changing effect files for realizing different voice changing effects, and each voice changing effect file is configured to correspond to an indication parameter value; obtain the target indication parameter value input through the effect setting interface; determine the target voice changing effect file indicated by the target indication parameter value in the voice changing effect file; and generate the target audio with the voice changing effect corresponding to the target voice changing effect file through the voice changing effect plug-in and the target voice changing effect file. In this way, by deploying a voice changing effect plug-in configured with multiple voice changing effects in an audio processing application, and the voice changing effect file corresponding to each voice changing effect is configured to correspond to an indication parameter value, when using the voice changing effect plug-in, the effect setting interface corresponding to the voice changing effect plug-in can be displayed, and the target indication parameter value indicating the desired voice changing effect is obtained through the effect setting interface, and the target voice changing effect file corresponding to the desired voice changing effect is determined according to the target indication parameter value, so that the target audio with the desired voice changing effect is generated based on the target voice changing effect file through the voice changing effect plug-in, and multiple voice changing effects can be flexibly, conveniently and efficiently realized through a voice changing effect plug-in without occupying a large amount of processing resources, thereby effectively improving the audio processing efficiency.

[0137] Those skilled in the art will appreciate that all or part of the steps in the various methods of the above embodiments may be accomplished by a computer program, or by controlling related hardware through a computer program. The computer program may be stored in a computer-readable storage medium and loaded and executed by a processor.

[0138] To this end, an embodiment of the present application provides a computer-readable storage medium storing a computer program that can be loaded by a processor to execute the steps of any of the audio processing methods provided in the embodiments of the present application. For example, the computer program can execute the following steps:

[0139] In response to the selection operation of the voice changing effect plug-in, the effect setting interface corresponding to the voice changing effect plug-in is displayed in the audio processing application, the voice changing effect plug-in is configured with multiple voice changing effect files for realizing different voice changing effects, and each voice changing effect file is configured to correspond to an indication parameter value; the target indication parameter value input through the effect setting interface is obtained; in the voice changing effect file, the target voice changing effect file indicated by the target indication parameter value is determined; through the voice changing effect plug-in and the target voice changing effect file, the target audio with the voice changing effect corresponding to the target voice changing effect file is generated.

[0140] This solution can display an effect setting interface corresponding to a voice changing effect plug-in in an audio processing application in response to a selection operation on the voice changing effect plug-in, wherein the voice changing effect plug-in is configured with multiple voice changing effect files for implementing different voice changing effects, and each voice changing effect file is configured to correspond to an indication parameter value; obtain a target indication parameter value input through the effect setting interface; determine a target voice changing effect file indicated by the target indication parameter value in the voice changing effect file; and generate a target audio having a voice changing effect corresponding to the target voice changing effect file through the voice changing effect plug-in and the target voice changing effect file. In this way, by deploying a voice changing effect plug-in configured with multiple voice changing effects in an audio processing application, and the voice changing effect file corresponding to each voice changing effect is configured to correspond to an indication parameter value, when using the voice changing effect plug-in, the effect setting interface corresponding to the voice changing effect plug-in can be displayed, and the target indication parameter value indicating the desired voice changing effect is obtained through the effect setting interface, and the target voice changing effect file corresponding to the desired voice changing effect is determined according to the target indication parameter value, so that the target audio with the desired voice changing effect is generated based on the target voice changing effect file through the voice changing effect plug-in, and multiple voice changing effects can be flexibly, conveniently and efficiently realized through a voice changing effect plug-in without occupying a large amount of processing resources, thereby effectively improving the audio processing efficiency.

[0141] The specific implementation of the above operations can be found in the previous embodiments and will not be repeated here.

[0142] The computer-readable storage medium may include a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0143] Since the computer program stored in the computer-readable storage medium can execute the steps of any audio processing method provided in the embodiments of the present application, the beneficial effects that can be achieved by any audio processing method provided in the embodiments of the present application can be achieved. Please refer to the previous embodiments for details and will not be repeated here.

[0144] Among them, according to one aspect of the present application, a computer program product is provided, which includes a computer program, and the computer program is stored in a computer-readable storage medium; when the processor of an electronic device reads the computer program from the computer-readable storage medium, the processor executes the computer program, so that the electronic device executes the methods provided in the various optional implementations provided in the above embodiments.

[0145] The above is a detailed introduction to an audio processing method, device, storage medium and electronic device provided in the embodiments of the present application. Specific examples are used herein to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea. At the same time, for those skilled in the art, based on the ideas of the present application, there may be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. An audio processing method, characterized in that: include: In response to a selection operation of a voice changing effect plug-in, an effect setting interface corresponding to the voice changing effect plug-in is displayed in the audio processing application, wherein the voice changing effect plug-in is configured with a plurality of voice changing effect files for implementing different voice changing effects, and each voice changing effect file is configured to correspond to an indication parameter value; Obtaining a target indication parameter value input through the effect setting interface; Determining, in the voice changing effect file, a target voice changing effect file indicated by the target indication parameter value; A target audio with the voice changing effect corresponding to the target voice changing effect file is generated through the voice changing effect plug-in and the target voice changing effect file.

2. The audio processing method according to claim 1, wherein: Each voice changing effect uses at least one effector, which includes at least one of a high-pass filter, a low-pass filter, a reverb effector, a tremolo effector, a ring modulator, a pitch conversion effector, and a dry-wet ratio effector.

3. The audio processing method according to claim 2, wherein: Each of the voice changing effect files is obtained by setting parameters of at least one of the effectors based on the voice changing effect to be achieved.

4. The audio processing method according to claim 1, wherein: The effect setting interface includes a parameter adjustment control, and obtaining the target indication parameter value input through the effect setting interface includes: Obtaining a parameter value input through the parameter adjustment control; If the parameter value is of integer type and is within the numerical range formed by all the indicated parameter values, the parameter value is determined as the target voice changing parameter value; If not, an input error prompt message is generated, and the parameter value input through the parameter adjustment control is continuously obtained until the target voice changing parameter value is obtained.

5. The audio processing method according to any one of claims 1 to 4, characterized in that: In response to the selection operation of the voice changing effect plug-in, before displaying the effect setting interface corresponding to the voice changing effect plug-in in the audio processing application, the method further includes: Open the command line tool in the directory where the audio compiler is located; Obtaining plug-in compilation information input through the command line tool, the plug-in compilation information including the name, file path, and target platform information of the voice changing effect plug-in, the file path including the voice changing effect file configured for the voice changing effect plug-in, the target platform information indicating the target platform for applying the voice changing effect plug-in, the target platform including an audio processing application; Based on the plug-in compilation information, the voice changing effect plug-in is compiled by the audio compiler to deploy the voice changing effect plug-in in the audio processing application.

6. The audio processing method according to claim 5, wherein: The voice changing effect plug-in is configured with a parameter adjustment control. After the voice changing effect plug-in is compiled by the audio compiler based on the plug-in compilation information, the method further includes: The voice changing effect plug-in is recompiled, and the voice changing effect plug-in is deployed on the audio processing application based on the file obtained by the recompilation process. During the recompilation process, the parameter attribute type of the parameter adjustment control is adjusted to an integer type, and the step size of the parameter adjustment control is adjusted to a preset value, so that the parameter value input through the parameter adjustment control is of integer type and belongs to the numerical range composed of all indicated parameter values.

7. The audio processing method according to claim 6, wherein: The step of deploying the voice changing effect plug-in on the audio processing application based on the file obtained through the recompilation process includes: Add the target file of the target file type obtained from the recompilation process to the directory where the audio processing application is located, so as to deploy the voice changing effect plug-in in the audio processing application.

8. An audio processing device, characterized in that: include: A selection unit is configured to, in response to a selection operation on a voice changing effect plug-in, display an effect setting interface corresponding to the voice changing effect plug-in in the audio processing application, wherein the voice changing effect plug-in is configured with a plurality of voice changing effect files for implementing different voice changing effects, and each voice changing effect file is configured to correspond to an indication parameter value; an acquiring unit, configured to acquire a target indication parameter value input through the effect setting interface; A determining unit, configured to determine, from the voice changing effect file, a target voice changing effect file indicated by the target indication parameter value; The generating unit is used to generate a target audio with the voice changing effect corresponding to the target voice changing effect file through the voice changing effect plug-in and the target voice changing effect file.

9. An electronic device, characterized in that: The method comprises a processor and a memory, wherein the memory stores a computer program, and when the computer program is executed by the processor, the processor is enabled to perform the steps of any one of the methods of claims 1 to 7.

10. A computer-readable storage medium, characterized in that The method comprises a computer program. When the computer program is run on an electronic device, the computer program is used to enable the electronic device to execute the steps of any one of the methods of claims 1 to 7.

Images