Audio processing method and device, computer readable storage medium and electronic device

Abstract

The invention discloses an audio processing method and device, a computer readable storage medium and an electronic device. The method comprises the steps that a preset operation acting on a preset control is responded, an original audio is acquired, a target audio mixing template corresponding to the preset operation is determined from multiple audio mixing templates, and different audio mixing templates are used for representing sound mixing strategies applied to different scenes; obtaining a target sound mixing parameter corresponding to the target sound mixing template; and carrying out sound mixing processing on the original audio based on the target sound mixing parameter to obtain a target audio. According to the invention, the technical problem of high difficulty in audio mixing processing in the prior art is solved.

Description

Technical Field

[0001] The present disclosure relates to the field of audio processing, and in particular, to an audio processing method, device, computer-readable storage medium, and electronic device. Background Art

[0002] At present, the development of the electronic game industry has promoted new demands related to user-generated content (UGC). For example, game products come with editing functions, allowing users to modify the original framework to form derivative versions, or directly release products in the form of game editors for ordinary users to create their own game works. For most UGC game works, the development difficulty is lower than commercial production. The UGC development environment or tools pursue low technical barriers and attach importance to user-friendliness. In the process of game audio development, mixing is emphasized, especially "dynamic mixing". At present, the design and implementation of dynamic mixing rely on professional experience (both audio and game aspects) and development tools (such as game engines or audio middleware), involving the use of many parameter combinations, and the threshold for ordinary users is relatively high.

[0003] To address the above-mentioned problems, no effective solution has been proposed yet. Summary of the invention

[0004] At least some embodiments of the present disclosure provide an audio processing method, device, computer-readable storage medium, and electronic device to at least solve the technical problem of the difficulty in audio mixing processing in the related art.

[0005] According to one embodiment of the present disclosure, there is provided an audio processing method, wherein a graphical user interface is provided through a terminal device, and the content displayed by the graphical user interface includes at least preset controls. The method comprises: in response to a preset operation acting on the preset control, obtaining original audio, and determining a target mixing template corresponding to the preset operation from a plurality of mixing templates, wherein different mixing templates are used to characterize sound mixing strategies applied to different scenarios; obtaining target mixing parameters corresponding to the target mixing template; and performing mixing processing on the original audio based on the target mixing parameters to obtain the target audio.

[0006] According to one embodiment of the present disclosure, there is also provided an audio processing device, which provides a graphical user interface through a terminal device, and the content displayed by the graphical user interface includes at least preset controls. The device includes: a response module, which is used to respond to a preset operation acting on the preset control, obtain original audio, and determine a target mixing template corresponding to the preset operation from multiple mixing templates, wherein different mixing templates are used to characterize sound mixing strategies applied to different scenarios; an acquisition module, which is used to obtain target mixing parameters corresponding to the target mixing template; and a processing module, which is used to perform mixing processing on the original audio based on the target mixing parameters to obtain the target audio.

[0007] According to one embodiment of the present disclosure, a computer-readable storage medium is further provided, in which a computer program is stored, wherein the computer program is configured to execute any of the above-mentioned audio processing methods when running.

[0008] According to one embodiment of the present disclosure, an electronic device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and the processor is configured to run the computer program to execute any of the above audio processing methods.

[0009] In at least some embodiments of the present disclosure, in response to a preset operation acting on a preset control, original audio is obtained, and a target mixing template corresponding to the preset operation is determined from multiple mixing templates, wherein different mixing templates are used to characterize sound mixing strategies applied to different scenarios; target mixing parameters corresponding to the target mixing templates are obtained; and the original audio is mixed based on the target mixing parameters to obtain the target audio, thereby reducing the difficulty of mixing the audio. It is easy to notice that the sound mixing strategies for different scenarios can be pre-defined through the mixing templates. After the original audio is obtained, the target mixing template corresponding to the sound mixing strategy for the scenario required by the user can be determined from multiple mixing templates. The original audio can be mixed according to the target mixing template, thereby making the operation of mixing the original audio simpler, so as to achieve the purpose of reducing the difficulty of mixing the audio, thereby solving the technical problem of the difficulty of mixing the audio in the related art. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] The drawings described herein are used to provide a further understanding of the present disclosure and constitute a part of the present application. The illustrative embodiments of the present disclosure and their descriptions are used to explain the present disclosure and do not constitute an improper limitation on the present disclosure. In the drawings:

[0011] Figure 1 is a hardware structure block diagram of a mobile terminal of an audio processing method according to an embodiment of the present disclosure;

[0012] Figure 2is a flowchart of an audio processing method according to one embodiment of the present disclosure;

[0013] Figure 3 is a schematic diagram of a mixing parameter and a mapping curve according to an embodiment of the present disclosure;

[0014] Figure 4 is a structural block diagram of a device according to one embodiment of the present disclosure;

[0015] Figure 5 is a schematic diagram of an electronic device according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0016] In order to enable those skilled in the art to better understand the scheme of the present disclosure, the technical scheme in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only part of the embodiments of the present disclosure, not all of the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by ordinary technicians in the field without creative work should fall within the scope of protection of the present disclosure.

[0017] It should be noted that the terms "first", "second", etc. in the specification and claims of the present disclosure and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present disclosure described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product, or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products, or devices.

[0018] In a possible implementation, with respect to the mixing processing methods commonly used in the context of the audio processing field, the inventor, after practice and careful research, still found that there is a technical problem that mixing audio is difficult. Based on this, the game scene applied to the embodiment of the present disclosure can be any game scene that requires audio, and the game type targeted can be any game type. An audio processing method is proposed, and the technical concept adopted is to reduce the difficulty of users mixing the original audio by setting multiple mixing templates, so that users can more conveniently mix the original audio, thereby solving the technical problem of the difficulty of mixing audio in the related technology, and then achieving the technical effect of improving the convenience of mixing audio.

[0019] The above method embodiments involved in the present disclosure can be executed in a mobile terminal, a computer terminal or a similar computing device. Taking running on a mobile terminal as an example, the mobile terminal can be a smart phone, a tablet computer, a handheld computer, a mobile Internet device, a PAD, a game console and other terminal devices. Figure 1 FIG. 1 is a hardware structure block diagram of a mobile terminal of an audio processing method according to an embodiment of the present disclosure. Figure 1 As shown, the mobile terminal may include one or more ( Figure 1 The processor 102 (only one is shown) may include, but is not limited to, a central processing unit (CPU), a graphics processing unit (GPU), a digital signal processing (DSP) chip, a microprocessor (MCU), a field-programmable logic device (FPGA), a neural network processor (NPU), a tensor processing unit (TPU), an artificial intelligence (AI) type processor, etc.) and a memory 104 for storing data. In one embodiment of the present disclosure, it may also include: an input / output device 108 and a display device 110.

[0020] In some optional embodiments mainly based on game scenarios, the above-mentioned device can also provide a human-computer interaction interface with a touch-sensitive surface, which can sense finger contact and / or gestures to perform human-computer interaction with a graphical user interface (GUI). The human-computer interaction function may include the following interactions: creating web pages, drawing, word processing, making electronic documents, games, video conferencing, instant messaging, sending and receiving emails, call interface, playing digital videos, playing digital music and / or web browsing, etc. The executable instructions for executing the above-mentioned human-computer interaction functions are configured / stored in a computer program product or readable storage medium executable by one or more processors.

[0021] Those skilled in the art will understand that Figure 1 The structure shown is only for illustration and does not limit the structure of the mobile terminal. Figure 1 More or fewer components as shown, or with Figure 1 Different configurations are shown.

[0022] First, some nouns or terms that appear in the process of describing the embodiments of the present disclosure are subject to the following explanations:

[0023] User-generated content (UGC) can be displayed or provided to other users through the Internet platform.

[0024] Wave Works Interactive Sound Engine (Wwise for short) is software that can be used for interactive media and video games. It consists of audio creation tools and a sound engine.

[0025] Real-Time Parameter Control (RTPC): It can be a parameter control method used to map external program parameters to internal audio parameters.

[0026] Mixing: Integrate multiple signal sources into a single audio track (mono or multi-channel), adjust the parameters of each signal source or add effects to optimize the interaction and obtain a better overall listening experience.

[0027] Equalizer (EQ for short): In the audio field, it refers to a hardware or software tool that suppresses or enhances different frequency bands of the signal to modify the overall listening experience.

[0028] Dynamic compression: In the audio field, it generally refers to dynamically adjusting the audio output amplitude, especially suppressing it within a certain range when the volume is too high. It is usually used to control the audio output within a reasonable range to avoid distortion.

[0029] Side-chaining, in the audio field, mainly refers to a derivative method or function applied to effects such as dynamic compression. That is, the effector controls the processing of the current signal according to the amplitude and other values ​​of another signal. It is often used to achieve the avoidance of secondary content over important content.

[0030] User Interface (UI) refers to the medium or specific form for interaction and information exchange between the software system and the user.

[0031] According to one embodiment of the present disclosure, an embodiment of an audio processing method is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although the logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0032] In a possible implementation, an embodiment of the present disclosure provides an audio processing method that provides a graphical user interface through a terminal device, wherein the terminal device may be the local terminal device mentioned above, or may be a client device in the cloud interaction system mentioned above. Figure 2 is a flow chart of an audio processing method according to one embodiment of the present disclosure, wherein a graphical user interface is provided by a terminal device, and the content displayed by the graphical user interface includes at least preset controls, such as Figure 2 As shown, the method comprises the following steps:

[0033] Step S202, in response to a preset operation acting on a preset control, original audio is acquired, and a target mixing template corresponding to the preset operation is determined from a plurality of mixing templates.

[0034] Among them, different mixing templates are used to represent the sound mixing strategies applied to different scenarios.

[0035] Different mixing templates among the above-mentioned multiple mixing templates may include mixing parameters, wherein the mixing parameters include but are not limited to: loudness (volume), balance, effects (reverberation, dynamic compression) and other parameters.

[0036] The above-mentioned preset controls may be physical controls or virtual controls, wherein the preset controls may be buttons, sliders, progress bars, toolbars, scroll bars, and the preset controls are not specifically limited here. The above-mentioned preset operations may be click, slide, long press, drag, etc., and the operations of the preset controls are not specifically limited here.

[0037] The above-mentioned graphical user interface can be an interactive interface provided by the editor, such as a drop-down list, a programming interface, through which the user can perform preset operations on preset controls to obtain the original audio and determine the target mixing template corresponding to the preset operation from multiple mixing templates.

[0038] In an optional embodiment, for complex and changeable game scenarios, the type of mixing template can be determined based on common game categories and typical scenarios that most users can understand; when controlling the adjustment of mixing parameters in multiple dimensions, a single parameter can be used as the template type, and a mathematical relationship can be established between the parameter and all other mixing parameters. During the game, the mixing parameters can change with the template type.

[0039] In shooting games, there can be many types of mixing templates to suit different scenarios and game types; for example, in military shooting games, mixing templates can affect the user's hearing of explosions, gunshots, battle cries, etc. to enhance the player's combat experience, while in science fiction shooting games, mixing templates can modify the sound effects of future technology, such as laser gunshots, robot sounds, etc.

[0040] In role-playing games, remix templates can be used to create different scene atmospheres and character features; for example, in fantasy role-playing games, remix templates can affect the user's hearing of magic sounds, monster roars, background sound effects of city life, etc., to increase the immersion of the game, while in modern urban role-playing games, remix templates can modify city traffic sounds, crowd noise, nightclub music, etc. to enhance the sense of reality.

[0041] In racing games, remix templates can be used to reproduce real racing scenes and increase the tension and excitement of the game. For example, in racing games, remix templates can affect the user's hearing of engine roars, tire friction sounds, brake sounds, etc. to simulate a real racing experience. At the same time, it can also modify the audience cheering, racing car collision sounds, etc., to increase the entertainment of the game.

[0042] In business simulation games, mixing templates can be used to reproduce various business scenarios and environments. For example, in farm management games, mixing templates can modify animal calls, agricultural machinery operation sounds, natural environment sounds, etc. to increase the realism of the game. In city construction management games, mixing templates can affect the user's hearing of construction sounds, citizens' conversations, city traffic sounds, etc., to enhance the sense of immersion in the game.

[0043] From the above examples, it can be seen that the mixing template can be determined according to the type and scene of the game to create a more realistic and immersive gaming experience. Different types of games require different sound effects, and the types of mixing templates will also vary accordingly. Further, taking the practice in a game editor project as an example, the following mixing strategy can be adopted. The editor can provide an interactive interface or a programming interface so that users can switch mixing templates. Users can switch templates through a drop-down list in the interactive interface. As shown in Table 1, the mixing parameters corresponding to different mixing templates are shown, where blank cells are used to indicate that no parameter adjustment is made and the status quo is maintained.

[0044] Table 1

[0045]

[0046] In an optional embodiment, the types of remix templates can be summarized and refined by integrating game categories and game scenes. For example, the practice of the present disclosure in a game editing project can adopt the following classifications: default, action, combat, multiplayer online combat, casual, role-playing game type, general plot, nostalgic plot. The classification design has a certain flexibility and can be updated or expanded with the iteration of the product; the design principle of the remix template can be to adapt to the mainstream game categories and scenes facing the editor with limited classification to meet common user needs.

[0047] Step S204: obtaining target mixing parameters corresponding to the target mixing template.

[0048] The above-mentioned target mixing parameters may be one or more, wherein the target mixing parameters include but are not limited to: loudness, equalization, effector (reverberation, compression) parameters, etc.

[0049] In an optional embodiment, the target mixing parameters under the target mixing template may be determined according to the value of the template number corresponding to the target mixing template. The target mixing parameters may be values ​​corresponding to different types of mixing.

[0050] For example, the mixing template with template number 0 can be the default template (Default), in which all mixing parameters are not adjusted, effects such as reverberation are turned off, and the sound remains original; the mixing template with template number 8 can be a nostalgic plot template, in which the voice volume can be increased, the mid-frequency of other content can be weakened by EQ, and the reverberation effect is turned on for the voice content.

[0051] Step S206: performing mixing processing on the original audio based on the target mixing parameters to obtain the target audio.

[0052] In an optional embodiment, after obtaining the target mixing parameters, the various mixing values ​​of the original audio can be adjusted according to the adjustment method included in the target mixing parameters to obtain the target audio. It should be noted that the mixing process of the original audio can be a real-time dynamic mixing process of the original audio, and the original audio can be mixed in real time during the playback of the original audio, so that the played audio is the target audio obtained after the mixing process of the original audio.

[0053] In the development of game audio, more emphasis is placed on mixing, for example, dynamic mixing. Compared with traditional mixing in the record or film and television industries, the characteristic of dynamic mixing is that the parameters are not fixed, but change in real time during playback according to certain strategies to adapt to the game situation or player operation. In the process of mixing audio, there are two concepts: dynamic compression and dynamic mixing. Among them, dynamic compression is a processing for signal amplitude, which is more common in the traditional mixing process; dynamic mixing is different from traditional mixing. It is a new concept that mainly accompanies the development of game audio, emphasizing that various mixing parameters (including dynamic compression and others) are all variable in real time during playback.

[0054] Since the design and implementation of dynamic mixing has a high threshold for ordinary users, the present disclosure encapsulates the combination of several parameters into a simple "mixing template. Different mixing templates reflect mixing strategies for different scenarios, and simplify parameter adjustments in multiple dimensions into template switching in a single dimension. In terms of interactive design, complex and professional audio concepts or terms are avoided, and templates are defined in popular terms. For users, the interactive form of "template selection" is simple and easy to use, and they can easily experience relatively professional "dynamic mixing".

[0055] In at least some embodiments of the present disclosure, in response to a preset operation acting on a preset control, original audio is obtained, and a target mixing template corresponding to the preset operation is determined from multiple mixing templates, wherein different mixing templates are used to characterize sound mixing strategies applied to different scenarios; target mixing parameters corresponding to the target mixing templates are obtained; and the original audio is mixed based on the target mixing parameters to obtain the target audio, thereby reducing the difficulty of mixing the audio. It is easy to notice that the sound mixing strategies for different scenarios can be pre-defined through the mixing templates. After the original audio is obtained, the target mixing template corresponding to the sound mixing strategy for the scenario required by the user can be determined from multiple mixing templates. The original audio can be mixed according to the target mixing template, thereby making the operation of mixing the original audio simpler, so as to achieve the purpose of reducing the difficulty of mixing the audio, thereby solving the technical problem of the difficulty of mixing the audio in the related art.

[0056] In the above embodiment of the present application, in response to a preset operation acting on a preset control, a target mixing template corresponding to the preset operation is determined from multiple mixing templates, including: in response to a first click operation acting on the preset control, a list window is displayed in a graphical user interface, wherein the list window displays multiple mixing templates; in response to a selection operation acting on multiple mixing templates, the mixing template corresponding to the selection operation is determined as the target mixing template.

[0057] The above-mentioned preset control may be a control for displaying a list window. The above-mentioned first click operation may be that the user directly clicks the preset control in the graphical user interface, or the above-mentioned first click operation may be that the user clicks the preset control in the graphical user interface by means of a mouse or the like.

[0058] In an optional embodiment, in response to the first click operation on the preset control, a list window can be displayed in the graphical user interface so that the user can view multiple remix templates through the list window, wherein the specific form of the list window is not specifically limited here; optionally, the user can view multiple remix templates through a drop-down list, and can also determine to perform a selection operation on multiple remix templates through the drop-down list, thereby determining that the remix template corresponding to the selection operation is the target remix template. This method is suitable for setting a remix template for the entire game or a certain scene.

[0059] In the above embodiment of the present application, in response to a preset operation acting on a preset control, a target mixing template corresponding to the preset operation is determined from multiple mixing templates, including: in response to a second click operation acting on the preset control, a mixing interface interface is displayed in a graphical user interface, wherein multiple mixing templates are displayed in the mixing interface interface; in response to a selection operation acting on multiple mixing templates, the mixing template corresponding to the selection operation is determined as the target mixing template.

[0060] The above-mentioned preset control can be used to display the control of the mixing interface. The above-mentioned second click operation can be that the user directly clicks the preset control in the graphical user interface, and the above-mentioned second click operation can also be that the user clicks the preset control in the graphical user interface by means of a mouse or the like.

[0061] In an optional embodiment, in response to a second click operation on a preset control, a mixing interface can be displayed in a graphical user interface so that a user can view multiple mixing templates through the mixing interface, wherein the specific form of the mixing interface is not specifically limited herein; optionally, a user can select a desired target mixing template by switching between multiple mixing templates. A game editor can generally support users to write programs to control game logic, and the switching function of mixing templates can be reflected in a programming interface provided by the editor to the user so that the user can control the game logic more flexibly, thereby switching mixing templates in any situation.

[0062] In the above embodiment of the present application, obtaining target mixing parameters corresponding to the target mixing template includes: obtaining target identification information corresponding to the target mixing template; and determining the target mixing parameters based on a mapping relationship between the target identification information and the target mixing parameters.

[0063] The above target identification information can be used to indicate the type of the mixing template, wherein the target mixing template and the target mixing parameters can be understood as a "one-to-many" mathematical relationship. The only independent variable in the mathematical relationship can be the template type, for example, 0 = Default, 1 = Action, 2 = Combat, ... and so on, wherein 0, 1, 2 can be used as the target identification information; multiple dependent variables can be various mixing parameters, for example, the loudness of a group of sounds, the side chain compression switch, the reverberation parameters, the total voice limit, etc.

[0064] For example, the mixing template with target identification information of 0 can be the Default template, in which all mixing parameters are not adjusted, effects such as reverberation are turned off, and the sound remains original; the mixing template with target identification information of 8 can be a nostalgic plot template, in which the voice volume can be increased, the mid-frequency of other content can be weakened by EQ, and the reverberation effect is turned on for the voice content.

[0065] In an optional embodiment, a mechanism may be established to reflect the mathematical relationship between the target mixing parameters and the target identification information, and to make the former change following the latter. For example, the target identification information may be set to P, and the music loudness adjustment value may be set to V; when P=5, V=+3, and when P=6, V=-3.

[0066] In the above embodiment of the present application, based on the mapping relationship between the target identification information and the target mixing parameters, the target mixing parameters are determined, including: obtaining multiple mapping curves, wherein different mapping curves are used to characterize the mapping relationship between different mixing templates and different mixing parameters; reading curve values ​​corresponding to the target identification information from the multiple mapping curves; and obtaining the target mixing parameters based on the read curve values.

[0067] Taking the practice in the game editor project as an example, audio development can be based on the interactive sound engine (Wwise) middleware, set a real-time parameter control (RTPC) as the target identification information, set the mapping curve in the Wwise project, determine the relationship between each mixing parameter and the real-time parameter control, and when the editor is running, the program reads the user's template selection and sends it to the Wwise engine through the real-time parameter control. The Wwise engine links the mixing parameters in real time according to the mapping curve and reflects it in the auditory output. Among them, the real-time parameter control can be the parameters required to build the curve, and the template can be assigned to set the identification information.

[0068] The curve values ​​read from the plurality of mapping curves may be values ​​corresponding to different nodes in the curves.

[0069] Figure 3 is a schematic diagram of a mixing parameter and a mapping curve according to an embodiment of the present disclosure, such as Figure 3 As shown, the horizontal axis represents the identification information of the mapping curve, which is used to represent different types of mixing templates, and the vertical axis represents the mixing parameters, which are used to represent the specific values ​​of the mixing parameters. The figure shows the curve relationship between multiple mixing parameters related to the equalizer and P. The ideas of other audio middleware are similar and will not be repeated here. If you do not use audio middleware, you can develop the audio bottom layer yourself to realize the above association, that is, you can realize the mathematical relationship between the dependent variable and the independent variable.

[0070] In actual scenarios, Wwise can receive RTPC values ​​sent by external programs, respond in real time, and adjust various mixing parameters according to the relationship set by the curve. For example, Figure 3 In the figure is a set of mixing parameters related to a certain EQ. When the RTPC named P is adjusted to 0, the mixing parameters Band1Gain = 0, Band3Gain = 0; when P is adjusted to 1, Band1Gain = 0, Band3Gain = 3; when P is adjusted to 2, Band1Gain = 6, Band3Gain = -6. And so on, the real-time linkage of other parameters and P is similar.

[0071] In the above embodiment of the present application, the target mixing parameters are determined based on the mapping relationship between the target identification information and the target mixing parameters, including: obtaining a mapping function corresponding to the mapping relationship; inputting the target identification information into the mapping function, and obtaining the output result of the mapping function to obtain the target mixing parameters.

[0072] The above-mentioned mapping function may be a function obtained by establishing a mapping relationship in a mathematical manner.

[0073] In an optional embodiment, a mapping function corresponding to the mapping relationship may be obtained, and by inputting the target identification information corresponding to the target mixing template into the mapping function, a corresponding output result may be calculated by the mapping function, thereby determining the output result as the target mixing parameter.

[0074] It should be noted that the correspondence between different templates and different mixing parameters may be fixed, and the user can generally achieve different mixing effects by switching different templates and changing different mixing parameters.

[0075] In the above embodiment of the present application, the method also includes: constructing multiple mixing templates based on different scenarios; constructing multiple mapping curves based on multiple mixing parameters, wherein the multiple mixing parameters correspond one-to-one to the multiple mapping curves; adjusting the curve values ​​of the multiple mapping curves to determine the mapping relationship between the multiple mixing templates and the multiple mixing parameters.

[0076] In an optional embodiment, multiple mapping curves may be constructed in advance based on multiple mixing parameters, such as Figure 3 As shown, corresponding mapping curves can be constructed for different mixing parameters, so that the mixing parameters and the mapping curves correspond one to one. After obtaining the mapping curve, the user can adjust the curve value of the mapping curve according to actual needs, thereby determining the mapping relationship between multiple mixing templates and multiple mixing parameters. For example, when the RTPC named P is adjusted to 0, the mixing parameters Band1Gain=0, Band3Gain=0; when P is adjusted to 1, Band1Gain=0, Band3Gain=3; when P is adjusted to 2, Band1Gain=6, Band 3Gain=-6. By analogy, the real-time linkage of other parameters and P is similar.

[0077] Through the description of the above implementation methods, those skilled in the art can clearly understand that the method according to the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present disclosure, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal device (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods of each embodiment of the present disclosure.

[0078] In the present embodiment, a device is also provided, which is used to implement the above-mentioned embodiments and preferred implementation modes, and the descriptions that have been made will not be repeated. As used below, the term "module" can implement a combination of software and / or hardware of a predetermined function. Although the devices described in the following embodiments are preferably implemented in software, the implementation of hardware, or a combination of software and hardware, is also possible and conceived.

[0079] Figure 4 is a structural block diagram of an apparatus according to one embodiment of the present disclosure, wherein a graphical user interface is provided through a terminal device, and the content displayed by the graphical user interface includes at least preset controls, such as Figure 4 As shown, the device 400 includes: a response module 402 , an acquisition module 404 , and a processing module 406 .

[0080] Among them, the response module is used to respond to the preset operation acting on the preset control, obtain the original audio, and determine the target mixing template corresponding to the preset operation from multiple mixing templates, wherein different mixing templates are used to characterize the sound mixing strategies applied to different scenarios; the acquisition module is used to obtain the target mixing parameters corresponding to the target mixing template; the processing module is used to mix the original audio based on the target mixing parameters to obtain the target audio.

[0081] In the above embodiment of the present disclosure, the response module is also used to respond to a first click operation on a preset control, display a list window in a graphical user interface, wherein a plurality of mixing templates are displayed in the list window, and respond to a selection operation on the plurality of mixing templates, determine that the mixing template corresponding to the selection operation is the target mixing template.

[0082] In the above-mentioned embodiment of the present disclosure, the response module is also used to respond to a second click operation on a preset control, display a mixing interface in a graphical user interface, wherein a plurality of mixing templates are displayed in the mixing interface, and respond to a selection operation on the plurality of mixing templates, and determine that the mixing template corresponding to the selection operation is the target mixing template.

[0083] In the above embodiment of the present disclosure, the acquisition module is further used to acquire target identification information corresponding to the target mixing template, and determine the target mixing parameters based on the mapping relationship between the target identification information and the target mixing parameters.

[0084] In the above-mentioned embodiment of the present disclosure, the acquisition module is further used to acquire multiple mapping curves, wherein different mapping curves are used to characterize the mapping relationship between different mixing templates and different mixing parameters, and the curve values ​​corresponding to the target identification information are read from the multiple mapping curves, and the target mixing parameters are obtained based on the read curve values.

[0085] In the above embodiment of the present disclosure, the acquisition module is further used to acquire a mapping function corresponding to the mapping relationship, input the target identification information into the mapping function, and acquire an output result of the mapping function to obtain the target mixing parameter.

[0086] In the above embodiments of the present disclosure, the device further includes: a construction module and an adjustment module.

[0087] Among them, the construction module is used to construct multiple mixing templates based on different scenarios, and to construct multiple mapping curves based on multiple mixing parameters, wherein the multiple mixing parameters correspond one-to-one to the multiple mapping curves, and the curve values ​​of the multiple mapping curves are adjusted to determine the mapping relationship between the multiple mixing templates and the multiple mixing parameters.

[0088] It should be noted that the above modules can be implemented by software or hardware. For the latter, it can be implemented in the following ways, but not limited to: the above modules are all located in the same processor; or the above modules are located in different processors in any combination.

[0089] An embodiment of the present disclosure further provides a computer-readable storage medium, in which a computer program is stored, wherein the computer program is configured to execute the steps of any of the above method embodiments when running.

[0090] Optionally, in this embodiment, the above-mentioned computer-readable storage medium may include but is not limited to: a USB flash drive, a read-only memory (ROM), a random access memory (RAM), a mobile hard disk, a magnetic disk or an optical disk, and other media that can store computer programs.

[0091] Optionally, in this embodiment, the computer-readable storage medium may be located in any one of the computer terminals in a computer terminal group in a computer network, or in any one of the mobile terminals in a mobile terminal group.

[0092] Optionally, in this embodiment, the computer-readable storage medium may be configured to store a computer program for performing the following steps:

[0093] Step S101, in response to a preset operation acting on a preset control, obtaining original audio, and determining a target mixing template corresponding to the preset operation from a plurality of mixing templates, wherein different mixing templates are used to represent sound mixing strategies applied to different scenarios;

[0094] Step S102, obtaining target mixing parameters corresponding to the target mixing template;

[0095] Step S103, performing mixing processing on the original audio based on the target mixing parameters to obtain the target audio.

[0096] Optionally, the computer-readable storage medium is also configured to store program codes for executing the following steps: in response to a first click operation on a preset control, displaying a list window in a graphical user interface, wherein a plurality of mixing templates are displayed in the list window; in response to a selection operation on a plurality of mixing templates, determining that the mixing template corresponding to the selection operation is a target mixing template.

[0097] Optionally, the computer-readable storage medium is further configured to store program codes for executing the following steps: in response to a second click operation on a preset control, displaying a mixing interface in a graphical user interface, wherein a plurality of mixing templates are displayed in the mixing interface; in response to a selection operation on a plurality of mixing templates, determining that the mixing template corresponding to the selection operation is a target mixing template.

[0098] Optionally, the computer-readable storage medium is further configured to store program codes for executing the following steps: obtaining target identification information corresponding to the target mixing template; and determining the target mixing parameters based on a mapping relationship between the target identification information and the target mixing parameters.

[0099] Optionally, the computer-readable storage medium is further configured to store program codes for executing the following steps: obtaining multiple mapping curves, wherein different mapping curves are used to characterize the mapping relationship between different mixing templates and different mixing parameters; reading curve values ​​corresponding to the target identification information from the multiple mapping curves; and obtaining the target mixing parameters based on the read curve values.

[0100] Optionally, the computer-readable storage medium is further configured to store program codes for executing the following steps: obtaining a mapping function corresponding to the mapping relationship; inputting the target identification information into the mapping function, and obtaining an output result of the mapping function to obtain a target mixing parameter.

[0101] Optionally, the computer-readable storage medium is further configured to store program codes for executing the following steps: constructing multiple mixing templates based on different scenarios; constructing multiple mapping curves based on multiple mixing parameters, wherein the multiple mixing parameters correspond one-to-one to the multiple mapping curves; adjusting the curve values ​​of the multiple mapping curves to determine the mapping relationship between the multiple mixing templates and the multiple mixing parameters.

[0102] In the computer-readable storage medium of this embodiment, an audio processing method is provided, which responds to a preset operation acting on a preset control, obtains original audio, and determines a target mixing template corresponding to the preset operation from multiple mixing templates, wherein different mixing templates are used to characterize sound mixing strategies applied to different scenarios; obtains target mixing parameters corresponding to the target mixing template; and mixes the original audio based on the target mixing parameters to obtain the target audio, thereby reducing the difficulty of mixing the audio. It is easy to notice that the sound mixing strategies for different scenarios can be pre-defined through the mixing template. After the original audio is obtained, the target mixing template corresponding to the sound mixing strategy for the scenario required by the user can be determined from multiple mixing templates. The original audio can be mixed according to the target mixing template, thereby making the operation of mixing the original audio simpler, so as to achieve the purpose of reducing the difficulty of mixing the audio, thereby solving the technical problem of the difficulty of mixing the audio in the related art.

[0103] Through the description of the above implementation, it is easy for those skilled in the art to understand that the example implementation described here can be implemented by software, or by software combined with necessary hardware. Therefore, the technical solution according to the implementation of the present disclosure can be embodied in the form of a software product, which can be stored in a computer-readable storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, including several instructions to enable a computing device (which can be a personal computer, a server, a terminal device, or a network device, etc.) to execute the method according to the implementation of the present disclosure.

[0104] In the exemplary embodiments of the present application, a program product capable of implementing the above method of the present embodiment is stored on a computer-readable storage medium. In some possible implementations, various aspects of the embodiments of the present disclosure may also be implemented in the form of a program product, which includes a program code. When the program product is run on a terminal device, the program code is used to enable the terminal device to execute the steps described in the above "Exemplary Method" section of the present embodiment according to various exemplary implementations of the present disclosure.

[0105] According to the program product for implementing the above method in the embodiment of the present disclosure, it can adopt a portable compact disk read-only memory (CD-ROM) and include program code, and can be run on a terminal device, such as a personal computer. However, the program product of the embodiment of the present disclosure is not limited to this. In the embodiment of the present disclosure, the computer-readable storage medium can be any tangible medium containing or storing a program, which can be used by or in combination with an instruction execution system, an apparatus or a device.

[0106] The program product may be in any combination of one or more computer-readable media. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination thereof. More specific examples (non-exhaustive) of computer-readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof.

[0107] It should be noted that the program code contained in the computer-readable storage medium can be transmitted using any appropriate medium, including but not limited to wireless, wired, optical cable, RF, etc., or any suitable combination of the above.

[0108] An embodiment of the present disclosure further provides an electronic device, including a memory and a processor, wherein a computer program is stored in the memory, and the processor is configured to run the computer program to execute the steps in any one of the above method embodiments.

[0109] Optionally, the electronic device may further include a transmission device and an input / output device, wherein the transmission device is connected to the processor, and the input / output device is connected to the processor.

[0110] Optionally, in this embodiment, the processor may be configured to perform the following steps through a computer program:

[0111] Step S101, in response to a preset operation acting on a preset control, obtaining original audio, and determining a target mixing template corresponding to the preset operation from a plurality of mixing templates, wherein different mixing templates are used to represent sound mixing strategies applied to different scenarios;

[0112] Step S102, obtaining target mixing parameters corresponding to the target mixing template;

[0113] Step S103, performing mixing processing on the original audio based on the target mixing parameters to obtain the target audio.

[0114] Optionally, the above-mentioned processor can also be configured to perform the following steps through a computer program: in response to a first click operation applied to a preset control, a list window is displayed in a graphical user interface, wherein a plurality of mixing templates are displayed in the list window; in response to a selection operation applied to a plurality of mixing templates, a mixing template corresponding to the selection operation is determined as a target mixing template.

[0115] Optionally, the above-mentioned processor can also be configured to perform the following steps through a computer program: in response to a second click operation applied to a preset control, a mixing interface is displayed in a graphical user interface, wherein a plurality of mixing templates are displayed in the mixing interface; in response to a selection operation applied to a plurality of mixing templates, a mixing template corresponding to the selection operation is determined as a target mixing template.

[0116] Optionally, the processor may be configured to execute the following steps through a computer program: obtaining target identification information corresponding to the target mixing template; and determining the target mixing parameters based on a mapping relationship between the target identification information and the target mixing parameters.

[0117] Optionally, the processor may also be configured to perform the following steps through a computer program: obtaining a plurality of mapping curves, wherein different mapping curves are used to characterize the mapping relationship between different mixing templates and different mixing parameters; reading curve values ​​corresponding to the target identification information from the plurality of mapping curves; and obtaining the target mixing parameters based on the read curve values.

[0118] Optionally, the computer-readable storage medium is further configured to store program codes for executing the following steps: obtaining a mapping function corresponding to the mapping relationship; inputting the target identification information into the mapping function, and obtaining an output result of the mapping function to obtain a target mixing parameter.

[0119] Optionally, the processor may also be configured to perform the following steps through a computer program: construct multiple mixing templates based on different scenarios; construct multiple mapping curves based on multiple mixing parameters, wherein the multiple mixing parameters correspond one-to-one to the multiple mapping curves; and adjust the curve values ​​of the multiple mapping curves to determine the mapping relationship between the multiple mixing templates and the multiple mixing parameters.

[0120] In the electronic device of this embodiment, an audio processing method is provided, which responds to a preset operation acting on a preset control, obtains original audio, and determines a target mixing template corresponding to the preset operation from multiple mixing templates, wherein different mixing templates are used to characterize sound mixing strategies applied to different scenarios; obtains target mixing parameters corresponding to the target mixing template; and mixes the original audio based on the target mixing parameters to obtain the target audio, thereby reducing the difficulty of mixing the audio. It is easy to notice that the sound mixing strategies for different scenarios can be pre-defined through the mixing template. After the original audio is obtained, the target mixing template corresponding to the sound mixing strategy for the scenario required by the user can be determined from multiple mixing templates, and the original audio can be mixed according to the target mixing template, thereby making the operation of mixing the original audio simpler, so as to achieve the purpose of reducing the difficulty of mixing the audio, thereby solving the technical problem of the difficulty of mixing the audio in the related art.

[0121] Figure 5 is a schematic diagram of an electronic device according to an embodiment of the present disclosure. Figure 5 As shown, the electronic device 500 is merely an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0122] like Figure 5 As shown, the electronic device 500 is in the form of a general computing device. The components of the electronic device 500 may include but are not limited to: at least one processor 510, at least one memory 520, a bus 530 connecting different system components (including the memory 520 and the processor 510), and a display 540.

[0123] The memory 520 stores program codes, which can be executed by the processor 510, so that the processor 510 executes the steps described in the method section of the embodiment of the present application according to various exemplary embodiments of the present disclosure.

[0124] The memory 520 may include a readable medium in the form of a volatile storage unit, such as a random access memory unit (RAM) 5201 and / or a cache memory unit 5202, and may further include a read-only memory unit (ROM) 5203, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory.

[0125] In some examples, the memory 520 may also include a program / utility 5204 having a set (at least one) of program modules 5205, such program modules 5205 including but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which or a combination thereof may include the implementation of a network environment. The memory 520 may further include a memory remotely disposed relative to the processor 510, and these remote memories may be connected to the electronic device 500 via a network. Examples of the above-mentioned network include but are not limited to the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0126] Bus 530 may represent one or more of several types of bus structures, including a memory unit bus or memory unit controller, a peripheral bus, an accelerated graphics port, a local bus of processor 510, or a bus using any of a variety of bus architectures.

[0127] The display 540 may be, for example, a touch screen liquid crystal display (LCD) that enables a user to interact with a user interface of the electronic device 500 .

[0128] Optionally, the electronic device 500 may also communicate with one or more external devices 600 (e.g., keyboards, pointing devices, Bluetooth devices, etc.), one or more devices that enable a user to interact with the electronic device 500, and / or any device that enables the electronic device 500 to communicate with one or more other computing devices (e.g., routers, modems, etc.). Such communication may be performed through an input / output (I / O) interface 550. Furthermore, the electronic device 500 may also communicate with one or more networks (e.g., a local area network (LAN), a wide area network (WAN), and / or a public network, such as the Internet) through a network adapter 560. Figure 5 As shown, the network adapter 560 communicates with other modules of the electronic device 500 via the bus 530. It should be understood that although Figure 5 Not shown, other hardware and / or software modules may be used in conjunction with the electronic device 500, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0129] The electronic device 500 may further include: a keyboard, a cursor control device (such as a mouse), an input / output interface (I / O interface), a network interface, a power supply and / or a camera.

[0130] It can be understood by those skilled in the art that Figure 5 The structure shown is for illustration only and does not limit the structure of the above electronic device. Figure 5 More or fewer components as shown, or with Figure 1 The memory 520 may be used to store computer programs and corresponding data, such as the computer programs and corresponding data corresponding to the audio processing method in the embodiment of the present disclosure. The processor 510 executes various functional applications and data processing by running the computer programs stored in the memory 520, that is, implements the above-mentioned audio processing method.

[0131] In the above embodiments of the present disclosure, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0132] In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. Among them, the device embodiments described above are only schematic. For example, the division of the units can be a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of units or modules, which can be electrical or other forms.

[0133] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple units. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0134] In addition, each functional unit in each embodiment of the present disclosure may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0135] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present disclosure is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present disclosure. The aforementioned storage medium includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, disk or optical disk and other media that can store program codes.

[0136] The above is only a preferred embodiment of the present disclosure. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principle of the present disclosure. These improvements and modifications should also be regarded as the scope of protection of the present disclosure.

Claims

1. An audio processing method, characterized in that: A graphical user interface is provided by a terminal device, wherein the content displayed by the graphical user interface includes at least a preset control, and the method includes: In response to a preset operation acting on the preset control, original audio is acquired, and a target mixing template corresponding to the preset operation is determined from a plurality of mixing templates, wherein different mixing templates are used to represent sound mixing strategies applied to different scenarios; Obtaining target mixing parameters corresponding to the target mixing template; The original audio is mixed based on the target mixing parameter to obtain the target audio.

2. The method according to claim 1, characterized in that In response to the preset operation acting on the preset control, determining the target mixing template corresponding to the preset operation from the multiple mixing templates includes: In response to a first click operation on the preset control, displaying a list window in the graphical user interface, wherein the list window displays the plurality of mixing templates; In response to a selection operation on the plurality of mixing templates, a mixing template corresponding to the selection operation is determined as the target mixing template.

3. The method according to claim 1, characterized in that In response to the preset operation acting on the preset control, determining the target mixing template corresponding to the preset operation from the multiple mixing templates includes: In response to a second click operation on the preset control, displaying a mixing interface in the graphical user interface, wherein the mixing interface displays the multiple mixing templates; In response to a selection operation on the plurality of mixing templates, a mixing template corresponding to the selection operation is determined as the target mixing template.

4. The method according to claim 1, characterized in that: Obtaining target mixing parameters corresponding to the target mixing template includes: Obtaining target identification information corresponding to the target mixing template; The target mixing parameters are determined based on a mapping relationship between the target identification information and the target mixing parameters.

5. The method according to claim 4, characterized in that Determining the target mixing parameters based on the mapping relationship between the target identification information and the target mixing parameters includes: Acquire multiple mapping curves, wherein different mapping curves are used to represent mapping relationships between the different mixing templates and different mixing parameters; Reading a curve value corresponding to the target identification information from the plurality of mapping curves; Based on the read curve value, the target mixing parameter is obtained.

6. The method according to claim 4, characterized in that Determining the target mixing parameters based on the mapping relationship between the target identification information and the target mixing parameters includes: Obtaining a mapping function corresponding to the mapping relationship; The target identification information is input into the mapping function, and an output result of the mapping function is acquired to obtain the target mixing parameter.

7. The method according to claim 4, characterized in that The method further comprises: Based on the different scenarios, construct the multiple mixing templates; Based on the plurality of mixing parameters, constructing a plurality of mapping curves, wherein the plurality of mixing parameters correspond one to one to the plurality of mapping curves; The curve values ​​of the plurality of mapping curves are adjusted to determine the mapping relationship between the plurality of mixing templates and the plurality of mixing parameters.

8. An audio processing device, characterized in that: A graphical user interface is provided by a terminal device, wherein the content displayed by the graphical user interface includes at least a preset control, and the apparatus includes: A response module, used to respond to a preset operation acting on the preset control, obtain original audio, and determine a target mixing template corresponding to the preset operation from a plurality of mixing templates, wherein different mixing templates are used to represent sound mixing strategies applied to different scenarios; An acquisition module, used to acquire target mixing parameters corresponding to the target mixing template; The processing module is used to perform mixing processing on the original audio based on the target mixing parameters to obtain the target audio.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, wherein the computer program is configured to execute the method according to any one of claims 1 to 7 when executed by a processor.

10. An electronic device comprising a memory and a processor, characterized in that: A computer program is stored in the memory, and the processor is configured to run the computer program to perform the method according to any one of claims 1 to 7.

Images