Audio processing method and device, and storage medium

Abstract

The embodiments of the present disclosure provide an audio processing method and device, and a storage medium. The audio processing method comprises: during a preview process of a video editing draft, if it is detected that a sound effect parameter of any target track of the current frame to be previewed has changed, clearing a pre-cached sound effect processing result of the target track and a pre-cached sound mixing result of all the tracks in a cache unit; starting from said current frame, re-acquiring pre-cached audio decoded data of the target track, and re-performing sound effect processing on the audio decoded data on the basis of the changed sound effect parameter; and starting from said current frame, re-performing sound mixing on sound effect processing results of all the tracks, and playing a sound mixing result. In the embodiments of the present disclosure, when, during a preview process of a video editing draft, a sound effect parameter of any target track of the current frame to be previewed has changed, audio decoding does not need to be re-performed, and only sound effect processing and sound mixing need to be re-performed, thus avoiding a time-consuming audio decoding process, such that sound effect adjustments can take effect in real time, thereby ensuring the smoothness of the preview process.

Description

Audio processing method, device and storage medium

[0001] This application claims priority to Chinese Patent Application No. 202311119206.1 filed on August 31, 2023, and the contents of the above-mentioned Chinese patent application disclosure are hereby incorporated by reference in their entirety as a part of this application. Technical Field

[0002] Embodiments of the present disclosure relate to an audio processing method, device, and storage medium. Background Art

[0003] Non-linear editing is the digital production of videos with the help of computers. It can quickly and accurately access materials in the form of frames or files directly from the computer's hard disk for editing, overcoming the shortcomings of linear editing. It also takes up less equipment and has a user-friendly human-computer interface, thereby improving video production efficiency.

[0004] During the non-linear editing process, the video editing draft can usually be previewed. During the preview process, audio processing will go through audio decoding, sound effect processing, mixing, mixed sound effect processing, and playback. However, during the preview process, if the user adjusts the sound effect in real time, the adjusted sound effect cannot take effect in real time, resulting in a large delay, which affects the user experience.

[0005] Summary of the Invention

[0006] Embodiments of the present disclosure provide an audio processing method, device, and storage medium.

[0007] In a first aspect, an embodiment of the present disclosure provides an audio processing method, comprising:

[0008] During the preview of the video editing draft, if it is detected that the sound effect parameters of any target track of the current preview frame have changed, the sound effect processing results of the target track pre-cached in the cache unit and the mixing results of all pre-cached tracks are cleared;

[0009] Re-acquire the pre-cached audio decoded data of the target track starting from the current frame to be previewed, and re-process the audio decoded data according to the changed sound effect parameters;

[0010] Remix the sound processing results of all tracks starting from the current preview frame and play the mixed results.

[0011] In a second aspect, an embodiment of the present disclosure provides an audio processing device, including:

[0012] a cache clearing unit configured to clear the pre-cached sound effect processing results of any target track in the previewed video draft and the pre-cached mixing results of all tracks in the cache unit if a change in the sound effect parameters of any target track in the currently previewed frame is detected;

[0013] an audio effect processing unit configured to reacquire the pre-cached audio decoded data of the target track starting from the current frame to be previewed, and re-process the audio decoded data according to the changed audio effect parameters;

[0014] A mixing unit configured to remix the audio processing results of all tracks starting from the current frame to be previewed; and

[0015] The playing unit is configured to play the mixing result.

[0016] In a third aspect, an embodiment of the present disclosure provides an electronic device, including: at least one processor and a memory;

[0017] The memory stores computer-executable instructions;

[0018] The at least one processor executes the computer-executable instructions stored in the memory, so that the at least one processor performs the audio processing method described in the first aspect and various possible designs of the first aspect.

[0019] In a fourth aspect, an embodiment of the present disclosure provides a computer-readable storage medium, in which computer execution instructions are stored. When a processor executes the computer execution instructions, the audio processing method described in the first aspect and various possible designs of the first aspect is implemented.

[0020] In a fifth aspect, an embodiment of the present disclosure provides a computer program product, comprising computer-executable instructions. When a processor executes the computer-executable instructions, the audio processing method as described in the first aspect and various possible designs of the first aspect is implemented. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, a brief introduction will be given below to the drawings required for use in the description of the embodiments. Obviously, the drawings described below are some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0022] FIG1 is an example diagram of an audio processing method provided by an embodiment of the present disclosure;

[0023] FIG2 is a flow chart of an audio processing method according to an embodiment of the present disclosure;

[0024] FIG3 is a flow chart of an audio processing method provided by another embodiment of the present disclosure;

[0025] FIG4 is a structural block diagram of an audio processing device provided by an embodiment of the present disclosure; and

[0026] FIG5 is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0027] To make the objectives, technical solutions, and advantages of the embodiments of the present disclosure more clear, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present disclosure, not all of the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments of the present disclosure without making any creative efforts shall fall within the scope of protection of the present disclosure.

[0028] During the non-linear editing process, the video editing draft can usually be previewed. During the preview process, the audio processing will go through audio decoding, sound effect processing, mixing, mixed sound effect processing, playback and other processes. During the preview process, if the user adjusts the sound effect in real time, it is necessary to re-decode the audio, perform sound effect processing, mixing, mixed sound effect processing and other processes according to the adjusted sound effect before continuing to play with the adjusted sound effect. As a result, the adjusted sound effect cannot take effect in real time, the delay is large, and the user experience is affected.

[0029] In particular, in one technical solution, considering that both audio decoding and sound effect processing are time-consuming, in order to ensure the smoothness of the preview process, data caching will be performed at each step in the audio processing process. Optionally, a decoding thread corresponding to each track can be used to perform audio decoding on each track separately, and the audio decoding data corresponding to each track can be cached separately; a sound effect processing thread corresponding to each track can be used to perform sound effect processing on the audio decoding data of each track separately (the audio decoding data is deleted from the cache after being read to ensure that the audio decoding process can continue), and the sound effect processing results corresponding to each track are cached separately; a mixing thread is used to mix the sound effect processing results of each track (the sound effect processing results are deleted from the cache after being read to ensure that the sound effect processing process can continue), and the mixing results are cached (after mixing, the mixing results can be further mixed with sound effects, of course, they can also not be mixed with sound effects), and then the mixing results are played, thereby realizing self-driving of the entire audio processing process. Based on the above-mentioned caching mechanism, if the user adjusts the sound effect in real time, since the audio decoding, sound effect processing, and mixing processes of the current frame to be previewed have been completed in advance, the audio decoding data and sound effect processing results of the current frame to be previewed have been cleared, and only the cached mixing result is left. The mixing result still uses the sound effect before the adjustment. Therefore, it is necessary to re-decode the audio from the current frame to be previewed, and perform sound effect processing and mixing according to the adjusted sound effect before continuing to play with the adjusted sound effect. As a result, the adjusted sound effect cannot take effect in real time, resulting in a large delay.

[0030] In order to solve the above technical problems, the present disclosure takes into account that when adjusting the sound effects during the preview of the video editing draft, the sound effect processing data cannot be reused, while the audio decoding data before the sound effect processing can be reused. Therefore, the audio decoding data is cached for a period of time to ensure that the audio decoding data will not be used again before the audio decoding data is cleared. In this way, when adjusting the sound effects, the pre-cached audio decoding data can be directly re-read without re-audio decoding. Only the sound effect processing and mixing need to be re-performed, which avoids the time-consuming audio decoding process, so that the sound effect adjustment can take effect in real time, and the smoothness of the preview process is ensured.

[0031] Specifically, the audio processing method disclosed herein is as follows: during the preview process of a video editing draft, if it is detected that the sound effect parameters of any target track of the current frame to be previewed have changed, the sound effect processing results of the target track pre-cached in the cache unit and the mixing results of all pre-cached tracks are cleared; audio decoding data of the pre-cached target track is re-acquired starting from the current frame to be previewed, and the audio decoding data is re-processed according to the changed sound effect parameters; the sound effect processing results of all tracks are re-mixed starting from the current frame to be previewed, and the mixing results are played.

[0032] Optionally, the audio processing during the preview of the video editing draft is shown in Figure 1. During the preview of the video editing draft, a driving unit can be used to drive the frame-by-frame processing of the video editing draft, and the audio decoding thread corresponding to each track is used to perform audio decoding on each track respectively, and the decoded data of each track is cached in the audio decoding cache unit corresponding to each track respectively; the sound effect processing thread corresponding to each track is used to read the audio decoding data of each track from the audio decoding cache unit corresponding to each track respectively to perform sound effect processing, and the sound effect processing results can be cached in the sound effect processing cache unit corresponding to each track respectively; the sound effect processing results are read from the sound effect processing cache units corresponding to all tracks by a mixing thread for mixing, and the mixed results can be cached in the mixing cache unit, and the mixed results are read from the mixing cache unit in sequence for playback.

[0033] Among them, when the sound effect processing thread corresponding to each track reads the audio decoding data of each track from the audio decoding cache unit corresponding to each track, the read audio decoding data will not be cleared from the audio decoding cache unit corresponding to each track, but will continue to be cached in the audio decoding cache unit; after the mixed results are read from the mixing cache unit in sequence for playback, the audio decoding cache unit corresponding to each track can be cleared according to the playback progress (preview progress), that is, the audio decoding data of each track corresponding to a frame that has been previewed will be cleared.

[0034] If it is detected that the sound effect parameters of any target track of the current frame to be previewed have changed, the sound effect processing results cached in the sound effect processing cache unit corresponding to the target track and the mixing results of all tracks in the mixing cache unit can no longer be used. Therefore, the sound effect processing cache unit and the mixing cache unit corresponding to the target track are cleared (the sound effect parameters of other tracks in the current frame to be previewed have not changed, and there is no need to clear the sound effect processing cache unit). At this time, the audio decoding data of the current frame to be previewed has not been cleared in the audio decoding cache unit corresponding to each track. Therefore, the audio decoding data of the target track can be re-read from the audio decoding cache data unit corresponding to the target track starting from the current frame to be previewed, and the audio decoding data can be re-processed according to the changed sound effect parameters; the sound effect processing results of all tracks are re-mixed starting from the current frame to be previewed, and the mixing results are cached in the mixing cache unit, and the mixing results of the current frame to be previewed are read from the mixing cache unit for playback.

[0035] It should be noted that the user information and data involved in this disclosure are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of relevant countries and regions, and provide corresponding operation entrances for users to choose to authorize or refuse.

[0036] The audio processing method of the present disclosure will be described in detail below with reference to specific embodiments.

[0037] Referring to Figure 2, Figure 2 is a flow chart of an audio processing method provided by an embodiment of the present disclosure. The method of this embodiment can be applied in electronic devices such as terminal devices or servers, and the audio processing method includes:

[0038] S201. During the preview of the video editing draft, if it is detected that the sound effect parameters of any target track of the current preview frame have changed, the sound effect processing results of the target track pre-cached in the cache unit and the mixing results of all pre-cached tracks are cleared.

[0039] In this embodiment, the audio processing process during the normal preview of the video editing draft is as follows: the decoding thread corresponding to each track is used to perform audio decoding on each track respectively, and the audio decoding data corresponding to each track is cached respectively; the sound effect processing thread corresponding to each track is used to perform sound effect processing on the audio decoding data of each track respectively, and the sound effect processing results corresponding to each track are cached respectively; a mixing thread is used to mix the sound effect processing results of each track (after mixing, the mixed results can be further mixed with sound effects, of course, mixed sound effects processing can also be not performed), and the mixing results are cached, and then the mixing results are played. The mixing result of the current frame can be played while displaying the current frame, thereby realizing the preview of the video editing draft.

[0040] During the preview of the video editing draft, the user can adjust the sound effects. When adjusting the sound effects, the preview process of the video editing draft can be continued, and of course the video editing draft can also be paused.

[0041] The sound effect adjustment may be to adjust the sound effect parameters of the portion before the current frame to be previewed. The adjusted sound effect parameters have an impact on the portion before the current frame to be previewed, and the adjusted sound effect parameters do not affect the preview of the current frame to be previewed and the frames after the current frame to be previewed.

[0042] Sound effect adjustment can also be performed on the sound effect parameters of the part after the current frame to be previewed (frames that are farther away from the current frame to be previewed and have not been decoded, sound effect processed, and mixed). The adjusted sound effect parameters will not affect the preview of the current frame to be previewed and the frames that have been decoded, sound effect processed, and mixed after the current frame to be previewed. The frames within the range of the adjusted sound effect parameters can be processed with the adjusted sound effect parameters during subsequent sound effect processing.

[0043] When the sound effect adjustment involves the current frame to be previewed, that is, the impact range of the adjusted sound effect parameters covers the current frame to be previewed and / or covers the frames that have been decoded, sound effect processed, and mixed after the current frame to be previewed, then the sound effect adjustment will affect the preview of the current frame to be previewed and the frames that have been decoded, sound effect processed, and mixed after the current frame to be previewed. To address this situation, in this embodiment, during the preview of the video editing draft, it is detected whether the sound effect parameters of any target track of the current frame to be previewed have changed. If so, the sound effect processing results of the target tracks pre-cached after the current frame to be previewed and the mixing results of all tracks cannot be used anymore. It is necessary to clear the sound effect processing results of the target tracks pre-cached after the current frame to be previewed and the mixing results of all tracks. Since the cache unit is usually a first-in-first-out cache unit, the used sound effect processing results and mixing results have been cleared. Therefore, it is sufficient to directly clear the sound effect processing results of the target tracks pre-cached in the cache unit and the mixing results of all tracks pre-cached.

[0044] S202 : Reacquire the pre-cached audio decoded data of the target track starting from the current frame to be previewed, and re-process the audio decoded data according to the changed sound effect parameters.

[0045] In this embodiment, since the sound effect processing results of the target track pre-cached in the cache unit and the mixing results of all tracks pre-cached have been cleared, it is necessary to re-acquire the sound effect processing results of the target track and the mixing results of all tracks starting from the current frame to be previewed.

[0046] In this embodiment, in order to more quickly reacquire the sound effect processing results of the target track and the mixing results of all tracks starting from the current preview frame, the audio decoded data of each track may not be directly cleared after being read by the sound effect processing thread, but may be cached for a period of time for use in subsequent sound effect adjustments without the need for re-audio decoding. Optionally, after a frame of audio decoded data of any track is produced by the audio decoding thread, it may be cached and not directly cleared after being read by the sound effect processing thread. Instead, the audio decoded data of the frame may be cleared after the mixing result corresponding to the frame is played (that is, the frame is previewed), because the audio decoded data of the frame will no longer be used in the subsequent preview process. However, it is necessary to re-acquire the sound effect processing results of the target track and the mixing results of all tracks starting from the current frame to be previewed. Since the current frame to be previewed has not been previewed, the audio decoding data of each track in the current frame to be previewed has not been cleared. The audio effect processing thread of the target track can be used to re-read the audio decoding data of the target track in the current frame to be previewed starting from the current frame to be previewed, and the audio effect processing of the audio decoding data can be restarted in sequence according to the changed sound effect parameters.

[0047] S203 , remixing the sound effect processing results of all tracks starting from the current frame to be previewed, and playing the mixed results.

[0048] In this embodiment, the mixing thread can re-acquire the sound effect processing results of all tracks starting from the current frame to be previewed, mix the sound effect results of all tracks, and play the mixing results in sequence, that is, the mixing results of the current frame to be previewed are played while the picture of the current frame to be previewed is displayed, thereby realizing audio playback of the video editing draft preview process.

[0049] The audio processing method provided by this embodiment is as follows: during the preview of the video editing draft, if it is detected that the sound effect parameters of any target track of the current frame to be previewed have changed, the sound effect processing results of the target track pre-cached in the cache unit and the mixing results of all pre-cached tracks are cleared; the audio decoding data of the pre-cached target track is re-acquired starting from the current frame to be previewed, and the audio decoding data is re-processed according to the changed sound effect parameters; the sound effect processing results of all tracks are re-mixed starting from the current frame to be previewed, and the mixing results are played. During the preview of the video editing draft, if the sound effect parameters of any target track of the current frame to be previewed have changed, there is no need to re-decode the audio, only re-process the sound effect and re-mix it, which avoids the time-consuming audio decoding process, allows the sound effect adjustment to take effect in real time, and ensures the smoothness of the preview process.

[0050] Based on any of the above embodiments, during the preview of the video editing draft, the sound effect processing thread corresponding to each track can be used to perform sound effect processing on the audio decoding data of each track respectively, and the sound effect processing results can be cached in the sound effect processing cache unit corresponding to each track respectively; the mixing thread can be used to read the sound effect processing results from the sound effect processing cache units corresponding to all tracks for mixing, and the mixed results can be cached in the mixing cache unit, and then the current frame to be previewed can be read from the mixing cache unit for playback during playback.

[0051] Optionally, the sound effect processing cache unit may also be a first-in-first-out (FIFO) cache unit. Subsequent mixing threads may read the sound effect processing results from the sound effect processing cache unit in order, and delete the sound effect processing results of a frame from the sound effect processing cache unit after reading a frame of sound effect processing results, thereby ensuring the continuity of the sound effect processing process. Optionally, the sound effect processing cache unit may be a first-in-first-out (FIFO) ring buffer. Of course, in this embodiment, the sound effect processing cache unit may also be a first-in-first-out (FIFO) non-ring buffer. In this case, after a frame of sound effect processing results is retrieved (read and deleted), the remaining sound effect processing results need to be moved forward in order.

[0052] Optionally, the mixing cache unit may be a first-in, first-out (FIFO) cache unit. During playback, the mixing results may be read from the mixing cache unit in order, and after a frame of mixing results is read, the frame of mixing results is deleted from the mixing cache unit, thereby ensuring the continuity of the mixing process. Optionally, the mixing cache unit may be a first-in, first-out (FIFO) ring buffer. Of course, the mixing cache unit in this embodiment may also be a non-first-in, first-out (FIFO) ring buffer. In this case, after a frame of mixing results is retrieved (read and deleted), the remaining mixing results need to be moved to the previous storage location in sequence.

[0053] Based on the above embodiment, S201 clears the sound effect processing result of the target track pre-cached in the cache unit and the mixing results of all pre-cached tracks, which may specifically include:

[0054] Clears the audio processing cache unit corresponding to the target track and the mixing cache units corresponding to all tracks.

[0055] In this embodiment, when determining whether the sound effect parameters of any target track of the current frame to be previewed have changed, the sound effect processing results of the target track of the current frame to be previewed and the sound effect processing results of all tracks pre-cached after the current frame to be previewed and the sound effect processing results of all tracks in the sound effect processing cache unit and the mixing cache unit corresponding to the target track can no longer be used, so the sound effect processing cache unit corresponding to the target track and the mixing cache units corresponding to all tracks can be directly cleared.

[0056] Based on any of the above embodiments, during the preview of the video editing draft, the audio decoding thread corresponding to each track can be used to perform audio decoding on each track separately, and the decoded data of each track can be cached in the audio decoding cache unit corresponding to each track.

[0057] The audio decoding cache unit can be a first-in-first-out (FIFO) cache unit. In subsequent steps, audio decoded data can be read from the audio decoding cache unit in a sequential order. Reading a frame of audio decoded data does not delete the frame of audio decoded data from the audio decoding cache unit. Instead, the frame of audio decoded data is cached for a period of time until the mixing result corresponding to the frame is played. That is, the frame is previewed. The audio decoded data of the frame will no longer be used and can be cleared. In other words, the cleaning of the audio decoded data in the audio decoding cache unit is based on the preview progress (AudioClock). After the mixing result corresponding to the current preview frame is played, the audio decoding cache unit corresponding to each track can be notified, and the audio decoded data of the current preview frame can be cleared in the audio decoding cache unit corresponding to each track. Optionally, the audio decoding cache unit can be a first-in-first-out (FIFO) ring buffer (RingBuffer); of course, the audio decoding cache unit in this embodiment can also be a first-in-first-out (FIFO) non-ring buffer. In this case, after a frame of decoded data is deleted, the remaining decoded data needs to be moved forward in storage position.

[0058] Based on the above embodiment, S202 reacquires the pre-cached audio decoded data of the target track starting from the current frame to be previewed, which may specifically include:

[0059] In the audio decoding cache unit corresponding to the target track, the audio decoding data is re-read starting from the current frame to be previewed.

[0060] In this embodiment, when it is necessary to re-acquire the sound effect processing result of the target track starting from the current frame to be previewed, since the audio decoding data of the current frame to be previewed and after the current frame to be previewed in the audio decoding cache unit corresponding to the target track have not been cleared, the sound effect processing thread corresponding to the target track only needs to re-read the audio decoding data from the current frame to be previewed in the audio decoding cache unit corresponding to the target track, and re-process the sound effect using the changed sound effect parameters based on the read audio decoding data, without the need to re-decode the audio, thereby avoiding the time-consuming audio decoding process.

[0061] Optionally, when re-reading the audio decoded data starting from the current frame to be previewed in the audio decoding cache unit corresponding to the target track, the frame pointer can be moved to the time point corresponding to the current frame to be previewed in the audio decoding cache unit corresponding to the target track; the audio decoded data is re-read starting from the current frame to be previewed based on the frame pointer, that is, the audio decoded data at the frame pointer is read. After the reading is completed, the frame pointer moves backward and the audio decoded data at the frame pointer can continue to be read.

[0062] Furthermore, after the audio decoded data is re-processed with sound effects according to the changed sound effect parameters, the sound effect processing results are cached in the sound effect processing cache unit corresponding to the target track; the sound effect processing results are read from the sound effect processing cache units corresponding to all tracks for mixing, and the mixing results are cached in the mixing cache unit; the mixing result corresponding to the current frame to be previewed is read from the mixing cache unit for playback.

[0063] Based on any of the above embodiments, as shown in FIG3 , detecting whether the sound effect parameters of any target track of the current preview frame have changed in S201 may specifically include:

[0064] S301, when previewing the current frame to be previewed, detecting whether the sound effect parameters of each track have changed;

[0065] S302: If it is determined that the sound effect parameters of any target track have changed, determine whether the current preview frame is within the influence range of the changed sound effect parameters;

[0066] S303: If it is determined that the current frame to be previewed is within the influence range of the changed sound effect parameters, it is determined that the sound effect parameters of the target track of the current frame to be previewed are changed.

[0067] In this embodiment, a detection is performed before each frame is previewed to detect whether the sound effect parameters of each track have changed. Therefore, when the current frame to be previewed is previewed, the sound effect parameters of each track are also detected to determine whether they have changed.

[0068] Any feasible method can be used to detect whether the sound effect parameters of each track have changed. Optionally, in this embodiment, when a sound effect adjustment instruction for the target track is received, the sound effect of the target track is adjusted according to the sound effect adjustment instruction. The sound effect adjustment can be performed on a certain section of material of the target track, or on multiple sections of material of the target track. In addition, the sound effect update count is updated (increased by 1) in the attribute information of the target track, wherein the sound effect update count is used to record the number of sound effect adjustments. If the sound effect is adjusted for a certain section of material, the sound effect technical value is updated in the attribute information of the section of material, and the sound effect update count is used to record the total number of sound effect adjustments for the section of material.

[0069] When previewing the current frame to be previewed, the system detects whether the sound effect parameters of each track have changed by obtaining the current sound effect update count value in the attribute information of each track and determining whether the current sound effect update count value of each track has changed relative to the historical sound effect update count value of each track when previewing the previous frame. If the current sound effect update count value of any target track has changed, it is determined that the sound effect parameters of the target track have changed. The sound effect update count value can be used to quickly and accurately determine whether the sound effect parameters of each track have changed.

[0070] Furthermore, since changes in sound effect parameters may affect the current frame to be previewed and frames that have been decoded, sound effect processed, and mixed after the current frame to be previewed, or may not affect the current frame to be previewed and frames that have been decoded, sound effect processed, and mixed after the current frame to be previewed, if it is determined that the sound effect parameters of any target track have changed, it is determined whether the current frame to be previewed is within the influence range of the changed sound effect parameters. Optionally, when adjusting the sound effect parameters of the target track according to the sound effect adjustment instruction, the influence range of the changed sound effect parameters can be recorded in the attribute information of the target track. If the sound effect adjustment is performed on a certain section of material, the influence range of the changed sound effect parameters is recorded in the attribute information of the section of material. Then, based on the influence range of the changed sound effect parameters recorded in the attribute information, it can be determined whether the current frame to be previewed is within the influence range of the changed sound effect parameters. If it is determined that the current frame to be previewed is within the influence range of the changed sound effect parameters, it is determined that the sound effect parameters of the target track of the current frame to be previewed have changed, and then the above-mentioned S201-S203 are executed; otherwise, if it is determined that the current frame to be previewed is not within the influence range of the changed sound effect parameters, it is determined that the sound effect parameters of the target track of the current frame to be previewed have not changed, and there is no need to execute the above-mentioned S201-S203, but audio processing in the normal preview process continues.

[0071] Corresponding to the audio processing method described in the preceding embodiments, FIG4 is a block diagram of the structure of an audio processing device provided in an embodiment of the present disclosure. For ease of illustration, only the portions relevant to the present embodiment are shown. Referring to FIG4 , audio processing device 400 includes a cache cleaning unit 401, an audio effect processing unit 402, a mixing unit 403, and a playback unit 404.

[0072] The cache clearing unit 401 is configured to clear the pre-cached sound effect processing results of the target track and the pre-cached mixing results of all tracks in the cache unit if it detects that the sound effect parameters of any target track of the current preview frame have changed during the preview of the video editing draft;

[0073] The audio effect processing unit 402 is configured to reacquire the pre-cached audio decoded data of the target track starting from the current preview frame, and re-process the audio decoded data according to the changed audio effect parameters;

[0074] The audio mixing unit 403 is configured to remix the audio processing results of all tracks starting from the current preview frame;

[0075] The playing unit 404 is configured to play the mixing result.

[0076] In one or more embodiments of the present disclosure, when clearing the pre-cached audio effect processing results of the target track and the pre-cached mixing results of all tracks in the cache unit, the cache clearing unit 401 is configured to:

[0077] Clear the sound effect processing cache unit corresponding to the target track and the mixing cache units corresponding to all tracks; wherein the sound effect processing cache unit is configured to cache the sound effect processing results of the target track, and the mixing cache unit is configured to cache the mixing results of all tracks.

[0078] In one or more embodiments of the present disclosure, when the audio effect processing unit 402 reacquires the pre-cached audio decoded data of the target track starting from the current frame to be previewed, it is configured to:

[0079] In the audio decoding cache unit corresponding to the target track, the audio decoding data is re-read starting from the current frame to be previewed; wherein the audio decoding cache unit is configured to store the audio decoding data of the target track.

[0080] In one or more embodiments of the present disclosure, after re-processing the audio decoded data according to the changed sound effect parameters, the sound effect processing unit 402 is further configured to:

[0081] Cache the sound effect processing result into the sound effect processing cache unit corresponding to the target track;

[0082] Accordingly, the mixing unit 403 is configured to read the sound effect processing results from the sound effect processing cache units corresponding to all tracks respectively for mixing, and cache the mixing results in the mixing cache units;

[0083] The playing unit 404 is configured to read the mixing result corresponding to the current frame to be previewed from the mixing buffer unit and play it.

[0084] In one or more embodiments of the present disclosure, the cache cleaning unit 401 is further configured to:

[0085] When previewing the current frame to be previewed, detect whether the sound effect parameters of each track have changed;

[0086] If it is determined that the sound effect parameters of any target track have changed, then determining whether the current frame to be previewed is within the influence range of the changed sound effect parameters;

[0087] If it is determined that the current frame to be previewed is within the influence range of the changed sound effect parameters, it is determined that the sound effect parameters of the target track of the current frame to be previewed are changed.

[0088] In one or more embodiments of the present disclosure, when the cache cleaning unit 401 previews the current frame to be previewed and detects whether the sound effect parameters of each track have changed, it is configured to:

[0089] When previewing the current frame to be previewed, obtain the current sound effect update count value in the attribute information of each track;

[0090] Determine whether the current sound effect update count value of each track has changed relative to the historical sound effect update count value of each track when previewing the previous frame;

[0091] If the current sound effect update count value of any target track changes, it is determined that the sound effect parameter of the target track changes.

[0092] In one or more embodiments of the present disclosure, the audio processing device further includes a sound effect adjustment unit configured to:

[0093] In response to a sound effect adjustment instruction for a target track, adjusting sound effect parameters of the target track according to the sound effect adjustment instruction;

[0094] The sound effect update count value is updated in the attribute information of the target track, and the influence range of the changed sound effect parameter is recorded in the attribute information of the target track.

[0095] In one or more embodiments of the present disclosure, when the audio effect processing unit 402 rereads the audio decoding data starting from the current preview frame in the audio decoding cache unit corresponding to the target track, it is configured to:

[0096] In the audio decoding cache unit corresponding to the target track, the frame pointer is moved to the time point corresponding to the current frame to be previewed;

[0097] Re-read the audio decoding data starting from the current preview frame based on the frame pointer.

[0098] In one or more embodiments of the present disclosure, the cache cleaning unit 401 is further configured to:

[0099] After the mixing result corresponding to the current frame to be previewed is played, the audio decoding data of the current frame to be previewed is cleared in the audio decoding cache unit corresponding to each track.

[0100] In one or more embodiments of the present disclosure, each cache unit is a first-in-first-out cache unit.

[0101] In one or more embodiments of the present disclosure, each cache unit is a first-in-first-out ring buffer.

[0102] The device provided in this embodiment can be used to execute the technical solution of the above method embodiment. Its implementation principle and technical effects are similar and will not be described in detail in this embodiment.

[0103] Referring to FIG5 , there is shown a schematic diagram of the structure of an electronic device 500 suitable for implementing an embodiment of the present disclosure. The electronic device 500 may be a terminal device or a server. The terminal device may include, but is not limited to, mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, personal digital assistants (PDAs), tablet computers (Portable Android Devices, PADs), portable multimedia players (PMPs), vehicle-mounted terminals (e.g., vehicle-mounted navigation terminals), and fixed terminals such as digital TVs and desktop computers. The electronic device shown in FIG5 is merely an example and should not limit the functionality and scope of use of the embodiments of the present disclosure.

[0104] As shown in FIG5 , the electronic device 500 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 501, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 502 or a program loaded from a storage device 508 into a random access memory (RAM) 503. Various programs and data required for the operation of the electronic device 500 are also stored in the RAM 503. The processing device 501, the ROM 502, and the RAM 503 are connected to each other via a bus 504. An input / output (I / O) interface 505 is also connected to the bus 504.

[0105] Typically, the following devices may be connected to the I / O interface 505: an input device 506 including, for example, a touch screen, a touchpad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 507 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 508 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 509. The communication device 509 may allow the electronic device 500 to communicate with other devices wirelessly or by wire to exchange data. Although FIG5 shows an electronic device 500 having various devices, it should be understood that it is not required to implement or have all of the devices shown. More or fewer devices may be implemented or have alternatively.

[0106] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network via the communication device 509, or installed from the storage device 508, or installed from the ROM 502. When the computer program is executed by the processing device 501, the above-mentioned functions defined in the method of the embodiment of the present disclosure are performed.

[0107] It should be noted that the computer-readable medium mentioned above in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the two. A computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or component, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, device, or component. In the present disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, which carries computer-readable program code. Such a propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transport a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium may be transmitted using any suitable medium, including but not limited to wires, optical cables, RF (radio frequency), etc., or any suitable combination thereof.

[0108] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0109] The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device executes the method shown in the above embodiment.

[0110] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages, or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet Service Provider).

[0111] The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, program segment, or a part of code, and the module, program segment, or a part of code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order than that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of the boxes in the block diagram and / or flowchart, can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0112] The units involved in the embodiments described in this disclosure may be implemented in software or hardware. In some cases, the name of a unit does not limit the unit itself. For example, the first acquisition unit may also be described as a "unit for acquiring at least two Internet Protocol addresses."

[0113] The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, and without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chip (SOCs), complex programmable logic devices (CPLDs), and the like.

[0114] In the context of the present disclosure, a machine-readable medium can be a tangible medium that can contain or store a program for use by or in conjunction with an instruction execution system, device or equipment. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium can include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0115] In a first aspect, according to one or more embodiments of the present disclosure, there is provided an audio processing method, comprising:

[0116] During the preview of the video editing draft, if it is detected that the sound effect parameters of any target track of the current preview frame have changed, the sound effect processing results of the target track pre-cached in the cache unit and the mixing results of all pre-cached tracks are cleared;

[0117] Re-acquire the pre-cached audio decoded data of the target track starting from the current frame to be previewed, and re-process the audio decoded data according to the changed sound effect parameters;

[0118] Remix the sound processing results of all tracks starting from the current preview frame and play the mixed results.

[0119] According to one or more embodiments of the present disclosure, clearing the pre-cached audio effect processing results of the target track and the pre-cached mixing results of all tracks in the cache unit includes:

[0120] Clear the audio processing cache unit corresponding to the target track and the mixing cache units corresponding to all tracks; the audio processing cache unit is used to cache the audio processing results of the target track, and the mixing cache unit is used to cache the mixing results of all tracks.

[0121] According to one or more embodiments of the present disclosure, re-acquiring pre-cached audio decoded data of a target track starting from a current frame to be previewed includes:

[0122] In the audio decoding cache unit corresponding to the target track, the audio decoding data is re-read starting from the current frame to be previewed; wherein the audio decoding cache unit is used for the audio decoding data of the target track.

[0123] According to one or more embodiments of the present disclosure, after re-processing the audio decoded data according to the changed sound effect parameters, the method further includes:

[0124] Cache the sound effect processing result into the sound effect processing cache unit corresponding to the target track;

[0125] Accordingly, the sound effect processing results of all tracks are remixed starting from the current preview frame, and the mixed results are played, including:

[0126] Read the sound effect processing results from the sound effect processing cache units corresponding to all tracks respectively for mixing, and cache the mixing results in the mixing cache units;

[0127] The mixing result corresponding to the current preview frame is read from the mixing buffer unit for playback.

[0128] According to one or more embodiments of the present disclosure, the audio processing method further includes:

[0129] When previewing the current frame to be previewed, detect whether the sound effect parameters of each track have changed;

[0130] If it is determined that the sound effect parameters of any target track have changed, then determining whether the current frame to be previewed is within the influence range of the changed sound effect parameters;

[0131] If it is determined that the current frame to be previewed is within the influence range of the changed sound effect parameters, it is determined that the sound effect parameters of the target track of the current frame to be previewed are changed.

[0132] According to one or more embodiments of the present disclosure, when previewing the current frame to be previewed, detecting whether the sound effect parameters of each track have changed includes:

[0133] When previewing the current frame to be previewed, obtain the current sound effect update count value in the attribute information of each track;

[0134] Determine whether the current sound effect update count value of each track has changed relative to the historical sound effect update count value of each track when previewing the previous frame;

[0135] If the current sound effect update count value of any target track changes, it is determined that the sound effect parameter of the target track changes.

[0136] According to one or more embodiments of the present disclosure, the audio processing method further includes:

[0137] In response to a sound effect adjustment instruction for a target track, adjusting sound effect parameters of the target track according to the sound effect adjustment instruction;

[0138] The sound effect update count value is updated in the attribute information of the target track, and the influence range of the changed sound effect parameter is recorded in the attribute information of the target track.

[0139] According to one or more embodiments of the present disclosure, rereading audio decoding data starting from a current frame to be previewed in an audio decoding cache unit corresponding to a target track includes:

[0140] In the audio decoding cache unit corresponding to the target track, the frame pointer is moved to the time point corresponding to the current frame to be previewed;

[0141] Re-read the audio decoding data starting from the current preview frame based on the frame pointer.

[0142] According to one or more embodiments of the present disclosure, the audio processing method further includes:

[0143] After the mixing result corresponding to the current frame to be previewed is played, the audio decoding data of the current frame to be previewed is cleared in the audio decoding cache unit corresponding to each track.

[0144] According to one or more embodiments of the present disclosure, each cache unit is a first-in-first-out cache unit.

[0145] According to one or more embodiments of the present disclosure, each cache unit is a first-in-first-out ring buffer.

[0146] In a second aspect, according to one or more embodiments of the present disclosure, there is provided an audio processing device, including:

[0147] A cache clearing unit is configured to clear the pre-cached sound effect processing results of the target track and the pre-cached mixing results of all tracks in the cache unit if it is detected that the sound effect parameters of any target track of the current preview frame have changed during the preview of the video editing draft;

[0148] The audio effect processing unit is used to re-acquire the pre-cached audio decoded data of the target track starting from the current preview frame, and re-process the audio decoded data according to the changed audio effect parameters;

[0149] The mixing unit is used to remix the sound processing results of all tracks starting from the current preview frame;

[0150] The playback unit is used to play the mixing result.

[0151] According to one or more embodiments of the present disclosure, when clearing the pre-cached audio effect processing results of the target track and the pre-cached mixing results of all tracks in the cache unit, the cache cleaning unit is configured to:

[0152] Clear the audio processing cache unit corresponding to the target track and the mixing cache units corresponding to all tracks; the audio processing cache unit is used to cache the audio processing results of the target track, and the mixing cache unit is used to cache the mixing results of all tracks.

[0153] According to one or more embodiments of the present disclosure, when the audio effect processing unit reacquires the pre-cached audio decoded data of the target track starting from the current frame to be previewed, it is configured to:

[0154] In the audio decoding cache unit corresponding to the target track, the audio decoding data is re-read starting from the current frame to be previewed; wherein the audio decoding cache unit is used for the audio decoding data of the target track.

[0155] According to one or more embodiments of the present disclosure, after the sound effect processing unit re-processes the audio decoded data according to the changed sound effect parameters, it is further configured to:

[0156] Cache the sound effect processing result into the sound effect processing cache unit corresponding to the target track;

[0157] Correspondingly, the mixing unit is used to read the sound effect processing results from the sound effect processing cache units corresponding to all tracks respectively for mixing, and cache the mixing results in the mixing cache unit;

[0158] The playback unit is used to read the mixing result corresponding to the current frame to be previewed from the mixing cache unit for playback.

[0159] According to one or more embodiments of the present disclosure, the cache cleaning unit is further configured to:

[0160] When previewing the current frame to be previewed, detect whether the sound effect parameters of each track have changed;

[0161] If it is determined that the sound effect parameters of any target track have changed, then determining whether the current frame to be previewed is within the influence range of the changed sound effect parameters;

[0162] If it is determined that the current frame to be previewed is within the influence range of the changed sound effect parameters, it is determined that the sound effect parameters of the target track of the current frame to be previewed are changed.

[0163] According to one or more embodiments of the present disclosure, when previewing the current frame to be previewed, the cache cleaning unit detects whether the sound effect parameters of each track have changed, and is configured to:

[0164] When previewing the current frame to be previewed, obtain the current sound effect update count value in the attribute information of each track;

[0165] Determine whether the current sound effect update count value of each track has changed relative to the historical sound effect update count value of each track when previewing the previous frame;

[0166] If the current sound effect update count value of any target track changes, it is determined that the sound effect parameter of the target track changes.

[0167] According to one or more embodiments of the present disclosure, the audio processing device further includes a sound effect adjustment unit, configured to:

[0168] In response to a sound effect adjustment instruction for a target track, adjusting sound effect parameters of the target track according to the sound effect adjustment instruction;

[0169] The sound effect update count value is updated in the attribute information of the target track, and the influence range of the changed sound effect parameter is recorded in the attribute information of the target track.

[0170] According to one or more embodiments of the present disclosure, when the audio effect processing unit rereads the audio decoding data starting from the current preview frame in the audio decoding cache unit corresponding to the target track, it is configured to:

[0171] In the audio decoding cache unit corresponding to the target track, the frame pointer is moved to the time point corresponding to the current frame to be previewed;

[0172] Re-read the audio decoding data starting from the current preview frame based on the frame pointer.

[0173] According to one or more embodiments of the present disclosure, the cache cleaning unit is further configured to:

[0174] After the mixing result corresponding to the current frame to be previewed is played, the audio decoding data of the current frame to be previewed is cleared in the audio decoding cache unit corresponding to each track.

[0175] According to one or more embodiments of the present disclosure, each cache unit is a first-in-first-out cache unit.

[0176] According to one or more embodiments of the present disclosure, each cache unit is a first-in-first-out ring buffer.

[0177] In a third aspect, according to one or more embodiments of the present disclosure, there is provided an electronic device, comprising: at least one processor and a memory;

[0178] Memory stores computer-executable instructions;

[0179] At least one processor executes the computer-executable instructions stored in the memory, so that the at least one processor executes the audio processing method of the first aspect and various possible designs of the first aspect.

[0180] In a fourth aspect, according to one or more embodiments of the present disclosure, a computer-readable storage medium is provided, in which computer execution instructions are stored. When a processor executes the computer execution instructions, the audio processing method as described in the first aspect and various possible designs of the first aspect are implemented.

[0181] In a fifth aspect, according to one or more embodiments of the present disclosure, a computer program product is provided, comprising computer execution instructions. When a processor executes the computer execution instructions, the audio processing method of the first aspect and various possible designs of the first aspect are implemented.

[0182] The above description is merely a preferred embodiment of the present disclosure and an illustration of the technical principles employed. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by the specific combination of the above-mentioned technical features, but also includes other technical solutions formed by any combination of the above-mentioned technical features or their equivalents without departing from the above-mentioned disclosed concepts. For example, a technical solution formed by replacing the above-mentioned features with (but not limited to) technical features with similar functions disclosed in this disclosure.

[0183] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details have been included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0184] Although the subject matter has been described in language specific to structural features and / or methodological logical acts, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are merely example forms of implementing the claims.

Claims

1. An audio processing method, comprising: During the preview of the video editing draft, if it is detected that the sound effect parameters of any target track of the current preview frame have changed, the sound effect processing results of the target track pre-cached in the cache unit and the mixing results of all pre-cached tracks are cleared; Reacquire the pre-cached audio decoded data of the target track starting from the current frame to be previewed, and re-process the audio decoded data according to the changed sound effect parameters; Remix the audio processing results of all tracks starting from the current frame to be previewed, and play the mixed results.

2. The method according to claim 1, wherein: The clearing of the sound effect processing result of the target track pre-cached in the cache unit and the mixing results of all pre-cached tracks includes: Clear the sound effect processing cache unit corresponding to the target track and the mixing cache units corresponding to all tracks; wherein the sound effect processing cache unit is used to cache the sound effect processing result of the target track, and the mixing cache unit is used to cache the mixing results of all tracks.

3. The method according to claim 1, wherein: The reacquiring the pre-cached audio decoding data of the target track starting from the current frame to be previewed includes: In the audio decoding cache unit corresponding to the target track, audio decoding data is re-read starting from the current frame to be previewed; wherein the audio decoding cache unit is used for the audio decoding data of the target track.

4. The method according to claim 2, wherein: After re-processing the audio decoded data according to the changed sound effect parameters, the method further includes: Cache the sound effect processing result in the sound effect processing cache unit corresponding to the target track; The remixing of the sound effect processing results of all tracks starting from the current frame to be previewed and playing the mixed results includes: Read the sound effect processing results from the sound effect processing cache units corresponding to all tracks respectively for mixing, and cache the mixing results in the mixing cache units; The mixing result corresponding to the current frame to be previewed is read from the mixing cache unit for playback.

5. The method according to claim 1, further comprising: When previewing the current frame to be previewed, detect whether the sound effect parameters of each track have changed; If it is determined that the sound effect parameters of any target track have changed, then determining whether the current frame to be previewed is within the influence range of the changed sound effect parameters; If it is determined that the current frame to be previewed is within the influence range of the changed sound effect parameters, it is determined that the sound effect parameters of the target track of the current frame to be previewed are changed.

6. The method according to claim 5, wherein: When previewing the current frame to be previewed, detecting whether the sound effect parameters of each track have changed includes: When previewing the current frame to be previewed, obtain the current sound effect update count value in the attribute information of each track; Determine whether the current sound effect update count value of each track has changed relative to the historical sound effect update count value of each track when previewing the previous frame; If the current sound effect update count value of any target track changes, it is determined that the sound effect parameter of the target track changes.

7. The method according to claim 6, further comprising: In response to a sound effect adjustment instruction for a target track, adjusting sound effect parameters of the target track according to the sound effect adjustment instruction; The sound effect update count value is updated in the attribute information of the target track, and the influence range of the changed sound effect parameter is recorded in the attribute information of the target track.

8. The method according to claim 3, wherein: The step of re-reading the audio decoding data starting from the current frame to be previewed in the audio decoding cache unit corresponding to the target track includes: In the audio decoding cache unit corresponding to the target track, the frame pointer is moved to the time point corresponding to the current frame to be previewed; Re-read the audio decoding data starting from the current frame to be previewed based on the frame pointer.

9. The method according to claim 3, further comprising: After the mixing result corresponding to the current frame to be previewed is played, the audio decoding data of the current frame to be previewed is cleared in the audio decoding cache units corresponding to each track.

10. The method according to any one of claims 2-4, 8-9, wherein: Each cache unit is a first-in-first-out cache unit.

11. The method according to claim 10, wherein: Each cache unit is a first-in-first-out circular buffer.

12. An audio processing device, comprising: The cache clearing unit is configured to clear the sound effect processing result of any target track of the current frame to be previewed and the mixing results of all tracks pre-cached in the cache unit during the preview of the video editing draft, if it is detected that the sound effect parameters of the target track of the current frame to be previewed have changed; The audio effect processing unit is configured to reacquire the pre-cached audio decoded data of the target track starting from the current frame to be previewed, and re-process the audio decoded data according to the changed audio effect parameters; A mixing unit is configured to remix the audio processing results of all tracks starting from the current frame to be previewed; as well as The playing unit is configured to play the mixing result.

13. An electronic device comprising: at least one processor and memory; Wherein, the memory stores computer-executable instructions; The at least one processor executes the computer-executable instructions stored in the memory, so that the at least one processor performs the method according to any one of claims 1 to 11.

14. A computer-readable storage medium, wherein: The computer-readable storage medium stores computer-executable instructions, and when the processor executes the computer-executable instructions, the method according to any one of claims 1 to 11 is implemented.

15. A computer program product comprising computer executable instructions, wherein: When the processor executes the computer-executable instructions, the method according to any one of claims 1 to 11 is implemented.

Images