Multimedia resource processing method and device, equipment and storage medium

Abstract

The invention provides a multimedia resource processing method and device, equipment and a storage medium, and the method comprises the steps: determining a target audio clip based on a multimedia resource editing page, responding to a preset audio processing operation for the target audio clip, and carrying out the human voice separation processing of the target audio clip, the method comprises the steps of obtaining a human voice audio segment and a background voice audio segment corresponding to a target audio segment, performing noise reduction processing and / or target voice effect processing on the human voice audio segment to obtain a processed human voice audio segment, and generating a processing result audio segment corresponding to the target audio segment based on the background voice audio segment and the processed human voice audio segment. Visibly, according to the embodiment of the invention, noise reduction and target sound effect processing on the target audio clip on the multimedia resource editing page can be supported, the sound quality of the target audio clip is improved, and the editing experience of a user is improved.

Description

Technical Field

[0001] The present disclosure relates to the field of data processing, and in particular to a multimedia resource processing method, device, equipment and storage medium. Background Art

[0002] With the continuous improvement of multimedia resource processing technology, people's demands for interactive functions supported by multimedia resource editing tools are becoming more and more diverse, such as sound processing of videos and audios to improve the audio-visual effects of videos and audios.

[0003] Therefore, how to enrich multimedia resource processing related functions to improve user experience is a technical problem that urgently needs to be solved. Summary of the invention

[0004] In order to solve the above technical problems, an embodiment of the present disclosure provides a multimedia resource processing method.

[0005] In a first aspect, the present disclosure provides a multimedia resource processing method, the method comprising:

[0006] Determining a target audio segment based on a multimedia resource clipping page; wherein at least one audio track is displayed on the multimedia resource clipping page, and the target audio segment corresponds to part or all of the audio data on a target audio track in the at least one audio track;

[0007] In response to a preset audio processing operation for the target audio segment, performing vocal separation processing on the target audio segment to obtain a vocal audio segment and a background sound audio segment corresponding to the target audio segment, and performing noise reduction processing and / or target sound effect processing on the vocal audio segment to obtain a processed vocal audio segment;

[0008] Based on the background sound audio segment and the processed human voice audio segment, a processing result audio segment corresponding to the target audio segment is generated; wherein the processing result audio segment is used to update the target audio segment on the target audio track.

[0009] In an optional implementation, the at least one audio track includes a recorded audio track, and the recorded audio track is used to display a recorded audio segment. The determining the target audio segment based on the multimedia resource clipping page includes:

[0010] In response to a recording operation performed on a multimedia resource clipping page, obtaining a recording audio segment corresponding to the recording operation;

[0011] The recorded audio segment is determined as a target audio segment.

[0012] In an optional implementation manner, the method further includes:

[0013] In response to a background sound volume adjustment operation performed on the multimedia resource clipping page, the volume of the background sound audio segment is processed based on the adjustment result volume corresponding to the background sound volume adjustment operation to obtain a background sound audio segment after volume processing;

[0014] Accordingly, the step of generating a processing result audio segment corresponding to the target audio segment based on the background sound audio segment and the processed human voice audio segment includes:

[0015] Based on the volume-processed background sound audio segment and the processed human voice audio segment, a processing result audio segment corresponding to the target audio segment is generated.

[0016] In an optional implementation manner, performing noise reduction processing and / or target sound effect processing on the human voice audio segment to obtain a processed human voice audio segment includes:

[0017] Performing noise reduction processing on the human voice audio segment corresponding to the target audio segment to obtain a human voice audio segment after noise reduction processing;

[0018] For the target sound effect processing, the human voice audio segment after the noise reduction processing is subjected to human voice transformation processing to obtain a processed human voice audio segment.

[0019] In an optional implementation manner, the method further includes:

[0020] In response to a pitch adjustment operation performed on the multimedia resource clipping page, the pitch of the processed human voice audio segment is processed based on the pitch adjustment result to obtain a pitch-processed human voice audio segment;

[0021] Accordingly, the step of generating a processing result audio segment corresponding to the target audio segment based on the background sound audio segment and the processed human voice audio segment includes:

[0022] Based on the background sound audio segment and the pitch-processed human voice audio segment, a processing result audio segment corresponding to the target audio segment is generated.

[0023] In an optional implementation manner, the target audio segment belongs to an original video, and after generating a processed audio segment corresponding to the target audio segment based on the background sound audio segment and the processed human voice audio segment, the method further includes:

[0024] The editing result video is played on the multimedia resource clipping page; wherein the editing result video is obtained by updating the target audio segment in the original video with the processing result audio segment.

[0025] In an optional implementation manner, before performing noise reduction processing and / or target sound effect processing on the human voice audio segment to obtain the processed human voice audio segment, the method further includes:

[0026] Obtaining original volume information of the human voice audio clip;

[0027] Correspondingly, after performing noise reduction processing and / or target sound effect processing on the human voice audio segment to obtain the processed human voice audio segment, the method further includes:

[0028] Based on the original volume information, the volume of the processed human voice audio segment is processed.

[0029] In a second aspect, the present disclosure provides a multimedia resource processing device, the device comprising:

[0030] A first determination module is used to determine a target audio segment based on a multimedia resource clipping page; wherein at least one audio track is displayed on the multimedia resource clipping page, and the target audio segment corresponds to part or all of the audio data on the target audio track in the at least one audio track;

[0031] a vocal separation module, configured to perform vocal separation processing on the target audio segment in response to a preset audio processing operation for the target audio segment, obtain a vocal audio segment and a background sound audio segment corresponding to the target audio segment, and perform noise reduction processing and / or target sound effect processing on the vocal audio segment to obtain a processed vocal audio segment;

[0032] A generation module is used to generate a processing result audio segment corresponding to the target audio segment based on the background sound audio segment and the processed human voice audio segment; wherein the processing result audio segment is used to update the target audio segment on the target audio track.

[0033] In a third aspect, the present disclosure provides a computer-readable storage medium, wherein the computer-readable storage medium stores instructions, and when the instructions are executed on a terminal device, the terminal device implements the above method.

[0034] In a fourth aspect, the present disclosure provides a multimedia resource processing device, comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the above method when executing the computer program.

[0035] In a fifth aspect, the present disclosure provides a computer program product, wherein the computer program product comprises a computer program / instructions, and the computer program / instructions implement the above method when executed by a processor.

[0036] Compared with the prior art, the technical solution provided by the embodiments of the present disclosure has at least the following advantages:

[0037] The disclosed embodiment provides a multimedia resource processing method, firstly, a target audio segment is determined based on a multimedia resource editing page, wherein at least one audio track is displayed on the multimedia resource editing page, and the target audio segment corresponds to part or all of the audio data on the target audio track in the at least one audio track, and in response to a preset audio processing operation for the target audio segment, a human voice separation process is performed on the target audio segment to obtain a human voice audio segment and a background sound audio segment corresponding to the target audio segment, and a noise reduction process and / or a target sound effect process are performed on the human voice audio segment to obtain a processed human voice audio segment, and based on the background sound audio segment and the processed human voice audio segment, a processing result audio segment corresponding to the target audio segment is generated, wherein the processing result audio segment is used to update the target audio segment on the target audio track. It can be seen that the disclosed embodiment can support noise reduction and target sound effect processing of the target audio segment on the multimedia resource editing page, thereby improving the sound quality of the target audio segment, thereby improving the editing experience of the user. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0039] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0040] Figure 1 A flowchart of a multimedia resource processing method provided by an embodiment of the present disclosure;

[0041] Figure 2 A schematic diagram of a multimedia resource clipping page provided by an embodiment of the present disclosure;

[0042] Figure 3 A schematic diagram of another multimedia resource clipping page provided by an embodiment of the present disclosure;

[0043] Figure 4 A schematic diagram of another multimedia resource clipping page provided by an embodiment of the present disclosure;

[0044] Figure 5 A schematic diagram of another multimedia resource clipping page provided by an embodiment of the present disclosure;

[0045] Figure 6 A schematic diagram of the structure of a multimedia resource processing device provided by an embodiment of the present disclosure;

[0046] Figure 7 A schematic diagram of the structure of a multimedia resource processing device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0047] In order to more clearly understand the above-mentioned objectives, features and advantages of the present disclosure, the scheme of the present disclosure will be further described below. It should be noted that the embodiments of the present disclosure and the features in the embodiments can be combined with each other without conflict.

[0048] In the following description, many specific details are set forth to facilitate a full understanding of the present disclosure, but the present disclosure may also be implemented in other ways different from those described herein; it is obvious that the embodiments in the specification are only part of the embodiments of the present disclosure, rather than all of the embodiments.

[0049] With the continuous improvement of multimedia resource processing technology, people's demands for interactive functions supported by multimedia resource editing tools are becoming more and more diverse, such as sound processing of videos and audios to improve the audio-visual effects of videos and audios.

[0050] Therefore, how to enrich multimedia resource processing related functions to improve user experience is a technical problem that urgently needs to be solved.

[0051] To this end, the embodiment of the present disclosure provides a multimedia resource processing method. First, the embodiment of the present disclosure provides a multimedia resource processing method, which determines a target audio segment based on a multimedia resource clipping page, wherein at least one audio track is displayed on the multimedia resource clipping page, and the target audio segment corresponds to part or all of the audio data on the target audio track in the at least one audio track. In response to a preset audio processing operation for the target audio segment, the target audio segment is subjected to vocal separation processing to obtain a vocal audio segment and a background sound audio segment corresponding to the target audio segment, and the vocal audio segment is subjected to noise reduction processing and / or target sound effect processing to obtain a processed vocal audio segment. Based on the background sound audio segment and the processed vocal audio segment, a processing result audio segment corresponding to the target audio segment is generated, wherein the processing result audio segment is used to update the target audio segment on the target audio track. It can be seen that the embodiment of the present disclosure can support noise reduction and target sound effect processing of the target audio segment on the multimedia resource clipping page, thereby improving the sound quality of the target audio segment and thus improving the editing experience of the user.

[0052] Based on this, the present disclosure provides a multimedia resource processing method, referring to Figure 1 , is a flowchart of a multimedia resource processing method provided by an embodiment of the present disclosure, the method comprising:

[0053] S101: Determine a target audio segment based on a multimedia resource clipping page.

[0054] Therein, at least one audio track is displayed on the multimedia resource clipping page, and the target audio segment corresponds to part or all of the audio data on the target audio track in the at least one audio track.

[0055] The multimedia resource processing method provided by the embodiments of the present disclosure can be applied to a client. For example, the client may include a mobile client (referred to as a mobile terminal) deployed on a smart phone, tablet computer, etc., and may also include a PC client (referred to as a PC terminal) deployed on a desktop computer, etc.

[0056] In the disclosed embodiment, the multimedia resource clipping page includes a multimedia resource clipping page with a video or audio resource clipping function, and at least one audio track, such as a vocal audio track, a background sound audio track, etc., is displayed on the multimedia resource clipping page.

[0057] In the disclosed embodiment, the target audio clip may be any audio clip or video clip with audio in the current user's album, or an audio clip or video clip with audio being displayed on a multimedia resource clipping page, etc. The target audio clip may include a partial audio clip or a complete audio clip.

[0058] In the disclosed embodiment, the target audio segment is determined based on the multimedia resource clipping page, wherein the multimedia resource clipping page displays at least one audio track, the at least one audio track includes the target audio track, and part or all of the audio data on the target audio track belongs to the target audio segment.

[0059] S102: In response to a preset audio processing operation for the target audio segment, the target audio segment is subjected to vocal separation processing to obtain a vocal audio segment and a background sound audio segment corresponding to the target audio segment, and the vocal audio segment is subjected to noise reduction processing and / or target sound effect processing to obtain a processed vocal audio segment.

[0060] In the embodiments of the present disclosure, the preset audio processing operation for the target audio clip may include triggering the audio processing control on the multimedia resource clipping page to trigger vocal separation processing, noise reduction processing and / or target sound effect processing on the target audio clip; it may also include interactive triggering operations such as double-clicking, long pressing, and sliding to trigger vocal separation processing, noise reduction processing and / or target sound effect processing on the target audio clip.

[0061] In an optional implementation, the preset audio processing operation for the target audio clip may include triggering an audio processing control on a multimedia resource editing page. Specifically, when a trigger operation for the audio processing control for the target audio clip is received, the target audio clip is subjected to vocal separation processing, and an audio processing panel is pulled up on the multimedia editing page. The audio processing panel is used to perform noise reduction processing and / or target sound effect processing on the target audio clip.

[0062] Among them, the vocal separation processing is used to separate the human voice and background sound in the target audio segment to obtain the vocal audio segment and the background sound audio segment corresponding to the target audio segment. The vocal separation processing can be implemented based on the vocal separation module, and the embodiments of the present disclosure do not impose any restrictions on this.

[0063] like Figure 2 FIG. 2 is a schematic diagram of a multimedia clipping page provided by an embodiment of the present disclosure. The multimedia clipping page displays a target audio segment 201 and an audio processing control 202. When a trigger operation for the audio processing control is received, an audio processing panel is pulled up on the multimedia clipping page, wherein the audio processing panel is used to perform noise reduction processing and / or target sound effect processing on the target audio segment.

[0064] For example, Figure 3, which is a schematic diagram of a multimedia editing page provided by an embodiment of the present disclosure. The multimedia editing page displays an audio processing panel 301 for performing noise reduction processing and / or target sound effect processing on a target audio segment.

[0065] In the disclosed embodiment, the noise reduction process refers to eliminating the noise in the human voice audio segment, wherein the noise in the human voice audio segment may include human saliva sound, microphone spray sound, dental sound, etc. Specifically, the noise in the human voice audio segment corresponding to the target audio segment is subjected to the noise reduction process to obtain the human voice audio segment after the noise reduction process.

[0066] In an optional implementation, performing noise reduction processing on the human voice audio segment corresponding to the target audio segment may include a triggering operation of a noise reduction control on a multimedia clipping page, and in response to the triggering operation of the noise reduction control on the multimedia clipping page, performing noise reduction processing on the noise in the human voice audio segment corresponding to the target audio segment to obtain a human voice audio segment after noise reduction processing. Specifically, the noise reduction processing may be implemented by a noise reduction module.

[0067] As mentioned above Figure 3 The multimedia resource clipping page shown. The multimedia resource clipping page displays a noise reduction control 302. When a trigger operation of the noise reduction control on the multimedia clipping page is received, the noise in the human voice audio segment corresponding to the target audio segment is subjected to noise reduction processing to obtain the human voice audio segment after noise reduction processing.

[0068] Target sound effect processing refers to beautifying the human voice audio clip, that is, adjusting the character's voice. The target sound effect is any sound effect in the sound effect resource package that is in a selected state. Specifically, for the target sound effect processing, the human voice audio clip after the noise reduction processing is subjected to a human voice transformation processing to obtain a processed human voice audio clip. Among them, human voice transformation can be understood as changing the timbre, that is, changing the original sound to improve the sound quality. For example, the target sound effect processing can specifically be to call the processing logic corresponding to the target sound effect in the sound effect resource package when the target sound effect is selected, and perform a human voice transformation processing on the human voice audio clip after the noise reduction processing.

[0069] In an optional implementation, the target sound effect processing includes a selection operation of the target sound effect on the multimedia clipping page. Specifically, in response to the selection operation of the target sound effect on the multimedia clipping page, the processing logic corresponding to the target sound effect in the sound effect resource package is called to perform a human voice transformation process on the human voice audio segment after the noise reduction process. That is, the human voice transformation process is performed based on programming.

[0070] In the disclosed embodiment, a human voice separation process is performed on a target audio segment to obtain a human voice audio segment and a background sound audio segment corresponding to the target audio segment, and the human voice audio segment is processed to obtain a processed human voice audio segment. The processing of the human voice audio segment may include noise reduction processing and target sound effect processing.

[0071] In an optional implementation, the human voice audio segment is subjected to noise reduction processing to obtain a noise-reduced human voice audio segment, and the noise-reduced human voice audio segment is determined as the processed human voice audio segment. That is, based on the human voice audio segment, only noise reduction processing is performed on the human voice audio segment.

[0072] In another optional implementation, the human voice audio segment is processed with the target sound effect to obtain the processed human voice audio segment, that is, based on the human voice audio segment, the human voice audio segment is only processed with the target sound effect.

[0073] In another optional implementation, the human voice audio segment may be subjected to noise reduction processing and target sound effect processing to obtain a processed human voice audio segment. That is, the human voice audio segment is first subjected to noise reduction processing to obtain a human voice audio segment subjected to noise reduction processing, and then the human voice audio segment subjected to noise reduction processing is subjected to human voice transformation processing to obtain a processed human voice audio segment subjected to target sound effect processing.

[0074] S103: Based on the background sound audio segment and the processed human voice audio segment, generate a processing result audio segment corresponding to the target audio segment.

[0075] The processing result audio segment is used to update the target audio segment on the target audio track.

[0076] In the embodiment of the present disclosure, the background sound audio segment and the processed human voice audio segment are synthesized to obtain a processing result audio segment corresponding to the target audio segment. The processing result audio segment is used to update the target audio segment on the target audio track. Specifically, the processing result audio segment can replace the target audio segment on the target audio track.

[0077] Based on the above embodiment, before synthesizing the processing result audio segment corresponding to the target audio segment, the pitch of the processed human voice audio segment can also be processed. Specifically, in response to the pitch adjustment operation on the multimedia resource clipping page, the pitch of the processed human voice audio segment is processed based on the pitch adjustment result to obtain the human voice audio segment after pitch processing. The pitch adjustment operation can include a pitch adjustment operation corresponding to the target sound effect on the multimedia clipping page.

[0078] In an optional embodiment, the pitch adjustment operation may include a sliding operation of a pitch slider corresponding to a target sound effect on the multimedia editing page. Specifically, in response to the sliding operation of the pitch slider corresponding to the target sound effect on the multimedia editing page, the pitch of the processed vocal audio clip is adjusted to obtain the vocal audio clip after pitch processing.

[0079] like Figure 4 , which is a schematic diagram of a multimedia clipping page provided by an embodiment of the present disclosure. The multimedia clipping page displays an audio processing panel, wherein the audio processing panel displays a target sound effect 401 in a selected state and a pitch slider 402 corresponding to the target sound effect. When a sliding operation of the pitch slider 402 acting on the multimedia clipping page is received, the pitch of the processed human voice audio segment is adjusted to obtain a human voice audio segment after pitch processing.

[0080] In addition, based on the pitch processing of the processed human voice audio clip, the volume of the background sound audio clip can also be processed. Specifically, in response to the background sound volume adjustment operation on the multimedia resource clipping page, the volume of the background sound audio clip is processed based on the adjustment result volume corresponding to the background sound volume adjustment operation to obtain the background sound audio clip after volume processing.

[0081] Among them, the background sound volume adjustment operation may include a sliding operation of a background sound volume slider on the multimedia resource clipping page. Optionally, when a sliding operation on the background sound volume slider is received, the background sound volume is adjusted to obtain a background sound audio clip after volume processing.

[0082] Based on the volume-processed background sound audio segment and the processed human voice audio segment, a processing result audio segment corresponding to the target audio segment is generated. Specifically, the background sound audio segment and the pitch-processed human voice audio segment can be synthesized using a synthesis module based on the timeline to generate a processing result audio segment corresponding to the target audio segment.

[0083] In the multimedia resource processing method provided by the embodiment of the present disclosure, first, a target audio segment is determined based on a multimedia resource editing page, wherein at least one audio track is displayed on the multimedia resource editing page, and the target audio segment corresponds to part or all of the audio data on the target audio track in the at least one audio track, and in response to a preset audio processing operation for the target audio segment, a human voice separation process is performed on the target audio segment to obtain a human voice audio segment and a background sound audio segment corresponding to the target audio segment, and the human voice audio segment is subjected to noise reduction processing and / or target sound effect processing to obtain a processed human voice audio segment, and based on the background sound audio segment and the processed human voice audio segment, a processing result audio segment corresponding to the target audio segment is generated, wherein the processing result audio segment is used to update the target audio segment on the target audio track. It can be seen that the embodiment of the present disclosure can support noise reduction and target sound effect processing of the target audio segment on the multimedia resource editing page, thereby improving the sound quality of the target audio segment, thereby improving the editing experience of the user.

[0084] In an embodiment of the present disclosure, at least one audio track is displayed on a multimedia resource clipping page, and the at least one audio track includes a recorded audio track, wherein the recorded audio track is used to display a recorded audio segment, and in response to a recording operation performed on the multimedia resource clipping page, a recorded audio segment corresponding to the recording operation is obtained, and the recorded audio segment is determined as a target audio segment.

[0085] The recording operation may include a recording control on the multimedia resource clipping page, and the recording audio segment is obtained by triggering the recording control.

[0086] In an optional implementation, the recording operation includes a long press operation on a recording control on a multimedia resource clipping page. Specifically, in response to the long press operation on the recording control on the multimedia resource clipping page, recording is started, a recorded audio segment is obtained, and the recorded audio segment is determined as a target audio segment.

[0087] In an optional implementation, the recording operation includes a single-click operation on a recording control on a multimedia resource clipping page. Specifically, in response to a single-click operation on a recording control on a multimedia resource clipping page, recording is started, a recorded audio segment is obtained, and the recorded audio segment is determined as a target audio segment.

[0088] like Figure 5As shown, it is a schematic diagram of a multimedia resource clipping page provided in an embodiment of the present disclosure, wherein a recording panel 501 is displayed on the multimedia resource clipping page, and a recording control 502 is displayed on the recording panel. When a trigger operation of the recording control acting on the multimedia resource clipping page is received, recording is started, a recorded audio segment is obtained, the recorded audio segment is determined as a target audio segment, and then preset audio processing is performed.

[0089] By recording, taking the recorded audio segment as the target audio segment, and then performing preset audio processing, user needs can be met and the user's editing experience can be further enhanced.

[0090] In an optional implementation, the target audio segment may also include the original video. Specifically, the target audio segment may be a portion of the original video or the complete original video. The original video is subjected to vocal separation to obtain a background sound audio segment and a vocal audio segment, and the background sound audio segment and the vocal audio segment are processed. Then, based on the background sound audio segment and the processed vocal audio segment, a processed result audio segment corresponding to the target audio segment is generated.

[0091] In order to show the user the processed audio clip, the embodiment of the present disclosure also supports previewing the processed audio clip after generating the processed audio clip corresponding to the target audio clip. Specifically, the edited video is played on the multimedia resource clipping page, wherein the edited video is obtained by updating the target audio clip in the original video with the processed audio clip.

[0092] In actual applications, after the noise reduction processing or target sound effect processing of the human voice audio clip, its volume will be affected. In order to ensure the authenticity of the processed human voice audio clip, the embodiment of the present disclosure also restores the volume of the processed human voice audio clip.

[0093] Specifically, first, before performing noise reduction processing and / or target sound effect processing on the vocal audio clip, the original volume information of the vocal audio clip is obtained, and then the vocal audio clip is subjected to noise reduction processing and / or target sound effect processing. After obtaining the processed vocal audio clip, the volume of the processed vocal audio clip is processed based on the original volume information.

[0094] The original volume information of the human voice audio segment is obtained by using an acquisition module, and the original volume information may include volume information in the human voice audio segment before processing, which may specifically be volume size, etc. Processing the volume of the processed human voice audio segment may include adjusting the volume of the processed human voice audio segment to restore it to the original volume.

[0095] In an optional implementation, an acquisition module is used to acquire the volume of a vocal audio clip before processing, and then the vocal audio clip is subjected to noise reduction processing and / or target sound effect processing to obtain a processed vocal audio clip. Then, based on the acquired original volume, the volume of the processed vocal audio clip is restored to the original volume.

[0096] The disclosed embodiment ensures the authenticity of the processed human voice audio segment by restoring the volume of the processed human voice audio segment, thereby further improving the user experience.

[0097] Based on the above method embodiment, the present disclosure also provides a multimedia resource processing device, referring to Figure 6 , is a schematic diagram of the structure of a multimedia resource processing device provided by an embodiment of the present disclosure, the device comprising:

[0098] A first determination module 601 is configured to determine a target audio segment based on a multimedia resource clipping page, wherein at least one audio track is displayed on the multimedia resource clipping page, and the target audio segment corresponds to part or all of the audio data on the target audio track in the at least one audio track;

[0099] The human voice separation module 602 is used to perform human voice separation processing on the target audio segment in response to the preset audio processing operation for the target audio segment, obtain a human voice audio segment and a background sound audio segment corresponding to the target audio segment, and perform noise reduction processing and / or target sound effect processing on the human voice audio segment to obtain a processed human voice audio segment;

[0100] The generation module 603 is used to generate a processing result audio segment corresponding to the target audio segment based on the background sound audio segment and the processed human voice audio segment; wherein the processing result audio segment is used to update the target audio segment on the target audio track.

[0101] In an optional implementation manner, the at least one audio track includes a recorded audio track, and the recorded audio track is used to display a recorded audio segment, and the first determining module includes:

[0102] A first acquisition submodule is used to respond to a recording operation on a multimedia resource clipping page and acquire a recording audio segment corresponding to the recording operation;

[0103] The first determining submodule is used to determine the recorded audio segment as a target audio segment.

[0104] In an optional implementation, the device further includes:

[0105] A first processing module is used for processing the volume of the background sound audio segment based on the volume of the adjustment result corresponding to the background sound volume adjustment operation in response to the background sound volume adjustment operation on the multimedia resource clipping page, so as to obtain the background sound audio segment after volume processing;

[0106] Accordingly, the generating module is specifically used for:

[0107] Based on the volume-processed background sound audio segment and the processed human voice audio segment, a processing result audio segment corresponding to the target audio segment is generated.

[0108] In an optional implementation, the human voice separation module includes:

[0109] A noise reduction module, used to perform noise reduction processing on the human voice audio segment corresponding to the target audio segment to obtain the human voice audio segment after noise reduction processing;

[0110] The human voice transformation module is used to perform human voice transformation processing on the human voice audio segment after the noise reduction processing according to the target sound effect processing, so as to obtain the processed human voice audio segment.

[0111] In an optional implementation, the device further includes:

[0112] A second processing module is used for processing the pitch of the processed human voice audio segment based on the pitch adjustment result in response to the pitch adjustment operation performed on the multimedia resource clipping page to obtain the human voice audio segment after pitch processing;

[0113] Accordingly, the generating module is specifically used for:

[0114] Based on the background sound audio segment and the pitch-processed human voice audio segment, a processing result audio segment corresponding to the target audio segment is generated.

[0115] In an optional implementation manner, the target audio segment belongs to an original video, and the device further includes:

[0116] The playing module plays the editing result video on the multimedia resource clipping page; wherein the editing result video is obtained by updating the target audio segment in the original video with the processing result audio segment.

[0117] In an optional implementation, the device further includes:

[0118] A first acquisition module, used to acquire original volume information of the human voice audio segment;

[0119] Accordingly, the device further comprises:

[0120] The third processing module is used to process the volume of the processed human voice audio segment based on the original volume information.

[0121] In the multimedia resource processing device provided by the embodiment of the present disclosure, first, a target audio segment is determined based on a multimedia resource editing page, wherein at least one audio track is displayed on the multimedia resource editing page, and the target audio segment corresponds to part or all of the audio data on the target audio track in the at least one audio track, and in response to a preset audio processing operation for the target audio segment, a human voice separation process is performed on the target audio segment to obtain a human voice audio segment and a background sound audio segment corresponding to the target audio segment, and the human voice audio segment is subjected to noise reduction processing and / or target sound effect processing to obtain a processed human voice audio segment, and based on the background sound audio segment and the processed human voice audio segment, a processing result audio segment corresponding to the target audio segment is generated, wherein the processing result audio segment is used to update the target audio segment on the target audio track. It can be seen that the embodiment of the present disclosure can support noise reduction and sound effect processing of the target audio segment on the multimedia resource editing page, thereby improving the sound quality of the target audio segment, thereby improving the editing experience of the user.

[0122] In addition to the above-mentioned method and apparatus, the embodiments of the present disclosure further provide a computer-readable storage medium, in which instructions are stored. When the instructions are executed on a terminal device, the terminal device implements the multimedia resource processing method described in the embodiments of the present disclosure.

[0123] The embodiment of the present disclosure further provides a computer program product, which includes a computer program / instructions. When the computer program / instructions are executed by a processor, the multimedia resource processing method described in the embodiment of the present disclosure is implemented.

[0124] In addition, the present disclosure also provides a multimedia resource processing device, see Figure 7 As shown, it may include:

[0125] Processor 701, memory 702, input device 703 and output device 704. The number of processors 701 in the multimedia resource processing device can be one or more. Figure 7 In some embodiments of the present disclosure, the processor 701, the memory 702, the input device 703 and the output device 704 may be connected via a bus or other means, wherein: Figure 7 The example of connecting through bus is taken in the following.

[0126] The memory 702 can be used to store software programs and modules. The processor 701 executes various functional applications and data processing of the multimedia resource processing device by running the software programs and modules stored in the memory 702. The memory 702 can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, at least one application required for a function, etc. In addition, the memory 702 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices. The input device 703 can be used to receive input digital or character information, and generate signal input related to user settings and function control of the multimedia resource processing device.

[0127] Specifically in this embodiment, the processor 701 will load the executable files corresponding to the processes of one or more applications into the memory 702 according to the following instructions, and the processor 701 will run the applications stored in the memory 702, thereby realizing various functions of the above-mentioned multimedia resource processing device.

[0128] It should be noted that, in this article, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.

[0129] The above description is only a specific embodiment of the present disclosure, so that those skilled in the art can understand or implement the present disclosure. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present disclosure. Therefore, the present disclosure will not be limited to the embodiments described herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A multimedia resource processing method, characterized in that: The method comprises: Determining a target audio segment based on a multimedia resource clipping page; wherein at least one audio track is displayed on the multimedia resource clipping page, and the target audio segment corresponds to part or all of the audio data on a target audio track in the at least one audio track; In response to a preset audio processing operation for the target audio segment, performing vocal separation processing on the target audio segment to obtain a vocal audio segment and a background sound audio segment corresponding to the target audio segment, and performing noise reduction processing and / or target sound effect processing on the vocal audio segment to obtain a processed vocal audio segment; Based on the background sound audio segment and the processed human voice audio segment, a processing result audio segment corresponding to the target audio segment is generated; wherein the processing result audio segment is used to update the target audio segment on the target audio track.

2. The method according to claim 1, characterized in that The at least one audio track includes a recorded audio track, and the recorded audio track is used to display a recorded audio segment. The determining of the target audio segment based on the multimedia resource clipping page includes: In response to a recording operation performed on a multimedia resource clipping page, obtaining a recording audio segment corresponding to the recording operation; The recorded audio segment is determined as a target audio segment.

3. The method according to claim 1, characterized in that The method further comprises: In response to a background sound volume adjustment operation performed on the multimedia resource clipping page, the volume of the background sound audio segment is processed based on the adjustment result volume corresponding to the background sound volume adjustment operation to obtain a background sound audio segment after volume processing; Accordingly, the step of generating a processing result audio segment corresponding to the target audio segment based on the background sound audio segment and the processed human voice audio segment includes: Based on the volume-processed background sound audio segment and the processed human voice audio segment, a processing result audio segment corresponding to the target audio segment is generated.

4. The method according to claim 1, characterized in that The performing noise reduction processing and / or target sound effect processing on the human voice audio segment to obtain a processed human voice audio segment includes: Performing noise reduction processing on the human voice audio segment corresponding to the target audio segment to obtain a human voice audio segment after noise reduction processing; For the target sound effect processing, the human voice audio segment after the noise reduction processing is subjected to human voice transformation processing to obtain a processed human voice audio segment.

5. The method according to claim 4, characterized in that The method further comprises: In response to a pitch adjustment operation performed on the multimedia resource clipping page, the pitch of the processed human voice audio segment is processed based on the pitch adjustment result to obtain a pitch-processed human voice audio segment; Accordingly, the step of generating a processing result audio segment corresponding to the target audio segment based on the background sound audio segment and the processed human voice audio segment includes: Based on the background sound audio segment and the pitch-processed human voice audio segment, a processing result audio segment corresponding to the target audio segment is generated.

6. The method according to claim 1, characterized in that The target audio segment belongs to the original video, and after generating a processing result audio segment corresponding to the target audio segment based on the background sound audio segment and the processed human voice audio segment, the method further includes: The editing result video is played on the multimedia resource clipping page; wherein the editing result video is obtained by updating the target audio segment in the original video with the processing result audio segment.

7. The method according to claim 1, characterized in that Before performing noise reduction processing and / or target sound effect processing on the human voice audio segment to obtain the processed human voice audio segment, the method further includes: Obtaining original volume information of the human voice audio clip; Correspondingly, after performing noise reduction processing and / or target sound effect processing on the human voice audio segment to obtain the processed human voice audio segment, the method further includes: Based on the original volume information, the volume of the processed human voice audio segment is processed.

8. A multimedia resource processing device, characterized in that: The device comprises: A first determination module is used to determine a target audio segment based on a multimedia resource clipping page; wherein at least one audio track is displayed on the multimedia resource clipping page, and the target audio segment corresponds to part or all of the audio data on the target audio track in the at least one audio track; a vocal separation module, configured to perform vocal separation processing on the target audio segment in response to a preset audio processing operation for the target audio segment, obtain a vocal audio segment and a background sound audio segment corresponding to the target audio segment, and perform noise reduction processing and / or target sound effect processing on the vocal audio segment to obtain a processed vocal audio segment; A generation module is used to generate a processing result audio segment corresponding to the target audio segment based on the background sound audio segment and the processed human voice audio segment; wherein the processing result audio segment is used to update the target audio segment on the target audio track.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores instructions, and when the instructions are executed on a terminal device, the terminal device implements the method according to any one of claims 1 to 7.

10. A multimedia resource processing device, characterized in that: include: A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the method according to any one of claims 1 to 7 is implemented.

Images