Audio playing method and device, electronic equipment and storage medium

Abstract

The present disclosure provides an audio playing method and device, electronic equipment and storage medium, relating to the technical field of Internet, the method comprising: displaying an audio playing interface, the audio playing interface comprising at least one audio creation area and at least one video display area, the audio creation area being capable of displaying a video beat pad, the video beat pad comprising at least one sub-beat pad displaying video clip information; in response to a triggering operation on a target sub-beat pad corresponding to a target video clip, displaying a video comprising the target video clip in the video display area. By displaying video clips through the video beat pad, the function of the beat pad is enriched, and the audio creation effect and the creation experience of the user are improved.

Description

Technical Field

[0001] This application relates to the field of Internet technology, and in particular to an audio playback method, apparatus, electronic device, and storage medium. Background Technology

[0002] This section is intended to provide background or context for the embodiments of this disclosure set forth in the claims. The inclusion of certain descriptions herein does not constitute an admission that they are prior art.

[0003] A new form of creation has emerged in music production: the use of drum pads. A drum pad is an electronic device that enables electronic music performance and arrangement; similar to a synthesizer, it allows for customization of the timbre and musical phrases of each pad, producing sound through button presses. It is particularly suitable for electronic music that requires special effects. Music creators can output music by pressing the pads on the drum pad with their fingers.

[0004] With the rapid development of mobile phones, tablets and other terminals and music software, simple pad functions can also be realized through music software. Therefore, in related technologies, corresponding pad operations can be performed through music software installed on the terminal to realize music creation; specifically, users can select sampled audio through the pad in the music software and add it to the music being played.

[0005] However, the current music software's pad function is relatively simple, resulting in poor audio creation effects and a poor user experience. Summary of the Invention

[0006] This disclosure provides an audio playback method, apparatus, electronic device, and storage medium to enrich the functionality of a drum pad, improve audio creation effects, and enhance the user's creative experience.

[0007] In a first aspect, embodiments of this disclosure provide an audio playback method, including:

[0008] An audio playback interface is displayed, which includes at least one audio creation area and at least one video display area. The audio creation area can display a video pad, and the video pad includes at least one sub-pad displaying video clip information.

[0009] In response to a triggering operation on a target sub-impact pad corresponding to a target video clip, a video containing the target video clip is displayed in the video display area.

[0010] Optionally, the method further includes:

[0011] The predetermined screen is displayed in the video display area;

[0012] Displaying the video containing the target video clip in the video display area includes:

[0013] The video footage from the target video segment is superimposed onto the predetermined screen.

[0014] Optionally, the predetermined screen is one of the following:

[0015] The rhythm selection or dynamic visuals generated based on the currently playing target audio;

[0016] Reserve images;

[0017] Schedule a video.

[0018] Optionally, the method further includes:

[0019] In response to the received stop playback command for the target video segment, the display of the video containing the target video segment in the video display area is stopped.

[0020] Optionally, the audio creation area includes a toggle control, and the method further includes:

[0021] In response to a trigger operation on the switching control, the switching content corresponding to the audio creation area is obtained, and the audio creation area is switched between the turntable window and the video drum pad according to the switching content. The turntable window is used to adjust the parameters of the source audio corresponding to the audio creation area.

[0022] Optionally, the method further includes:

[0023] The first audio from the target video segment is superimposed onto the currently playing target audio; wherein the target audio is formed by at least one source audio corresponding to each of the audio creation regions.

[0024] Optionally, superimposing the first audio of the target video segment onto the target audio includes:

[0025] Obtain the rhythm point information of the source audio after the corresponding time, and superimpose the first audio onto the target audio according to the rhythm point information; wherein, the corresponding time is the trigger time of the video segment.

[0026] Optionally, the method further includes:

[0027] The audio playback interface displays a selection window for multiple pad clips, each pad clip containing at least one video segment.

[0028] In response to a triggering operation on a target impact pad material, at least one video segment information corresponding to the target impact pad material is displayed in the video impact pad.

[0029] Optionally, the method further includes:

[0030] The control for creating the impact pad is displayed in the audio playback interface;

[0031] In response to a trigger operation on the pad making control, the interface jumps from the audio playback interface to the pad making interface.

[0032] In response to the user's recording or selection of materials in the pad making interface, the corresponding video materials are acquired and displayed.

[0033] In response to the user's first editing operation, the video material is edited to obtain the produced video clip.

[0034] Optionally, after acquiring and displaying the corresponding video materials, the method further includes:

[0035] Identify and display the text information corresponding to the second audio in the video material;

[0036] The process of editing the video footage in response to the user's first editing operation to obtain a produced video clip includes:

[0037] In response to the user's operation of extracting the text information, based on the extracted text fragment, the video fragment that matches the text fragment is extracted from the video material to obtain the produced video fragment.

[0038] Optionally, the method further includes:

[0039] A preview interface showing at least one video clip that has been created;

[0040] In response to a trigger operation on any of the created video clips, play any of the created video clips.

[0041] Optionally, the method further includes:

[0042] In response to a user's second editing operation on any one of the created video clips, edit any one of the created video clips;

[0043] In response to a user's operation to adjust the order of at least one of the video segments, the arrangement order of the at least one of the video segments is adjusted.

[0044] Secondly, this disclosure also provides an audio playback method, including:

[0045] If a request to display the audio playback interface is received from the client, the display content of the audio playback interface is sent to the client so that the client can display the audio playback interface;

[0046] The audio playback interface includes at least one audio creation area and at least one video display area. The audio creation area can display video pads, and the video pads include at least one sub-pad displaying video clip information. The video display area can display a video containing a target video clip corresponding to the target sub-pad.

[0047] Optionally, the method further includes:

[0048] Generate or select a dynamic visual corresponding to the rhythm of the target audio currently being played by the client;

[0049] The dynamic image is sent to the client so that the client can display the dynamic image in the video display area.

[0050] Optionally, the method further includes:

[0051] If a switching request for the audio creation area is received from the client, the switching content corresponding to the switching request is sent to the client so that the client can switch the audio creation area between the turntable window and the video drum pad according to the switching content;

[0052] The DJ window is used to adjust the parameters of the source audio corresponding to the audio creation area.

[0053] Optionally, the method further includes:

[0054] If a request to obtain target impact pad material is received from the client, the target impact pad material is sent to the client so that the client can display at least one video segment information corresponding to the target impact pad material in the video impact pad.

[0055] Thirdly, embodiments of this disclosure also provide an audio playback device, including:

[0056] The first display module is used to display an audio playback interface, which includes at least one audio creation area and at least one video display area. The audio creation area can display a video pad, and the video pad includes at least one sub-pad displaying video clip information.

[0057] The second display module is used to display a video containing the target video segment in the video display area in response to a trigger operation on the target sub-impact pad corresponding to the target video segment.

[0058] The device further includes:

[0059] The third display module is used to display a predetermined image in the video display area;

[0060] The second display module is also used for:

[0061] The video footage from the target video segment is superimposed onto the predetermined screen.

[0062] Optionally, the predetermined screen is one of the following:

[0063] The rhythm selection or dynamic visuals generated based on the currently playing target audio;

[0064] Reserve images;

[0065] Schedule a video.

[0066] Optionally, the device further includes a stop module for:

[0067] In response to the received stop playback command for the target video segment, the display of the video containing the target video segment in the video display area is stopped.

[0068] Optionally, the audio creation area includes a switching control, and the device further includes a switching display module for:

[0069] In response to a trigger operation on the switching control, the switching content corresponding to the audio creation area is obtained, and the audio creation area is switched between the turntable window and the video drum pad according to the switching content. The turntable window is used to adjust the parameters of the source audio corresponding to the audio creation area.

[0070] Optionally, the device further includes an audio overlay module for:

[0071] The first audio from the target video segment is superimposed onto the currently playing target audio; wherein the target audio is formed by at least one source audio corresponding to each of the audio creation regions.

[0072] Optionally, the audio overlay module is further used for:

[0073] Obtain the rhythm point information of the source audio after the corresponding time, and superimpose the first audio onto the target audio according to the rhythm point information; wherein, the corresponding time is the trigger time of the video segment.

[0074] Optionally, the device further includes a fourth display module for:

[0075] The audio playback interface displays a selection window for multiple pad clips, each pad clip containing at least one video segment.

[0076] In response to a triggering operation on a target impact pad material, at least one video segment information corresponding to the target impact pad material is displayed in the video impact pad.

[0077] Optionally, the device further includes a material production module for:

[0078] The control for creating the impact pad is displayed in the audio playback interface;

[0079] In response to a trigger operation on the pad making control, the interface jumps from the audio playback interface to the pad making interface.

[0080] In response to the user's recording or selection of materials in the pad making interface, the corresponding video materials are acquired and displayed.

[0081] In response to the user's first editing operation, the video material is edited to obtain the produced video clip.

[0082] Optionally, after acquiring and displaying the corresponding video materials, the material production module is further used for:

[0083] Identify and display the text information corresponding to the second audio in the video material;

[0084] When the video material is edited in response to the user's first editing operation to obtain the produced video clip, the material production module is further configured to:

[0085] In response to the user's operation of extracting the text information, based on the extracted text fragment, the video fragment that matches the text fragment is extracted from the video material to obtain the produced video fragment.

[0086] Optionally, the device further includes a fifth display module for:

[0087] A preview interface showing at least one video clip that has been created;

[0088] In response to a trigger operation on any of the created video clips, play any of the created video clips.

[0089] Optionally, the device further includes an editing module for:

[0090] In response to a user's second editing operation on any one of the created video clips, edit any one of the created video clips;

[0091] In response to a user's operation to adjust the order of at least one of the video segments, the arrangement order of the at least one of the video segments is adjusted.

[0092] Fourthly, embodiments of this disclosure also provide an audio playback device, including:

[0093] The first sending module is configured to send the content of the audio playback interface to the client if it receives a request from the client to display the audio playback interface, so that the client can display the audio playback interface; the audio playback interface includes at least one audio creation area and at least one video display area, the audio creation area can display a video pad, the video pad includes at least one sub-pad displaying video clip information, and the video display area can display a video containing a target video clip corresponding to the target sub-pad.

[0094] Optionally, the device further includes:

[0095] The image acquisition module is used to generate or select dynamic images corresponding to the rhythm of the target audio currently being played by the client;

[0096] The second sending module is used to send the dynamic image to the client so that the client can display the dynamic image in the video display area.

[0097] Optionally, the device further includes a third transmitting module for:

[0098] If a switching request for the audio creation area is received from the client, the switching content corresponding to the switching request is sent to the client so that the client can switch the audio creation area between the turntable window and the video drum pad according to the switching content;

[0099] The DJ window is used to adjust the parameters of the source audio corresponding to the audio creation area.

[0100] Optionally, the device further includes a fourth transmitting module for:

[0101] If a request to obtain target impact pad material is received from the client, the target impact pad material is sent to the client so that the client can display at least one video segment information corresponding to the target impact pad material in the video impact pad.

[0102] Fifthly, embodiments of this disclosure also provide an electronic device, including a processor and a memory, wherein the memory stores a computer program executable on the processor, and when the computer program is executed by the processor, the processor implements the steps of either the first aspect or the second aspect of the audio playback method.

[0103] In a sixth aspect, embodiments of this disclosure also provide a computer-readable storage medium storing a computer program that, when run on an electronic device, causes the electronic device to perform the steps of either the first aspect or the second aspect of the audio playback method.

[0104] In a seventh aspect, embodiments of this disclosure provide a computer program product including computer instructions stored in a computer-readable storage medium; when a processor of an electronic device reads the computer instructions from the computer-readable storage medium, the processor executes the computer instructions, causing the electronic device to perform the steps of any of the above-described audio playback methods.

[0105] The audio playback method provided in this disclosure has at least the following beneficial effects:

[0106] According to the solution provided in this embodiment, an audio playback interface is displayed through music software. The audio playback interface includes an audio creation area and a video display area. The audio creation area can display a video pad. When the user triggers a target sub-pad corresponding to a target video segment in the video pad, a video containing the target video segment can be displayed in the video display area. In this way, the video segment is displayed through the video pad, which enriches the function of the pad and improves the user's audio creation experience.

[0107] Other features and advantages of this disclosure will be set forth in the following description and will be apparent in part from the description or may be learned by practicing the disclosure. The objects and other advantages of this disclosure may be realized and obtained by means of the structures particularly pointed out in the written description, claims, and drawings. Attached Figure Description

[0108] To more clearly illustrate the technical solutions in the embodiments of this disclosure or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this disclosure. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0109] Figure 1 A flowchart of an audio playback method provided in this disclosure embodiment;

[0110] Figure 2 A schematic diagram of an audio playback interface provided in an embodiment of this disclosure;

[0111] Figure 3 This is a schematic diagram illustrating the operation of a video impact pad provided in an embodiment of the present disclosure;

[0112] Figure 4 This is a schematic diagram illustrating the selection of a predetermined screen for a video display area, provided by an embodiment of this disclosure.

[0113] Figure 5 This is a schematic diagram illustrating the switching between a DJ window and a video drum pad, provided in an embodiment of the present disclosure.

[0114] Figure 6 A flowchart of another audio playback method provided in this disclosure embodiment;

[0115] Figure 7A This is a schematic diagram illustrating the selection of a drum pad material in an audio playback interface provided by an embodiment of the present disclosure;

[0116] Figure 7B A schematic diagram illustrating a percussion pad element in an audio playback interface provided in this embodiment of the present disclosure;

[0117] Figure 8A A schematic diagram of a striking pad manufacturing interface provided in an embodiment of this disclosure;

[0118] Figure 8B A schematic diagram illustrating a video clip used in creating impact pad material, provided by an embodiment of this disclosure;

[0119] Figure 8C A preview diagram of a manufactured impact pad material provided for an embodiment of this disclosure;

[0120] Figure 8D A schematic diagram of an interface for generating audio creation works provided in this embodiment of the disclosure;

[0121] Figure 9 A flowchart of another audio playback method provided in this disclosure embodiment;

[0122] Figure 10A A schematic diagram of an audio playback device provided in an embodiment of this disclosure;

[0123] Figure 10B A schematic diagram of another audio playback device provided in an embodiment of this disclosure;

[0124] Figure 10C A schematic diagram of another audio playback device provided in an embodiment of this disclosure;

[0125] Figure 11This is a schematic diagram of the structure of an electronic device provided in an embodiment of this disclosure. Detailed Implementation

[0126] To make the objectives, technical solutions, and advantages of this disclosure clearer, the disclosure will be further described in detail below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this disclosure, and not all of them. All other embodiments obtained by those skilled in the art based on the embodiments of this disclosure without creative effort are within the scope of protection of this disclosure.

[0127] It should be noted that the terms "first," "second," etc., used in the specification and claims of this disclosure are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such use of data can be interchanged where appropriate so that the embodiments of this disclosure described herein can be implemented in orders other than those illustrated or described herein.

[0128] Furthermore, the terms “comprising” and “having”, and any variations thereof, are intended to cover non-exclusive inclusion, such that a process, method, system, product, or apparatus that includes a series of steps or units is not necessarily limited to those steps or units that are explicitly listed, but may include other steps or units that are not explicitly listed or that are inherent to such process, method, product, or apparatus.

[0129] The design concept of the embodiments of this disclosure will be introduced below.

[0130] As mentioned earlier, with the rapid development of mobile phones, tablets, and other terminals, as well as music software, simple drum pad functions can now be implemented through music software. Therefore, related technologies allow users to perform drum pad operations through music software installed on a device to achieve music creation; specifically, users can select sampled audio on the drum pad within the music software and add it to the music being played. However, current music software drum pads are primarily audio drum pads, with relatively limited functionality, resulting in poor music creation effects and a subpar user experience.

[0131] In view of this, to enrich the functionality of the percussion pad, this embodiment of the disclosure uses the percussion pad to integrate video clips with music for audio-visual fusion. An audio playback interface is displayed through music software. This interface includes an audio creation area and a video display area. The audio creation area can display the video percussion pad. When a user triggers a target sub-percussion pad corresponding to a target video clip within the video percussion pad, a video containing the target video clip can be displayed in the video display area. Thus, by displaying video clips through the video percussion pad, the functionality of the percussion pad is enriched, and the user's audio creation experience is improved.

[0132] The audio playback method of this application embodiment will be described below with reference to the accompanying drawings and specific embodiments.

[0133] The audio playback method of this disclosure can be applied to a client or a server. The client can be software (e.g., music software), a webpage, a mini-program, etc., and can be installed on a terminal device, including but not limited to desktop computers, mobile phones, computers, smart home appliances, smart voice interaction devices, in-vehicle terminals, and other electronic devices. The server can be installed on a server, which can be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms.

[0134] The audio playback method of the client in this embodiment of the present disclosure will be described below.

[0135] refer to Figure 1 The present disclosure provides an audio playback method, including the following steps S101-S102:

[0136] Step S101: Display an audio playback interface. The audio playback interface includes at least one audio creation area and at least one video display area. The audio creation area can display a video pad, and the video pad includes at least one sub-pad displaying video clip information.

[0137] In this embodiment, the client can respond to a user's trigger operation on the audio playback interface by sending a request to the server to display the audio playback interface, and receive the display content of the audio playback interface returned by the server, thereby displaying the audio playback interface. The audio creation area in the audio playback interface allows the user to create audio content. The number of audio creation areas can be set as needed, such as two or three, and is not limited here. Any audio creation area can display a video pad and can add corresponding source audio, such as a song.

[0138] The number of sub-palettes in the video pad can be set as needed, such as 6 or 12, and is not limited here. Each sub-palette can be regarded as a selection control, which displays video clip information, such as the cover image corresponding to the video clip. The video clips corresponding to the video pad can be selected by the user from the pad materials recommended by the system. Each pad material contains at least one video clip, or they can be created by the user or uploaded to the system by other users, and is not limited here.

[0139] For example, such as Figure 2 The audio playback interface shown has a video pad displayed in the audio creation area on the right (dashed box on the right). This video pad contains 6 sub-pads 21 ( Figure 2 The right-hand squares (the sub-pads 21) each display a cover image of a video clip. This audio creation area also includes an audio adding window for adding source audio for playback, as well as volume control controls. The video display area 22 is located in the center of the audio playback interface.

[0140] Figure 2 The audio playback interface shown is merely an example. This embodiment does not limit the display position of the audio creation area and the video display area, and can be set arbitrarily as needed.

[0141] In step S102, in response to the triggering operation of the target sub-impact pad corresponding to the target video clip, the video containing the target video clip is displayed in the video display area.

[0142] The triggering operation can be, for example, a click or a swipe, and is not limited in this respect. When the user triggers the target sub-pad, the client responds to the triggering operation by displaying a video clip containing the target video clip corresponding to the target sub-pad in the video display area. For example, it may display only the target video clip, or overlay the target video clip onto other screens displayed in the video display area. Figure 3 As shown, suppose the video pad contains 6 sub-pads, each displaying a person's image. When a user clicks on one of the sub-pads, a video clip of the person's image corresponding to that sub-pad is displayed in the video display area.

[0143] This embodiment of the disclosure uses a video pad to display video clips, enriching the functionality of the pad and allowing users to blend video clips with the audio being played, thus improving the user's audio creation experience.

[0144] In some embodiments, to improve the audio playback effect of the audio playback interface, the client may also display a predetermined frame in the video display area. Optionally, the predetermined frame can be obtained in the following two possible ways:

[0145] The first possible approach is to select or generate dynamic visuals based on the rhythm of the currently playing target audio.

[0146] The target audio can be formed from at least one source audio. Each audio creation area can play the corresponding source audio. When multiple source audios are playing, they can be merged to form the target audio.

[0147] On one hand, dynamic visuals can be generated based on the rhythm of the currently playing target audio. Specifically, the system can provide various types of dynamic visuals, including but not limited to ripples, bar charts, and animations. When the target audio is played, dynamic visuals matching the rhythm of the target audio can be generated based on the user-selected type, for example, the dynamic visuals changing with the rhythm; alternatively, dynamic visuals matching the rhythm of the target audio can be generated based on system-recommended types, for example... Figure 2 The video display area in the video showcases dynamic visuals generated based on bar charts.

[0148] On the other hand, the system can also select corresponding dynamic visuals based on the rhythm of the currently playing target audio. Specifically, the system can provide dynamic visuals corresponding to various types of audio rhythms. The client can select the corresponding dynamic visual based on the rhythm type of the currently playing target audio, or it can select the corresponding dynamic visual from various dynamic visuals based on the user's selection command. The type of dynamic visual can also include, but is not limited to, ripples, bar charts, animations, etc., which can be set as needed.

[0149] It should be noted that when the target audio is formed from multiple source audios, the dynamic image can be a dynamic image that matches the rhythm of one of the source audios. For example, the dynamic image can match the rhythm of the source audio with higher volume, or match the rhythm of a specified source audio. There are no restrictions here.

[0150] The second possible option is to choose to pre-order photos or videos.

[0151] Specifically, users can select and reserve photos or videos from their local photo album.

[0152] like Figure 4 As shown, the client responds to user actions triggered by the album in the audio playback interface, displaying videos, photos, etc., from the album. When the user selects a picture or video from the album, the selected picture or video is displayed in the video display area. When a pre-selected video is displayed, it loops along with the target audio; when a pre-selected picture is displayed, it remains fixed while the target audio is playing.

[0153] Optionally, when displaying a predetermined screen in the video display area, in step S102 above, when displaying a video containing the target video segment in the video display area, the video footage from the target video segment can be superimposed onto the predetermined screen.

[0154] Furthermore, during the process of displaying a video containing the target video clip in the video display area, the client can also respond to a stop playback command received from the target video clip and stop displaying the video containing the target video clip in the video display area.

[0155] The stop playback command can be generated in response to a user's trigger operation on a sub-pad corresponding to another video segment. In this case, the target video segment will stop being displayed in the video display area, and the other video segment will continue to be displayed. Alternatively, the stop playback command can be generated in response to the completion of the playback of the currently playing target audio. That is, if the target audio segment has not been fully displayed when the target audio has finished playing, the display also needs to be stopped.

[0156] In this embodiment of the disclosure, while displaying the target video segment in the video display area, the first audio in the target video segment can also be superimposed on the currently playing target audio; as mentioned above, the target audio is formed by the source audio corresponding to at least one audio creation area.

[0157] For example, when the target audio is formed from two source audios, the target audio can be obtained by fusing the two source audios. Specifically, when fusing two source audios, one source audio can be designated as the reference source audio, and the playback rate or beat count of the other source audio can be adjusted before fusing it with the reference source audio.

[0158] The method of superimposing the first audio from the target video segment onto the currently playing target audio can include the following two possible implementations:

[0159] In one possible implementation, the first audio from the target video segment is directly superimposed onto the currently playing target audio.

[0160] In another possible implementation, the rhythm point information of the source audio after the corresponding time is obtained, and the first audio is superimposed on the target audio according to the rhythm point information; wherein, the corresponding time is the trigger time of the video segment.

[0161] Specifically, when any source audio included in the target audio is a song with a high-precision MIDI (Musical Instrument Digital Interface) pitch file, the client can obtain the rhythm point information of that source audio from the server. Then, when the user triggers the target sub-pad, the client can obtain the rhythm point information of that source audio after the trigger moment and adjust the pitch of the first audio according to this rhythm point information, superimposing the adjusted first audio onto the target audio. Thus, when the user clicks the target sub-pad, the first audio will align with the MIDI pitch point of the aforementioned source audio after the trigger moment, achieving an automatic pitch correction effect.

[0162] Similarly, during the process of overlaying the first audio of the target video segment onto the target audio, the client can also stop playing the first audio in response to receiving a stop playback command for the target video segment.

[0163] In some embodiments, any audio creation area may display both a video drum pad and a turntable window, which is used to adjust parameters of the source audio being played, such as playback speed and volume. Each audio creation area can switch between the turntable window and the video drum pad.

[0164] Optionally, the audio creation area includes a switching control. The client can also respond to the trigger operation of the switching control, obtain the switching content corresponding to the audio creation area, and switch the audio creation area between the turntable window and the video drum pad according to the switching content. The turntable window is used to adjust the parameters of the source audio corresponding to the audio creation area.

[0165] When a user triggers the switching control for the audio creation area, the client can send a switching request to the server and receive the corresponding switching content from the server. Specifically, the switching request can instruct either the turntable window to switch to a video drum pad or vice versa. The client receives either the video drum pad or the turntable window from the server. The turntable window can include an object to manipulate (e.g., a vinyl record), volume control, etc. Manipulating the object allows adjustment of the playback speed of the source audio, while the volume control allows adjustment of the source audio volume.

[0166] For example, such as Figure 5 As shown, assuming the audio playback interface contains two audio creation areas, at the first moment, the left audio creation area displays a turntable window 51 (left dashed box) and a switching control 52. This turntable window includes a vinyl record, volume control, and an audio addition window 53 for adding source audio to be played. The right audio creation area displays a video drum pad, switching control, volume control, and an audio addition window. At the second moment after the first moment, the user triggers the switching button in the left audio creation area, and the client responds by switching the turntable window in that audio creation area to the video drum pad. At the third moment after the second moment, the user triggers the switching button in the right audio creation area, and the client responds by switching the video drum pad in that audio creation area to the turntable window. At the fourth moment after the third moment, the user triggers the switching button in the left audio creation area, and the client responds by switching the video drum pad in that audio creation area to the turntable window.

[0167] As can be seen, by switching between the video drum pad and the turntable window, the audio playback interface can be transformed into multiple audio creation interfaces, realizing various audio creation modes, including single turntable + single video drum pad, dual turntable, dual turntable + single video drum pad, dual turntable + dual video drum pad, etc., which greatly improves the user's creation experience.

[0168] Based on the above embodiments, the audio playback method in this disclosure will be described in detail below using a specific example. (See attached document for details.) Figure 6 The diagram shown is a flowchart of another audio playback method provided in this embodiment of the disclosure, which specifically includes:

[0169] In step S601, the client displays an audio playback interface, which includes a turntable window, a video pad, and a video display area. The video pad includes multiple sub-pads that display video clip information.

[0170] In step S602, the client displays the dynamic image corresponding to the currently playing music in the video display area.

[0171] The currently playing music can be a song played in the area where the DJ turntable is located, a song played in the area where the video drum pad is located, or a combination of the two songs.

[0172] In step S603, the client responds to the trigger operation of a sub-pad in the video pad by overlaying the video image of the video segment corresponding to the sub-pad onto the dynamic image, and overlaying the audio of the video segment onto the music.

[0173] In step S604, the client responds to the trigger operation of the switching control corresponding to the DJ window and switches the DJ window to another video pad.

[0174] In step S605, the client responds to the trigger operation of the switching control corresponding to the video drum pad by switching the video drum pad to another DJ window.

[0175] In this embodiment, a video pad is used to display video clips. On one hand, the video footage from the clip can be superimposed on a predetermined frame in the video display area. On the other hand, the first audio from the video clip can be superimposed on the currently playing target audio, enriching the pad's functionality. This allows users to combine video clips with the music being played, giving the video clips a musical rhythm, thus improving the music creation effect and the user's music creation experience. Furthermore, by switching between the video pad and the DJ window, various music creation modes can be implemented to meet the user's music creation needs.

[0176] In some embodiments, to facilitate user selection of video pad material, the client may also perform the following steps A1-A2:

[0177] Step A1: Display a selection window for multiple pad clips in the audio playback interface. Each pad clip contains at least one video clip.

[0178] The display position of the selection window within the audio playback interface can be set as needed and is not limited here. The pad materials can be provided by the system, created by the user, or uploaded by other users. Optionally, the selection window can display the cover images of multiple pad materials, allowing the user to choose different pad materials. The pad materials displayed in the selection window can be selected by the system from a large pool of pad materials to match the target audio being played, or they can be randomly displayed.

[0179] Step A2: In response to a trigger operation on the target pad material, display at least one video segment information corresponding to the target pad material in the video pad.

[0180] For example, such as Figure 7A As shown, the selection window is located above the video pads. Currently, multiple pad materials 71 recommended by the system are displayed. Each pad material corresponds to a cover image. When the user triggers the cover image of one of the pad materials, the terminal device responds to the trigger operation and displays multiple video clips corresponding to that pad material on multiple sub-pads of the video pads.

[0181] Since there are many pad materials, the selection window only displays a few pad materials. The other pad materials that are not displayed can be displayed by the user by sliding the selection window, or by the user triggering the corresponding viewing control.

[0182] For example, such as Figure 7B As shown, the selection window includes a "View More" control 72. In response to the user's triggering operation on the "View More" control 72, the client displays a list of more drum pad materials in a floating window. This list displays the cover image of the drum pad material, as well as the description information of the drum pad material, such as "Funny Quartet", "Someone is a Rapper", "Cute Cat Meowing", "Pig Family", etc. The user can scroll up and down the list of drum pad materials to display more drum pad materials.

[0183] In some embodiments, to further enhance the user's creative experience, the client can also provide a function for creating impact pad materials. In this case, the client can perform the following steps B1-B4:

[0184] Step B1: Display the pad creation controls in the audio playback interface.

[0185] The display position of the pad creation control can be set as needed, for example, displaying the pad creation control in the pad material selection window or floating window.

[0186] Step B2: In response to a trigger operation on the pad making control, jump from the audio playback interface to the pad making interface.

[0187] The interface for creating a drum pad can include a title editing area, a material selection area, and an effect preview area. Users can edit the title of the drum pad material in the title editing area, select video materials in the material selection area, and the completed drum pad material can be displayed in the effect preview area. Specifically, the material selection area can include material acquisition controls, which can include one or both of the following: material recording controls and material selection controls.

[0188] For example, such as Figure 8A The drum pad creation interface shown has the text "Enter your keyboard name" displayed in the title editing area. The keyboard name is the title of the drum pad material. Users can tap the text to bring up the keyboard and enter the title of the drum pad material. The material selection area includes "Record" and "Album" controls (i.e., material selection controls). The effect preview area is located below the material selection area and contains preview areas for multiple video clips.

[0189] It should be noted that, Figure 8A The display positions of the title editing area, material selection area, and effect preview area in the document are merely examples and can be set as needed in actual applications; no limitations are imposed here.

[0190] Step B3: In response to the user's recording or selection of materials in the pad creation interface, acquire and display the corresponding video materials.

[0191] Specifically, users can trigger the aforementioned material recording control to perform a material recording operation and obtain recorded video materials, or trigger the aforementioned material selection control to perform a material selection operation, obtain the corresponding video materials, and display them in the material selection area.

[0192] Step B4: In response to the user's first editing operation, edit the video footage to obtain the produced video clip.

[0193] The interface for creating the striking pad can include editing controls, such as... Figure 8AThe "Edit" control allows the client to jump from the pad creation interface to the material editing interface after the user triggers it. The user can then perform the first editing operation on the video material in the material editing interface, which is used to select a video segment from the video material.

[0194] Optionally, to facilitate the selection of video segments from video materials, after obtaining and displaying the corresponding video materials in step B3 above, the text information corresponding to the second audio in the video materials can also be identified and displayed.

[0195] Specifically, audio recognition technology can be used to identify sentences in the second audio and convert them into a text timeline, thus obtaining text information. Each character in this text information corresponds to a time point, and then the corresponding video segment can be selected based on the text information.

[0196] At this point, step B4 above, which responds to the user's first editing operation by editing the video material to obtain the produced video clip, may include: responding to the user's operation of extracting text information, extracting video clips from the video material that match the text clips based on the extracted text clips to obtain the produced video clips.

[0197] Specifically, after a user performs a cut operation, the client obtains the start and end times corresponding to the cut text segment. Then, it extracts a video segment from the video footage between those start and end times. For example, if the video footage is one minute long and the user wants to cut a text segment between 20 and 30 seconds, the client will extract a video segment between 20 and 30 seconds from the one-minute video footage.

[0198] For example, such as Figure 8B The media editing interface shown currently displays a video clip with a duration of 1 minute and 30 seconds. Below the video clip are recognized text information, including text and a timeline. Each character in the text corresponds to a point in time on the timeline. Users can select a text segment to extract, such as... Figure 8B The text fragment "What do you want?" is extracted from the video footage. The time point corresponding to "you" is 30 seconds, and the time point corresponding to "how" is 35 seconds. After the client obtains the text fragment, it can determine the start and end time points of the text fragment, that is, 30-35 seconds, and then extract the video segment from the video footage between 30 and 35 seconds.

[0199] Optionally, you can set the duration range of each video clip, such as 1-10 seconds; you can also set the number of video clips for each pad material, such as 1-12, without limitation.

[0200] Based on the above embodiments of this application, after obtaining the produced video clip, a preview interface of the video clip can be displayed, and the video clip can be played. Specifically, the following steps C1-C2 can be performed:

[0201] Step C1: Display a preview interface of at least one video clip that has been created.

[0202] As mentioned above, the various video clips produced can be displayed in the effect preview area, such as... Figure 8C The preview interface shown displays the effect preview area, showcasing the preview effect of each video clip on the video pad. It includes multiple sub-areas, each of which can be considered a preview sub-pad, displaying information about a single video clip. After creating a video clip, you can click... Figure 8C Use the "Add Material" control to add more video materials to create the next video clip. Click the "Finish" control to complete the creation of the drum pad material. Finally, you can upload the completed drum pad material to the server for other users to choose from.

[0203] Step C2: In response to a trigger operation on any of the created video clips, play any of the created video clips.

[0204] Specifically, users can trigger any sub-area containing a created video clip in the effect preview area. The client responds to this trigger operation by playing the video clip in the preview interface, such as... Figure 8C Play the video clip above the preview area.

[0205] Optionally, when playing any of the created video clips, the following steps D1-D2 can also be performed:

[0206] Step D1: In response to the user's second editing operation on any created video clip, edit any created video clip.

[0207] The second editing operation includes, but is not limited to, adjustments such as cutting and slicing, and deletion operations. Figure 8C As shown, when playing any of the created video clips, the sub-area of ​​the effect preview area corresponding to the video clip also displays editing controls 81 and deletion controls 82. Users can trigger the editing controls to perform adjustments such as cutting and slicing the video clip being played. The client responds to the adjustment operation and makes corresponding adjustments to the video clip. Users can also trigger the deletion controls, and the client responds to the trigger operation and deletes the corresponding video clip.

[0208] Step D3: In response to the user's operation to adjust the order of at least one video clip, adjust the arrangement order of the at least one video clip.

[0209] In this preview, multiple video clips created by the user are displayed in their respective sub-areas within the preview area, arranged in the order they were created. Users can also adjust the order of these video clips, meaning they can change the display position of one or more clips within the preview area. For example, adjusting the order can be a movement operation, where a sub-area within the preview area is moved, changing its display position.

[0210] In addition, audio clips can also be created using the same methods described above for creating video clips. Specifically, audio clips can be created based on audio materials using the same methods described above.

[0211] In some embodiments, the audio playback interface also includes a recording control. Before creating audio content on the audio playback interface, the user can trigger the recording control. In response to the triggering operation, the client records the user's audio creation process, including playing the target audio, adjusting the parameters of the source audio contained in the target audio through the DJ window, adding video clips through the video pad, etc. After the user has finished creating the audio content, the user can trigger the recording control again. In response to the triggering operation, the client generates a complete audio creation.

[0212] Optionally, users can save their audio creations locally or upload them to a server, such as publishing an Mlog (Music log) for other users to enjoy.

[0213] For example, such as Figure 8D As shown, this is the interface for generating audio creation works. After the user finishes creating the work, they can trigger the recording control again to display the audio creation work generation interface. The user can enter the name of the work. After the audio creation work is generated, the user can trigger the "Save to Local" control to save the generated audio creation work. Furthermore, the user can also upload the audio creation work to the server.

[0214] The following describes the server-side audio playback method provided in the embodiments of this disclosure.

[0215] like Figure 9 As shown in the embodiments of this disclosure, an audio playback method is also provided, including the following steps:

[0216] Step S901: If a request to display the audio playback interface is received from the client, the display content of the audio playback interface is sent to the client so that the client can display the audio playback interface; the audio playback interface includes at least one audio creation area and at least one video display area. The audio creation area can display video pads, and the video pads include at least one sub-pad displaying video clip information. The video display area can display a video containing the target video clip corresponding to the target sub-pad.

[0217] The server-side component can be a backend server for the client, receiving interface display requests from the client and sending the corresponding interface content back to the client. The server stores various pad materials, each containing at least one video clip. It can send recommended pad materials to the client, allowing the client to display at least one video clip corresponding to the pad material in the video pad display area. Users can trigger a target sub-pad corresponding to a target video clip within the client. In response to this trigger, the client displays a video containing the target video clip in the video display area.

[0218] This embodiment of the disclosure uses a video pad to display video clips, enriching the functionality of the pad and allowing users to blend video clips with the audio being played, thus improving the user's audio creation experience.

[0219] Optionally, to improve the audio playback effect on the audio playback interface, dynamic images can also be displayed in the video display area. In this case, the server can also execute the following steps E1-E2:

[0220] E1. Generate or select dynamic visuals corresponding to the rhythm of the target audio currently being played on the client.

[0221] The specific implementation process for this step is described in the preceding implementation and will not be repeated here.

[0222] E2. Send the dynamic images to the client so that the client can display the dynamic images in the video display area.

[0223] Optionally, any audio creation area can display not only a video drum pad but also a DJ turntable window. The server can also perform the following steps:

[0224] If a request to switch the audio creation area is received from the client, the corresponding switching content is sent to the client so that the client can switch the audio creation area between the turntable window and the video drum pad according to the switching content.

[0225] Optionally, the client can obtain the user-selected pad material from the server. In this case, the server can also perform the following steps:

[0226] If a request to obtain target pad material is received from the client, the target pad material is sent to the client so that the client can display at least one video segment information corresponding to the target pad material in the video pad.

[0227] Based on the same inventive concept, this disclosure also provides an audio playback device. The principle of this device in solving the problem is similar to the client method in the above embodiments. Therefore, the implementation of this device can refer to the implementation of the method, and repeated details will not be described again.

[0228] like Figure 10A As shown in the figure, an audio playback device provided in this embodiment includes a first display module 101 and a second display module 102.

[0229] The first display module 101 is used to display an audio playback interface. The audio playback interface includes at least one audio creation area and at least one video display area. The audio creation area can display a video pad. The video pad includes at least one sub-pad displaying video clip information.

[0230] The second display module 102 is used to display a video containing the target video clip in the video display area in response to a trigger operation on the target sub-impact pad corresponding to the target video clip.

[0231] This embodiment of the disclosure uses a video pad to display video clips, enriching the functionality of the pad and allowing users to blend video clips with the audio being played, thus improving the user's audio creation experience.

[0232] Optional, such as Figure 10B As shown, the device also includes:

[0233] The third display module 103 is used to display a predetermined image in the video display area;

[0234] The second display module 102 is also used for:

[0235] Superimpose video footage from the target video segment onto a predetermined frame.

[0236] Optionally, the scheduled screen may be one of the following:

[0237] The rhythm selection or dynamic visuals generated based on the currently playing target audio;

[0238] Reserve images;

[0239] Schedule a video.

[0240] Optionally, the device also includes a stop module 104 for:

[0241] In response to a stop playback command obtained from the target video segment, the display of the video containing the target video segment is stopped in the video display area.

[0242] Optionally, the audio creation area includes toggle controls, and the device also includes a toggle display module 105 for:

[0243] In response to a trigger operation on the switching control, the corresponding switching content for the audio creation area is obtained, and the audio creation area is switched between the turntable window and the video drum pad according to the switching content. The turntable window is used to adjust the parameters of the source audio corresponding to the audio creation area.

[0244] Optionally, the device also includes an audio overlay module 106 for:

[0245] The first audio from the target video segment is superimposed onto the currently playing target audio; wherein the target audio is formed by source audio corresponding to at least one audio creation region.

[0246] Optionally, the audio overlay module 106 is also used for:

[0247] Obtain the rhythm point information of the source audio after the corresponding time, and superimpose the first audio onto the target audio according to the rhythm point information; where the corresponding time is the trigger time of the video segment.

[0248] Optionally, the device also includes a fourth display module 107 for:

[0249] The audio playback interface displays a selection window for multiple pad clips, each pad clip containing at least one video segment.

[0250] In response to a trigger operation on the target pad material, at least one video segment information corresponding to the target pad material is displayed in the video pad.

[0251] Optionally, the device also includes a material production module 108, used for:

[0252] Display the control for creating the drum pad in the audio playback interface;

[0253] In response to a trigger action on the pad making control, the interface jumps from the audio playback interface to the pad making interface.

[0254] In response to the user's recording or selection of materials in the pad creation interface, the corresponding video materials are acquired and displayed.

[0255] In response to the user's first editing action, the video footage is edited to obtain the produced video clip.

[0256] Optionally, after acquiring and displaying the corresponding video footage, the footage creation module 108 is also used for:

[0257] Identify and display the text information corresponding to the second audio in the video footage;

[0258] In response to the user's first editing action, when editing video footage to obtain the produced video clip, the footage creation module is also used for:

[0259] In response to the user's text information extraction operation, based on the extracted text fragment, the video fragment that matches the text fragment is extracted from the video material to obtain the produced video fragment.

[0260] Optionally, the device also includes a fifth display module 109, used for:

[0261] A preview interface showing at least one video clip that has been created;

[0262] In response to a trigger operation on any created video clip, play any created video clip.

[0263] Optionally, the device also includes an editing module 1010 for:

[0264] In response to a user's second editing operation on any created video clip, edit any created video clip;

[0265] In response to a user's operation to adjust the order of at least one video clip, the arrangement order of the at least one video clip is adjusted.

[0266] Based on the same inventive concept, this disclosure also provides an audio playback device. The principle of this device in solving the problem is similar to the method of the server in the above embodiments. Therefore, the implementation of this device can refer to the implementation of the method, and the repeated parts will not be described again.

[0267] like Figure 10C As shown in the figure, an audio playback device provided in this disclosure includes:

[0268] The first sending module 1011 is used to send the display content of the audio playback interface to the client if it receives a display request for the audio playback interface from the client, so that the client can display the audio playback interface; the audio playback interface includes at least one audio creation area and at least one video display area, the audio creation area can display video pads, the video pads include at least one sub-pad displaying video clip information, and the video display area can display a video containing the target video clip corresponding to the target sub-pad.

[0269] Optionally, the device also includes:

[0270] The image acquisition module 1012 is used to generate or select dynamic images corresponding to the rhythm of the target audio currently being played on the client.

[0271] The second sending module 1013 is used to send the dynamic image to the client so that the client can display the dynamic image in the video display area.

[0272] Optionally, the device further includes a third transmitting module 1014, used for:

[0273] If a client sends a request to switch the audio creation area, the client sends the corresponding switching content to the client so that the client can switch the audio creation area between the turntable window and the video drum pad according to the switching content; the turntable window is used to adjust the parameters of the source audio corresponding to the audio creation area.

[0274] Optionally, the device further includes a fourth transmitting module 1015, used for:

[0275] If a request to obtain target pad material is received from the client, the target pad material is sent to the client so that the client can display at least one video segment information corresponding to the target pad material in the video pad.

[0276] For ease of description, the above sections are divided into modules according to their functions and described separately. Of course, in implementing this application, the functions of each module can be implemented in one or more software or hardware components.

[0277] Those skilled in the art will understand that various aspects of this application can be implemented as a system, method, or program product. Therefore, various aspects of this application can be specifically implemented in the following forms: a completely hardware implementation, a completely software implementation (including firmware, microcode, etc.), or a combination of hardware and software implementations, collectively referred to herein as a "circuit," "module," or "system."

[0278] Regarding the apparatus in the above embodiments, the specific execution methods of each module have been described in detail in the embodiments related to the method, and will not be elaborated here.

[0279] Based on the same inventive concept, this disclosure also provides an electronic device. The principle of this electronic device in solving the problem is similar to the method of the above embodiments. Therefore, the implementation of this electronic device can refer to the implementation of the method, and repeated details will not be described again.

[0280] See Figure 11As shown, the electronic device may include a processor 1102, a memory 1101, an input device 1103, and an output device 1104, etc. The input device may include a keyboard, mouse, touchscreen, etc., and the output device 1104 may include a display device, such as a liquid crystal display (LCD) or a cathode ray tube (CRT). The memory 1101 provides the processor 1102 with program instructions and data stored in the memory 1101. In this embodiment, the memory 1101 can be used to store the audio playback program in this embodiment.

[0281] Processor 1102 executes the audio playback method in any of the above embodiments by calling program instructions stored in memory 1101, for example... Figure 1 The illustrated embodiment provides an audio playback method.

[0282] This disclosure does not limit the specific connection medium between the memory 1101, input device 1103, output device 1104, and processor 1102. Optionally, the memory 1101, input device 1103, output device 1104, and processor 1102 can be connected via a bus. The bus can be divided into address bus, data bus, control bus, etc.

[0283] The memory may include read-only memory (ROM) and random access memory (RAM), and may also include non-volatile memory (NVM), such as at least one disk storage device. Optionally, the memory may also be at least one storage device located remotely from the aforementioned processor.

[0284] The processors mentioned above can be general-purpose processors, including central processing units, network processors (NPs), etc.; they can also be digital signal processors (DSPs), application-specific integrated circuits, field-programmable gate arrays or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc.

[0285] This disclosure also provides a computer storage medium storing a computer program. The processor of an electronic device reads the computer program from the computer-readable storage medium and executes the computer program, causing the electronic device to perform the audio playback method in any of the above method embodiments.

[0286] In specific implementation, computer storage media can include: Universal Serial Bus Flash Drive (USB), portable hard drive, Read-Only Memory (ROM), Random Access Memory (RAM), magnetic disk or optical disk, and other storage media that can store program code.

[0287] Based on the same inventive concept as the above-described method embodiments, this application provides a computer program product or computer program that includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the steps of any of the above-described audio playback methods.

[0288] The program product may employ any combination of one or more readable media. A readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples (a non-exhaustive list) of readable storage media include: electrical connections having one or more wires, portable disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.

[0289] Those skilled in the art will understand that embodiments of this disclosure can be provided as methods, systems, or computer program products. Therefore, this disclosure can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this disclosure can take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0290] This disclosure is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to this disclosure. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart illustrations. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0291] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0292] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0293] Obviously, those skilled in the art can make various modifications and variations to this disclosure without departing from its spirit and scope. Therefore, if such modifications and variations fall within the scope of the claims of this disclosure and their equivalents, this disclosure is also intended to include such modifications and variations.

Claims

1. An audio playback method, characterized in that, include: An audio playback interface is displayed, which includes at least one audio creation area and at least one video display area. The audio creation area can add source audio and display video pads. The video pads include at least one sub-pad that displays video clip information. The sub-pad is a selection control. In response to a triggering operation on a target sub-impact pad corresponding to a target video clip, a video containing the target video clip is displayed in the video display area; The audio playback interface displays a selection window for multiple batting pad video clips, each containing at least one video segment; wherein each batting pad video clip is selected from a storage of batting pad video clips that match the target audio being played, based on the currently playing target audio. In response to a trigger operation targeting video footage of a target impact pad, the target impact pad video footage is acquired, and at least one video segment corresponding to the target impact pad video footage is displayed in the video impact pad.

2. The method according to claim 1, characterized in that, The method further includes: The predetermined screen is displayed in the video display area; Displaying the video containing the target video clip in the video display area includes: The video footage from the target video segment is superimposed onto the predetermined screen.

3. The method according to claim 2, characterized in that, The predetermined screen is one of the following: The rhythm selection or dynamic visuals generated based on the currently playing target audio; Reserve images; Schedule a video.

4. The method according to any one of claims 1 to 3, characterized in that, The method further includes: In response to the received stop playback command for the target video segment, the display of the video containing the target video segment in the video display area is stopped.

5. The method according to any one of claims 1 to 3, characterized in that, The audio creation area includes a switching control, and the method further includes: In response to a trigger operation on the switching control, the switching content corresponding to the audio creation area is obtained, and the audio creation area is switched between the turntable window and the video drum pad according to the switching content. The turntable window is used to adjust the parameters of the source audio corresponding to the audio creation area.

6. The method according to any one of claims 1 to 3, characterized in that, The method further includes: The first audio from the target video segment is superimposed onto the currently playing target audio; wherein the target audio is formed by at least one source audio corresponding to each of the audio creation regions.

7. The method according to claim 6, characterized in that, The step of superimposing the first audio of the target video segment onto the target audio includes: Obtain the rhythm point information of the source audio after the corresponding time, and superimpose the first audio onto the target audio according to the rhythm point information; wherein, the corresponding time is the trigger time of the video segment.

8. The method according to any one of claims 1 to 3, characterized in that, The method further includes: The control for creating the impact pad is displayed in the audio playback interface; In response to a trigger operation on the pad making control, the interface jumps from the audio playback interface to the pad making interface. In response to the user's recording or selection of materials on the pad creation interface, the corresponding pad video materials are acquired and displayed. In response to the user's first editing operation, the video footage of the impact pad is edited to obtain the produced video clip.

9. The method according to claim 8, characterized in that, After acquiring and displaying the corresponding impact pad video footage, the process also includes: Identify the text information corresponding to the second audio in the video material of the impact pad, and display the text information; The process of editing the impact pad video footage in response to the user's first editing operation to obtain a produced video clip includes: In response to the user's operation of extracting the text information, based on the extracted text fragment, the video fragment that matches the text fragment in the video material of the impact pad is extracted to obtain the produced video fragment.

10. The method according to claim 8, characterized in that, The method further includes: A preview interface showing at least one video clip that has been created; In response to a trigger operation on any of the created video clips, play any of the created video clips.

11. The method according to claim 10, characterized in that, The method further includes: In response to a user's second editing operation on any one of the created video clips, edit any one of the created video clips; In response to a user's operation to adjust the order of at least one of the video segments, the arrangement order of the at least one of the video segments is adjusted.

12. An audio playback method, characterized in that, include: If a request to display the audio playback interface is received from the client, the display content of the audio playback interface is sent to the client so that the client can display the audio playback interface; The audio playback interface includes at least one audio creation area and at least one video display area. The audio creation area can add source audio and display video pads. The video pads include at least one sub-pad displaying video clip information. The sub-pad is a selection control. The video display area can display a video containing the target video clip corresponding to the target sub-pad. The client also displays a selection window for multiple batting pad video clips in the audio playback interface, each batting pad video clip containing at least one video segment; wherein, each batting pad video clip is a batting pad video clip selected from the stored batting pad video clips that matches the target audio being played. If a request to obtain target impact pad video material is received from the client, the target impact pad video material is sent to the client so that the client can display at least one video segment information corresponding to the target impact pad video material in the video impact pad.

13. The method according to claim 12, characterized in that, The method further includes: Generate or select a dynamic visual corresponding to the rhythm of the target audio currently being played by the client; The dynamic image is sent to the client so that the client can display the dynamic image in the video display area.

14. The method according to claim 12 or 13, characterized in that, The method further includes: If a switching request for the audio creation area is received from the client, the switching content corresponding to the switching request is sent to the client so that the client can switch the audio creation area between the turntable window and the video drum pad according to the switching content; The DJ window is used to adjust the parameters of the source audio corresponding to the audio creation area.

15. An audio playback device, characterized in that, include: The first display module is used to display an audio playback interface. The audio playback interface includes at least one audio creation area and at least one video display area. The audio creation area can add source audio and display video pads. The video pads include at least one sub-pad that displays video clip information. The sub-pad is a selection control. The second display module is used to display a video containing the target video segment in the video display area in response to a trigger operation on the target sub-impact pad corresponding to the target video segment; The fourth display module is used to display a selection window for multiple batting pad video materials in the audio playback interface. Each batting pad video material contains at least one video clip. Each batting pad video material is selected from the stored batting pad video materials to match the target audio, based on the currently playing target audio. In response to a trigger operation targeting video footage of a target impact pad, the target impact pad video footage is acquired, and at least one video segment corresponding to the target impact pad video footage is displayed in the video impact pad.

16. The apparatus according to claim 15, characterized in that, The device further includes: The third display module is used to display a predetermined image in the video display area; The second display module is also used for: The video footage from the target video segment is superimposed onto the predetermined screen.

17. The apparatus according to claim 16, characterized in that, The predetermined screen is one of the following: The rhythm selection or dynamic visuals generated based on the currently playing target audio; Reserve images; Schedule a video.

18. The apparatus according to any one of claims 15 to 17, characterized in that, The device further includes a stop module for: In response to the received stop playback command for the target video segment, the display of the video containing the target video segment in the video display area is stopped.

19. The apparatus according to any one of claims 15 to 17, characterized in that, The audio creation area includes switching controls, and the device further includes a switching display module for: In response to a trigger operation on the switching control, the switching content corresponding to the audio creation area is obtained, and the audio creation area is switched between the turntable window and the video drum pad according to the switching content. The turntable window is used to adjust the parameters of the source audio corresponding to the audio creation area.

20. The apparatus according to any one of claims 15 to 17, characterized in that, The device also includes an audio overlay module for: The first audio from the target video segment is superimposed onto the currently playing target audio; wherein the target audio is formed by at least one source audio corresponding to each of the audio creation regions.

21. The apparatus according to claim 20, characterized in that, The audio overlay module is also used for: Obtain the rhythm point information of the source audio after the corresponding time, and superimpose the first audio onto the target audio according to the rhythm point information; wherein, the corresponding time is the trigger time of the video segment.

22. The apparatus according to any one of claims 15 to 17, characterized in that, The device also includes a material production module for: The control for creating the impact pad is displayed in the audio playback interface; In response to a trigger operation on the pad making control, the interface jumps from the audio playback interface to the pad making interface. In response to the user's recording or selection of materials on the pad creation interface, the corresponding pad video materials are acquired and displayed. In response to the user's first editing operation, the video footage of the impact pad is edited to obtain the produced video clip.

23. The apparatus according to claim 22, characterized in that, After acquiring and displaying the corresponding impact pad video footage, the footage production module is further used for: Identify and display the text information corresponding to the second audio in the video material of the impact pad; When the video footage of the impact pad is edited in response to the user's first editing operation to obtain the produced video clip, the footage production module is further configured to: In response to the user's operation of extracting the text information, based on the extracted text fragment, the video fragment that matches the text fragment in the video material of the impact pad is extracted to obtain the produced video fragment.

24. The apparatus according to claim 23, characterized in that, The device further includes a fifth display module, used for: A preview interface showing at least one video clip that has been created; In response to a trigger operation on any of the created video clips, play any of the created video clips.

25. The apparatus according to claim 23, characterized in that, The device further includes an editing module for: In response to a user's second editing operation on any one of the created video clips, edit any one of the created video clips; In response to a user's operation to adjust the order of at least one of the video segments, the arrangement order of the at least one of the video segments is adjusted.

26. An audio playback device, characterized in that, include: The first sending module is used to send the content of the audio playback interface to the client if it receives a request from the client to display the audio playback interface, so that the client can display the audio playback interface. The audio playback interface includes at least one audio creation area and at least one video display area. The audio creation area can add source audio and display video pads. The video pads include at least one sub-pad displaying video clip information. The sub-pad is a selection control. The video display area can display a video containing the target video clip corresponding to the target sub-pad. The client also displays a selection window for multiple batting pad video clips in the audio playback interface, each batting pad video clip containing at least one video segment; wherein, each batting pad video clip is a batting pad video clip selected from the stored batting pad video clips that matches the target audio being played. The fourth sending module is used to send the target impact pad video material to the client if it receives a request from the client to obtain the target impact pad video material, so that the client can display at least one video segment information corresponding to the target impact pad video material in the video impact pad.

27. The apparatus according to claim 26, characterized in that, The device further includes: The image acquisition module is used to generate or select dynamic images corresponding to the rhythm of the target audio currently being played by the client; The second sending module is used to send the dynamic image to the client so that the client can display the dynamic image in the video display area.

28. The apparatus according to claim 26 or 27, characterized in that, The device further includes a third transmitting module for: If a switching request for the audio creation area is received from the client, the switching content corresponding to the switching request is sent to the client so that the client can switch the audio creation area between the turntable window and the video drum pad according to the switching content; The DJ window is used to adjust the parameters of the source audio corresponding to the audio creation area.

29. An electronic device, characterized in that, It includes a processor and a memory, wherein the memory stores a computer program that can run on the processor, and when the computer program is executed by the processor, causes the processor to perform the steps of any one of the methods described in claims 1 to 11, 12 to 14.

30. A computer-readable storage medium, characterized in that, It stores a computer program that, when run on an electronic device, causes the electronic device to perform the steps of any of the methods described in claims 1 to 11 and 12 to 14.

Images