Method, apparatus and medium for processing multimedia data

Abstract

Embodiments of the present disclosure provide a multimedia data processing method, device, equipment and medium. The present disclosure displays a song sharing card when receiving the song sharing card, and displays part of the lyrics of the shared song in the song sharing card. The user can click the song sharing card. In response to the click operation on the song sharing card, a song playing interface is displayed. The song playing interface can be used to display the lyrics and set content of the shared song. The set content is displayed as a specific display effect, which enriches the display form of the lyrics. In the case that the specific display effect is displayed, the shared song is played, which enriches the interaction mode of the song sharing process, thereby improving the flexibility of the song sharing process, and further improving the interactivity between friends.

Description

TECHNICAL FIELD

[0001] Embodiments of the present disclosure relate to the technical field of multimedia data processing, and more particularly, to a multimedia data processing method, device, equipment and medium. BACKGROUND

[0002] This section is intended to provide background information to the embodiments of the present disclosure recited in the claims. The description herein does not constitute admission of prior art.

[0003] Nowadays, song sharing gradually becomes an important way of communication between friends. Users can send songs heard in audio playing software to instant messaging software to share good songs with friends in instant messaging software, exchange experiences, and so on.

[0004] In related technologies, the sharing form of songs is limited to song link sharing. After receiving the song link, the shared user can only jump to the Hyper Text Markup Language 5.0 (HTML5) page by clicking the song link to hear the song through the HTML5 page, and cannot provide other interactive ways.

[0005] In the above implementation process, the interactive way is single and has poor flexibility, so that the interactivity between friends is low, and the user experience is poor. SUMMARY

[0006] In view of the problem of single interactive way and poor flexibility in the song sharing process in related technologies, embodiments of the present disclosure at least provide a multimedia data processing method, device, equipment and medium.

[0007] In a first aspect of the embodiments of the present disclosure, a multimedia data processing method is provided, which comprises:

[0008] In the case of receiving a song sharing card, the song sharing card is displayed, and part of the lyrics of the shared song is displayed in the song sharing card;

[0009] In response to a click operation on the song sharing card, a song playing interface is displayed, which is used to display the lyrics and setting content of the shared song, wherein the setting content is displayed as a specific display effect;

[0010] In the case that the specific display effect is displayed, the shared song is played.

[0011] In an embodiment of the present disclosure, the specific display effect corresponds to a preset time length.

[0012] In a case where the specific display effect display is completed, the shared song is played, including:

[0013] In a case where the display time of the specific display effect reaches a preset length of time, the first sentence of lyrics of the shared song is displayed on the song playing interface, and the shared song is played.

[0014] In an embodiment of the present disclosure, when the lyrics of the shared song and the set content are displayed on the song playing interface, the method includes:

[0015] Displaying the lyrics of the shared song on the song playing interface;

[0016] Displaying a display control above the displayed lyrics, the display control being used to display the set content according to a specific display effect;

[0017] The set content is target lyrics in the lyrics of the shared song, or the set content is a message content, which is obtained based on a message operation of a user creating the song sharing card.

[0018] In an embodiment of the present disclosure, after the shared song is played in a case where the specific display effect display is completed, the method further includes:

[0019] In response to playing to a part corresponding to the target lyrics in the shared song, displaying a message identifier on the song playing interface;

[0020] In response to a triggering operation on the message identifier, displaying the message content, which is obtained based on a message operation of a user creating the song sharing card.

[0021] In an embodiment of the present disclosure, the song sharing card is provided with a playing control;

[0022] In a case where the song sharing card is received, after the song sharing card is displayed, the method further includes:

[0023] In response to a triggering operation on the playing control, playing a part corresponding to the target lyrics in the shared song.

[0024] In an embodiment of the present disclosure, the song sharing card further displays a comment script;

[0025] When the shared song is played, the method further includes:

[0026] Displaying the comment script in the form of a bullet screen at a set position of the song playing interface.

[0027] In an embodiment of the present disclosure, the part of lyrics displayed on the song sharing card is target lyrics in the shared song, and the song sharing card further displays a background picture and / or an expression material.

[0028] In a second aspect of the embodiments of the present disclosure, a processing apparatus for multimedia data is provided, and the apparatus comprises:

[0029] The display module is configured to display the song sharing card in a case where the song sharing card is received, and the song sharing card displays part of lyrics of a shared song.

[0030] The display module is further configured to display a song playing interface in response to a click operation on the song sharing card, and the song playing interface is configured to display lyrics of the shared song and setting content, wherein the setting content is displayed as a specific display effect.

[0031] The playing module is configured to play the shared song in a case where the specific display effect is displayed.

[0032] In an embodiment of the present disclosure, the specific display effect corresponds to a preset time length.

[0033] The playing module is configured to:

[0034] In a case where the display time of the specific display effect reaches the preset time length, the first lyrics of the shared song are displayed on the song playing interface, and the shared song is played.

[0035] In an embodiment of the present disclosure, in a case where the lyrics of the shared song and the setting content are displayed on the song playing interface, the display module is further configured to display the lyrics of the shared song on the song playing interface.

[0036] The display module is further configured to display a display control on the displayed lyrics, and the display control is configured to display the setting content according to a specific display effect.

[0037] The setting content is target lyrics in the lyrics of the shared song, or the setting content is a message content, and the message content is obtained based on a message operation of a user who creates the song sharing card.

[0038] In an embodiment of the present disclosure, the display module is further configured to display a message identifier on the song playing interface in response to playing to a part corresponding to the target lyrics in the shared song.

[0039] The display module is further configured to display the message content in response to a trigger operation on the message identifier, and the message content is obtained based on a message operation of a user who creates the song sharing card.

[0040] In an embodiment of the present disclosure, the song sharing card is provided with a playing control.

[0041] The playing module is further configured to play the part of the shared song corresponding to the target lyric in response to a triggering operation on the playing control.

[0042] In one embodiment of the present disclosure, the song sharing card further displays a comment script.

[0043] When the shared song is played, the display module is further configured to display the comment script in the form of a barrage at a set position of a song playing interface.

[0044] In one embodiment of the present disclosure, the part of the lyric displayed in the song sharing card is a target lyric in the shared song, and the song sharing card further displays a background picture and / or an expression material.

[0045] In a third aspect of the embodiments of the present disclosure, a terminal device is provided, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the operations performed by the multimedia data processing method provided in the first aspect and any of the embodiments of the first aspect when executing the program.

[0046] In a fourth aspect of the embodiments of the present disclosure, a computer readable storage medium is provided, which stores a program, and the program is executed by a processor to perform the operations performed by the multimedia data processing method provided in the first aspect and any of the embodiments of the first aspect.

[0047] In a fifth aspect of the embodiments of the present disclosure, a computer program product is provided, which includes a computer program, and the program is executed by a processor to implement the operations performed by the multimedia data processing method provided in the first aspect and any of the embodiments of the first aspect.

[0048] The present disclosure displays the song sharing card when receiving the song sharing card, and displays a part of the lyric of the shared song in the song sharing card. The user can click the song sharing card. In response to the clicking operation on the song sharing card, a song playing interface is displayed, which can be used to display the lyric of the shared song and set content. The set content is displayed as a specific display effect, which enriches the display form of the lyric. When the specific display effect is displayed, the shared song is played, which enriches the interactive mode of the song sharing process, thereby improving the flexibility of the song sharing process, and further improving the interactivity between friends. BRIEF DESCRIPTION OF DRAWINGS

[0049] The above and other objects, features and advantages of the present disclosure will become more apparent from the following detailed description read in conjunction with the accompanying drawings, in which:

[0050] Figure 1 is a flowchart of a multimedia data processing method according to an exemplary embodiment of the present disclosure;

[0051] Figure 2 is an interface diagram of a chat interface according to an exemplary embodiment of the present disclosure;

[0052] Figure 3 is an interface diagram of a card design interface according to an exemplary embodiment of the present disclosure;

[0053] Figure 4 is an interface diagram of a card design interface according to an exemplary embodiment of the present disclosure;

[0054] Figure 5 is an interface diagram of a background selection interface according to an exemplary embodiment of the present disclosure;

[0055] Figure 6 is an interface diagram of an image editing interface according to an exemplary embodiment of the present disclosure;

[0056] Figure 7 is an interface diagram of a card design interface according to an exemplary embodiment of the present disclosure;

[0057] Figure 8 is an interface diagram of a card design interface according to an exemplary embodiment of the present disclosure;

[0058] Figure 9 is an interface diagram of a song playing interface according to an exemplary embodiment of the present disclosure;

[0059] Figure 10 is an interface diagram of a card design interface according to an exemplary embodiment of the present disclosure;

[0060] Figure 11 is an interface diagram of a song playing interface according to an exemplary embodiment of the present disclosure;

[0061] Figure 12 is an interface diagram of a song playing interface according to an exemplary embodiment of the present disclosure;

[0062] Figure 13 is an interface diagram of a song playing interface according to an exemplary embodiment of the present disclosure;

[0063] Figure 14 is an interface schematic diagram of a card design interface according to an exemplary embodiment of the present disclosure;

[0064] Figure 15 is an interface schematic diagram of a song playing interface according to an exemplary embodiment of the present disclosure;

[0065] Figure 16 is a block diagram of a multimedia data processing apparatus according to an exemplary embodiment of the present disclosure;

[0066] Figure 17 is a schematic diagram of a computer readable storage medium according to an exemplary embodiment of the present disclosure;

[0067] Figure 18 is a structural schematic diagram of a terminal device according to an exemplary embodiment of the present disclosure;

[0068] In the drawings, identical or corresponding reference signs indicate identical or corresponding parts. DETAILED DESCRIPTION

[0069] The principles and spirits of the present disclosure will be described below with reference to several exemplary embodiments. It should be understood that these embodiments are given only to enable those skilled in the art to better understand and implement the present disclosure, and do not limit the scope of the present disclosure in any way. On the contrary, these embodiments are provided to make the present disclosure more thorough and complete, and to fully convey the scope of the present disclosure to those skilled in the art.

[0070] Those skilled in the art know that the embodiments of the present disclosure can be implemented as a system, apparatus, device, method or computer program product. Therefore, the present disclosure can be embodied in the form of a complete hardware, complete software (including firmware, resident software, microcode, etc.), or a combination of hardware and software.

[0071] According to the embodiments of the present disclosure, a multimedia data processing method is proposed, so that in the case of receiving a song sharing card, the display of lyrics and the playing of songs can be realized in a more diverse way, thereby improving the diversity and flexibility of the interactive way in the song sharing process, and further improving the interactivity between friends and user experience.

[0072] The multimedia data processing method described above can be executed by a terminal device, which can be a desktop computer, a portable computer, a notebook computer, a tablet computer, a smart phone, a smart watch, a Moving Picture Experts Group Audio Layer III (MP3) player, a Moving Picture Experts Group Audio Layer IV (MP4) player, or the like. The specific type of the terminal device is not limited in the embodiments of the present disclosure.

[0073] It should be noted that the application scenarios described above are only for facilitating the understanding of the spirit and principles of the present disclosure, and the embodiments of the present disclosure are not limited in this respect. On the contrary, the embodiments of the present disclosure can be applied to any applicable scenario.

[0074] The multimedia data processing method provided by the exemplary embodiments of the present disclosure will be described below in conjunction with the above introduction of the application scenarios, with reference to Figure 1

[0075] Referring to Figure 1 , Figure 1 is a flowchart of a multimedia data processing method according to an exemplary embodiment of the present disclosure. The method includes:

[0076] S101, in the case of receiving a song sharing card, the song sharing card is displayed, and part of the lyrics of the shared song is displayed in the song sharing card.

[0077] In a possible implementation, a target application platform can be installed and run on the terminal device, so as to receive the song sharing card through the target application platform, and then display the received song sharing card through the target application platform, and display part of the lyrics of the shared song in the song sharing card.

[0078] The target application platform can provide a chat interface. After the terminal device receives the song sharing card through the target application platform, the received song sharing card can be displayed through the chat interface of the target application platform.

[0079] Optionally, the target application platform can be a plurality of types of applications. For example, the target application platform can be an instant messaging application, and a plurality of users can communicate with each other through the instant messaging application.

[0080] Referring to Figure 2 , Figure 2 is an interface schematic diagram of a chat interface according to an exemplary embodiment of the present disclosure, as Figure 2 ​As shown, the target application platform is taken as an instant messaging application, Figure 2 As shown, the chat interface is the chat interface of the instant messaging application, and the song sharing card displayed in the chat interface is clicked by the user.

[0081] S102, in response to the click operation of the song sharing card, a song playing interface is displayed, which is used to display the lyrics and setting content of the shared song, wherein the setting content is displayed as a specific display effect.

[0082] In a possible implementation, in the case that the user clicks the song sharing card, the terminal device can respond to the click operation of the song sharing card to start the music playing software, so that the interface currently displayed by the terminal device changes from the chat interface of the target application platform to the song playing interface of the music playing software, so as to display the lyrics and setting content of the shared song through the song playing interface, and display the setting content as a specific display effect, so as to highlight the display of the setting content, thereby improving the diversity of the interaction process.

[0083] Optionally, the user can trigger the jump of the target application platform to the audio playing software by triggering any position of the song sharing card.

[0084] S103, in the case that the specific display effect is displayed, the shared song is played.

[0085] The present disclosure displays the song sharing card in the case that the song sharing card is received, and displays part of the lyrics of the shared song in the song sharing card. The user can click the song sharing card, and in response to the click operation of the song sharing card, a song playing interface is displayed, which can be used to display the lyrics and setting content of the shared song, wherein the setting content is displayed as a specific display effect, which enriches the display form of the lyrics, so that in the case that the specific display effect is displayed, the shared song is played, which enriches the interactive mode of the song sharing process, thereby improving the flexibility of the song sharing process, and further improving the interactivity between friends.

[0086] After introducing the basic principles of the present disclosure, various non-limiting embodiments of the present disclosure will be specifically introduced.

[0087] In some embodiments, for S101, the part of the lyrics displayed in the song sharing card can be the target lyrics in the shared song, or the part of the lyrics displayed in the song sharing card can be any lyrics in the shared song, which is not limited by the present disclosure.

[0088] In addition, the song sharing card can also display a background picture and / or an expression material, and the background picture and the expression material can be set by the sharing user when sharing the song.

[0089] First, the process of setting the background picture of the song sharing card by the sharing user will be introduced as follows:

[0090] It should be noted that the terminal device of the sharing user can provide a background adding function for the sharing user in the audio playing software. For example, the terminal device can provide a card design interface for the sharing user through the audio playing software to provide the background adding function for the user through the card design interface.

[0091] In one possible implementation, after the sharing user triggers the sharing operation in the song playing interface, the terminal device can display the card design interface in response to the sharing operation in the song playing interface, and display at least one alternative background picture and / or a custom background option in the card design interface, so that the sharing user can select from the at least one alternative background picture or set the background picture by himself through the custom background option; the terminal device can generate the song sharing card based on the selected background picture and the lyrics of the song to be shared in response to the selection operation of any alternative background picture or in response to the background picture selection operation based on the custom background option, so that the song sharing card can include the background picture.

[0092] It should be noted that the alternative background picture can be a pre-set background picture. Referring to Figure 3 , Figure 3 is a schematic diagram of a card design interface according to an exemplary embodiment of the present disclosure, in which Figure 3 The background material 1, the background material 2, the background material 3, and the background material 4 are at least one alternative background picture, and the sharing user can select a background picture that he is satisfied with as the background of the song sharing card.

[0093] In addition, it should be noted that the display area of the alternative background picture can be provided with a sliding function, and the user can display more alternative background pictures by performing a sliding operation (such as left sliding) in the display area of the alternative background picture.

[0094] By providing at least one alternative background picture in the card design interface, the sharing user can select from the alternative background picture to set the background of the song sharing card.

[0095] In a possible implementation, if the user selects any one of the at least one alternative background picture, the terminal device can generate the song sharing card with the selected alternative background picture as the background of the song sharing card in response to the selection operation of the user. In addition, the generated song sharing card can be displayed in the card design interface, so that the user can preview the effect of the song sharing card in advance.

[0096] Still taking the card design interface as shown in Figure 3 , the 301 is the generated song sharing card. After the user selects any one of the alternative background pictures, the background picture of the generated song sharing card 301 is the selected alternative background picture.

[0097] In addition, for the convenience of the user, the selected alternative background picture can be highlighted, so that the user can quickly determine which alternative background picture is currently selected. For example, the selected alternative background picture can be displayed in a magnified manner, and / or the border of the selected alternative background picture can be highlighted.

[0098] Optionally, after previewing the effect of the song sharing card, if the user finds that the generated song sharing card does not meet the user's needs, the user can reselect at least one alternative background picture. The reselection process is the same as the above process, and details are not repeated here.

[0099] For the process of setting the background picture through the custom background option, the card design interface can refer to Figure 4 , Figure 4 is a schematic diagram of a card design interface according to an example embodiment of the present disclosure. As shown in Figure 4 , the function entry with the text label "album picture" displayed in the display area of the alternative background picture is the custom background option. The user can trigger the function entry with the text label "album picture" to display the image data stored in the terminal device, so that the sharer user can select from the image data.

[0100] In a possible implementation, the terminal device can display a background selection interface in response to the triggering operation of the custom background option, so that the sharer user can select from the multiple image data displayed in the background selection interface. The terminal device can add the selected image data as the background picture to the song sharing card in response to the selection operation of any one of the image data.

[0101] Referring to Figure 5 , Figure 5 is a schematic diagram of a background selection interface according to an example embodiment of the present disclosure. As shown in Figure 5As shown, the background selection interface displays image data (i.e., picture 1, picture 2, picture 3, …, picture 12) stored in the terminal device, and the sharer user can select any image data as the background picture of the song sharing card.

[0102] After the sharer user selects the image data, the background selection interface jumps back to the card design interface as shown in Figure 4 , and the background picture displayed in the generated song sharing card 401 is the image data selected by the sharer user in the background selection interface. In addition, after the sharer user previews the effect of the song sharing card, if the generated song sharing card does not meet his / her own needs, the sharer user can reselect from the at least one alternative background picture or reselect from the image data stored in the terminal device through the custom background option. The reselection process is the same as the above process, and thus will not be described herein.

[0103] It should be noted that the number of alternative background pictures is generally limited, and the custom background option is provided to enable the sharer user to select the background picture from the internal storage of the terminal device, thereby improving the flexibility of the background selection process.

[0104] The above process is described by taking an example in which the sharer user directly selects the image data stored in the terminal device as the background picture. In more possible implementation manners, the sharer user can also edit the image data to use the edited image data as the background picture of the song sharing card.

[0105] For example, the image editing interface can be used to provide the sharer user with the editing function of the selected image data. In a possible implementation manner, the terminal device can display the image editing interface in response to the selection operation of any image data in the background selection interface, so that the sharer user can edit the selected image data through the image editing interface, and the terminal device can add the edited image data as the background picture to the song sharing card based on the editing operation of the image data in the image editing interface.

[0106] It should be noted that the editing operation can include a cropping operation, and optionally, the editing operation can also include other more types of operations, and the specific type of the editing operation is not limited in the present disclosure.

[0107] Taking the editing operation as the cropping operation as an example, referring to Figure 6 , Figure 6 is a schematic diagram of an image editing interface according to an example embodiment of the present disclosure, as shown in Figure 6 , the user can crop the selected image data through, for example, Figure 6The image editing interface is shown, and the selected image data is cropped. After the cropping is completed, the button with the text "select" is clicked to jump back to the card design interface, so that the sharing user can preview the effect of the generated song sharing card through the card design interface.

[0108] By providing an image editing interface for the sharing user, the sharing user can edit the image data according to their own preferences to obtain image data that meets their needs as a background picture for a song sharing card, thereby improving the flexibility of the background picture setting process and meeting the customization needs of the sharing user.

[0109] Through the above embodiments, the visual audio lyric sharing can be combined with the pre-set background picture and the user-defined background picture, so that the sharing user experience is more personalized.

[0110] Next, the process of adding expression materials by the sharing user in the song sharing card is introduced:

[0111] It should be noted that the terminal device of the sharing user can provide an expression adding function for the sharing user in the audio playing software. For example, the terminal device can provide a card design interface for the sharing user through the audio playing software to provide an expression adding function for the user through the card design interface.

[0112] In one possible implementation, after the sharing user triggers the sharing operation in the song playing interface, the terminal device can display the card design interface in response to the sharing operation in the song playing interface, and display at least one alternative expression material and / or a custom background option in the card design interface, so that the sharing user can select from at least one alternative expression material or set the expression material through the custom expression option; in response to the selection operation of any alternative expression material or in response to the expression material selection operation based on the custom expression option, a song sharing card is generated based on the selected expression material and the lyrics of the song to be shared, so that the song sharing card can include the expression material.

[0113] It should be noted that the alternative expression material can be a pre-set expression material. See Figure 7 , Figure 7 is an interface schematic diagram of a card design interface according to an exemplary embodiment of the present disclosure. In the card design interface as shown in Figure 7 , expression 1, expression 2, expression 3, and expression 4 are at least one alternative expression material, and the sharing user can select the expression material that meets their own needs to add to the song sharing card.

[0114] In addition, it should be noted that the display area of ​​the alternative expression materials may be provided with a sliding function, and the user may slide the display area of ​​the alternative expression materials (eg, slide to the left) to display more alternative expression materials.

[0115] By providing at least one alternative expression material in the card design interface so that the sharing user can select from the alternative expression materials to add the expression material to the song sharing card, the diversity of the song sharing card can be improved.

[0116] Optionally, the candidate expression material may be a dynamic expression or a static expression, and the present disclosure does not limit the specific type of the candidate expression material.

[0117] In response to the selection operation of any candidate expression material, generating a song sharing card based on the selected candidate expression material and the lyrics of the song to be shared can be achieved in the following manner:

[0118] In response to the selection operation of any alternative expression material, the lyrics of the song to be shared are displayed in the first setting area of ​​the setting card template, and the selected alternative expression material is displayed in the second setting area of ​​the setting card template to realize the generation of the song sharing card.

[0119] In addition, after the song sharing card is generated according to the display method described above, the generated song sharing card can be displayed in the card design interface. The song sharing card includes the lyrics of the song to be shared and the selected alternative expression materials, so that the sharing user can pre-check the display effect of the alternative expression materials on the song sharing card.

[0120] Still as Figure 7 Taking the card design interface shown as an example, 701 is the generated song sharing card. Taking the sharing user selecting expression 1 from the alternative expression materials as an example, the expression material displayed in the generated song sharing card 701 is expression 1, so that the user can preview the display effect of expression 1 in the song sharing card.

[0121] Optionally, after previewing the display effect of the selected alternative expression material in the song sharing card, if the sharing user finds that the display effect is not ideal, he or she can reselect from at least one alternative expression material. The reselection process is the same as the above process and will not be repeated here.

[0122] It should be noted that the card design interface may be provided with a delete control so that the sharing user can delete the added emoticon material through the delete control when the display effect of the emoticon material is not ideal.

[0123] In a possible implementation, after generating the song sharing card based on the selected alternative expression material and the lyrics of the song to be shared, the displayed expression material can be deleted from the song sharing card displayed in the card design interface in response to a triggering operation of the delete control.

[0124] Still taking the card design interface as shown in Figure 7 FIG. 7 as an example, the button 702 is the delete control. The sharer triggers the button 702, and the displayed expression material in the song sharing card can be deleted.

[0125] As for the process of setting the expression material through the custom expression option, the terminal device can display an expression selection interface in response to a triggering operation of the custom expression option, display a plurality of image data in the expression selection interface, so that the sharer can select from the plurality of image data, and the terminal device can add the selected image data as the expression material to be added to the song sharing card in response to a selection operation of any image data.

[0126] After the sharer selects the image data in the expression selection interface, the expression selection interface jumps back to the card design interface as shown in Figure 7 FIG. 7, and the displayed expression material in the generated song sharing card 701 is the image data selected by the sharer in the expression selection interface. In addition, after the sharer previews the display effect of the expression material selected by the sharer in the song sharing card, if the sharer finds that the display effect of the selected expression material is not ideal, the sharer can reselect from the at least one alternative expression material or reselect through the custom expression option from the image data stored in the terminal device. The reselection process is the same as the above process, and details are not repeated here.

[0127] It should be noted that the number of alternative expression materials is generally limited, and the custom expression option is provided to enable the sharer to select the expression material from the internal storage of the terminal device, thereby improving the flexibility of the expression selection process.

[0128] Whether the sharer selects the expression material to be added to the song sharing card from the at least one alternative expression material or sets the expression material to be added to the song sharing card through the custom expression option, the added expression material can be further adjusted.

[0129] In a possible implementation, in response to the selection operation on any alternative expression material, the song sharing card is generated based on the selected alternative expression material and the lyrics of the to-be-shared song, and in response to the adjustment operation on the expression material in the song sharing card displayed by the card design interface, the generated song sharing card is updated based on the adjusted expression material.

[0130] The adjustment operation can include a moving operation, a scaling operation, and a rotating operation. Optionally, the adjustment operation can also include other types of operations, and the specific type of the adjustment operation is not limited in the present disclosure.

[0131] Referring to Figure 8 , Figure 8 is an interface schematic diagram of a card design interface according to an example embodiment of the present disclosure, as Figure 8 The expression material displayed in the song sharing card shown in FIG. 6 is rotated and scaled.

[0132] Through the above embodiments, the lyrics sharing of visualized audio can be combined with expression materials. In the song sharing card, the user who shares can add expression materials to express his / her attitude, and the size, position, and angle of the expression materials can be adjusted according to different actual display conditions of different lyrics.

[0133] It should be noted that whether the song sharing card includes a background picture and expression materials or not, the song sharing card can be linked to the song playing interface after being triggered, so as to realize the playing of the shared song through the song playing interface.

[0134] In some embodiments, in S102, when the lyrics of the shared song and the set content are displayed in the song playing interface, the following method can be used:

[0135] The lyrics of the shared song are displayed in the song playing interface, and a display control is displayed above the displayed lyrics to display the set content in the display control according to a specific display effect.

[0136] The display control can be a display frame. The set content can be target lyrics in the lyrics of the shared song, or the set content can also be a message content obtained based on a message operation of a user who creates the song sharing card (hereinafter referred to as a sharing user). The specific display effect can be a display in a set color, a magnified display, a water ripple effect, and the like.

[0137] It should be noted that the above are only several example introductions to the display control, the set content, and the specific display effect. In more possible implementations, the display control, the set content, and the specific display effect can also be in other forms, and the present disclosure does not limit them.

[0138] It should be noted that no matter whether the setting content is the target lyrics or the comment content, the setting content can be determined based on the operation of the sharing user. Taking the setting content as the target lyrics as an example, the determination process of the setting content can be as follows:

[0139] The sharing user can select at least one lyric from the lyrics displayed in the song playing interface of the audio playing software when playing a song through the song playing interface of the audio playing software. The terminal device used by the sharing user can determine the selected lyrics as the target lyrics in response to the sharing operation in the song playing interface.

[0140] It should be noted that the sharing user can start the lyric selection function by long pressing the lyrics to be selected. After the lyric selection function is started, the sharing user can select the lyrics to be shared by clicking the lyrics.

[0141] Referring to Figure 9 , Figure 9 is an interface schematic diagram of a song playing interface according to an example embodiment of the present disclosure, as shown in Figure 9 The lyrics of the currently playing song can be displayed in the song playing interface, and the sharing user can long press the lyrics to be selected in the song playing interface as shown in Figure 9 to start the lyric selection function, so that the sharing user can select the lyrics to be shared through the song playing interface.

[0142] Optionally, the selected lyrics can be displayed with a selected mark in front, so that the user can know which lyrics have been selected by the user through the selected mark.

[0143] Still taking the song playing interface as shown in Figure 9 as an example, as shown in Figure 9 the "√" mark is the selected mark, and the song marked with the "√" mark is the selected lyrics, that is, the four lyrics "I know my future is not a dream", "I take every minute seriously", "My future is not a dream", and "My heart is following the hope" are the selected lyrics.

[0144] Optionally, the song playing interface can be provided with a sharing control, so that the sharing user can trigger the sharing operation in the song playing interface by triggering the sharing control of the song playing interface after selecting the lyrics to be shared.

[0145] Still taking the song playing interface as shown in Figure 9The button with the text label of "audio sharing" is a sharing control in the illustrated song playing interface, and the sharer user can share the song through the button with the text label of "audio sharing". That is, after the sharer user selects the four lyrics of "I know my future is not a dream", "I take every minute seriously", "My future is not a dream", and "My heart is following hope", the sharer user can trigger the button with the text label of "audio sharing", and the terminal device can determine the four selected lyrics as target lyrics in response to the button with the text label of "audio sharing".

[0146] For example, the setting content is set as a message content, and the determination process of the setting content can also be:

[0147] It should be noted that the terminal device of the sharer user can provide a message function for the sharer user in the audio playing software. For example, the terminal device can provide a card design interface for the sharer user through the audio playing software to provide a message function for the user through the card design interface.

[0148] In a possible implementation, after the sharer user triggers a sharing operation in the song playing interface, the terminal device can display a card design interface in response to the sharing operation in the song playing interface, and display a message option in the card design interface, so that the user can trigger the message option to start the message function; the terminal device can display a message input area in response to the triggering operation of the message option to provide a message input function for the user through the message input area.

[0149] Referring to Figure 10 , Figure 10 is an interface schematic diagram of a card design interface according to an exemplary embodiment of the present disclosure, and in the card design interface as shown in Figure 10 The option with the text label of "message" is a message option in the card design interface as shown in

[0150] It should be noted that after the sharer user triggers the message option, the terminal device can display a message input area as shown in area 1001 in the card design interface as shown in Figure 10 The sharer user can call the text input function of the terminal device through the triggering of the message input area, for example, the terminal device can display a virtual keyboard in response to the triggering operation of the message input area, so that the sharer user can input the message through the virtual keyboard. As shown in Figure 10 The message content input by the sharer user in the message input area is "good life slowly meet".

[0151] The terminal device can obtain the text input by the sharer user in the message input area to determine the obtained text as the message content.

[0152] After the determination of the target content is achieved through the above process, the sharing user can generate a song sharing card based on the determined target content, so that the terminal device of the shared user can achieve the acquisition of the set content based on the received song sharing card, and then display the set content in the display control according to a specific display effect.

[0153] Taking the target content as the target lyrics for example, referring to Figure 11 , Figure 11 is an interface schematic diagram of a song playing interface according to an exemplary embodiment of the present disclosure, as Figure 11 shown, the song playing interface displays the lyrics of the shared song, and a display frame 1101 (i.e., a display control) is displayed above the lyrics, and the target lyrics displayed in the display frame 1101.

[0154] Optionally, when the set content is displayed in the display control according to a specific display effect, the intro of the shared song can be played to give the user a visual and auditory experience, thereby improving the user experience and enriching the diversity of the interaction process.

[0155] It should be noted that the specific display effect can be set with a preset time length, so for S103, when the specific display effect is displayed, the shared song can be played in the following way:

[0156] When the display time of the specific display effect reaches the preset time length, the first lyrics of the shared song are displayed in the song playing interface, and the shared song is played.

[0157] That is, when the display time of the specific display effect reaches the preset time length, the terminal device can cancel the display of the display control and the content displayed therein, only display the lyrics of the shared song in the song playing interface, and start displaying from the first lyrics of the shared song, while playing the shared song, for example, playing the shared song from the first lyrics.

[0158] The preset time length can be any length, for example, the preset time length can be 3 seconds (S), and optionally, the preset time length can also be other lengths, and the present disclosure does not limit the value of the preset time length.

[0159] Optionally, after playing the shared song, the message identifier can be displayed on the song playing interface when playing to the part corresponding to the target lyrics in the shared song in the case that the specific display effect display is completed, and the user can view the message content of the sharing user by triggering the message identifier. In the case that the user triggers the message identifier, the terminal device can display the message content in response to the triggering operation of the message identifier, wherein the message content is obtained based on the message operation of the user who creates the song sharing card, and the process of obtaining the message content has been described above, and will not be described here.

[0160] By setting the message identifier on the song playing interface, the user can select whether to trigger the message identifier according to the user's own needs, so that the user can view the message content according to the user's own needs, thereby improving the flexibility of the interaction process.

[0161] Referring to Figure 12 , Figure 12 is an interface schematic diagram of a song playing interface according to an exemplary embodiment of the present disclosure, as Figure 12 indicated, the four continuous lyrics "I know my future is not a dream", "I take every minute seriously", "My future is not a dream", and "My heart is following hope" are target lyrics, and when playing to the first lyric (that is, "I know my future is not a dream"), the terminal device can display a message identifier 1201 in the song playing interface as Figure 12 indicated, so that the user can trigger the message identifier 1201 to view the message content.

[0162] If the user triggers the message identifier 1201 in the song playing interface as Figure 12 indicated, the terminal device can display the song playing interface of Figure 12 in the form as Figure 13 indicated, referring to Figure 13 , Figure 13 is an interface schematic diagram of a song playing interface according to an exemplary embodiment of the present disclosure, as Figure 13 indicated, in the case that the user triggers the message identifier, the display of the message identifier can be cancelled, and a message display control 1301 can be displayed in the playing interface, so that the message content (that is, "live well and meet slowly") is displayed in the message display control 1301.

[0163] Optionally, as Figure 13 indicated, the message display control can also display the username of the sharing user and the time (that is, the message time) when the sharing user adds the message. In addition, the avatar of the sharing user can be displayed beside the message display control.

[0164] In addition, in some embodiments, the sharer user can also add a comment script to the shared lyrics when sharing the song, and based on this, the comment content can also be displayed in the song sharing card displayed by the terminal device of the sharpee user.

[0165] First, the process of adding a comment script by the sharer user will be introduced as follows:

[0166] It should be noted that the terminal device of the sharer user can provide the sharer user with a script adding function in the audio playing software. For example, the terminal device can provide the sharer user with a card design interface through the audio playing software to provide the user with a script adding function through the card design interface.

[0167] In a possible implementation, after the sharer user triggers the sharing operation in the song playing interface, the terminal device can display the card design interface in response to the sharing operation in the song playing interface, and display at least one alternative comment script in the card design interface, so that the user can select from the at least one alternative comment script; the terminal device can generate a song sharing card based on the selected alternative comment script and the lyrics of the song to be shared in response to the selection operation on any alternative comment script, so that the song sharing card can include the selected alternative comment script.

[0168] It should be noted that the alternative comment script can be a pre-set comment script. For example, Figure 14 , Figure 14 is an interface schematic diagram of a card design interface according to an exemplary embodiment of the present disclosure, in which Figure 14 As shown in the card design interface, "I want to share happiness with you", "Let the past brilliance be repaid with loneliness", "Live well and meet slowly", and "Some small happiness and good luck" are at least one alternative comment script, from which the user can select a comment script that he or she is satisfied with to add to the song sharing card.

[0169] In addition, it should be noted that the display area of the alternative comment script can be provided with a sliding function, and the user can display more alternative comment scripts by performing a sliding operation (such as upward sliding) in the display area of the alternative comment script.

[0170] By providing at least one alternative comment script in the card design interface, the user can select from the alternative comment script to add a comment script to the song sharing card, thereby improving the diversity of the song sharing card.

[0171] In response to the selection operation on any alternative comment script, the terminal device can generate a song sharing card based on the selected alternative comment script and the lyrics of the song to be shared in the following way:

[0172] In response to the selection operation on any of the alternative comment templates, the lyrics of the shared song are displayed in the first setting area of the setting card template, and the selected alternative comment template is displayed in the third setting area of the setting card template, so as to generate the song sharing card.

[0173] In addition, after the song sharing card is generated in the display mode as described above, the generated song sharing card can be displayed in the card design interface, and the song sharing card includes the lyrics of the song to be shared and the selected alternative comment template, so that the user can preview the display effect of the alternative comment template in the song sharing card.

[0174] Still taking the card design interface as shown in Figure 14 For example, 1401 is the generated song sharing card, and the user selects “I want to share happiness with you” in the alternative comment template, and the comment displayed in the generated song sharing card 1401 is “I want to share happiness with you”, so that the user can preview the display effect of the comment in the song sharing card.

[0175] Optionally, after the user previews the display effect of the selected alternative comment template in the song sharing card, if the display effect is not ideal, the user can reselect at least one alternative comment template, and the reselection process is the same as the above process, which will not be repeated here.

[0176] Through the above embodiment, the visual audio lyrics sharing and the function of adding a comment template can be combined. The added comment template can increase the interaction between the user and the friend. At the same time, the pre-set alternative comment template has a more beautiful display from the visual point of view, saves the time of the user editing the comment template, and can better express the personal attitude of the user and increase the sharing desire of the user.

[0177] The song sharing card generated through the above process can include the comment template, so that the shared song sharing card displayed in the comment template can be received by the shared user, and the shared user can directly see the comment template added by the sharing user in the song sharing card.

[0178] When playing the shared song through the song playing interface, the comment template can be displayed in the form of a scroll in the setting position of the song playing interface.

[0179] The setting position can be any position in the song playing interface, and the specific position of the setting position is not limited in the present disclosure.

[0180] Referring to Figure 15 , Figure 15is an interface schematic diagram of a song playing interface according to an exemplary embodiment of the present disclosure, as Figure 15 As shown in the figure, "I want to share happiness with you" is a comment text added by the sharing user.

[0181] Optionally, when the comment text is displayed in the form of a barrage, the comment text can be played once in the form of a barrage from right to left in the song playing interface, and the comment text can also be played in a loop in the form of a barrage from right to left in the song playing interface. The present disclosure does not limit which way to use.

[0182] By providing a text adding function for the sharing user and displaying the comment text added by the sharing user in the song playing interface during the process of playing the shared song by the shared user through the audio playing software, the diversity of the interaction process is greatly improved, thereby improving the user experience.

[0183] The scheme provided by the present disclosure can support the sharing user to share the song in the form of a song sharing card to the target application platform through the audio plus lyrics sharing form, so that the song sharing card becomes the fifth chat medium other than text, expression, video and picture, so that the sharing user and the shared user can have a music chat based on the song sharing card.

[0184] Moreover, special display forms can be given to the user who flows back from the target application platform to the audio playing software, including lyric special effect display, friend comment text barrage form display and combination of friend comment color egg new play, increasing the interaction mode in the song sharing process and improving the user retention.

[0185] The above process is described by taking the example of jumping to the audio playing software by clicking the song sharing card and playing the song through the song playing interface. In more possible implementation manners, the song sharing card can also be provided with a play control so that the shared user can listen to the shared song in the chat interface through the playing software.

[0186] In some embodiments, after receiving the song sharing card and displaying the song sharing card, if the user triggers the play control in the song sharing card, the terminal device can play the part corresponding to the target lyrics in the shared song in response to the triggering operation of the play control.

[0187] Still taking the chat interface as shown in Figure 2 as an example, in the song sharing card displayed in the chat interface as shown in Figure 2 , the play button 201 is a play control, and the user can listen to the part corresponding to the target lyrics in the shared song by triggering the button 201.

[0188] By setting the play control in the song sharing card, the shared user can listen to a part of the song without jumping to the application, so that the user can jump to the audio playing software to listen to the whole song when the listening effect is satisfactory, thereby reducing the processing pressure of the terminal device and improving the processing speed of the terminal device.

[0189] After introducing the multimedia data processing method of the example embodiment of the present disclosure, next, the structure of the multimedia data processing device of the example embodiment of the present disclosure and the terminal device for implementing the multimedia data processing method are described.

[0190] Referring to Figure 16 , Figure 16 is a block diagram of a multimedia data processing device according to an example embodiment of the present disclosure, which comprises:

[0191] The display module 1601 is configured to display the song sharing card in a case where the song sharing card is received, and the song sharing card displays part of the lyrics of the shared song.

[0192] The display module 1601 is further configured to display a song playing interface in response to a click operation on the song sharing card, and the song playing interface is configured to display the lyrics of the shared song and the set content, wherein the set content is displayed as a specific display effect.

[0193] The play module 1602 is configured to play the shared song in a case where the specific display effect is displayed.

[0194] In an embodiment of the present disclosure, the specific display effect corresponds to a preset time length.

[0195] The play module 1602 is configured to:

[0196] In a case where the display time of the specific display effect reaches the preset time length, the first lyrics of the shared song are displayed on the song playing interface, and the shared song is played.

[0197] In an embodiment of the present disclosure, when the lyrics of the shared song and the set content are displayed on the song playing interface, the display module is further configured to display the lyrics of the shared song on the song playing interface.

[0198] The display module 1601 is further configured to display a display control above the displayed lyrics, and the display control is configured to display the set content according to a specific display effect.

[0199] The setting content is target lyrics in lyrics of the shared song, or the setting content is a comment content, and the comment content is obtained based on a comment operation of a user creating the song sharing card.

[0200] In an embodiment of the present disclosure, the display module 1601 is further configured to display a comment identifier in the song playing interface in response to playing the part corresponding to the target lyrics in the shared song.

[0201] The display module 1601 is further configured to display a comment content in response to a triggering operation on the comment identifier, and the comment content is obtained based on a comment operation of a user creating the song sharing card.

[0202] In an embodiment of the present disclosure, the song sharing card is provided with a playing control.

[0203] The playing module 1602 is further configured to play the part corresponding to the target lyrics in the shared song in response to a triggering operation on the playing control.

[0204] In an embodiment of the present disclosure, the song sharing card further displays a comment script.

[0205] When playing the shared song, the display module 1601 is further configured to display the comment script in the form of a barrage at a set position in the song playing interface.

[0206] In an embodiment of the present disclosure, the part of lyrics displayed in the song sharing card is target lyrics in the shared song, and the song sharing card further displays a background picture and / or an expression material.

[0207] It should be noted that although several modules of the multimedia data processing apparatus are mentioned in the foregoing detailed description, such division is merely exemplary and not mandatory. In fact, according to the embodiments of the present disclosure, the features and functions of two or more modules described above can be embodied in one module. Conversely, the features and functions of one module described above can be further divided into modules for embodiment.

[0208] The present disclosure further provides a computer readable storage medium. Figure 17 FIG. 17 is a schematic diagram of a computer readable storage medium according to an exemplary embodiment of the present disclosure, as shown in the figure, the storage medium stores a computer program 1701, and the computer program 1701 can execute the multimedia data processing method provided by any embodiment of the present disclosure when executed by a processor. Figure 17

[0209] ​The terminal device can include a memory and a processor. The memory is configured to store computer instructions executable on the processor. The processor is configured to implement the method for processing multimedia data according to any of the embodiments of the present disclosure when executing the computer instructions. Figure 18 , Figure 18 is a structural schematic diagram of a terminal device according to an exemplary embodiment of the present disclosure. The terminal device 1800 can include, but is not limited to, a processor 1810, a memory 1820, and a bus 1830 connecting different system components including the memory 1820 and the processor 1810.

[0210] The memory 1820 stores computer instructions executable by the processor 1810, so that the processor 1810 can execute the method for processing multimedia data according to any of the embodiments of the present disclosure. The memory 1820 can include a random access memory unit RAM 1821, a cache memory unit 1822, and / or a read-only memory unit ROM 1823. The memory 1820 can further include a program tool 1825 having a set of program modules 1824, which include, but are not limited to, an operating system, one or more application programs, other program modules, and program data, one or more combinations of which can include implementation of a network environment.

[0211] The bus 1830 can include, for example, a data bus, an address bus, and a control bus, etc. The terminal device 1800 can further communicate with an external device 1850, for example, a keyboard, a Bluetooth device, etc., through an I / O interface 1840. The terminal device 1800 can further communicate with one or more networks, for example, a local area network, a wide area network, a public network, etc., through a network adapter 1860. As shown, the network adapter 1860 can also communicate with other modules of the terminal device 1800 through the bus 1830. Figure 18

[0212] The present disclosure further provides a computer program product including a computer program. When the program is executed by the processor 1810 of the terminal device 1800, the method for processing multimedia data according to any of the embodiments of the present disclosure can be implemented.

[0213] In addition, although the operations of the method of the present disclosure are described in a specific order in the accompanying drawings, this does not require or imply that the operations must be performed in that specific order, or that all of the operations must be performed to achieve a desired result. Additionally or alternatively, certain steps can be omitted, combined into a single step, and / or divided into multiple steps.

[0214] ​While the spirit and principles of the present disclosure have been described with reference to several specific embodiments, it is to be understood that the present disclosure is not limited to the specific embodiments disclosed and that the division of the aspects is not meant to imply that features from the aspects cannot be combined to benefit from the disclosure, but is merely for convenience of presentation. The present disclosure is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the claims appended hereto.

Claims

1. A method for processing multimedia data, characterized in that: The method comprises: When a song sharing card is received, the song sharing card is displayed, wherein the song sharing card displays part of the lyrics of the shared song; In response to a click operation on the song sharing card, a song playing interface is displayed, wherein the song playing interface is used to display the lyrics of the shared song and setting content, wherein the setting content is displayed as a specific display effect; When the specific display effect is completed, playing the shared song; Part of the lyrics displayed in the song sharing card are target lyrics in the lyrics of the shared song, and a play control is provided in the song sharing card; In the case of receiving a song sharing card, after displaying the song sharing card, the method further includes: In response to the triggering operation on the play control, the portion of the shared song corresponding to the target lyrics is played.

2. The method according to claim 1, characterized in that The specific display effect corresponds to a preset duration; When the specific display effect is completed, playing the shared song includes: When the display time of the specific display effect reaches a preset time length, the first sentence of the lyrics of the shared song is displayed on the song playback interface, and the shared song is played.

3. The method according to claim 1, characterized in that When displaying the lyrics and setting content of the shared song in the song playing interface, the method includes: Display the lyrics of the shared song in the song playback interface; Displaying a display control above the displayed lyrics, wherein the display control is used to display the set content according to a specific display effect; The setting content is the target lyrics in the lyrics of the shared song, or the setting content is the message content, which is obtained based on the message operation of the user who created the song sharing card.

4. The method according to claim 3, characterized in that When the specific display effect is completed, after playing the shared song, the method further includes: In response to playing a portion corresponding to target lyrics in the shared song, displaying a message icon on the song playback interface; In response to the triggering operation of the message identifier, the message content is displayed, and the message content is obtained based on the message operation of the user who created the song sharing card.

5. The method according to claim 1, wherein The song sharing card also displays comment text; When playing the shared song, the method further includes: The comment text is displayed in the form of a bullet screen at a set position on the song playing interface.

6. The method according to claim 1, characterized in that The portion of lyrics displayed in the song sharing card is the target lyrics in the shared song, and the song sharing card also displays a background image and / or expression material.

7. A multimedia data processing device, characterized in that: The device comprises: A display module is configured to display a song sharing card upon receipt, wherein the song sharing card displays part of the lyrics of the shared song; The display module is further configured to display a song playing interface in response to a click operation on the song sharing card, wherein the song playing interface is configured to display the lyrics of the shared song and setting content, wherein the setting content is displayed as a specific display effect; A playing module, configured to play the shared song when the specific display effect is completed; Part of the lyrics displayed in the song sharing card are target lyrics in the lyrics of the shared song, and a play control is provided in the song sharing card; The playback module is further configured to play a portion of the shared song corresponding to the target lyrics in response to a triggering operation on the playback control.

8. The device according to claim 7, characterized in that The specific display effect corresponds to a preset duration; The playing module, when used to play the shared song after the specific display effect is completed, is used to: When the display time of the specific display effect reaches a preset time length, the first sentence of the lyrics of the shared song is displayed on the song playback interface, and the shared song is played.

9. The device according to claim 7, characterized in that When displaying the lyrics of the shared song and the setting content in the song playing interface, the display module is also used to display the lyrics of the shared song in the song playing interface; The display module is further configured to display a display control above the displayed lyrics, wherein the display control is configured to display the set content according to a specific display effect; The setting content is the target lyrics in the lyrics of the shared song, or the setting content is the message content, which is obtained based on the message operation of the user who created the song sharing card.

10. The device according to claim 9, characterized in that The display module is further configured to display a message mark on the song playback interface in response to playing a portion corresponding to target lyrics in the shared song; The display module is also used to display the message content in response to the triggering operation of the message identifier, and the message content is obtained based on the message operation of the user who created the song sharing card.

11. The device according to claim 7, characterized in that The song sharing card also displays comment text; When playing the shared song, the display module is also used to display the comment text in the form of a bullet screen at a set position on the song playing interface.

12. The device according to claim 7, characterized in that The portion of lyrics displayed in the song sharing card is the target lyrics in the shared song, and the song sharing card also displays a background image and / or expression material.

13. A terminal device, characterized in that: The terminal device includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the operations performed by the multimedia data processing method according to any one of claims 1 to 6 when executing the program.

14. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a program, and the processor executes the operations performed by the multimedia data processing method according to any one of claims 1 to 6 through the program.

Images