Message sending method, device, equipment and storage medium

Abstract

The present disclosure relates to a message sending method, device, equipment and storage medium, and relates to the field of multimedia technology. The method includes: displaying a conversation interface between a first object and a second object; in response to a resource generation operation for a voice message input in the conversation interface, generating a multimedia resource corresponding to the voice message, the multimedia resource including at least one of a picture and a video; in response to a sending operation for the multimedia resource, sending the multimedia resource to the second object. The method enriches the interactive forms in the conversation scene and improves the diversity of conversation messages. Moreover, the method can generate multimedia resources based on voice messages in a conversation scene with one click, and also improves the convenience of generating multimedia resources, thereby improving the interaction efficiency. Moreover, since the multimedia resources are generated instantly based on voice messages, the content of the multimedia resources is more specific, so that the probability of user interaction in the conversation scene can be improved through personalized and novel multimedia resources.

Description

Technical Field

[0001] The present disclosure relates to the field of multimedia technology, and in particular to a message sending method, device, equipment and storage medium. Background Art

[0002] With the development of multimedia technology, more and more applications provide conversation functions, such as people can have conversations with others through the conversation interface within the application. Among them, people can send voice messages to others on the conversation interface to have voice conversations with others. For users, inputting voice is more efficient and convenient than inputting text. Therefore, how to better combine voice for conversation is a problem we need to solve. Summary of the invention

[0003] The present disclosure provides a message sending method, device, equipment and storage medium, which enriches the interactive forms in the conversation scene, improves the diversity of conversation messages, improves the interaction efficiency, and can improve the interaction probability of users in the conversation scene through personalized and novel multimedia resources. The technical solution of the present disclosure is as follows.

[0004] On the one hand, a message sending method is provided, the method comprising:

[0005] Displaying a conversation interface between the first object and the second object;

[0006] In response to a resource generation operation for a voice message inputted in the conversation interface, a multimedia resource corresponding to the voice message is generated, wherein the multimedia resource includes at least one of a picture and a video;

[0007] In response to a sending operation on the multimedia resource, the multimedia resource is sent to the second object.

[0008] In some embodiments, the method further comprises:

[0009] Displaying a voice input panel, wherein the voice input panel includes a voice collection control and a resource generation control;

[0010] In response to the voice collection control being triggered, acquiring the voice message;

[0011] The step of generating a multimedia resource corresponding to a voice message inputted in the conversation interface in response to a resource generating operation includes:

[0012] In response to the triggering operation from the voice collection control to the triggering operation of the resource generation control, a multimedia resource corresponding to the voice message is generated.

[0013] In some embodiments, the resource generation control includes at least one of a picture generation control and a video generation control; the response from the trigger operation on the voice acquisition control to the trigger operation on the resource generation control includes at least one of the following:

[0014] In response to a drag operation from the voice collection control to the picture generation control, generating a picture corresponding to the voice message;

[0015] In response to a drag operation from the voice collection control to the video generation control, a video corresponding to the voice message is generated.

[0016] In some embodiments, the method further comprises:

[0017] In response to the triggering operation from the voice collection control to the resource generation control, resource prompt information is displayed, where the resource prompt information is used to prompt the type of multimedia resources to be generated.

[0018] In some embodiments, in response to the sending operation of the multimedia resource, before sending the multimedia resource to the second object, the method further includes:

[0019] Displaying the multimedia resource on the voice input panel, and playing the multimedia resource in response to a triggering operation on the multimedia resource;

[0020] Alternatively, the multimedia resource is displayed on the voice input panel, and in response to a triggering operation on the multimedia resource, the multimedia resource and the voice message are played.

[0021] In some embodiments, the method further comprises at least one of the following:

[0022] In response to the regeneration operation of the displayed multimedia resource, regenerate the multimedia resource corresponding to the voice message, the regenerated multimedia resource being different from the multimedia resource;

[0023] In response to a replacement operation on the displayed multimedia resource, a plurality of candidate multimedia resources are displayed, and in response to a selection operation on any candidate multimedia resource, the multimedia resource is replaced with the any candidate multimedia resource.

[0024] In some embodiments, the method further comprises:

[0025] In response to the sending operation on the multimedia resource, the voice message is sent to the second object.

[0026] In some embodiments, the generated multimedia resources are multiple, and before the multimedia resources are sent to the second object in response to the sending operation of the multimedia resources, the method further includes:

[0027] Displaying multiple multimedia resources corresponding to the voice message;

[0028] The sending of the multimedia resource to the second object in response to the sending operation of the multimedia resource comprises:

[0029] In response to a sending operation on any multimedia resource among the multiple multimedia resources, the any multimedia resource is sent to the second object.

[0030] In some embodiments, the method further comprises:

[0031] In response to a triggering operation on any historical voice message on the conversation interface, displaying at least one function control of any historical voice message, wherein the at least one function control includes a resource generation control;

[0032] In response to a triggering operation on the resource generation control, a first multimedia resource is generated, and the first multimedia resource is displayed on the conversation interface, wherein the first multimedia resource corresponds to any one of the historical voice messages.

[0033] In some embodiments, the method further comprises:

[0034] Displaying, on the session interface, a resource generation control for at least one historical voice message on the session interface;

[0035] In response to a triggering operation of a resource generation control of any one of the at least one historical voice message, a second multimedia resource is generated and displayed on the session interface, wherein the second multimedia resource corresponds to any one of the historical voice messages.

[0036] In some embodiments, the method further comprises at least one of the following:

[0037] In response to a sending operation on any multimedia resource displayed on the session interface, sending the any multimedia resource to the second object;

[0038] In response to a forwarding operation on any multimedia resource displayed on the session interface, the any multimedia resource is sent to a third object.

[0039] In some embodiments, the method further comprises:

[0040] When the multimedia resource includes a facial image, displaying a face replacement control in an associated area of ​​the conversation message where the multimedia resource is located;

[0041] In response to a triggering operation on the face replacement control, displaying a plurality of candidate images;

[0042] In response to a selection operation on any candidate image, the facial image in the multimedia resource is replaced with the facial image in the candidate image.

[0043] According to another aspect of an embodiment of the present disclosure, a message sending device is provided, the device comprising:

[0044] A display unit, configured to display a conversation interface between the first object and the second object;

[0045] A generating unit, configured to execute a resource generating operation in response to a voice message inputted in the conversation interface, and generate a multimedia resource corresponding to the voice message, wherein the multimedia resource includes at least one of a picture and a video;

[0046] The sending unit is configured to execute, in response to a sending operation on the multimedia resource, sending the multimedia resource to the second object.

[0047] In some embodiments, the display unit is further configured to perform:

[0048] Displaying a voice input panel, wherein the voice input panel includes a voice collection control and a resource generation control;

[0049] The device further includes an acquisition unit configured to acquire the voice message in response to the voice collection control being triggered;

[0050] The generating unit is configured to execute:

[0051] In response to the triggering operation from the voice collection control to the triggering operation of the resource generation control, a multimedia resource corresponding to the voice message is generated.

[0052] In some embodiments, the resource generation control includes at least one of a picture generation control and a video generation control; and the generation unit is configured to perform at least one of the following:

[0053] In response to a drag operation from the voice collection control to the picture generation control, generating a picture corresponding to the voice message;

[0054] In response to a drag operation from the voice collection control to the video generation control, a video corresponding to the voice message is generated.

[0055] In some embodiments, the display unit is further configured to perform:

[0056] In response to the triggering operation from the voice collection control to the resource generation control, resource prompt information is displayed, where the resource prompt information is used to prompt the type of multimedia resources to be generated.

[0057] In some embodiments, the display unit is further configured to perform:

[0058] Displaying the multimedia resource on the voice input panel, and playing the multimedia resource in response to a triggering operation on the multimedia resource;

[0059] Alternatively, the multimedia resource is displayed on the voice input panel, and in response to a triggering operation on the multimedia resource, the multimedia resource and the voice message are played.

[0060] In some embodiments, the apparatus further comprises at least one of the following:

[0061] a regeneration unit, configured to execute, in response to a regeneration operation on the displayed multimedia resource, regenerate the multimedia resource corresponding to the voice message, the regenerated multimedia resource being different from the multimedia resource;

[0062] The candidate display unit is configured to display a plurality of candidate multimedia resources in response to a replacement operation on the displayed multimedia resource, and replace the multimedia resource with any candidate multimedia resource in response to a selection operation on any candidate multimedia resource.

[0063] In some embodiments, the sending unit is further configured to execute:

[0064] In response to the sending operation on the multimedia resource, the voice message is sent to the second object.

[0065] In some embodiments, the generated multimedia resources are multiple, and the display unit is further configured to execute:

[0066] Displaying multiple multimedia resources corresponding to the voice message;

[0067] The sending unit is configured to execute:

[0068] In response to a sending operation on any multimedia resource among the multiple multimedia resources, the any multimedia resource is sent to the second object.

[0069] In some embodiments, the display unit is further configured to perform:

[0070] In response to a triggering operation on any historical voice message on the conversation interface, displaying at least one function control of any historical voice message, wherein the at least one function control includes a resource generation control;

[0071] The generating unit is further configured to generate a first multimedia resource in response to a triggering operation on the resource generating control, and display the first multimedia resource on the conversation interface, wherein the first multimedia resource corresponds to any one of the historical voice messages.

[0072] In some embodiments, the display unit is further configured to perform:

[0073] Displaying, on the session interface, a resource generation control for at least one historical voice message on the session interface;

[0074] The generating unit is further configured to execute a triggering operation of a resource generating control for any one of the at least one historical voice message, generate a second multimedia resource, and display the second multimedia resource on the session interface, wherein the second multimedia resource corresponds to any one of the historical voice messages.

[0075] In some embodiments, the sending unit is further configured to perform at least one of the following:

[0076] In response to a sending operation on any multimedia resource displayed on the session interface, sending the any multimedia resource to the second object;

[0077] In response to a forwarding operation on any multimedia resource displayed on the session interface, the any multimedia resource is sent to a third object.

[0078] In some embodiments, the display unit is further configured to perform:

[0079] When the multimedia resource includes a facial image, displaying a face replacement control in an associated area of ​​the conversation message where the multimedia resource is located;

[0080] In response to a triggering operation on the face replacement control, displaying a plurality of candidate images;

[0081] In response to a selection operation on any candidate image, the facial image in the multimedia resource is replaced with the facial image in the candidate image.

[0082] According to another aspect of an embodiment of the present disclosure, a terminal is provided, the terminal including:

[0083] one or more processors;

[0084] A memory for storing program codes executable by the processor;

[0085] The processor is configured to execute the program code to implement the above-mentioned message sending method.

[0086] According to another aspect of an embodiment of the present disclosure, a computer-readable storage medium is provided. When a program code in the computer-readable storage medium is executed by a processor of a terminal, the terminal is enabled to execute the above-mentioned message sending method.

[0087] According to another aspect of an embodiment of the present disclosure, a computer program product is provided, including a computer program, and when the computer program is executed by a processor, the above-mentioned message sending method is implemented.

[0088] The disclosed embodiment provides a message sending method, which can generate multimedia resources such as pictures and videos corresponding to voice messages input in a conversation interface in response to a resource generation operation, and can send the multimedia resources to the conversation object, thereby enriching the interactive form in the conversation scene and improving the diversity of conversation messages. In addition, the method can generate multimedia resources such as pictures and videos based on voice messages in a conversation scene with one click, and also improves the convenience of generating multimedia resources, thereby improving the interaction efficiency. In addition, since the multimedia resources are generated instantly based on voice messages, the content of the multimedia resources is more specific, so that the probability of user interaction in the conversation scene can be increased through personalized and novel multimedia resources.

[0089] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0090] The drawings herein are incorporated into and constitute a part of the specification, illustrate embodiments consistent with the present disclosure, and together with the description are used to explain the principles of the present disclosure, and do not constitute improper limitations on the present disclosure.

[0091] Figure 1 It is a schematic diagram showing an implementation environment according to an exemplary embodiment.

[0092] Figure 2 The figure is a flowchart of a message sending method according to an exemplary embodiment.

[0093] Figure 3 The figure is a flowchart of another message sending method according to an exemplary embodiment.

[0094] Figure 4 The figure is a schematic diagram of a voice input panel according to an exemplary embodiment.

[0095] Figure 5is a schematic diagram of another voice input panel according to an exemplary embodiment.

[0096] Figure 6 is a schematic diagram of yet another voice input panel according to an exemplary embodiment.

[0097] Figure 7 is a schematic diagram of yet another voice input panel according to an exemplary embodiment.

[0098] Figure 8 The figure is a schematic diagram showing a voice input panel in which the multimedia resource is a video according to an exemplary embodiment.

[0099] Fig. 9 The diagram is a schematic diagram of a conversation interface according to an exemplary embodiment.

[0100] Fig.10 It is a schematic diagram of another conversation interface according to an exemplary embodiment.

[0101] Fig.11 is a schematic diagram of yet another conversation interface according to an exemplary embodiment.

[0102] Fig.12 The present invention is a flowchart of an interface display according to an exemplary embodiment.

[0103] Fig.13 The invention is a block diagram of a device for sending a message according to an exemplary embodiment.

[0104] Fig.14 It is a block diagram of a terminal according to an exemplary embodiment. DETAILED DESCRIPTION

[0105] In order to enable ordinary persons in the art to better understand the technical solutions of the present disclosure, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings.

[0106] It should be noted that the terms "first", "second", etc. in the specification and claims of the present disclosure and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present disclosure described herein can be implemented in an order other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0107] It should be noted that the information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, stored data, displayed data, etc.) and signals involved in this disclosure are all authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant laws, regulations and standards of relevant countries and regions. For example, the voice messages, candidate multimedia resources, candidate images, etc. involved in this disclosure are all obtained with full authorization.

[0108] The message sending method provided by the embodiment of the present disclosure can be executed by a terminal. Figure 1 This is a schematic diagram of an implementation environment provided by the embodiment of the present disclosure, see Figure 1 , the implementation environment includes: a terminal 101 and a server 102. In the embodiment of the present disclosure, a target application is installed on the terminal 101, and the target application provides a conversation function, and the user can have a conversation with others through the conversation interface in the application. Conversation messages include but are not limited to messages in the form of text, voice, pictures, and videos. The target application can be any application that provides a conversation function, such as a shopping application, a news application, a search application, a video application, and a social application, and is not specifically limited here. The server 102 is the background server of the target application, and can provide background services for the conversation function of the terminal 101.

[0109] The terminal 101 may be at least one of a smart phone, a smart watch, a desktop computer, a laptop, a virtual reality terminal, an augmented reality terminal, a wireless terminal, and a laptop computer. The terminal 101 has a communication function and can access a wired network or a wireless network. The terminal 101 may generally refer to one of a plurality of terminals, and those skilled in the art may know that the number of the above terminals may be more or less. The server 102 may be an independent physical server, or a server cluster or a distributed file system composed of a plurality of physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN (Content Delivery Network), and big data and artificial intelligence platforms. In some embodiments, the server 102 is directly or indirectly connected to the terminal 101 by wired or wireless communication, which is not limited in the embodiments of the present disclosure. Optionally, the number of the above servers 102 may be more or less, which is not limited in the embodiments of the present disclosure. Of course, the server 102 may also include other functional servers to provide more comprehensive and diversified services. Among them, the server 102 undertakes the main computing work, and the terminal 101 undertakes the secondary computing work; or, the server 102 undertakes the secondary computing work, and the terminal 101 undertakes the main computing work; or, the server 102 or the terminal 101 can each independently undertake the computing work, which is not limited in the embodiments of the present disclosure.

[0110] Figure 2 is a flow chart of a message sending method according to an exemplary embodiment. Figure 2 As shown, the method is executed by a terminal, and the method includes the following steps.

[0111] In step S201, the terminal displays a conversation interface between the first object and the second object.

[0112] In the embodiment of the present disclosure, the conversation interface is used for a first object to have a conversation with a second object, and the first object is an object using a terminal. The terminal can send a conversation message to the second object through the conversation interface, and receive a conversation message sent by the second object through the conversation interface. The conversation message includes but is not limited to messages in the form of text, voice, picture, and video.

[0113] In the embodiments of the present disclosure, the conversation interface may be an interface within any application having a conversation function.

[0114] In step S202, in response to a resource generation operation for a voice message input in the conversation interface, the terminal generates a multimedia resource corresponding to the voice message, where the multimedia resource includes at least one of a picture and a video.

[0115] In the embodiment of the present disclosure, the resource generation operation is used to generate multimedia resources corresponding to the voice message. The multimedia resources include at least one of a picture and a video. The generated multimedia resources may be one or more, and the types of the multiple multimedia resources may be one or more.

[0116] In some embodiments, the multimedia resource corresponding to the voice message includes an entity in the voice message. For example, if there is an entity "dog" in the voice message, the multimedia resource includes dog. Optionally, the voice message is an instruction message for indicating what kind of multimedia resource to generate. For example, if the voice message indicates to generate "cat", the multimedia resource includes cat.

[0117] The terminal generates multimedia resources corresponding to the voice message, including but not limited to the following implementations.

[0118] In a first implementation, the terminal inputs a voice message into a first resource generation model, processes the voice message through the first resource generation model, and outputs a multimedia resource. The first resource generation model is used to generate multimedia resources based on the voice message. Optionally, the first resource generation model is an AIGC (Artificial Intelligence Generated Content) model. In this implementation, the multimedia resources corresponding to the voice message are directly generated through the AIGC model, which improves convenience, and because it is a generative multimedia resource, the accuracy of the multimedia resource is guaranteed.

[0119] In a second implementation, the terminal converts the voice message into text, inputs the text into a second resource generation model, processes the text through the second resource generation model, and outputs a multimedia resource. The second resource generation model is used to generate multimedia resources based on the text. Optionally, the second resource generation model is an AIGC model. In the implementation, the voice message is first converted into text, and then the multimedia resource is generated based on the text. Since the text is easy for the model to recognize, the multimedia resource generated based on the text is more accurate.

[0120] In the third implementation, the terminal extracts keywords from the voice message, inputs the keywords into the second resource generation model, processes the keywords through the second resource generation model, and outputs multimedia resources. Optionally, the keywords are words used to represent entities, thereby facilitating the generation of multimedia resources. For example, the keyword is "house". In this implementation, multimedia resources are generated based on keywords in the voice message, avoiding interference from other redundant information and improving the efficiency and accuracy of multimedia resource generation.

[0121] In a fourth implementation, the terminal extracts a keyword from the voice message. The multimedia resource corresponding to the keyword is determined from the resource correspondence, and the multimedia resource is output as the multimedia resource corresponding to the voice message. The resource correspondence includes multiple keywords and multimedia resources corresponding to each of the multiple keywords. In this implementation, since the resource correspondence is established in advance, the multimedia resource is generated based on the resource correspondence, which improves convenience.

[0122] In the embodiments of the present disclosure, the terminal may generate multimedia resources based on the voice message itself, or the terminal may send the voice message to the server, and the server may generate multimedia resources based on the voice message.

[0123] In step S203, in response to the sending operation of the multimedia resource, the terminal sends the multimedia resource to the second object.

[0124] In the embodiments of the present disclosure, the terminal may send multimedia resources alone, or may send a voice message while sending the multimedia resources, which is not specifically limited herein.

[0125] After the terminal sends the multimedia resource to the second object, the session message containing the multimedia resource is displayed on the session interface. In response to the triggering operation on the multimedia resource on the session interface, the terminal can also play the multimedia resource.

[0126] The disclosed embodiment provides a message sending method, which can generate multimedia resources such as pictures and videos corresponding to voice messages input in a conversation interface in response to a resource generation operation, and can send the multimedia resources to the conversation object, thereby enriching the interactive form in the conversation scene and improving the diversity of conversation messages. In addition, the method can generate multimedia resources such as pictures and videos based on voice messages in a conversation scene with one click, and also improves the convenience of generating multimedia resources, thereby improving the interaction efficiency. In addition, since the multimedia resources are generated instantly based on voice messages, the content of the multimedia resources is more specific, so that the probability of user interaction in the conversation scene can be increased through personalized and novel multimedia resources.

[0127] Above Figure 2 This is the basic process of message sending. Figure 3 The process of sending messages is further described. Figure 3 , Figure 3 The present invention is a flowchart of a message sending method according to an exemplary embodiment. The method is executed by a terminal and includes the following steps.

[0128] In step S301, the terminal displays a conversation interface between the first object and the second object.

[0129] In the embodiment of the present disclosure, the conversation interface is an interface within the target application, and the conversation interface provides a conversation function. Optionally, the target application is a short video application. Accordingly, a conversation control is displayed on the work playback page of the second object, and in response to a triggering operation on the conversation control, the terminal displays a conversation interface between the first object and the second object. Alternatively, a conversation control is displayed on the main page of the second object, and in response to a triggering operation on the conversation control, the terminal displays a conversation interface with the second object. Optionally, the status information of the second object is also displayed on the conversation interface, indicating whether the second object is in a live broadcast state, etc.

[0130] The conversation interface is a conversation interface between a first object and a second object, and the first object is also an object using a terminal. A conversation message can be sent to the second object through the conversation interface, and a conversation message sent by the second object can also be received through the conversation interface. Conversation messages include but are not limited to messages in the form of text, voice, picture, and video. Furthermore, a conversation message can include messages in multiple forms, such as both voice messages and picture messages.

[0131] In the embodiment of the present disclosure, there may be multiple second objects, that is, the conversation interface may be a conversation interface of a group.

[0132] In step S302, in response to a voice input operation on the conversation interface, the terminal displays a voice input panel, which includes a voice collection control and a resource generation control; in response to the voice collection control being triggered, the terminal obtains a voice message.

[0133] The voice input panel is used to obtain voice messages and generate multimedia resources. Optionally, the voice input panel is displayed on the conversation interface in the form of a masked pop-up window.

[0134] In some embodiments, a voice input control is displayed on the conversation interface, and the voice input operation refers to a trigger operation on the voice input control. Optionally, the trigger operation on the voice input control is a long press operation on the voice input control. Accordingly, after entering the voice input panel in response to the long press operation on the voice input control, the long press operation is transformed into a long press operation on the voice collection control on the voice input panel. During the long press operation, the terminal collects the voice message input by the user to obtain the voice message.

[0135] In step S303, in response to the triggering operation from the voice collection control to the resource generation control, the terminal generates multimedia resources corresponding to the voice message.

[0136] In some embodiments, the triggering operation from the voice acquisition control to the resource generation control is a dragging operation from the voice acquisition control to the resource generation control. Wherein, in the process of triggering the voice acquisition control, in response to the dragging operation from the voice acquisition control to the resource generation control, the multimedia resources corresponding to the voice message are generated, that is, the operation of obtaining the voice message and generating the multimedia resources is a continuous gesture operation. Taking the triggering operation of the voice acquisition control as a long press operation of the voice acquisition control as an example, the continuous gesture operation is a continuous gesture operation of long press plus dragging. Alternatively, after the triggering operation of the voice acquisition control is ended, that is, after the finger leaves the screen, then in response to the dragging operation from the voice acquisition control to the resource generation control, the terminal generates the multimedia resources corresponding to the voice message.

[0137] In other embodiments, the triggering operation of the voice collection control to the triggering operation of the resource generation control refers to triggering the voice collection control and then triggering the resource generation control. After the triggering operation of the voice collection control ends, that is, after the finger leaves the screen, the terminal generates multimedia resources corresponding to the voice message in response to the triggering operation of the resource generation control. Optionally, the triggering operation of the voice collection control is a long press operation, and the triggering operation of the resource generation control is a click operation.

[0138] In some embodiments, the resource generation control includes at least one of a picture generation control and a video generation control. The above process of the terminal generating multimedia resources corresponding to the voice message in response to the triggering operation from the voice acquisition control to the resource generation control includes at least one of the following implementations: in response to the dragging operation from the voice acquisition control to the picture generation control, the terminal generates a picture corresponding to the voice message; in response to the dragging operation from the voice acquisition control to the video generation control, the terminal generates a video corresponding to the voice message.

[0139] In this embodiment, a picture generation control and a video generation control are provided on the voice input panel. By dragging the voice acquisition control to any generation control, corresponding types of multimedia resources are generated. That is, through the voice input panel, not only multimedia resources can be generated, but also multiple types of multimedia resources can be generated, which improves the diversity of interaction, and improves the diversity and richness of multimedia resources, and can increase the user's utilization rate of the multimedia resource generation function.

[0140] In some embodiments, while generating multimedia resources, the terminal also converts the voice message into text and displays the text on the multimedia resources, thereby improving the interface display effect.

[0141] For example, when the terminal generates an image, it also converts the voice message into text and displays the text on the image. When the terminal generates a video, it also converts the voice message into text and displays the text in the video. Furthermore, the text is used as subtitles in the video.

[0142] In some embodiments, the voice input panel further includes a text control, and in response to a drag operation from the voice collection control to the text control, the terminal converts the voice message into text. Furthermore, the text is displayed on the voice input panel.

[0143] In some embodiments, the voice input panel also includes a close control. In response to a drag operation from the voice collection control to the close control, the terminal cancels the display of the voice input panel and discards the collected voice message. In this embodiment, by providing a close control, the user can discard the collected voice message if he is not satisfied with the collected voice message, and then collect the voice message again.

[0144] In some embodiments, in response to the triggering operation from the voice acquisition control to the resource generation control, the terminal displays resource prompt information, and the resource prompt information is used to prompt the type of multimedia resources to be generated. The type includes but is not limited to pictures, videos, text, etc. Further, the type indicated by the resource prompt information is the same as the type corresponding to the resource generation control. For example, if the resource generation control refers to the picture generation control, the type prompted by the resource prompt information is a picture; if the resource generation control refers to the video generation control, the type prompted by the resource prompt information is a video. In this embodiment, the resource prompt information is displayed to prompt the type of multimedia resources to be generated, which increases the amount of information transmitted, and then based on the information transmitted, the probability of user interaction can be increased.

[0145] For example, see Figure 4 , Figure 4 4 is a schematic diagram of a voice input panel according to an exemplary embodiment. The voice input panel displays a picture generation control 401, a video generation control 402, a text generation control 403, a close control 404 and a voice collection control 405. In response to the drag operation from the voice collection control 405 to the picture generation control 401, the terminal displays resource prompt information 406, and the resource prompt information 406 is used to prompt that the multimedia resource to be generated is a picture.

[0146] For example, see Figure 5 , Figure 5 1 is a schematic diagram of a voice input panel according to an exemplary embodiment. In response to a drag operation from a voice acquisition control to a video generation control, the terminal displays resource prompt information 501, and the resource prompt information 501 is used to prompt that the multimedia resource to be generated is a video.

[0147] In the embodiment of the present disclosure, the process of generating multimedia resources corresponding to the voice message in response to the resource generation operation of the voice message input in the conversation interface is realized through the above step S303. In this embodiment, the voice collection control and the resource generation control are displayed on the voice input panel, and in response to the triggering operation from the voice collection control to the resource generation control, the multimedia resources corresponding to the collected voice message are generated, so that the resource generation control is directly triggered after the voice message is collected by the voice collection control, and the visual connection between the voice message and the multimedia resource is established, and then the multimedia resource corresponding to the voice message is directly generated, which improves the convenience of interaction.

[0148] In some embodiments, the terminal also displays the generation process of the multimedia resource on the voice input panel. For example, during the generation process of the multimedia resource, the process in which the transparency of the multimedia resource gradually decreases is displayed. Alternatively, during the generation process of the multimedia resource, a generation progress bar of the multimedia resource is displayed, and the generation progress bar is used to indicate the generation progress of the multimedia resource. In this embodiment, by displaying the transparency change process of the multimedia resource, the display effect of the multimedia resource is improved. By displaying the generation progress bar, the amount of information transmission is increased, which makes it easier for users to understand the generation progress.

[0149] Optionally, when the multimedia resource is a picture, the process of the transparency of the picture gradually decreasing is displayed. When the multimedia resource is a video, the generation progress bar of the video is displayed, and further, the process of the transparency of the video cover gradually decreasing is displayed.

[0150] Optionally, the voice input panel also displays first prompt information for prompting that the multimedia resource is being generated.

[0151] In some embodiments, during the process of generating multimedia resources, that is, after the voice message is acquired, the terminal also displays a voice playback control on the voice input panel, and the voice playback control is used to play the input voice message. In this way, the acquired voice message can be played at any time without waiting for the multimedia resource to be generated before the voice message is allowed to be played, which improves the convenience of interaction.

[0152] In some embodiments, during the process of generating multimedia resources, that is, after the voice message is acquired, a voice sending control is also displayed on the voice input panel, which is used to send the voice message after being triggered. In this way, the voice message can be sent separately without waiting for the multimedia resource to be generated before the voice message is allowed to be sent, which improves the convenience of interaction.

[0153] In some embodiments, during the process of generating multimedia resources, a close control is also displayed on the voice input panel, and the close control is used to cancel the generation of multimedia resources and discard the acquired voice message after being triggered.

[0154] In some embodiments, during the process of generating multimedia resources, a resource sending control is also displayed on the voice input panel, and the resource sending control is in a non-interactive state, which is used to indicate that the multimedia resource is being generated. After the multimedia resource is generated, the resource sending control is in an interactive state, which is used to indicate that the multimedia resource has been generated and can be sent. In response to a triggering operation on the resource sending control, the terminal sends the multimedia resource.

[0155] In some embodiments, after the multimedia resource is generated, the terminal further displays a second prompt message on the voice input panel to prompt that the multimedia resource has been successfully generated.

[0156] For example, see Figure 6 , Figure 6 1 is a schematic diagram of a voice input panel according to an exemplary embodiment. In the process of generating multimedia resources, the voice input panel displays a first prompt message and a multimedia resource with gradually decreasing transparency, and also displays a voice play control 601, a voice send control 602, a close control 603 and a resource send control 604.

[0157] For example, see Figure 7 , Figure 7 7 is a schematic diagram of a voice input panel according to an exemplary embodiment. After the multimedia resource is generated, the terminal displays the multimedia resource and the second prompt information on the voice input panel, and the state of the resource sending control 701 changes to an interactive state.

[0158] In step S304, the terminal displays the multimedia resource on the voice input panel, and plays the multimedia resource in response to the triggering operation on the multimedia resource.

[0159] In the disclosed embodiment, the terminal displays the generated multimedia resources on the voice input panel, thereby enabling the user to preview the generated multimedia resources. In this way, the multimedia resources are sent only when the user is satisfied with the generated multimedia resources, thereby improving the integrity and convenience of the interaction.

[0160] It should be noted that, when the multimedia resource is a picture, the picture is directly displayed on the voice input panel without being triggered and then played. When the multimedia resource is a video, in response to the triggering operation of the video, the terminal plays the video. Optionally, when the multimedia resource is a video, a video playback progress bar is also displayed on the voice input panel to indicate the playback progress of the video.

[0161] For example, see Figure 8 , Figure 8The figure is a schematic diagram of a voice input panel of a multimedia resource as a video according to an exemplary embodiment. Taking the multimedia resource as a video as an example, a play control 801 is displayed on the multimedia resource, and in response to a triggering operation on the play control 801, the terminal plays the video.

[0162] In other embodiments, if the multimedia resource is a video, after the terminal generates the multimedia resource, the video is played directly on the voice input panel without the need for the user to trigger it, thereby further improving the interaction efficiency.

[0163] In other embodiments, in response to a trigger operation on a multimedia resource, the terminal plays the multimedia resource and the voice message, thereby being able to not only preview the generated multimedia resource but also listen to the input voice message, and display both types of information through a one-click operation, thereby improving the interaction efficiency.

[0164] In some embodiments, at least one of the following implementation methods is also included: in response to a regeneration operation on the displayed multimedia resource, the terminal regenerates the multimedia resource corresponding to the voice message, and the regenerated multimedia resource is different from the multimedia resource; in response to a replacement operation on the displayed multimedia resource, the terminal displays multiple candidate multimedia resources, and in response to a selection operation on any candidate multimedia resource, the multimedia resource is replaced with any candidate multimedia resource.

[0165] In this embodiment, in response to the multimedia resource regeneration operation, the multimedia resource can be regenerated, so that when the user is not satisfied with the generated multimedia resource, it can be regenerated, which improves the diversity of functions and the convenience of interaction, and can be regenerated with one key, which also improves the interaction efficiency. In response to the multimedia resource replacement operation, the multimedia resource can be replaced with other multimedia resources selected by the user, which further improves the diversity and convenience of interaction, thereby improving the user's utilization rate of the function.

[0166] Optionally, the regeneration operation refers to a triggering operation on regenerating a control on a resource generation panel, or the regeneration operation refers to a triggering operation on a multimedia resource, and the triggering operation may be, for example, a long press operation or a double click operation.

[0167] The multiple candidate multimedia resources include at least one of the following: the multiple candidate multimedia resources are multiple multimedia resources stored in the terminal; or the multiple candidate multimedia resources are multimedia resources that have been sent by the user more than the first time in history. Or the multiple candidate multimedia resources are multimedia resources associated with the voice message among the multiple multimedia resources stored in the terminal. For example, the candidate multimedia resources include the entity indicated by the voice message.

[0168] It should be noted that the acquisition of multimedia resources stored in the terminal is authorized by the user. The authorization interface is displayed on the terminal, and the authorization interface displays prompt information, consent controls, and disagree controls. The prompt information is used to prompt the acquisition of multimedia resources stored in the terminal. The consent control is used to indicate that the user agrees that the terminal acquires the multimedia resources stored in the terminal. In response to the triggering operation of the consent control, the multimedia resources stored in the terminal are acquired.

[0169] In step S305, in response to the sending operation of the multimedia resource, the terminal sends the multimedia resource to the second object.

[0170] Optionally, in response to the sending operation of the multimedia resource, the terminal also sends a voice message to the second object. In this embodiment, the voice message is sent while sending the multimedia resource, that is, the multimedia resource and the voice message can be sent out at the same time through one-key operation, thereby improving the interaction efficiency.

[0171] In some embodiments, the sending operation may be a triggering operation on the multimedia resource, and the triggering operation may be a click operation or a long press operation, etc.

[0172] In some embodiments, a resource sending control is displayed on the voice input panel, and in response to a trigger operation on the resource sending control, the terminal sends a multimedia resource to the second object. Optionally, a prompt message is displayed on the resource sending control, which is used to prompt that the resource sending control is used to send multimedia resources. Further, in response to a trigger operation on the resource sending control, the terminal also sends a voice message to the second object. Accordingly, the sent multimedia resources and voice messages are displayed in a conversation message on the conversation interface, and the voice message can be displayed above or below the multimedia resources, which is not specifically limited here.

[0173] The sent multimedia resource is displayed in the conversation interface. Furthermore, the conversation interface also displays prompt information of the multimedia resource, which is used to prompt that the multimedia resource is a multimedia resource generated based on the voice message.

[0174] In some embodiments, a voice sending control is also displayed on the voice input panel, and in response to a triggering operation on the voice sending control, the terminal sends a voice message to the second object. Optionally, prompt information is displayed on the voice sending control to prompt that the voice sending control is used to send a voice message.

[0175] In some embodiments, there are multiple multimedia resources generated, and before sending the multimedia resources to the second object in response to the sending operation of the multimedia resources, the method also includes: the terminal displays multiple multimedia resources corresponding to the voice message; then the above-mentioned process of sending the multimedia resources to the second object in response to the sending operation of the multimedia resources includes the following steps: in response to the sending operation of any multimedia resource among the multiple multimedia resources, the terminal sends any multimedia resource to the second object.

[0176] The types of the multiple multimedia resources may be the same or different. If the resource generation control includes a picture generation control and a video generation control, when the multimedia resources are generated based on the picture generation control, the types of the multiple multimedia resources are all pictures; when the multimedia resources are generated based on the video generation control, the types of the multiple multimedia resources are all videos. If there is only one resource generation control, multimedia resources are randomly generated, and the types of the multiple multimedia resources may be the same or different.

[0177] The terminal displays multiple multimedia resources on the voice input panel. The sending operation on any multimedia resource may be a triggering operation on the multimedia resource.

[0178] In this embodiment, multiple multimedia resources corresponding to the voice message can be generated and displayed at one time, which provides the user with rich and diverse multimedia resources, improves the user's selection surface, allows the user to freely choose the multimedia resources they want to send, further improves the diversity and convenience of interaction, and increases the probability that the generated multimedia resources meet the user's preferences, thereby increasing the probability of the user sending messages based on the multimedia resources.

[0179] In the embodiments of the present disclosure, the conversation interface is taken as a conversation interface with a single object as an example for explanation. In other embodiments, the conversation interface is a group conversation interface, that is, in response to the sending operation of the multimedia resource, the terminal sends the multimedia resource to the group conversation and displays it on the group conversation interface.

[0180] In step S306, when the multimedia resource includes a facial image, the terminal displays a face replacement control in an associated area of ​​the conversation message where the multimedia resource is located.

[0181] In the embodiment of the present disclosure, the associated area of ​​the conversation message is also the adjacent area of ​​the conversation message, and the distance between the associated area and the conversation message is within a preset range. The face replacement control is used to replace the face image in the multimedia resource.

[0182] Optionally, the terminal performs facial image detection on the multimedia resource, and when a facial image is detected, the terminal displays a facial replacement control. Alternatively, the terminal sends the multimedia resource to a server, and the server performs facial image detection. Alternatively, the terminal generates the multimedia resource through a server, and after generating the multimedia resource, the server directly performs facial image detection on the multimedia resource, and sends the multimedia resource together with the detection result to the terminal, and the terminal displays a facial replacement control when the detection result indicates that the multimedia resource includes a facial image.

[0183] In step S307, in response to the triggering operation of the face replacement control, the terminal displays multiple candidate images; in response to the selection operation of any candidate image, the terminal replaces the face image in the multimedia resource with the face image in any candidate image.

[0184] Optionally, the multiple candidate images include at least one of the following: the multiple candidate images are multiple images including facial images saved on the terminal. Alternatively, the multiple candidate images are multiple images saved on the terminal and the saving time is no more than a preset time from the current time. Alternatively, the multiple candidate images are multiple images that the user has sent more than a second number of times in history. Alternatively, the multiple candidate images are multiple images that the user has sent more than a second number of times in history and include facial images.

[0185] In an embodiment of the present disclosure, when the generated multimedia resources include facial images, a face replacement control is also provided on the conversation interface to replace the facial images in the multimedia resources, and the facial images in the multimedia resources can be replaced with facial images in any candidate images based on the user's selection, thereby further improving the diversity of interaction and increasing the probability of users interacting in the conversation interface.

[0186] In some embodiments, the terminal can also generate multimedia resources for historical voice messages. In response to a trigger operation on any historical voice message on the conversation interface, the terminal displays at least one function control of the any historical voice message, and the at least one function control includes a resource generation control; in response to a trigger operation on the resource generation control, a first multimedia resource is generated, and the first multimedia resource is displayed on the conversation interface, and the first multimedia resource corresponds to the any historical voice message. In this embodiment, for the historical voice message in the conversation interface, a resource generation control is also provided in its function control, and multimedia resources can be generated for the historical voice message, which increases the generation entry of multimedia resources, further improves the diversity of interaction, and can improve the user's utilization rate of this function.

[0187] The triggering operation for the historical voice message may be a long press operation, a double click operation, etc.

[0188] The resource generation control is used to generate at least one of a picture and a video. Accordingly, the process of generating multimedia resources through the resource generation control includes the following three situations.

[0189] In the first case, the resource generation control is only used to generate pictures or only used to generate videos. Alternatively, the resource generation control is used to randomly generate pictures or videos. That is, when the resource generation control is only used to generate pictures, in response to the triggering operation of the resource generation control, the terminal generates pictures corresponding to the historical voice message; when the resource generation control is only used to generate videos, in response to the triggering operation of the resource generation control, the terminal generates videos corresponding to the historical voice message. When the resource generation control is used to randomly generate pictures or videos, in response to the triggering operation of the resource generation control, the terminal generates pictures or videos corresponding to the historical voice message.

[0190] In the second case, the resource generation control includes a picture generation control and a video generation control, that is, in response to the triggering operation of the historical voice message, the terminal directly displays the picture generation control and the video generation control. In response to the triggering operation of the picture generation control, the terminal generates a picture corresponding to the historical voice message. In response to the triggering operation of the video generation control, the terminal generates a video corresponding to the historical voice message.

[0191] In the third case, the picture generation control and the video generation control are subordinate controls of the resource generation control, that is, in response to the triggering operation of the historical voice message, the terminal displays the resource generation control, and in response to the triggering operation of the resource generation control, the terminal displays the picture generation control and the video generation control.

[0192] For example, see Fig. 9 , Fig. 9 1 is a schematic diagram of a conversation interface according to an exemplary embodiment. In response to a trigger operation on a historical voice message, the terminal displays a plurality of function controls, the plurality of function controls including a resource generation control 901, the resource generation control 901 being used to generate a picture.

[0193] In some embodiments, the terminal displays a resource generation control for at least one historical voice message on the session interface; in response to a triggering operation on the resource generation control for any one of the at least one historical voice message, generates a second multimedia resource, and displays the second multimedia resource on the session interface, the second multimedia resource corresponding to any one of the historical voice messages.

[0194] In this embodiment, for the historical voice messages on the conversation interface, the resource generation control is directly displayed on the conversation interface, so that the corresponding multimedia resources can be generated with one click, thereby improving the interaction efficiency.

[0195] In some embodiments, the at least one historical voice message is the most recent historical voice message, and the most recent historical voice message refers to the voice message that is sent most recently from the current time. Since the most recent historical voice message is the most up-to-date, that is, the probability of interaction through the voice message is the highest, and the probability that the user wants to generate its multimedia resources is the highest, the resource generation control is displayed to improve the convenience of user interaction, thereby increasing the probability of user interaction.

[0196] The process of generating the multimedia resource of the most recent historical voice message based on the resource generation control is the same as the process of generating the multimedia resource of any historical voice message based on the resource generation control, which will not be described in detail here.

[0197] Optionally, prompt information is displayed on the resource generation control to prompt the multimedia resource to be generated based on the voice message. The prompt information includes text, such as the text "voice painting". Further, the prompt information also includes an icon, and the form of the icon can be set as needed.

[0198] Wherein, for any historical voice message, the process in which the terminal generates the corresponding multimedia resource is the same as step S202, which will not be described in detail here.

[0199] For example, see Fig.10 , Fig.10 It is a schematic diagram of a conversation interface according to an exemplary embodiment, wherein there is a resource generation control 1001 of the most recent historical voice message on the conversation interface.

[0200] In other embodiments, for a multimedia resource generated based on a historical voice message, if the multimedia resource includes a facial image, a face replacement control is displayed in an associated area of ​​the conversation message where the multimedia resource is located; in response to a triggering operation on the face replacement control, multiple candidate images are displayed; in response to a selection operation on any candidate image, the facial image in the multimedia resource is replaced with a facial image in any candidate image.

[0201] Optionally, after replacing the facial image in the multimedia resource, the face replacement control is kept displayed on the conversation interface, so that if the user is not satisfied with the replaced face, he or she can replace it again.

[0202] For example, see Fig.11 , Fig.111 is a schematic diagram of a conversation interface according to an exemplary embodiment. In response to the triggering operation of the resource generation control of any voice message, a buffer interface for generating multimedia resources is displayed on the conversation interface, and after the multimedia resources are generated, the generated multimedia resources are displayed. Furthermore, if the multimedia resources include a facial image, a facial replacement control 1101 is also displayed in the associated area of ​​the conversation message where the multimedia resources are located.

[0203] For example, see Fig.12 , Fig.12 The present invention is a flowchart of an interface display according to an exemplary embodiment, wherein in response to a trigger operation on a face replacement control, the terminal displays multiple candidate images, and in response to a selection operation on any candidate image, the face image in the multimedia resource is replaced with the face image in the candidate image.

[0204] In an embodiment of the present disclosure, for any multimedia resource displayed on the conversation interface, the terminal can also send it to a second object or forward it to other objects. Accordingly, in response to a sending operation on any multimedia resource displayed on the conversation interface, the terminal sends the any multimedia resource to the second object. In response to a forwarding operation on any multimedia resource displayed on the conversation interface, the terminal sends the any multimedia resource to a third object. In this embodiment, not only can multimedia resources be generated on the conversation interface based on historical voice messages, but these multimedia resources can also be sent or forwarded to other objects, which improves the convenience of message sending and thereby increases the diversity of interactive functions on the conversation interface.

[0205] The multimedia resources displayed on the conversation interface include multimedia resources generated based on historical voice messages, multimedia resources sent by the second object, multimedia resources sent by the terminal, and the like.

[0206] The method provided by the embodiment of the present disclosure reduces the difficulty of operating the AIGC function and can increase the amount of content created by users. In addition, it expands the fun of sending voice messages in private message scenarios, making users more willing to send voice messages, thereby increasing the amount of voice messages sent. In addition, since users can instantly share corresponding multimedia resources when sending voice messages, the interaction path for users to share AIGC content is shortened, thereby improving the interaction efficiency and increasing the amount of private messages sent.

[0207] The method provided by the embodiment of the present disclosure can help users input instructions more conveniently to generate pictures or videos. In addition, the ability to embed AIGC in private message scenarios shortens the user's sharing path. In addition, the fun of message sending is improved. When the generated multimedia resources include facial images, users can quickly replace them with facial photos uploaded locally, allowing users to play with them when chatting with the conversation partner, which improves the diversity of functions.

[0208] The method provided by the embodiment of the present application reduces the user's input cost, stimulates the user's creativity, allows the user to share and communicate with the conversation partner more conveniently, and improves the interaction efficiency and convenience during the conversation.

[0209] The disclosed embodiment provides a message sending method, which can generate multimedia resources corresponding to voice messages input in a conversation interface in response to resource generation operations, and can send multimedia resources to conversation objects, thereby enriching the interactive forms in conversation scenarios and improving the diversity of conversation messages. In addition, the method can generate multimedia resources based on voice messages in a conversation scenario with one click, and also improves the convenience of generating multimedia resources, thereby improving the interaction efficiency. In addition, since multimedia resources are generated instantly based on voice messages, the content of multimedia resources is more specific, so that the interaction probability in user conversation scenarios can be improved through personalized and novel multimedia resources.

[0210] Fig.13 FIG. 1 is a block diagram of a message sending device according to an exemplary embodiment. Fig.13 , the device comprises:

[0211] The display unit 1301 is configured to display a conversation interface between the first object and the second object;

[0212] The generating unit 1302 is configured to execute a resource generating operation in response to a voice message inputted in the conversation interface, and generate a multimedia resource corresponding to the voice message, wherein the multimedia resource includes at least one of a picture and a video;

[0213] The sending unit 1303 is configured to execute a sending operation on the multimedia resource and send the multimedia resource to the second object in response to the sending operation on the multimedia resource.

[0214] In some embodiments, the display unit 1301 is further configured to perform:

[0215] Display the voice input panel, which includes a voice collection control and a resource generation control;

[0216] The device also includes an acquisition unit configured to acquire a voice message in response to the voice collection control being triggered;

[0217] The generating unit 1302 is configured to execute:

[0218] In response to the triggering operation from the voice collection control to the triggering operation of the resource generation control, a multimedia resource corresponding to the voice message is generated.

[0219] In some embodiments, the resource generation control includes at least one of a picture generation control and a video generation control; the generation unit 1302 is configured to perform at least one of the following:

[0220] In response to a drag operation from the voice collection control to the picture generation control, generating a picture corresponding to the voice message;

[0221] In response to a drag operation from the voice collection control to the video generation control, a video corresponding to the voice message is generated.

[0222] In some embodiments, the display unit 1301 is further configured to perform:

[0223] In response to the triggering operation from the voice collection control to the resource generation control, resource prompt information is displayed, and the resource prompt information is used to prompt the type of multimedia resources to be generated.

[0224] In some embodiments, the display unit 1301 is further configured to execute:

[0225] Displaying multimedia resources on the voice input panel, and playing the multimedia resources in response to a triggering operation on the multimedia resources;

[0226] Alternatively, the multimedia resource is displayed on the voice input panel, and in response to a triggering operation on the multimedia resource, the multimedia resource and the voice message are played.

[0227] In some embodiments, the apparatus further comprises at least one of the following:

[0228] a regeneration unit configured to execute, in response to a regeneration operation on the displayed multimedia resource, regenerate the multimedia resource corresponding to the voice message, the regenerated multimedia resource being different from the multimedia resource;

[0229] The candidate display unit is configured to display a plurality of candidate multimedia resources in response to a replacement operation on the displayed multimedia resource, and replace the multimedia resource with any candidate multimedia resource in response to a selection operation on any candidate multimedia resource.

[0230] In some embodiments, the sending unit 1303 is further configured to execute:

[0231] In response to the sending operation on the multimedia resource, a voice message is sent to the second object.

[0232] In some embodiments, the generated multimedia resources are multiple, and the display unit 1301 is further configured to execute:

[0233] Display multiple multimedia resources corresponding to the voice message;

[0234] The sending unit 1303 is configured to execute:

[0235] In response to a sending operation on any multimedia resource among the plurality of multimedia resources, any multimedia resource is sent to the second object.

[0236] In some embodiments, the display unit 1301 is further configured to perform:

[0237] In response to a triggering operation on any historical voice message on the conversation interface, display at least one function control of any historical voice message, wherein the at least one function control includes a resource generation control;

[0238] The generating unit 1302 is further configured to generate a first multimedia resource in response to a triggering operation on a resource generating control, and display the first multimedia resource on the conversation interface, wherein the first multimedia resource corresponds to any historical voice message.

[0239] In some embodiments, the display unit 1301 is further configured to perform:

[0240] Displaying, on the conversation interface, a resource generation control for at least one historical voice message on the conversation interface;

[0241] The generation unit 1302 is also configured to execute a trigger operation of a resource generation control in response to any one of the at least one historical voice messages, generate a second multimedia resource, and display the second multimedia resource on the conversation interface, wherein the second multimedia resource corresponds to any one of the historical voice messages.

[0242] In some embodiments, the sending unit 1303 is further configured to perform at least one of the following:

[0243] In response to a sending operation on any multimedia resource displayed on the session interface, sending any multimedia resource to the second object;

[0244] In response to a forwarding operation on any multimedia resource displayed on the session interface, any multimedia resource is sent to a third object.

[0245] In some embodiments, the display unit 1301 is further configured to perform:

[0246] When the multimedia resource includes a facial image, displaying a facial replacement control in an associated area of ​​the conversation message where the multimedia resource is located;

[0247] In response to a triggering operation on the face replacement control, displaying a plurality of candidate images;

[0248] In response to a selection operation on any candidate image, the facial image in the multimedia resource is replaced with the facial image in any candidate image.

[0249] The disclosed embodiment provides a message sending device, which can generate multimedia resources corresponding to voice messages input in a conversation interface in response to resource generation operations, and can send multimedia resources to conversation objects, thereby enriching the interactive forms in conversation scenarios and improving the diversity of conversation messages. In addition, the device can generate multimedia resources based on voice messages in a conversation scenario with one click, which also improves the convenience of generating multimedia resources, thereby improving the interaction efficiency. In addition, since multimedia resources are generated instantly based on voice messages, the content of multimedia resources is more specific, so that the interaction probability in user conversation scenarios can be improved through personalized and novel multimedia resources.

[0250] Regarding the device in the above embodiment, the specific manner in which each unit performs the operation has been described in detail in the embodiment of the method, and will not be elaborated here.

[0251] Fig.14 The structure block diagram of a terminal 1400 provided by an exemplary embodiment of the present disclosure is shown. The terminal 1400 may be: a smart phone, a tablet computer, an MP3 player (Moving Picture Experts Group Audio Layer III, Moving Picture Experts Group Audio Layer 3), an MP4 (Moving Picture Experts Group Audio Layer IV, Moving Picture Experts Group Audio Layer 4) player, a laptop computer or a desktop computer. The terminal 1400 may also be called a user device, a portable terminal, a laptop terminal, a desktop terminal or other names.

[0252] Typically, the terminal 1400 includes a processor 1401 and a memory 1402 .

[0253] The processor 1401 may include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 1401 may be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). The processor 1401 may also include a main processor and a coprocessor. The main processor is a processor for processing data in the awake state, also known as a CPU (Central Processing Unit); the coprocessor is a low-power processor for processing data in the standby state. In some embodiments, the processor 1401 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 1401 may also include an AI (Artificial Intelligence) processor, which is used to process computing operations related to machine learning.

[0254] The memory 1402 may include one or more computer-readable storage media, which may be non-transitory. The memory 1402 may also include a high-speed random access memory, and a non-volatile memory, such as one or more disk storage devices, flash memory storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 1402 is used to store at least one program code, which is used to be executed by the processor 1401 to implement the message sending method provided in the method embodiment of the present disclosure.

[0255] In some embodiments, the terminal 1400 may further optionally include: a peripheral device interface 1403 and at least one peripheral device. The processor 1401, the memory 1402 and the peripheral device interface 1403 may be connected via a bus or a signal line. Each peripheral device may be connected to the peripheral device interface 1403 via a bus, a signal line or a circuit board. Specifically, the peripheral device includes: at least one of a radio frequency circuit 1404, a display screen 1405, a camera assembly 1406, an audio circuit 1407 and a power supply 1408.

[0256] The peripheral device interface 1403 may be used to connect at least one peripheral device related to I / O (Input / Output) to the processor 1401 and the memory 1402. In some embodiments, the processor 1401, the memory 1402, and the peripheral device interface 1403 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 1401, the memory 1402, and the peripheral device interface 1403 may be implemented on a separate chip or circuit board, which is not limited in this embodiment.

[0257] The radio frequency circuit 1404 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The radio frequency circuit 1404 communicates with the communication network and other communication devices through electromagnetic signals. The radio frequency circuit 1404 converts the electrical signal into an electromagnetic signal for transmission, or converts the received electromagnetic signal into an electrical signal. Optionally, the radio frequency circuit 1404 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, and the like. The radio frequency circuit 1404 can communicate with other terminals through at least one wireless communication protocol. The wireless communication protocol includes, but is not limited to: a metropolitan area network, various generations of mobile communication networks (2G, 3G, 4G and 5G), a wireless local area network and / or a WiFi (Wireless Fidelity) network. In some embodiments, the radio frequency circuit 1404 may also include circuits related to NFC (Near Field Communication), which is not limited in the present disclosure.

[0258] The display screen 1405 is used to display a UI (User Interface). The UI may include graphics, text, icons, videos, and any combination thereof. When the display screen 1405 is a touch display screen, the display screen 1405 also has the ability to collect touch signals on the surface or above the surface of the display screen 1405. The touch signal can be input as a control signal to the processor 1401 for processing. At this time, the display screen 1405 can also be used to provide virtual buttons and / or virtual keyboards, also known as soft buttons and / or soft keyboards. In some embodiments, the display screen 1405 can be one, and the front panel of the terminal 1400 is set; in other embodiments, the display screen 1405 can be at least two, which are respectively set on different surfaces of the terminal 1400 or are folded; in some other embodiments, the display screen 1405 can be a flexible display screen, which is set on the curved surface or folded surface of the terminal 1400. Even, the display screen 1405 can also be set as a non-rectangular irregular figure, that is, a special-shaped screen. The display screen 1405 can be made of materials such as LCD (Liquid Crystal Display) and OLED (Organic Light-Emitting Diode).

[0259] The camera component 1406 is used to capture images or videos. Optionally, the camera component 1406 includes a front camera and a rear camera. Usually, the front camera is set on the front panel of the terminal, and the rear camera is set on the back of the terminal. In some embodiments, there are at least two rear cameras, which are any one of a main camera, a depth of field camera, a wide-angle camera, and a telephoto camera, so as to realize the fusion of the main camera and the depth of field camera to realize the background blur function, the fusion of the main camera and the wide-angle camera to realize panoramic shooting and VR (Virtual Reality) shooting function or other fusion shooting functions. In some embodiments, the camera component 1406 may also include a flash. The flash can be a monochrome temperature flash or a dual-color temperature flash. A dual-color temperature flash refers to a combination of a warm light flash and a cold light flash, which can be used for light compensation at different color temperatures.

[0260] The audio circuit 1407 may include a microphone and a speaker. The microphone is used to collect sound waves from the user and the environment, and convert the sound waves into electrical signals and input them into the processor 1401 for processing, or input them into the radio frequency circuit 1404 to achieve voice communication. For the purpose of stereo acquisition or noise reduction, there may be multiple microphones, which are respectively arranged at different parts of the terminal 1400. The microphone may also be an array microphone or an omnidirectional acquisition microphone. The speaker is used to convert the electrical signal from the processor 1401 or the radio frequency circuit 1404 into sound waves. The speaker may be a traditional film speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can not only convert the electrical signal into sound waves audible to humans, but also convert the electrical signal into sound waves inaudible to humans for purposes such as ranging. In some embodiments, the audio circuit 1407 may also include a headphone jack.

[0261] The power supply 1408 is used to power various components in the terminal 1400. The power supply 1408 can be an alternating current, a direct current, a disposable battery, or a rechargeable battery. When the power supply 1408 includes a rechargeable battery, the rechargeable battery can support wired charging or wireless charging. The rechargeable battery can also be used to support fast charging technology.

[0262] Those skilled in the art will understand that Fig.14 The structure shown in the figure does not constitute a limitation on the terminal 1400, and the terminal 1400 may include more or less components than those shown in the figure, or combine some components, or adopt a different component arrangement.

[0263] In an exemplary embodiment, a computer-readable storage medium including instructions is also provided, such as a memory including instructions, and the instructions can be executed by a processor of a terminal to complete the message sending method. Optionally, the computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0264] In an exemplary embodiment, a computer program product is also provided, including a computer program, which implements the above-mentioned message sending method when executed by a processor. In some embodiments, the computer program product involved in the embodiments of the present disclosure can be deployed on a terminal for execution, or on multiple terminals located at one location, or on multiple terminals distributed at multiple locations and interconnected by a communication network. Multiple terminals distributed at multiple locations and interconnected by a communication network can constitute a blockchain system.

[0265] Those skilled in the art will readily conceive of other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. The present disclosure is intended to cover any variations, uses or adaptations of the present disclosure, which follow the general principles of the present disclosure and include common knowledge or customary technical means in the art that are not disclosed in the present disclosure. The specification and embodiments are to be regarded as exemplary only, and the true scope and spirit of the present disclosure are indicated by the claims. All of the above optional technical solutions can be combined in any way to form optional embodiments of the present application, which will not be described one by one here.

[0266] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A message sending method, characterized in that: The method comprises: Displaying a conversation interface between the first object and the second object; Displaying a voice input panel, wherein the voice input panel includes a voice collection control and a resource generation control; In response to the voice collection control being triggered, acquiring a voice message; In response to the triggering operation from the voice collection control to the triggering operation of the resource generation control, generating a multimedia resource corresponding to the voice message, the multimedia resource including at least one of a picture and a video; In response to a sending operation on the multimedia resource, sending the multimedia resource to the second object; When the multimedia resource includes a facial image, displaying a face replacement control in an associated area of ​​the conversation message where the multimedia resource is located; In response to a triggering operation on the face replacement control, displaying a plurality of candidate images; In response to a selection operation on any candidate image, the facial image in the multimedia resource is replaced with the facial image in the candidate image.

2. The message sending method according to claim 1, characterized in that: The resource generation control includes at least one of a picture generation control and a video generation control; the response from the trigger operation on the voice acquisition control to the trigger operation on the resource generation control to generate the multimedia resource corresponding to the voice message includes at least one of the following: In response to a drag operation from the voice collection control to the picture generation control, generating a picture corresponding to the voice message; In response to a drag operation from the voice collection control to the video generation control, a video corresponding to the voice message is generated.

3. The message sending method according to claim 1, characterized in that: The method further comprises: In response to the triggering operation from the voice collection control to the resource generation control, resource prompt information is displayed, where the resource prompt information is used to prompt the type of multimedia resources to be generated.

4. The message sending method according to claim 1, characterized in that: Before sending the multimedia resource to the second object in response to the sending operation of the multimedia resource, the method further includes: Displaying the multimedia resource on the voice input panel, and playing the multimedia resource in response to a triggering operation on the multimedia resource; Alternatively, the multimedia resource is displayed on the voice input panel, and in response to a triggering operation on the multimedia resource, the multimedia resource and the voice message are played.

5. The message sending method according to claim 4, characterized in that: The method further comprises at least one of the following: In response to the regeneration operation of the displayed multimedia resource, regenerate the multimedia resource corresponding to the voice message, the regenerated multimedia resource being different from the multimedia resource; In response to a replacement operation on the displayed multimedia resource, a plurality of candidate multimedia resources are displayed, and in response to a selection operation on any candidate multimedia resource, the multimedia resource is replaced with the any candidate multimedia resource.

6. The message sending method according to claim 1, characterized in that: The method further comprises: In response to the sending operation on the multimedia resource, the voice message is sent to the second object.

7. The message sending method according to claim 1, characterized in that: There are multiple multimedia resources generated. Before sending the multimedia resources to the second object in response to the sending operation of the multimedia resources, the method further includes: Displaying multiple multimedia resources corresponding to the voice message; The sending of the multimedia resource to the second object in response to the sending operation of the multimedia resource comprises: In response to a sending operation on any multimedia resource among the multiple multimedia resources, the any multimedia resource is sent to the second object.

8. The message sending method according to claim 1, characterized in that: The method further comprises: In response to a triggering operation on any historical voice message on the conversation interface, displaying at least one function control of any historical voice message, wherein the at least one function control includes a resource generation control; In response to a triggering operation on the resource generation control, a first multimedia resource is generated, and the first multimedia resource is displayed on the conversation interface, wherein the first multimedia resource corresponds to any one of the historical voice messages.

9. The message sending method according to claim 1, characterized in that: The method further comprises: Displaying, on the session interface, a resource generation control for at least one historical voice message on the session interface; In response to a triggering operation of a resource generation control of any one of the at least one historical voice message, a second multimedia resource is generated and displayed on the session interface, wherein the second multimedia resource corresponds to any one of the historical voice messages.

10. The message sending method according to claim 8 or 9, characterized in that: The method further comprises at least one of the following: In response to a sending operation on any multimedia resource displayed on the session interface, sending the any multimedia resource to the second object; In response to a forwarding operation on any multimedia resource displayed on the session interface, the any multimedia resource is sent to a third object.

11. A message sending device, characterized in that: The device comprises: A display unit, configured to display a conversation interface between the first object and the second object; The display unit is further configured to execute display of a voice input panel, wherein the voice input panel includes a voice collection control and a resource generation control; An acquisition unit, configured to acquire a voice message in response to the voice acquisition control being triggered; A generating unit, configured to generate a multimedia resource corresponding to the voice message in response to a trigger operation on the voice collection control and a trigger operation on the resource generation control, wherein the multimedia resource includes at least one of a picture and a video; a sending unit, configured to execute, in response to a sending operation on the multimedia resource, sending the multimedia resource to the second object; The display unit is further configured to execute: When the multimedia resource includes a facial image, displaying a face replacement control in an associated area of ​​the conversation message where the multimedia resource is located; In response to a triggering operation on the face replacement control, displaying a plurality of candidate images; In response to a selection operation on any candidate image, the facial image in the multimedia resource is replaced with the facial image in the candidate image.

12. A terminal, characterized in that: include: processor; a memory for storing instructions executable by the processor; The processor is configured to execute the instructions to implement the message sending method according to any one of claims 1 to 10.

13. A computer-readable storage medium, characterized in that: When the instructions in the computer-readable storage medium are executed by a processor of a terminal, the terminal is enabled to execute the message sending method according to any one of claims 1 to 10.

14. A computer program product, characterized in that The computer program product comprises a computer program, and when the computer program is executed by a processor, the message sending method according to any one of claims 1 to 10 is implemented.

Images