Message merging method and device, equipment, storage medium and product

Abstract

The invention discloses a message merging method and device, equipment, a storage medium and a product, and belongs to the field of artificial intelligence. The method comprises the following steps: displaying n multimedia messages in a chat window, wherein n is a positive integer; receiving the (n + 1) th multimedia message; in response to the fact that the n + 1 multimedia messages meet the merging display condition, the n + 1 multimedia messages are merged and displayed into a merged message, and the message content of the merged message is obtained based on merging of the n + 1 multimedia messages; wherein the n + 1 multimedia messages comprise the n multimedia messages and the (n + 1) th multimedia message. According to the method, the n + 1 multimedia messages meeting the combined display condition in the chat window are combined and displayed into one combined message, so that the n + 1 multimedia messages meeting the combined display condition can be displayed in the chat window in the form of one combined message, and the space utilization rate of the chat window is improved; and thus, the message viewing efficiency of the user is improved.

Description

Technical Field

[0001] The present application relates to the field of artificial intelligence, and in particular to a message merging method, device, equipment, storage medium and product. Background Art

[0002] With the explosive development of Internet technology, online social networking has gradually become the main way for the general public to socialize.

[0003] In the related art, users realize online one-to-one communication or one-to-many communication through an application supporting chat dialogue. For example, users carry out online chat dialogue by sending multimedia messages in a chat window in an application supporting chat dialogue.

[0004] However, when users communicate in a chat window, they may send a large number of identical or similar multimedia messages, such as sending multiple identical emoticons to express the same emotion. These large numbers of identical or similar multimedia messages will overlap in the chat window at a high frequency, making it difficult for users who need to query other information to quickly locate useful information. Summary of the invention

[0005] The present application provides a message merging method, apparatus, device, storage medium and product, and the technical solution is as follows:

[0006] According to one aspect of the present application, a message merging method is provided, the method being executed by a chat client, the method comprising:

[0007] Display n multimedia messages in the chat window, where n is a positive integer;

[0008] Receive the n+1th multimedia message;

[0009] In response to n+1 multimedia messages satisfying a merge display condition, the n+1 multimedia messages are merged and displayed as a merged message, wherein the message content of the merged message is obtained by merging the n+1 multimedia messages;

[0010] The n+1 multimedia messages include the n multimedia messages and the n+1th multimedia message.

[0011] According to another aspect of the present application, a message merging method is provided, the method being executed by a server, the method comprising:

[0012] Receive n+1 multimedia messages, where n is a positive integer;

[0013] In the case where the n+1 multimedia messages meet the merge display condition, the n+1 multimedia messages are merged into one merged message, the message content of the merged message is obtained based on the merging of the n+1 multimedia messages;

[0014] The merged message is sent to the chat client.

[0015] According to another aspect of the present application, a message merging device is provided, the device comprising:

[0016] A display module, used for displaying n multimedia messages in the chat window, where n is a positive integer;

[0017] A receiving module, used for receiving the (n+1)th multimedia message;

[0018] The display module is further configured to, in response to n+1 multimedia messages satisfying a merge display condition, merge and display the n+1 multimedia messages into one merged message, wherein the message content of the merged message is obtained by merging the n+1 multimedia messages;

[0019] The n+1 multimedia messages include the n multimedia messages and the n+1th multimedia message.

[0020] According to another aspect of the present application, a message merging device is provided, the device comprising:

[0021] A receiving module, used for receiving n+1 multimedia messages, where n is a positive integer;

[0022] a merging module, configured to merge the n+1 multimedia messages into one merged message if the n+1 multimedia messages meet a merge display condition, wherein the message content of the merged message is obtained by merging the n+1 multimedia messages;

[0023] The sending module is used to send the merged message to the chat client.

[0024] According to another aspect of the present application, a computer device is provided, comprising: a processor and a memory, wherein at least one program is stored in the memory, and the at least one program is loaded and executed by the processor to implement the message merging method described above.

[0025] According to another aspect of the present application, a computer-readable storage medium is provided, in which at least one program is stored. The at least one program is loaded and executed by a processor to implement the message merging method described above.

[0026] According to another aspect of the present application, a computer program product is provided, which includes at least one program segment, and the at least one program segment is stored in a computer-readable storage medium; a processor of a computer device reads the at least one program segment from the computer-readable storage medium, and the processor executes the at least one program segment, so that the computer device executes the message merging method described above.

[0027] The beneficial effects of the technical solution provided by this application include at least:

[0028] In response to n+1 multimedia messages satisfying the merged display conditions, the n+1 multimedia messages are merged and displayed as one merged message, so that at most n multimedia messages satisfying the merged display conditions are displayed in the chat window; when the number of multimedia messages satisfying the merged display conditions reaches n+1, only one merged message is displayed in the chat window; by merging and displaying them as one merged message, the space utilization of the chat window is improved, and it can help improve the efficiency of users viewing messages. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0030] Figure 1 is a structural block diagram of a computer system provided by an exemplary embodiment of the present application;

[0031] Figure 2 is a flowchart of a message merging method provided by an exemplary embodiment of the present application;

[0032] Figure 3 is a flowchart of a message merging method provided by an exemplary embodiment of the present application;

[0033] Figure 4 is a schematic diagram of a chat window provided by an exemplary embodiment of the present application;

[0034] Figure 5 is a schematic diagram of a chat window provided by an exemplary embodiment of the present application;

[0035] Figure 6 is a schematic diagram of a chat window provided by an exemplary embodiment of the present application;

[0036] Figure 7 is a schematic diagram of a chat window provided by an exemplary embodiment of the present application;

[0037] Figure 8 is a flowchart of a message merging method provided by an exemplary embodiment of the present application;

[0038] Fig. 9 is a flowchart of a message merging method provided by an exemplary embodiment of the present application;

[0039] Fig.10 is a flowchart of a message merging method provided by an exemplary embodiment of the present application;

[0040] Fig.11 is a flowchart of a message merging method provided by an exemplary embodiment of the present application;

[0041] Fig.12 is a schematic diagram of a chat window provided by an exemplary embodiment of the present application;

[0042] Fig.13 is a schematic diagram of a chat window provided by an exemplary embodiment of the present application;

[0043] Fig.14 is a schematic diagram of a chat window provided by an exemplary embodiment of the present application;

[0044] Fig.15 is a flowchart of a message merging method provided by an exemplary embodiment of the present application;

[0045] Fig.16 is a schematic diagram of a chat window provided by an exemplary embodiment of the present application;

[0046] Fig.17 is a flowchart of a message merging method provided by an exemplary embodiment of the present application;

[0047] Fig.18 is a schematic diagram of a settings page provided by an exemplary embodiment of the present application;

[0048] Fig.19 is a flowchart of a message merging method provided by an exemplary embodiment of the present application;

[0049] Fig. 20 is a schematic diagram of a chat window provided by an exemplary embodiment of the present application;

[0050] Fig.21 is a flowchart of a message merging method provided by an exemplary embodiment of the present application;

[0051] Fig. 22 is a schematic diagram of a chat window provided by an exemplary embodiment of the present application;

[0052] Fig.23is a flowchart of a message merging method provided by an exemplary embodiment of the present application;

[0053] Fig.24 is a schematic diagram of a chat window provided by an exemplary embodiment of the present application;

[0054] Fig.25 is a flowchart of a message merging method provided by an exemplary embodiment of the present application;

[0055] Fig.26 is a schematic diagram of a chat window provided by an exemplary embodiment of the present application;

[0056] Fig. 27 is a flowchart of a message merging method provided by an exemplary embodiment of the present application;

[0057] Fig.28 is a flowchart of a message merging method provided by an exemplary embodiment of the present application;

[0058] Fig.29 is a flowchart of a message merging method provided by an exemplary embodiment of the present application;

[0059] Fig.30 is a flowchart of a message merging method provided by an exemplary embodiment of the present application;

[0060] Fig.31 is a flowchart of a message merging method provided by an exemplary embodiment of the present application;

[0061] Fig.32 is a flowchart of a message merging method provided by an exemplary embodiment of the present application;

[0062] Fig.33 is a flowchart of a message merging method provided by an exemplary embodiment of the present application;

[0063] Fig.34 is a flowchart of a message merging method provided by an exemplary embodiment of the present application;

[0064] Fig.35 is a flowchart of a message merging method provided by an exemplary embodiment of the present application;

[0065] Fig.36 is a flowchart of a message merging method provided by an exemplary embodiment of the present application;

[0066] Fig.37 is a flowchart of a message merging method provided by an exemplary embodiment of the present application;

[0067] Fig.38is a flowchart of a message merging method provided by an exemplary embodiment of the present application;

[0068] Fig.39 is a flowchart of a message merging method provided by an exemplary embodiment of the present application;

[0069] Fig.40 is a flowchart of a message merging method provided by an exemplary embodiment of the present application;

[0070] Fig.41 is a schematic diagram of a chat window provided by an exemplary embodiment of the present application;

[0071] Fig.42 is a flowchart of a message merging method provided by an exemplary embodiment of the present application;

[0072] Fig.43 is a flowchart of a message merging method provided by an exemplary embodiment of the present application;

[0073] Fig.44 is a flow chart of a generation algorithm model provided by an exemplary embodiment of the present application;

[0074] Fig.45 is a block diagram of a message merging device provided by an exemplary embodiment of the present application;

[0075] Fig.46 is a block diagram of a message merging device provided by an exemplary embodiment of the present application;

[0076] Fig.47 is a block diagram of a computer device provided by an exemplary embodiment of the present application. DETAILED DESCRIPTION

[0077] In order to make the objectives, technical solutions and advantages of the present application clearer, the implementation methods of the present application will be further described in detail below with reference to the accompanying drawings.

[0078] First, the nouns involved in the embodiments of the present application are briefly introduced:

[0079] Artificial Intelligence (AI) is the theory, method, technology and application system that uses digital computers or machines controlled by digital computers to simulate, extend and expand human intelligence, perceive the environment, acquire knowledge and use knowledge to obtain the best results. In other words, artificial intelligence is a comprehensive technology in computer science that attempts to understand the essence of intelligence and produce a new intelligent machine that can respond in a similar way to human intelligence. Artificial intelligence is to study the design principles and implementation methods of various intelligent machines so that machines have the functions of perception, reasoning and decision-making. Artificial intelligence technology is a comprehensive discipline that covers a wide range of fields, including both hardware-level technology and software-level technology. The basic technologies of artificial intelligence generally include sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, big data processing technology, pre-trained model technology, operation / interaction system, mechatronics, etc. Among them, the pre-trained model is also called a large model or a basic model. After fine-tuning, it can be widely used in downstream tasks in various major directions of artificial intelligence. Artificial intelligence software technology mainly includes computer vision technology, speech processing technology, natural language processing technology, and machine learning / deep learning.

[0080] Figure 1 The structure block diagram of a computer system 100 provided by an exemplary embodiment of the present application is shown. The computer system 100 includes: a terminal 120 and a server 140 .

[0081] The terminal 120 is installed and runs an application or web page that supports chat conversations. The application that supports chat conversations interacts with the user account through the chat page. The user account implements online chat by sending multimedia messages on the chat page, and the multimedia messages include at least one of text messages, picture messages, voice messages, emoticon messages, voice emoticon messages, and video messages. In some embodiments, the application that supports chat conversations is an application that can provide a chat function. Optionally, the application that supports chat conversations is an application that only provides a chat function. For example, the application that supports chat conversations is an instant messaging application. Optionally, the application that supports chat conversations is a client that provides at least two functions, at least two of which include a chat function. For example, the application that supports chat conversations is a game program.

[0082] The terminal 120 is connected to the server 140 via a wireless network or a wired network.

[0083] The server 140 includes at least one of a single server, multiple servers, a cloud computing platform, and a virtualization center. Exemplarily, the server 140 includes a memory 142 and a processor 144, and the memory 142 further includes a receiving module 1421, a display module 1422, and a sending module 1423. The receiving module 1421 is used to receive a request sent by a terminal; the display module 1422 is used to display the program page of the application; and the sending module 1423 is used to send a response to the terminal. The server 140 is used to provide background services for applications that support chat conversations. Optionally, the server 140 undertakes the main computing work and the terminal 120 undertakes the secondary computing work; or, the server 140 undertakes the secondary computing work and the terminal 120 undertakes the main computing work; or, the server 140 and the terminal 120 undertake the computing work in a collaborative manner.

[0084] In some embodiments, an AI model for merging multimedia messages is run in the server. For example, an AI model for merging emoticon messages. After receiving an emoticon message that meets the merge display condition, the server merges the emoticon messages that meet the merge display condition through the AI ​​model for merging emoticon messages to obtain a merged message. The server sends the merged message to the terminal for display.

[0085] Optionally, the device type of the terminal 120 includes at least one of a smart phone, a smart watch, a vehicle-mounted terminal, a wearable device, a smart TV, a tablet computer, an e-book reader, an MP3 player, an MP4 player, a laptop computer, and a desktop computer. The following embodiments are described by taking the terminal including a smart phone as an example.

[0086] Those skilled in the art will appreciate that the number of the above terminals may be more or less. For example, the above terminal may be only one, or the above terminals may be dozens or hundreds, or more. The embodiment of the present application does not limit the number of terminals and device types.

[0087] User accounts enable online one-to-one communication, or one-to-many communication, through applications that support chat conversations. For example, Figure 2 As shown, an application supporting chat dialogue is installed in the terminal 120, and the user account conducts an online chat dialogue by sending multimedia messages in a chat window 11 in the application supporting chat dialogue.

[0088] However, a user account may send a large number of identical or similar multimedia messages when communicating in the chat window 11, such as a user account sending multiple identical emoticons to express the same emotion. The high frequency of covering these identical or similar multimedia messages in the chat window 11 will make it impossible for the user account to query the useful information in the chat window 11 as soon as possible, so these identical or similar multimedia messages will interfere with some user accounts.

[0089] In response to the above problems, a message merging method is provided in an embodiment of the present application, which can effectively solve the problem of high-frequency coverage of a large number of identical or similar multimedia messages in the chat window, so that user accounts that need to send the same or similar multimedia messages can continue to send them, and at the same time these identical or similar multimedia messages will not affect other user accounts.

[0090] In some embodiments, the message merging method provided in the embodiment of the present application is executed by the terminal. In some embodiments, the message merging method provided in the embodiment of the present application is executed by the server. In some embodiments, the message merging method provided in the embodiment of the present application is executed by the terminal and the server in collaboration. Figure 1 The terminal 120 shown is used as an example for explanation.

[0091] In some embodiments, the chat window 11 displays at least one multimedia message sent by at least one user account. For example, the chat window 11 displays a first multimedia message 12 sent by user account 1, a second multimedia message 13 sent by user account 2, and more multimedia messages sent by more user accounts. Optionally, the same user account can repeatedly send multiple identical multimedia messages. Optionally, the same user account can send multiple different multimedia messages. Optionally, different user accounts can send multiple identical multimedia messages. Optionally, different user accounts can send multiple different multimedia messages.

[0092] For example, Figure 2 As shown, there are 4 multimedia messages displayed in the chat window 11, and the 4 multimedia messages belong to the same multimedia message, that is, the first multimedia message 12 sent by user account 1, the second multimedia message 13 sent by user account 2, the third multimedia message 14 sent by user account 3, and the fourth multimedia message 15 sent by user account 4 are the same multimedia message. Then, when the user account 5 sends a fifth multimedia message that is the same as the first multimedia message 12, the second multimedia message 13, the third multimedia message 14, and the fourth multimedia message 15, a merged message 16 is displayed in the chat window 11. The merged message 16 is obtained by merging the first multimedia message 12, the second multimedia message 13, the third multimedia message 14, the fourth multimedia message 15, and the fifth multimedia message.

[0093] Figure 3 is a flowchart of a message merging method provided by an exemplary embodiment of the present application. Figure 1 The terminal 120 in the computer system 100 shown executes, including:

[0094] Step 220: Display n multimedia messages in the chat window;

[0095] Display n multimedia messages in a chat window of a chat client. The chat client is a client capable of providing a chat function. Optionally, the chat client is a client that only provides a chat function. For example, the chat client is an instant messaging client. Optionally, the chat client is a client that provides at least two functions, at least two of which include a chat function. For example, the chat client is a game client.

[0096] The multimedia message includes at least one of a text message, a picture message, a voice message, an emoticon message, a voice emoticon message, and a video message.

[0097] Optionally, each of the n multimedia messages corresponds to the same user account. Optionally, each of the n multimedia messages corresponds to a different user account. Optionally, some of the n multimedia messages correspond to the same user account, and some correspond to different user accounts.

[0098] For example, Figure 4 As shown, four multimedia messages are displayed in the chat window 11, namely a first multimedia message 12 sent by user account 1, a second multimedia message 13 sent by user account 2, a third multimedia message 14 sent by user account 3 and a fourth multimedia message 15 sent by user account 4.

[0099] Step 240: receiving the (n+1)th multimedia message;

[0100] In some embodiments, the chat client only receives the n+1th multimedia message. It should be understood that in the embodiments of the present application, the chat client only receives but does not display the n+1th multimedia message. Optionally, the user account that sends the n+1th multimedia message is a user account in at least one user account corresponding to the n multimedia messages. Optionally, the user account that sends the n+1th multimedia message is not a user account in at least one user account corresponding to the n multimedia messages.

[0101] In some embodiments, the chat client receives and displays the (n+1)th multimedia message.

[0102] Step 260: In response to the n+1 multimedia messages satisfying the merged display condition, the n+1 multimedia messages are merged and displayed as one merged message.

[0103] In some embodiments, the merged display condition is a triggering condition for triggering the merging and displaying of n+1 multimedia messages into one merged message.

[0104] Optionally, the merge display condition is preset. Exemplarily, the merge display condition preset in advance is: receiving 5 identical multimedia messages. Then, when the fifth identical multimedia message is received, it is triggered to merge the n+1 multimedia messages into one merged message.

[0105] Optionally, the merged display condition is dynamically adjusted. In some embodiments, the merged display condition is dynamically adjusted based on the display situation of the chat client. The display situation includes at least one of the display size of the chat window and the number of online people. In some embodiments, the merged display condition is adjusted based on the display size of the chat window, and the display size of the chat window is proportional to the number of multimedia messages displayed in the chat window. Exemplarily, the larger the display size of the chat window, the more multimedia messages are displayed in the chat window; the smaller the display size of the chat window, the fewer multimedia messages are displayed in the chat window. Exemplarily, when the display size of the chat window is display size 1, the merged display condition is merged display condition 1; when the display size of the chat window is display size 2, the merged display condition is merged display condition 2. In some embodiments, the merged display condition is adjusted based on the number of online people in the chat window.

[0106] In some embodiments, in response to n+1 multimedia messages satisfying a merged display condition, the n multimedia messages are canceled from being displayed, and the n+1 multimedia messages are merged and displayed as one merged message.

[0107] In some embodiments, the message content of the merged message is obtained by merging n+1 multimedia messages, wherein the n+1 multimedia messages include n multimedia messages and the n+1th multimedia message.

[0108] In some embodiments, the visual content of the merged message is obtained by merging the visual contents of n+1 multimedia messages. Exemplarily, n+1 multimedia messages correspond to n+1 visual contents, and the visual content of the merged message is a visual content obtained by merging the n+1 visual contents. Optionally, the visual content includes at least one of text content, picture content, and decorative content.

[0109] In some embodiments, the voice content of the merged message is obtained by merging the voice contents of n+1 multimedia messages. Exemplarily, n+1 multimedia messages correspond to n+1 voice contents, and the voice content of the merged message is a voice content obtained by merging the n+1 voice contents.

[0110] In some embodiments, the message content of the merged message includes a common portion and a group portion.

[0111] The common part is obtained by merging at least one identical content in n+1 multimedia messages. For example, assuming that n+1 multimedia messages include identical text content, the common part is obtained by merging the identical text content in n+1 multimedia messages. Figure 2 As shown, the first multimedia message 12 sent by user account 1, the second multimedia message 13 sent by user account 2, the third multimedia message 14 sent by user account 3 and the fourth multimedia message 15 sent by user account 4 include the same text content "Congratulations on your prosperity". Then the same text content in the first multimedia message 12 sent by user account 1, the second multimedia message 13 sent by user account 2, the third multimedia message 14 sent by user account 3 and the fourth multimedia message 15 sent by user account 4 are merged to obtain the common part "Congratulations on your prosperity".

[0112] Optionally, the common part is obtained by merging some of the same contents in n+1 multimedia messages. Optionally, the common part is obtained by merging all the same contents in n+1 multimedia messages.

[0113] The group part is obtained by rearranging the individual contents in n+1 multimedia messages into n+1 individual contents representing the group. Figure 2 As shown, the first multimedia message 12 sent by user account 1 includes an individual expression avatar, the second multimedia message 13 sent by user account 2 includes an individual expression avatar, the third multimedia message 14 sent by user account 3 includes an individual expression avatar, and the fourth multimedia message 15 sent by user account 4 includes an individual expression avatar, then the multiple individual expression avatars are merged to obtain a group part including multiple individual expression avatars.

[0114] In some embodiments, the message content of the merged message also includes a background atmosphere part. The background atmosphere part is the message content that is added as the background atmosphere of the n+1 individual contents in addition to the message content of the n+1 multimedia messages. It should be understood that when the message content of the n+1 multimedia messages includes the background atmosphere content, the background atmosphere content can be used as a common part or a group part. For example, Figure 5 As shown, a red envelope background 19 is dynamically displayed in the chat window, and the red envelope background 19 is the background atmosphere content outside the message content of the n+1 multimedia messages.

[0115] In some embodiments, the additionally added message content as the background atmosphere of the n+1 individual contents is randomly generated based on the background atmosphere generation model. The background atmosphere generation model is obtained by training with a sample training set, and the sample training set includes sample background atmosphere content. The model parameters in the background atmosphere generation model are trained with the sample training set, and after multiple trainings, for example, after 10,000 sample trainings or when the model converges, a trained background atmosphere generation model capable of generating background atmosphere content is obtained.

[0116] In some embodiments, the display elements in the merged message include at least one of the following:

[0117] The apparent size of the merged message;

[0118] Merge numbers in messages;

[0119] The number of individual contents in the merged message;

[0120] The number of decorations in the merged message;

[0121] Merge the decoration level in the message;

[0122] The presentation method of n+1 individual contents used to represent the group in the merged message.

[0123] In some embodiments, the display elements in the merged message are related to the number of n+1 multimedia messages.

[0124] Optionally, the apparent size of the merged message is related to the number of n+1 multimedia messages. For example, Figure 6 As shown, the appearance size of the merged message is proportional to the number of n+1 multimedia messages. The more n+1 multimedia messages there are, the larger the appearance size of the merged message is. For example, when the number of n+1 multimedia messages is 5, the appearance size of the merged message is a first appearance size of 17; when the number of n+1 multimedia messages is 7, the appearance size of the merged message is a second appearance size of 18.

[0125] Optionally, the number in the merged message is related to the number of n+1 multimedia messages. Exemplarily, assuming that the multimedia messages that meet the merged display conditions include 5 multimedia messages including mountains, information related to the "Five Mountains" is displayed in the merged message, and "five" corresponds to "5". In some embodiments, the number in the merged message is used to represent the number of n+1 multimedia messages, and the number in the merged message is proportional to the number of n+1 multimedia messages. Optionally, the size of the number in the merged message is related to the number of n+1 multimedia messages. Optionally, the text in the merged message is related to the number of n+1 multimedia messages. Optionally, the size of the text in the merged message is related to the number of n+1 multimedia messages. Exemplarily, the size of the text in the merged message is proportional to the number of n+1 multimedia messages, and the more n+1 multimedia messages there are, the larger the text size in the merged message.

[0126] Optionally, the number of individual contents in the merged message is related to the number of n+1 multimedia messages. Exemplarily, the number of individual contents in the merged message is proportional to the number of n+1 multimedia messages. The more n+1 multimedia messages there are, the more individual contents there are in the merged message. Exemplarily, Figure 6 As shown, in the case where each multimedia message includes an individual expression avatar, the more multimedia messages there are, the more individual contents in the merged message there are. For example, in the case where 5 multimedia messages are included, the merged message includes five individual expression avatars; in the case where 7 multimedia messages are included, the merged message includes seven individual expression avatars.

[0127] Optionally, the number of decorations in the merged message is related to the number of n+1 multimedia messages. Exemplarily, the number of decorations in the merged message is proportional to the number of n+1 multimedia messages. The more n+1 multimedia messages there are, the more decorations there are in the merged message. Exemplarily, Figure 5 As shown, the more multimedia messages there are, the more red envelope decorations there are in the red envelope background 19.

[0128] Optionally, the decoration level in the merged message is related to the number of n+1 multimedia messages. Exemplarily, the decoration level in the merged message is proportional to the number of n+1 multimedia messages, and the more n+1 multimedia messages there are, the higher the decoration level in the merged message.

[0129] Optionally, the presentation mode of n+1 individual contents representing the group in the merged message is related to the number of n+1 multimedia messages. Figure 7As shown, when the number of n+1 multimedia messages is 5, the presentation method of the n+1 individual contents representing the group in the merged message is the first presentation method 21; when the number of n+1 multimedia messages is 11, the presentation method of the n+1 individual contents representing the group in the merged message is the first presentation method 22.

[0130] In some embodiments, the merged message is generated by an AI model. The AI ​​model is pre-trained through a sample training set, and the sample training set includes a sample message. The model parameters in the AI ​​model are trained through the sample training set, and after multiple trainings, for example, after 10,000 sample trainings or when the model converges, a trained AI model capable of generating a merged message is obtained.

[0131] In some embodiments, the AI ​​model includes a synthesis strength parameter, which includes a synthesis strength parameter value, and the synthesis strength parameter value is used to indicate the degree of change of the merged message relative to the n+1 multimedia messages. The larger the synthesis strength parameter value, the greater the degree of change of the merged message relative to the n+1 multimedia messages. That is, the larger the synthesis strength parameter value, the more other elements are added to the merged message.

[0132] In some embodiments, the display element in the merged message is related to a synthesis strength parameter of the AI ​​model.

[0133] To summarize, the method provided in the embodiment of the present application, in response to n+1 multimedia messages satisfying the merged display conditions, merges and displays n+1 multimedia messages into one merged message, so that at most n multimedia messages satisfying the merged display conditions are displayed in the chat window; when the number of multimedia messages satisfying the merged display conditions reaches n+1, only one merged message is displayed in the chat window; by merging and displaying them into one merged message, the space utilization of the chat window is improved, and it can help improve the efficiency of users viewing messages.

[0134] In some embodiments, the above-mentioned combined display condition for triggering the combination and display of n+1 multimedia messages into one combined message includes: the number of n+1 multimedia messages reaches a number threshold and satisfies a continuous message condition. Figure 8 As shown, the above step 260 can be replaced by the following sub-steps:

[0135] Step 261: In response to the number of n+1 multimedia messages reaching a number threshold and satisfying a continuous message condition, the n+1 multimedia messages are combined and displayed as one combined message.

[0136] In some embodiments, the quantity threshold is a trigger condition for triggering the merging and displaying of n+1 multimedia messages into one merged message.

[0137] Optionally, the quantity threshold is preset. Exemplarily, the quantity threshold preset in advance is: 5 multimedia messages. Then, when the 5th multimedia message is received, it is triggered to merge n+1 multimedia messages into one merged message.

[0138] Optionally, the quantity threshold is dynamically adjusted. In some embodiments, the quantity threshold is dynamically adjusted based on the display size of the chat window in the chat client. Exemplarily, when the display size of the chat window is 30*50, the quantity threshold is: 4 multimedia messages; when the display size of the chat window is 50*80, the quantity threshold is: 5 multimedia messages.

[0139] In some embodiments, the continuous message condition means that the sending time interval between two adjacent multimedia messages is less than a first threshold, and the number of other messages between the two adjacent multimedia messages is less than a second threshold.

[0140] In some embodiments, the first threshold is a time threshold for indicating the time interval between two adjacent multimedia messages. Exemplarily, assume that the two adjacent multimedia messages are multimedia message 1 and multimedia message 2, the sending time of multimedia message 1 is 10:00, and the sending time of multimedia message 2 is 10:03. Assuming that the first threshold is 1 minute, since the time interval between the sending time of multimedia message 1 and the sending time of multimedia message 2 is 3 minutes, which is greater than the first threshold, multimedia message 1 and multimedia message 2 do not meet the continuous message condition. Assuming that the first threshold is 5 minutes, since the time interval between the sending time of multimedia message 1 and the sending time of multimedia message 2 is 3 minutes, which is less than the first threshold, multimedia message 1 and multimedia message 2 meet the continuous message condition.

[0141] Optionally, the first threshold is preset. Optionally, the first threshold is dynamically adjusted.

[0142] In some embodiments, the second threshold is a quantity threshold for indicating the number of other messages between two adjacent multimedia messages. Exemplarily, it is assumed that the two adjacent multimedia messages are multimedia message 1 and multimedia message 2, and there are 4 other messages between multimedia message 1 and multimedia message 2. It is assumed that the second threshold is 5 other messages, then because the number of other messages between multimedia message 1 and multimedia message 2 is less than the second threshold, multimedia message 1 and multimedia message 2 meet the continuous message condition. It is assumed that the second threshold is 3 other messages, then because the number of other messages between multimedia message 1 and multimedia message 2 is greater than the second threshold, multimedia message 1 and multimedia message 2 meet the continuous message condition.

[0143] Optionally, the first threshold is preset. Optionally, the first threshold is dynamically adjusted.

[0144] To summarize, the method provided in the embodiment of the present application, in response to the number of n+1 multimedia messages reaching a quantity threshold and satisfying a continuous message condition, merges and displays n+1 multimedia messages into one merged message, so that at most n multimedia messages satisfying the merged display condition are displayed in the chat window; when the number of multimedia messages satisfying the merged display condition reaches n+1, only one merged message is displayed in the chat window; by merging and displaying them into one merged message, the space utilization rate of the chat window is improved, and it can help improve the efficiency of users viewing messages.

[0145] In some embodiments, the above-mentioned merged display conditions that trigger the merging and displaying of n+1 multimedia messages into one merged message include: the number of n+1 multimedia messages reaches a quantity threshold and satisfies a continuous message condition, and the n+1 multimedia messages are the same message or messages whose similarity reaches a threshold.

[0146] In some embodiments, Fig. 9 As shown, the above step 260 can also be replaced by the following sub-steps:

[0147] Step 262: In response to the number of n+1 multimedia messages reaching a number threshold and satisfying a continuous message condition and the n+1 multimedia messages being the same message, the n+1 multimedia messages are combined and displayed as one combined message.

[0148] In some embodiments, in response to the number of n+1 multimedia messages reaching a quantity threshold and satisfying a continuous message condition and the n+1 multimedia messages are messages of the same type, the n+1 multimedia messages are merged and displayed as a merged message. Optionally, the message type includes at least one of an expression type, a voice type, a voice expression type, a picture type, and a video type. Exemplarily, it is assumed that the n+1 multimedia messages are all voice expression messages. In response to the number of n+1 multimedia messages reaching a quantity threshold and satisfying a continuous message condition and the n+1 multimedia messages are voice expression messages, the n+1 multimedia messages are merged and displayed as a merged message.

[0149] In some embodiments, in response to the number of n+1 multimedia messages reaching a quantity threshold and satisfying a continuous message condition and the n+1 multimedia messages are messages including at least one identical content, the n+1 multimedia messages are merged and displayed as a merged message. Optionally, the message content includes at least one of text content, picture content, and voice content. Exemplarily, it is assumed that the n+1 multimedia messages are messages with the same text content. In response to the number of n+1 multimedia messages reaching a quantity threshold and satisfying a continuous message condition and the n+1 multimedia messages are messages with the same text content, the n+1 multimedia messages are merged and displayed as a merged message.

[0150] Optionally, in response to the number of n+1 multimedia messages reaching a number threshold and satisfying a continuous message condition and the n+1 multimedia messages are messages including partially identical content, the n+1 multimedia messages are merged and displayed as one merged message.

[0151] Optionally, in response to the number of n+1 multimedia messages reaching a number threshold and satisfying a continuous message condition and the n+1 multimedia messages are messages including all identical contents, the n+1 multimedia messages are merged and displayed as one merged message.

[0152] In some embodiments, Fig.10 As shown, the above step 260 can also be replaced by the following sub-steps:

[0153] Step 263: In response to the number of n+1 multimedia messages reaching a number threshold and satisfying a continuous message condition and the n+1 multimedia messages being messages with similarity reaching a threshold, the n+1 multimedia messages are combined and displayed as one combined message.

[0154] In some embodiments, in response to the number of n+1 multimedia messages reaching a quantity threshold and satisfying a continuous message condition and the n+1 multimedia messages being at least one message whose similarity reaches a threshold, the n+1 multimedia messages are merged and displayed as a merged message. The similarity includes at least one of picture similarity, text similarity, and voice similarity. Exemplarily, assuming that the n+1 multimedia messages are voice expression messages, the similarities corresponding to the n+1 multimedia messages include picture similarity, text similarity, and voice similarity.

[0155] Optionally, in response to the number of n+1 multimedia messages reaching a number threshold and satisfying a continuous message condition and the n+1 multimedia messages being messages whose partial similarity reaches a threshold, the n+1 multimedia messages are merged and displayed as one merged message.

[0156] Optionally, in response to the number of n+1 multimedia messages reaching a number threshold and satisfying a continuous message condition and the n+1 multimedia messages are messages whose similarities all reach a threshold, the n+1 multimedia messages are merged and displayed as one merged message.

[0157] In some embodiments, the similarity threshold is a threshold used to indicate the similarity between at least two multimedia messages.

[0158] Optionally, the threshold of the similarity is preset. Exemplarily, the threshold of the similarity is preset in advance as 90%. Then, when the similarity of n+1 multimedia messages reaches 90%, the n+1 multimedia messages are merged and displayed as a merged message. Optionally, the threshold of the similarity is dynamically adjusted.

[0159] In some embodiments, the similarity is detected by a pre-trained similarity detection model. The similarity detection model is obtained by training a sample training set. The sample training set includes at least one of sample text content, sample image content, sample video content, and sample voice content. The model parameters in the similarity detection model are trained by the sample training set, and after multiple trainings, for example, after 10,000 sample trainings or when the model converges, a trained similarity detection model capable of detecting a similarity threshold is obtained.

[0160] To summarize, the method provided in the embodiment of the present application, in response to the number of n+1 multimedia messages reaching a quantity threshold and satisfying a continuous message condition, and the n+1 multimedia messages are the same message or messages whose similarity reaches a threshold, merges and displays the n+1 multimedia messages into one merged message, and merges and displays the n+1 multimedia messages that meet the conditions into one merged message, thereby effectively reducing the number of multimedia messages displayed in the chat window, avoiding confusion in the message display in the chat window, and can help improve the efficiency of users viewing messages.

[0161] In some embodiments, the above-mentioned combined display conditions for triggering the merging and displaying of n+1 multimedia messages into one merged message include: the number of n+1 multimedia messages reaches a quantity threshold and satisfies a continuous message condition, and the n+1 multimedia messages are complementary type messages.

[0162] In some embodiments, Fig.11 As shown, the above step 260 can also be replaced by the following sub-steps:

[0163] Step 264: In response to the number of n+1 multimedia messages reaching a number threshold and satisfying a continuous message condition and the n+1 multimedia messages being complementary type messages, the n+1 multimedia messages are combined and displayed as one combined message.

[0164] In some embodiments, the complementary type of message includes at least one of the following:

[0165] ·Message contents are combined into multimedia messages of close activities among friends;

[0166] · The message contents are combined into multimedia messages of couples’ intimate activities;

[0167] ·Message contents are combined into multimedia messages for group entertainment activities;

[0168] ·The message contents are combined into a multimedia message for group blessing activities.

[0169] Optionally, in response to the number of n+1 multimedia messages reaching a number threshold and satisfying a continuous message condition and the n+1 multimedia messages are messages of intimate activities of friends, the n+1 multimedia messages are merged and displayed as a merged message. Exemplarily, assuming that there are two multimedia messages, one of which is a left-hand high-five action message and the other is a right-hand high-five action message, the two multimedia messages are merged and displayed as a merged high-five message. Exemplarily, if Fig.12 As shown, a left-hand high-five action message 33 and a right-hand high-five action message 34 are displayed in the chat window, and the two multimedia messages are combined and displayed as a combined high-five message 35.

[0170] Optionally, in response to the number of n+1 multimedia messages reaching a number threshold and satisfying a continuous message condition and the n+1 multimedia messages are messages of intimate activities of a couple, the n+1 multimedia messages are merged and displayed as a merged message. Exemplarily, assuming that there are two multimedia messages, one of which is a message of a boy's hugging action and the other is a message of a girl's hugging action, the two multimedia messages are merged and displayed as a merged message of a hug. Exemplarily, if Fig.13 As shown, a hugging action message 36 of the boy and a hugging action message 37 of the girl are displayed in the chat window, and the two multimedia messages are combined and displayed as a combined hugging message 38.

[0171] Optionally, in response to the number of n+1 multimedia messages reaching a number threshold and satisfying a continuous message condition and the n+1 multimedia messages are messages whose message contents are combined into group entertainment activities, the n+1 multimedia messages are merged and displayed as one merged message. Exemplarily, assuming that there are four multimedia messages, the first multimedia message is an action message for playing a first mahjong tile, the second multimedia message is an action message for playing a second mahjong tile, the third multimedia message is an action message for playing a third mahjong tile, and the fourth multimedia message is an action message for playing a fourth mahjong tile, then the four multimedia messages are merged and displayed as one merged message of playing mahjong on a mahjong table. Exemplarily, if Fig.14 As shown, the action message 61 of the first mahjong tile, the action message 62 of the second mahjong tile, the action message 63 of the third mahjong tile, and the action message 64 of the fourth mahjong tile are displayed in the chat window, and the four multimedia messages are merged and displayed as a merged message 65 of playing mahjong on the mahjong table.

[0172] In some embodiments, the merged message changes as the number of group entertainment activity messages that are combined into one message content changes. For example, in the case of three chess and card multimedia messages, a merged message of Landlords is displayed; in the case of four chess and card multimedia messages, a merged message of Mahjong is displayed; in the case of five chess and card multimedia messages, a merged message of Staring at the Eyes is displayed.

[0173] Optionally, in response to the number of n+1 multimedia messages reaching a number threshold and satisfying a continuous message condition and the n+1 multimedia messages are messages whose message contents are combined into a group blessing activity, the n+1 multimedia messages are merged and displayed as one merged message. Exemplarily, assuming that two multimedia messages are included, one multimedia message is a voice message 1 "Congratulations" sent by user account 1, and the other multimedia message is a voice message 2 "Get rich" sent by user account 2, then the two multimedia messages are merged and displayed as one voice merged message "Congratulations and get rich".

[0174] To summarize, the method provided in the embodiment of the present application, in response to the number of n+1 multimedia messages reaching a quantity threshold and satisfying a continuous message condition, and the n+1 multimedia messages are complementary types of messages, merges and displays the n+1 multimedia messages into one merged message, so that the complementary types of messages in the chat window can be merged and displayed. On the one hand, the number of messages displayed in the chat window is reduced, avoiding interference from a large number of messages that meet the merged display conditions; on the other hand, the complementary types of messages are merged to show a new display method, thereby enriching the interest of the messages in the chat window.

[0175] In some embodiments, when the n+2th multimedia message is received, the updated merged message is updated and displayed in the chat window. Fig.15 As shown, the above method also includes:

[0176] Step 270: receiving the (n+2)th multimedia message;

[0177] In some embodiments, the chat client only receives the n+2th multimedia message. It should be understood that in the embodiments of the present application, the chat client only receives but does not display the n+2th multimedia message. Optionally, the user account that sends the n+2th multimedia message is a user account in at least one user account corresponding to the n+1st multimedia message. Optionally, the user account that sends the n+2th multimedia message is not a user account in at least one user account corresponding to the n+1st multimedia message.

[0178] In some embodiments, the chat client receives and displays the (n+2)th multimedia message.

[0179] Step 280: In response to the n+2 multimedia messages satisfying the merged display condition, display the updated merged message.

[0180] In some embodiments, the n+2 multimedia messages include the n+1 multimedia messages and the n+2th multimedia message. When the n+2 multimedia messages meet the merged display condition, in response to receiving the n+2th multimedia message, an updated merged message is displayed. The message content of the updated merged message is obtained based on the merge of the n+2 multimedia messages.

[0181] For example, Fig.16 As shown, a first merged message 23 obtained by merging n+1 multimedia messages is displayed in the chat window. In response to receiving the n+2th multimedia message, and the n+1th multimedia message and the n+2th multimedia message satisfying the merged display condition, an updated merged message 24 is displayed in the chat window.

[0182] To sum up, the method provided in the embodiment of the present application displays an updated merged message while continuing to receive new multimedia messages that meet the merged display conditions, so that a merged message is always displayed in the chat window, but the merged message will be continuously updated according to the received messages, so that the merged message can continue to be dynamically adjusted and changed, which not only ensures that the display environment in the chat window is not affected, but also makes the display method of the messages in the chat window more diversified.

[0183] In some embodiments, Fig.17 As shown, the above method also includes:

[0184] Step 320: Display adjustment controls;

[0185] In some embodiments, the adjustment control is used to adjust the synthesis strength parameter of the AI ​​model. The AI ​​model is used to generate a merge message.

[0186] It is worth noting that the display form of the adjustment control is not limited in the embodiment of the present application. Exemplarily, the adjustment control is a knob. Optionally, the adjustment control is an adjustment lever. Optionally, the adjustment control is an input key.

[0187] Optionally, the adjustment control is displayed in the chat window. Optionally, the adjustment control is displayed in the settings page. In the embodiment of the present application, the adjustment control is displayed in the settings page as an example for explanation. It should be understood that the display position of the adjustment control is not limited. For example, Fig.18 As shown, an adjustment control 25 is displayed in the setting page.

[0188] Step 340: In response to a trigger operation on the adjustment control, determine the synthesis force parameters of the AI ​​model.

[0189] The trigger operation includes at least one of single click, double click, left and right slide, up and down slide, long press, hover, face recognition, and voice recognition. It is worth noting that the trigger operation includes but is not limited to the above mentioned ones. Those skilled in the art should be able to know that any operation that can achieve the above functions belongs to the protection scope of the embodiments of this application.

[0190] In some embodiments, the adjustment control includes an adjustment sub-control for each synthetic force sub-parameter in the synthetic force parameters of the AI ​​model. Exemplarily, when the synthetic force parameters of the AI ​​model include synthetic force sub-parameter 1 for sound and synthetic force sub-parameter 2 for pictures, the adjustment control includes adjustment sub-control 1 for synthetic force sub-parameter 1 and adjustment sub-control 2 for synthetic force sub-parameter 2.

[0191] To sum up, the method provided in the embodiment of the present application, by displaying adjustment controls, enables the synthesis intensity parameters used to control the merged messages to be adjusted through the adjustment controls, thereby improving the sense of participation of the user account, and enabling the merged messages to be generated based on the set synthesis intensity parameters, so that the merged messages are more in line with the needs of the user account.

[0192] In some embodiments, Fig.19 As shown, the above method also includes:

[0193] Step 410: Display the sender avatar corresponding to the merged message as a merged avatar.

[0194] In some embodiments, the merged avatar is obtained by merging all or part of the avatars of the sender of n+1 multimedia messages.

[0195] Optionally, the merged avatar includes all avatars of senders of n+1 multimedia messages.

[0196] Optionally, the merged avatar includes part of the avatars of the sender of n+1 multimedia messages.

[0197] Optionally, the part of avatars is the avatar of the sender of m multimedia messages among n+1 multimedia messages, and the value of m is a positive integer less than or equal to n.

[0198] Optionally, the m multimedia messages are m multimedia messages at fixed positions in a message sequence, such as merging the sender avatars of the first four multimedia messages into a merged avatar. It should be understood that, in the case where the m multimedia messages are m multimedia messages at fixed positions in a message sequence, the merged avatar is fixed or dynamically changing. If the sender avatars of the first four multimedia messages are merged into a merged avatar, the merged avatar is fixed; if the sender avatars of the last four multimedia messages are merged into a merged avatar, the merged avatar is dynamically changing.

[0199] Optionally, the m multimedia messages are randomly and dynamically selected. Exemplarily, m multimedia messages are randomly selected from n+1 multimedia messages for merging.

[0200] For example, Fig. 20 As shown, a merged avatar 26 is displayed on the chat window.

[0201] In some embodiments, Fig.21 As shown, the above method also includes:

[0202] Step 420: Display a special effect floating layer on the chat window for displaying the merged avatar.

[0203] In some embodiments, the special effect floating layer is used to prompt that a merged message is displayed on the chat window. Fig. 22 As shown, a special effect floating layer 27 for displaying the merged avatar 26 is displayed on the chat window. It is worth noting that the display method of the special effect floating layer is not limited in the embodiment of the present application. Those skilled in the art should be able to know that any display method that can achieve the above-mentioned prompt function belongs to the protection scope of the embodiment of the present application.

[0204] In some embodiments, the special effect floating layer is displayed when the user account has not read the merged message in the chat window.

[0205] In some embodiments, Fig.23 As shown, the above method also includes:

[0206] Step 430: In response to a trigger operation on the merged avatar, display the n+1 avatars after the splitting.

[0207] In some embodiments, the n+1 avatars correspond one-to-one to the avatars of the senders of the n+1 multimedia messages.

[0208] In some embodiments, the trigger operation on the merged avatar is used to indicate the splitting of the merged avatar. In some embodiments, the trigger operation on the merged avatar includes at least one of single click, double click, left and right slide, up and down slide, long press, hover, facial recognition, and voice recognition. It is worth noting that the trigger operations on the merged avatar include but are not limited to the above-mentioned ones. Those skilled in the art should be able to know that any operation that can achieve the above functions belongs to the protection scope of the embodiments of the present application.

[0209] In some embodiments, when at least two of the n+1 multimedia messages are sent by the same user account, the sender avatars of the n+1 multimedia messages are less than n+1. That is, when the sender avatars of the n+1 multimedia messages include t, in response to a trigger operation on the merged avatar, the t avatars after the split are displayed. The value of t is a positive integer less than or equal to n+1, and the value of n is a positive integer.

[0210] It is worth noting that the display order of the t avatars after splitting is not limited in the embodiment of the present application. Optionally, the display order of the t avatars after splitting is in the order of the sending time of the multimedia messages corresponding to the t avatars. For example, they are displayed in sequence from early to late according to the sending time. Optionally, the display order of the t avatars after splitting is in the order of the number of multimedia messages corresponding to the t avatars. For example, the number of multimedia messages corresponding to each avatar is obtained, assuming that avatar 1 corresponds to 10 multimedia messages and avatar 2 corresponds to 8 multimedia messages, they are displayed in sequence from most to least or from least to most.

[0211] In some embodiments, the t avatars after splitting are aggregated and displayed in a split display frame. The split display frame displays the t avatars after splitting. Optionally, the split display frame displays all the t avatars after splitting. Optionally, the split display frame displays some of the t avatars after splitting.

[0212] In some embodiments, in response to a trigger operation on the merged avatar, a split display frame is displayed. Fig.24As shown, in response to a single-click operation on the combined avatar 26 , a split display frame 28 is displayed, in which all or part of the split avatars are displayed.

[0213] In some embodiments, when some of the t avatars after splitting are displayed in the split display frame, the split display frame also includes a viewing control for viewing more avatars. In response to a triggering operation of the viewing control in the split display frame, all of the t avatars after splitting are displayed.

[0214] In some embodiments, the triggering operation of the viewing control includes at least one of single click, double click, left and right slide, up and down slide, long press, hover, face recognition, and voice recognition. It is worth noting that the triggering operation of the viewing control includes but is not limited to the above mentioned ones. Those skilled in the art should be able to know that any operation that can achieve the above functions belongs to the protection scope of the embodiments of the present application.

[0215] It is worth noting that the above steps 410, 420 and 430 are independent execution steps. The above steps 420 and 430 can only be executed when step 410 is successfully executed. The above steps 420 and 430 are not sequence-dependent.

[0216] To sum up, the method provided in the embodiment of the present application, by displaying the merged avatar, enables the user accounts in the chat window to know the multimedia messages sent by which user accounts the merged message is based on, which can help user accounts to view and understand each other more to a certain extent.

[0217] In some embodiments, Fig.25 As shown, the above method also includes:

[0218] Step 520: In response to a trigger operation on the merged message, display the split n+1 multimedia messages.

[0219] In some embodiments, the trigger operation on the merged message is used to indicate the splitting of the merged message. In some embodiments, the trigger operation on the merged message includes at least one of single click, double click, left and right slide, up and down slide, long press, hover, facial recognition, and voice recognition. It is worth noting that the trigger operation on the merged message includes but is not limited to the above-mentioned ones. Those skilled in the art should be able to know that any operation that can achieve the above functions belongs to the protection scope of the embodiments of the present application.

[0220] For example, Fig.26As shown, in response to a single-click operation on the merged message 16, the first multimedia message 12 sent by the split user account 1, the second multimedia message 13 sent by the user account 2, the third multimedia message 14 sent by the user account 3, the fourth multimedia message 15 sent by the user account 4 and the fifth multimedia message 19 sent by the user account 3 are displayed.

[0221] In some embodiments, the split n+1 multimedia messages are displayed according to the sending time of the n+1 multimedia messages. Optionally, the split n+1 multimedia messages are displayed in the order of sending time from earliest to latest. Optionally, the split n+1 multimedia messages are displayed in the order of sending time from latest to latest.

[0222] It is worth noting that the display order of the n+1 multimedia messages after splitting is not limited in the embodiment of the present application. Optionally, the display order of the n+1 multimedia messages after splitting is in the order of the sending time of the n+1 multimedia messages. For example, they are displayed in order from early to late according to the sending time.

[0223] To summarize, the method provided in the embodiment of the present application enables the user account in the chat window to view the merged message or single message as needed by displaying the split n+1 multimedia messages, thereby providing the user account with more options.

[0224] Fig. 27 is a flowchart of a message merging method provided by an exemplary embodiment of the present application. Figure 1 The server 140 in the computer system 100 shown executes, including:

[0225] Step 620: Receive n+1 multimedia messages;

[0226] In some embodiments, the server receives n+1 multimedia messages, wherein the multimedia messages include at least one of text messages, picture messages, voice messages, emoticon messages, voice emoticon messages, and video messages.

[0227] Optionally, each of the n+1 multimedia messages corresponds to the same user account. Optionally, each of the n+1 multimedia messages corresponds to a different user account. Optionally, some of the n+1 multimedia messages correspond to the same user account, and some correspond to different user accounts.

[0228] Step 640: When the n+1 multimedia messages meet the merged display condition, merge the n+1 multimedia messages into one merged message;

[0229] In some embodiments, the merged display condition is a triggering condition for triggering merging n+1 multimedia messages into one merged message.

[0230] Optionally, the merge display condition is preset. Exemplarily, the merge display condition preset in advance is: receiving 5 identical multimedia messages. Then, when the fifth identical multimedia message is received, it is triggered to merge the n+1 multimedia messages into one merged message.

[0231] Optionally, the merged display condition is dynamically adjusted. In some embodiments, the merged display condition is dynamically adjusted based on the display condition of the chat client. The display condition includes at least one of the display size of the chat window and the number of online users. Exemplarily, when the display size of the chat window is display size 1, the merged display condition is merged display condition 1; when the display size of the chat window is display size 2, the merged display condition is merged display condition 2.

[0232] In some embodiments, the message content of the merged message is obtained by merging n+1 multimedia messages.

[0233] Step 660: Send the merged message to the chat client.

[0234] In some embodiments, the merged message is sent to the chat client for display.

[0235] In some embodiments, the display elements in the merged message include at least one of the following:

[0236] The apparent size of the merged message;

[0237] Merge numbers in messages;

[0238] The number of individual contents in the merged message;

[0239] The number of decorations in the merged message;

[0240] Merge the decoration level in the message;

[0241] The presentation method of n+1 individual contents used to represent the group in the merged message.

[0242] In some embodiments, the display elements in the merged message are related to the number of n+1 multimedia messages.

[0243] Optionally, the apparent size of the merged message is related to the number of n+1 multimedia messages. For example, Figure 6As shown, the appearance size of the merged message is proportional to the number of n+1 multimedia messages. The more n+1 multimedia messages there are, the larger the appearance size of the merged message is. For example, when the number of n+1 multimedia messages is 5, the appearance size of the merged message is a first appearance size of 17; when the number of n+1 multimedia messages is 7, the appearance size of the merged message is a second appearance size of 18.

[0244] Optionally, the number in the merged message is related to the number of n+1 multimedia messages. In some embodiments, the number in the merged message is used to represent the number of n+1 multimedia messages, and the number in the merged message is proportional to the number of n+1 multimedia messages. Optionally, the size of the number in the merged message is related to the number of n+1 multimedia messages. Optionally, the text in the merged message is related to the number of n+1 multimedia messages. Optionally, the size of the text in the merged message is related to the number of n+1 multimedia messages. Exemplarily, the size of the text in the merged message is proportional to the number of n+1 multimedia messages, and the larger the number of n+1 multimedia messages, the larger the text size in the merged message.

[0245] Optionally, the number of individual contents in the merged message is related to the number of n+1 multimedia messages. Exemplarily, the number of individual contents in the merged message is proportional to the number of n+1 multimedia messages, and the more n+1 multimedia messages there are, the more individual contents there are in the merged message.

[0246] Optionally, the number of decorations in the merged message is related to the number of n+1 multimedia messages. Exemplarily, the number of decorations in the merged message is proportional to the number of n+1 multimedia messages, and the more n+1 multimedia messages there are, the more decorations there are in the merged message.

[0247] Optionally, the decoration level in the merged message is related to the number of n+1 multimedia messages. Exemplarily, the decoration level in the merged message is proportional to the number of n+1 multimedia messages, and the more n+1 multimedia messages there are, the higher the decoration level in the merged message.

[0248] Optionally, the presentation mode of n+1 individual contents representing the group in the merged message is related to the number of n+1 multimedia messages. Figure 7 As shown, when the number of n+1 multimedia messages is 5, the presentation method of the n+1 individual contents representing the group in the merged message is the first presentation method 21; when the number of n+1 multimedia messages is 11, the presentation method of the n+1 individual contents representing the group in the merged message is the first presentation method 22.

[0249] To summarize, the method provided in the embodiment of the present application merges n+1 multimedia messages into one merged message when the n+1 multimedia messages meet the merged display conditions, so that the chat client displays based on the received merged message, thereby effectively avoiding the problem of high-frequency coverage of a large number of identical or similar multimedia messages in the chat window. On the one hand, user accounts that need to send the same or similar multimedia messages can continue to send more identical or similar multimedia messages. On the other hand, these identical or similar multimedia messages can also be merged into one merged message without affecting other user accounts in the chat window.

[0250] In some embodiments, the above-mentioned combined display condition for triggering the merging of n+1 multimedia messages into one combined message includes: the number of n+1 multimedia messages reaches a number threshold and satisfies a continuous message condition. Fig.28 As shown, the above step 640 can be replaced by the following sub-steps:

[0251] Step 641: When the number of n+1 multimedia messages reaches a number threshold and satisfies a continuous message condition, the n+1 multimedia messages are merged into one merged message.

[0252] In some embodiments, the quantity threshold is a trigger condition for triggering merging n+1 multimedia messages into one merged message.

[0253] Optionally, the quantity threshold is preset. Exemplarily, the quantity threshold preset in advance is: 5 multimedia messages. Then, when the 5th multimedia message is received, it is triggered to merge n+1 multimedia messages into one merged message.

[0254] Optionally, the quantity threshold is dynamically adjusted. In some embodiments, the quantity threshold is dynamically adjusted based on the display size of the chat window in the chat client. Exemplarily, when the display size of the chat window is 30*50, the quantity threshold is: 4 multimedia messages; when the display size of the chat window is 50*80, the quantity threshold is: 5 multimedia messages.

[0255] In some embodiments, the continuous message condition means that the sending time interval between two adjacent multimedia messages is less than a first threshold, and the number of other messages between the two adjacent multimedia messages is less than a second threshold.

[0256] In some embodiments, the first threshold is a time threshold for indicating the time interval between two adjacent multimedia messages. Exemplarily, assume that the two adjacent multimedia messages are multimedia message 1 and multimedia message 2, the sending time of multimedia message 1 is 10:00, and the sending time of multimedia message 2 is 10:03. Assuming that the first threshold is 1 minute, since the time interval between the sending time of multimedia message 1 and the sending time of multimedia message 2 is 3 minutes, which is greater than the first threshold, multimedia message 1 and multimedia message 2 do not meet the continuous message condition. Assuming that the first threshold is 5 minutes, since the time interval between the sending time of multimedia message 1 and the sending time of multimedia message 2 is 3 minutes, which is less than the first threshold, multimedia message 1 and multimedia message 2 meet the continuous message condition.

[0257] Optionally, the first threshold is preset. Optionally, the first threshold is dynamically adjusted.

[0258] In some embodiments, the second threshold is a quantity threshold for indicating the number of other messages between two adjacent multimedia messages. Exemplarily, it is assumed that the two adjacent multimedia messages are multimedia message 1 and multimedia message 2, and there are 4 other messages between multimedia message 1 and multimedia message 2. It is assumed that the second threshold is 5 other messages, then because the number of other messages between multimedia message 1 and multimedia message 2 is less than the second threshold, multimedia message 1 and multimedia message 2 meet the continuous message condition. It is assumed that the second threshold is 3 other messages, then because the number of other messages between multimedia message 1 and multimedia message 2 is greater than the second threshold, multimedia message 1 and multimedia message 2 meet the continuous message condition.

[0259] Optionally, the first threshold is preset. Optionally, the first threshold is dynamically adjusted.

[0260] To summarize, the method provided in the embodiment of the present application merges n+1 multimedia messages into one merged message when the number of n+1 multimedia messages reaches a quantity threshold and satisfies a continuous message condition, so that the n+1 multimedia messages that reach a quantity threshold and satisfy the continuous message condition can be merged into one merged message, thereby effectively reducing the number of multimedia messages displayed in the chat window and avoiding confusion in the message display in the chat window.

[0261] In some embodiments, the above-mentioned conditions for triggering the merging and displaying of n+1 multimedia messages into one merged message include: the number of n+1 multimedia messages reaches a quantity threshold and satisfies a continuous message condition, and the n+1 multimedia messages are the same message or messages whose similarity reaches a threshold.

[0262] In some embodiments, Fig.29As shown, the above step 640 can also be replaced by the following sub-steps:

[0263] Step 642: When the number of n+1 multimedia messages reaches the number threshold and satisfies the continuous message condition and the n+1 multimedia messages are the same message, merge the n+1 multimedia messages into one merged message.

[0264] In some embodiments, when the number of n+1 multimedia messages reaches a quantity threshold and satisfies a continuous message condition and the n+1 multimedia messages are messages of the same type, the n+1 multimedia messages are merged into one merged message. Optionally, the message type includes at least one of an expression type, a voice type, a voice expression type, a picture type, and a video type. Exemplarily, when the number of n+1 multimedia messages reaches a quantity threshold and satisfies a continuous message condition and the n+1 multimedia messages are all voice expression messages, the n+1 multimedia messages are merged into one merged message.

[0265] In some embodiments, when the number of n+1 multimedia messages reaches a quantity threshold and satisfies a continuous message condition and the n+1 multimedia messages are messages including at least one identical content, the n+1 multimedia messages are merged into one merged message. Optionally, the message content includes at least one of text content, picture content, and voice content. Exemplarily, when the number of n+1 multimedia messages reaches a quantity threshold and satisfies a continuous message condition and the n+1 multimedia messages are messages with the same text content, the n+1 multimedia messages are merged into one merged message.

[0266] Optionally, when the number of n+1 multimedia messages reaches a number threshold and satisfies a continuous message condition and the n+1 multimedia messages are messages including partially identical content, the n+1 multimedia messages are merged into one merged message.

[0267] Optionally, when the number of n+1 multimedia messages reaches a number threshold and satisfies a continuous message condition and the n+1 multimedia messages are messages including all identical contents, the n+1 multimedia messages are merged into one merged message.

[0268] In some embodiments, Fig.30 As shown, the above step 640 can also be replaced by the following sub-steps:

[0269] Step 643: When the number of n+1 multimedia messages reaches the number threshold and satisfies the continuous message condition and the n+1 multimedia messages are messages whose similarity reaches the threshold, merge the n+1 multimedia messages into one merged message.

[0270] In some embodiments, when the number of n+1 multimedia messages reaches a number threshold and satisfies a continuous message condition and the n+1 multimedia messages are messages with at least one similarity reaching a threshold, the n+1 multimedia messages are merged into one merged message. The similarity includes at least one of picture similarity, text similarity, and voice similarity. Exemplarily, assuming that the n+1 multimedia messages are voice expression messages, the similarities corresponding to the n+1 multimedia messages include picture similarity, text similarity, and voice similarity.

[0271] Optionally, when the number of n+1 multimedia messages reaches a number threshold and satisfies a continuous message condition and the n+1 multimedia messages are messages whose partial similarity reaches a threshold, the n+1 multimedia messages are merged into one merged message.

[0272] Optionally, when the number of n+1 multimedia messages reaches a number threshold and satisfies a continuous message condition and the n+1 multimedia messages are messages whose similarities all reach a threshold, the n+1 multimedia messages are merged into one merged message.

[0273] In some embodiments, the similarity threshold is a threshold used to indicate the similarity between at least two multimedia messages.

[0274] Optionally, the threshold of the similarity is preset. Exemplarily, the threshold of the similarity is preset in advance as 90%. Then, when the similarity of n+1 multimedia messages reaches 90%, the n+1 multimedia messages are merged into one merged message. Optionally, the threshold of the similarity is dynamically adjusted.

[0275] In some embodiments, the similarity is detected by a pre-trained similarity detection model. The similarity detection model is obtained by training a sample training set. The sample training set includes at least one of sample text content, sample image content, sample video content, and sample voice content. The model parameters in the similarity detection model are trained by the sample training set, and after multiple trainings, for example, after 10,000 sample trainings or when the model converges, a trained similarity detection model capable of detecting a similarity threshold is obtained.

[0276] To summarize, the method provided in the embodiment of the present application can effectively reduce the number of multimedia messages displayed in the chat window and avoid confusion in the message display in the chat window by merging n+1 multimedia messages into one merged message when the number of n+1 multimedia messages reaches a quantity threshold and satisfies a continuous message condition, and the n+1 multimedia messages are the same messages or messages whose similarity reaches a threshold.

[0277] In some embodiments, the above-mentioned combined display conditions for triggering the merging and displaying of n+1 multimedia messages into one merged message include: the number of n+1 multimedia messages reaches a quantity threshold and satisfies a continuous message condition, and the n+1 multimedia messages are complementary type messages.

[0278] In some embodiments, Fig.31 As shown, the above step 640 can also be replaced by the following sub-steps:

[0279] Step 644: When the number of n+1 multimedia messages reaches the number threshold and satisfies the continuous message condition and the n+1 multimedia messages are complementary type messages, merge the n+1 multimedia messages into one merged message.

[0280] In some embodiments, the complementary type of message includes at least one of the following:

[0281] ·Message contents are combined into multimedia messages of close activities among friends;

[0282] · The message contents are combined into multimedia messages of couples’ intimate activities;

[0283] ·Message contents are combined into multimedia messages for group entertainment activities;

[0284] ·The message contents are combined into a multimedia message for group blessing activities.

[0285] Optionally, when the number of n+1 multimedia messages reaches a number threshold and meets a continuous message condition and the n+1 multimedia messages are messages of intimate activities of friends, the n+1 multimedia messages are merged into one merged message. Exemplarily, assuming that two multimedia messages are included, one multimedia message is a left-hand high-five action message, and the other multimedia message is a right-hand high-five action message, the two multimedia messages are merged into one merged message of high-five.

[0286] Optionally, when the number of n+1 multimedia messages reaches a number threshold and meets a continuous message condition and the n+1 multimedia messages are messages of intimate activities of a couple, the n+1 multimedia messages are merged into one merged message. Exemplarily, assuming that there are two multimedia messages, one of which is a message of a boy's hugging action and the other is a message of a girl's hugging action, the two multimedia messages are merged into one merged message of a hug.

[0287] Optionally, when the number of n+1 multimedia messages reaches a number threshold and meets a continuous message condition and the n+1 multimedia messages are messages whose message contents are combined into group entertainment activities, the n+1 multimedia messages are merged into one merged message. Exemplarily, assuming that there are four multimedia messages, the first multimedia message is an action message of playing a first mahjong tile, the second multimedia message is an action message of playing a second mahjong tile, the third multimedia message is an action message of playing a third mahjong tile, and the fourth multimedia message is an action message of playing a fourth mahjong tile, then the four multimedia messages are merged into one merged message of playing mahjong on a mahjong table.

[0288] Optionally, when the number of n+1 multimedia messages reaches a number threshold and meets a continuous message condition and the n+1 multimedia messages are messages whose contents are combined into a group blessing activity, the n+1 multimedia messages are merged into one merged message. Exemplarily, assuming that there are two multimedia messages, one of which is a voice message 1 "Congratulations" sent by user account 1, and the other is a voice message 2 "Get rich" sent by user account 2, then the two multimedia messages are merged into one voice merged message of "Congratulations and get rich".

[0289] To summarize, the method provided in the embodiment of the present application, by merging n+1 multimedia messages into one merged message when the number of n+1 multimedia messages reaches a quantity threshold and meets the continuous message condition, and the n+1 multimedia messages are complementary type messages, enables the complementary type messages in the chat window to be merged and displayed. On the one hand, it reduces the number of messages displayed in the chat window and avoids interference from a large number of messages that meet the merged display conditions; on the other hand, it enables the complementary type messages to be displayed in a new way through merging, thereby enriching the interest of the messages in the chat window.

[0290] In some embodiments, when the n+2th multimedia message is received, the merged message is updated. Fig.32 As shown, the above method also includes:

[0291] Step 670: Receive the (n+2)th multimedia message;

[0292] Optionally, the user account sending the n+2th multimedia message is a user account in at least one user account corresponding to the n+1st multimedia message. Optionally, the user account sending the n+2th multimedia message is not a user account in at least one user account corresponding to the n+1st multimedia message.

[0293] Step 680: When the n+2 multimedia messages meet the merged display condition, merge the n+2 multimedia messages into an updated merged message;

[0294] In some embodiments, the n+2 multimedia messages include the n+1 multimedia message and the n+2th multimedia message. The message content of the updated merged message is obtained based on the merger of the n+2 multimedia messages.

[0295] Step 690: Send the updated merged message to the chat client.

[0296] In some embodiments, an updated merged message obtained by merging n+2 multimedia messages is sent to a chat client for display.

[0297] To sum up, the method provided in the embodiment of the present application updates the merged message while continuing to receive new multimedia messages that meet the merged display conditions, so that a merged message is always displayed in the chat window, but the merged message will be continuously updated according to the received messages, so that the merged message can continue to be dynamically adjusted and changed, which not only ensures that the display environment in the chat window is not affected, but also makes the display method of the messages in the chat window more diversified.

[0298] In some embodiments, the message content of the multimedia message includes visual content. Fig.33 As shown, the above step of merging n+1 multimedia messages into one merged message can be replaced by the following steps:

[0299] Step 710: Merge the visual contents of n+1 multimedia messages to obtain the visual content of a merged message.

[0300] In some embodiments, the visual content of the merged message is obtained by merging the visual contents of n+1 multimedia messages. Exemplarily, n+1 multimedia messages correspond to n+1 visual contents, and the visual content of the merged message is a visual content obtained by merging the n+1 visual contents. Optionally, the visual content includes at least one of text content, picture content, and decorative content.

[0301] In some embodiments, the message content of the multimedia message includes voice content. Fig.34 As shown, the above step of merging n+1 multimedia messages into one merged message can also be replaced by the following steps:

[0302] Step 720: Merge the voice contents of the n+1 multimedia messages to obtain the voice content of the merged message.

[0303] In some embodiments, the voice content of the merged message is obtained by merging the voice contents of n+1 multimedia messages. Exemplarily, n+1 multimedia messages correspond to n+1 voice contents, and the voice content of the merged message is a voice content obtained by merging the n+1 voice contents.

[0304] In some embodiments, the message content of the merged message includes a common portion and a group portion. Fig.35 As shown, the above step of merging n+1 multimedia messages into one merged message can also be replaced by the following steps:

[0305] Step 730: merging at least one identical content in the n+1 multimedia messages to obtain a common part;

[0306] In some embodiments, the common part is obtained by merging at least one identical content in n+1 multimedia messages. Exemplarily, assuming that n+1 multimedia messages include identical text content, the common part is obtained by merging the identical text content in n+1 multimedia messages. Figure 2 As shown, the first multimedia message 12 sent by user account 1, the second multimedia message 13 sent by user account 2, the third multimedia message 14 sent by user account 3 and the fourth multimedia message 15 sent by user account 4 include the same text content "Congratulations on your prosperity". Then the same text content in the first multimedia message 12 sent by user account 1, the second multimedia message 13 sent by user account 2, the third multimedia message 14 sent by user account 3 and the fourth multimedia message 15 sent by user account 4 are merged to obtain the common part "Congratulations on your prosperity".

[0307] Optionally, the common part is obtained by merging some of the same contents in n+1 multimedia messages. Optionally, the common part is obtained by merging all the same contents in n+1 multimedia messages.

[0308] Step 740: Rearrange the individual contents in the n+1 multimedia messages into n+1 individual contents representing the group to obtain the group part.

[0309] In some embodiments, there are n+1 individual contents corresponding to n+1 multimedia messages. The group content is obtained by rearranging the n+1 individual contents corresponding to the n+1 multimedia messages.

[0310] In some embodiments, the message content of the merged message also includes a background atmosphere portion. Fig.36 As shown, the above step of merging n+1 multimedia messages into one merged message can also be replaced by the following steps:

[0311] Step 750: In addition to the message content of the n+1 multimedia messages, the message content serving as the background atmosphere of the n+1 individual contents is additionally added to obtain a background atmosphere part.

[0312] It should be understood that, when the message contents of the n+1 multimedia messages include background atmosphere content, the background atmosphere content can be used as a common part or a group part.

[0313] In some embodiments, the additionally added message content as the background atmosphere of the n+1 individual contents is randomly generated based on the background atmosphere generation model. The background atmosphere generation model is obtained by training with a sample training set, and the sample training set includes sample background atmosphere content. The model parameters in the background atmosphere generation model are trained with the sample training set, and after multiple trainings, for example, after 10,000 sample trainings or when the model converges, a trained background atmosphere generation model capable of generating background atmosphere content is obtained.

[0314] In some embodiments, the display element in the merged message is related to the synthesis strength parameter of the AI ​​model. Fig.37 As shown, the above step of merging n+1 multimedia messages into one merged message can also be replaced by the following steps:

[0315] Step 770: Inputting n+1 multimedia messages and synthesis intensity parameters into the AI ​​model;

[0316] In some embodiments, the AI ​​model is pre-trained with a sample training set, which includes sample messages. The model parameters in the AI ​​model are trained with the sample training set, and after multiple trainings, for example, after 10,000 sample trainings or when the model converges, a trained AI model capable of generating merged messages is obtained.

[0317] In some embodiments, the AI ​​model includes a synthesis strength parameter, which includes a synthesis strength parameter value, and the synthesis strength parameter value is used to indicate the degree of change of the merged message relative to the n+1 multimedia messages. The larger the synthesis strength parameter value, the greater the degree of change of the merged message relative to the n+1 multimedia messages. That is, the larger the synthesis strength parameter value, the more other elements are added to the merged message.

[0318] Step 780: Generate a merge message based on the AI ​​model.

[0319] In some embodiments, the AI ​​model generates a merged message based on the input n+1 multimedia messages and the synthesis intensity parameters.

[0320] In some embodiments, the synthesis intensity parameter includes at least two synthesis intensity sub-parameters. The AI ​​model generates a merged message based on the input n+1 multimedia messages and the at least two synthesis intensity sub-parameters. Exemplarily, when the synthesis intensity parameter includes a synthesis intensity sub-parameter 1 for sound and a synthesis intensity sub-parameter 2 for pictures, the AI ​​model generates a merged message based on the input n+1 multimedia messages and the synthesis intensity sub-parameter 1 for sound and the synthesis intensity sub-parameter 2 for pictures.

[0321] In some embodiments, Fig.38 As shown, before step 770, it also includes:

[0322] Step 760: Receive synthesis intensity parameters.

[0323] In some embodiments, the chat client sends a synthetic force parameter to the server. The synthetic force parameter is adjusted through the adjustment control in the chat client. In response to the trigger operation on the adjustment control, the synthetic force parameter value of the AI ​​model is determined. The trigger operation includes at least one of single-click, double-click, left and right sliding, up and down sliding, long press, hovering, facial recognition, and voice recognition. It is worth noting that the trigger operation includes but is not limited to the above-mentioned ones. Those skilled in the art should be able to know that any operation that can achieve the above functions belongs to the protection scope of the embodiments of the present application.

[0324] Optionally, the adjustment control is displayed in the chat window. Optionally, the adjustment control is displayed in the settings page. In the embodiment of the present application, the adjustment control is displayed in the settings page as an example for explanation. It should be understood that the display position of the adjustment control is not limited.

[0325] In summary, the method provided in the embodiment of the present application may generate different merged messages based on different conditions. When the user account sets the synthesis strength parameter, the AI ​​model generates a merged message based on the synthesis strength parameter, which can improve the user account's sense of participation and make the merged message more in line with the needs of the user account.

[0326] In some embodiments, the AI ​​model for merging multimedia messages is trained based on the following method:

[0327] A sample training set for training an AI model is obtained. The sample training set includes sample multimedia messages and sample merged messages as labels.

[0328] The sample multimedia message is input into the AI ​​model, and the predicted merged message is output. The error loss between the predicted merged message and the sample merged message is calculated based on the loss function. Based on the error loss, the model parameters in the AI ​​model are trained through the error back propagation algorithm. After multiple trainings, for example, after 10,000 sample trainings, or when the model converges, an AI model capable of merging multimedia messages is obtained.

[0329] It is worth noting that the embodiment of the present application does not limit the loss function used to calculate the error loss between the prediction merge message and the sample merge message. Those skilled in the art should be able to know that any loss function that can achieve the above calculation belongs to the protection scope of the embodiment of the present application.

[0330] In some embodiments, the sample multimedia message also corresponds to at least two sample synthesis strength parameters. The sample multimedia message corresponding to each sample synthesis strength parameter is input into the AI ​​model, and a predicted merged message is output. The error loss between the predicted merged message and the sample merged message is calculated based on the loss function. Based on the error loss, the model parameters in the AI ​​model are trained by an error back propagation algorithm.

[0331] Exemplarily, it is assumed that sample multimedia message 1 corresponds to sample synthesis strength parameter 1 and sample synthesis strength parameter 2. Sample multimedia message 1 corresponding to sample synthesis strength parameter 1 is input into the AI ​​model, and predicted merged message 1 is output. Error loss 1 between predicted merged message 1 and sample merged message is calculated based on the loss function. Based on error loss 1, the model parameters in the AI ​​model are trained by the error back propagation algorithm. Sample multimedia message 1 corresponding to sample synthesis strength parameter 2 is input into the AI ​​model, and predicted merged message 2 is output. Error loss 2 between predicted merged message 2 and sample merged message is calculated based on the loss function. Based on error loss 2, the model parameters in the AI ​​model are trained by the error back propagation algorithm.

[0332] Fig.39 is a flowchart of a message merging method provided by an exemplary embodiment of the present application. Figure 1 The server 140 in the computer system 100 shown in the figure executes the above method, and the method further includes:

[0333] Step 820: Generate a merged avatar based on the sender avatar corresponding to the merged message;

[0334] In some embodiments, the merged avatar is obtained by merging all or part of the avatars of the sender of n+1 multimedia messages.

[0335] Optionally, the merged avatar includes all avatars of senders of n+1 multimedia messages.

[0336] Optionally, the merged avatar includes part of the avatars of the sender of n+1 multimedia messages.

[0337] Optionally, the part of avatars is the avatar of the sender of m multimedia messages among n+1 multimedia messages, and the value of m is a positive integer less than or equal to n.

[0338] Optionally, the m multimedia messages are m multimedia messages at fixed positions, such as merging the sender avatars of the first four multimedia messages into a merged avatar. It should be understood that, in the case where the m multimedia messages are m multimedia messages at fixed positions, the merged avatar is fixed or dynamically changing. If the sender avatars of the first four multimedia messages are merged into a merged avatar, the merged avatar is fixed; if the sender avatars of the last four multimedia messages are merged into a merged avatar, the merged avatar is dynamically changing.

[0339] Optionally, the m multimedia messages are randomly and dynamically selected. Exemplarily, m multimedia messages are randomly selected from n+1 multimedia messages for merging.

[0340] Step 840: Send the merged avatar to the chat client.

[0341] In some embodiments, the merged avatar is sent to the chat client.

[0342] To sum up, the method provided in the embodiment of the present application, by generating a merged avatar and sending the merged avatar to the chat client, enables the user accounts in the chat window to know the multimedia messages sent by which user accounts the merged message is based on, which can help user accounts to view and understand each other more to a certain extent.

[0343] Fig.40 is a flowchart of a message merging method provided by an exemplary embodiment of the present application. Figure 1 The terminal 120 and the server 140 in the computer system 100 shown in the figure cooperate to execute the above method, and the method further includes:

[0344] Step 1: The terminal displays n multimedia messages;

[0345] For a specific implementation, please refer to the above step 220 .

[0346] Step 2: The terminal receives the (n+1)th multimedia message;

[0347] For the specific implementation, please refer to the above step 240 .

[0348] Step 3: The server receives the (n+1)th multimedia message;

[0349] For the specific implementation, please refer to the above step 620.

[0350] It is worth noting that there is no order distinction between step 2 and step 3. In some embodiments, step 2 is performed before step 3. In some embodiments, step 3 is performed before step 2. In some embodiments, step 2 and step 3 are performed simultaneously.

[0351] Step 4: When the n+1 multimedia messages meet the merge display condition, the server merges the n+1 multimedia messages into one merged message;

[0352] For the specific implementation, please refer to the above step 640.

[0353] Step 5: The server sends a merge message to the terminal;

[0354] For the specific implementation, please refer to the above step 660.

[0355] Step 6: The terminal receives the merge message sent by the server;

[0356] The terminal receives a combined message generated by the server when n+1 multimedia messages meet the combined display condition.

[0357] Step 7: The terminal displays a merge message;

[0358] For the specific implementation, please refer to the above step 260 .

[0359] Step 8: The terminal receives the trigger operation of the user account on the merge message;

[0360] In some embodiments, the trigger operation on the merged message is used to indicate the splitting of the merged message. In some embodiments, the trigger operation on the merged message includes at least one of single click, double click, left and right slide, up and down slide, long press, hover, facial recognition, and voice recognition. It is worth noting that the trigger operation on the merged message includes but is not limited to the above-mentioned ones. Those skilled in the art should be able to know that any operation that can achieve the above functions belongs to the protection scope of the embodiments of the present application.

[0361] Step 9: The terminal displays the split n+1 multimedia messages in response to the trigger operation on the merged message;

[0362] For the specific implementation, please refer to the above step 520.

[0363] Step 10: The server generates a merged avatar based on the sender avatar corresponding to the merged message;

[0364] For a specific implementation, please refer to the above step 820.

[0365] Step 11: The server sends the merged avatar to the terminal;

[0366] For the specific implementation, please refer to the above step 840.

[0367] Step 12: The terminal receives the merged avatar;

[0368] The terminal receives a merged avatar obtained by merging all or part of the avatars of the sender of the n+1 multimedia messages.

[0369] Step 13: The terminal displays the merged avatar;

[0370] For a specific implementation, please refer to the above step 410 .

[0371] Step 14: The terminal receives a trigger operation of the user account on the merged avatar;

[0372] In some embodiments, the trigger operation on the merged avatar is used to indicate the splitting of the merged avatar. In some embodiments, the trigger operation on the merged avatar includes at least one of single click, double click, left and right slide, up and down slide, long press, hover, facial recognition, and voice recognition. It is worth noting that the trigger operations on the merged avatar include but are not limited to the above-mentioned ones. Those skilled in the art should be able to know that any operation that can achieve the above functions belongs to the protection scope of the embodiments of the present application.

[0373] Step 15: The terminal responds to the trigger operation on the merged avatar and displays the n+1 avatars after the splitting;

[0374] For the specific implementation, please refer to the above step 430 .

[0375] It is worth noting that the above steps 10 to 15 can be performed after step 4.

[0376] Step 16: The terminal receives the (n+2)th multimedia message;

[0377] For the specific implementation, please refer to the above step 270 .

[0378] Step 17: The server receives the (n+2)th multimedia message;

[0379] For the specific implementation, please refer to the above step 670.

[0380] It is worth noting that there is no order distinction between step 16 and step 17. In some embodiments, step 16 is performed before step 17. In some embodiments, step 17 is performed before step 16. In some embodiments, step 16 and step 17 are performed simultaneously.

[0381] Step 18: When the n+2 multimedia messages meet the merge display condition, the server merges the n+2 multimedia messages into an updated merged message;

[0382] For the specific implementation, please refer to the above step 680.

[0383] Step 19: The server sends the updated merged message to the terminal;

[0384] For the specific implementation, please refer to the above step 690.

[0385] Step 20: The terminal receives the updated merged message;

[0386] The terminal receives an updated merged message generated by the server when the n+2 multimedia messages meet the merged display condition.

[0387] Step 21: The terminal displays the updated merge message.

[0388] For the specific implementation, please refer to the above step 280 .

[0389] It is worth noting that the above steps 16 to 21 can be performed after step 7.

[0390] Optionally, the following uses a multimedia message as an emoticon message as an example for explanation.

[0391] In the related art, the emoji messages sent in social software groups are relatively independent, each emoji message is presented in an individual form, and the animation and shape of each emoji message are fixed and cannot be changed. The quoting and +1 operations of emoji messages can only be performed outside of emoji messages. Due to the large number of people in social software groups, it is often seen that a large number of homogeneous emoji messages are swiped across the screen. The swiping of emoji messages across the screen will cause a large number of invalid emoji messages to appear in the social software group. These repeated emoji messages are just an emotional expression of the user account that sent the emoji message. For people who receive emoji messages, the message notifications brought by the high-frequency emoji messages will only cause interference, and the user account will spend a lot of time to find useful information in the social software group.

[0392] In order to solve the above problems, a message merging method is provided in the embodiment of the present application, and a more efficient, easy-to-operate and interesting screen-swiping voice emoticon package function is designed for the user account. The AI ​​model is controlled to generate new voice emoticon package messages through the synthesis function of the AI ​​model and the random number of screen-swiping people in the social software group. Thereby, when sending voice emoticon package messages, the user account's personal emotions can be conveyed, and the voice emoticon package messages can be presented in different shapes after repeated screen swiping. At the same time, the group message disturbance caused by screen swiping can be avoided, and important messages in the social software group can be received in the shortest time.

[0393] In some embodiments, the user account of the chat client opens the function panel, selects the voice emoticon package, and sends the voice emoticon package message to the chat window. Fig.41 As shown, the user account opens the function panel 31, clicks the voice emoticon package 32 in the function panel 31, and sends the voice emoticon package 32 to the chat window for display.

[0394] In some embodiments, a user account may choose to turn the sound of a voice emoticon on or off.

[0395] In some embodiments, when the same voice emoji message starts to be swiped across the screen in a social software group, and the number of voice emoji messages is greater than or equal to 5, the AI ​​model will automatically take over the voice emoji message. At this time, the voice emoji message sent by a single user account is no longer presented as a single voice emoji message in the chat window, but becomes a merged voice emoji message. In the visual experience of the merged voice emoji message, the emoji area becomes larger, and the avatar of the user account that sent the message becomes a collection display. Long press the avatar collection to see how many user accounts have sent voice emoji messages.

[0396] In some embodiments, the shape and sound of the combined voice emoticon package message will change with the number of screen swipes. The shape includes at least one of shape, font, color, animation, and decoration. The sound includes at least one of chorus, voice change (male voice, female voice, cartoon voice, animal voice, etc.), and atmosphere sound (applause, fireworks, insect chirping, bird chirping, etc.).

[0397] In some embodiments, the synthesis intensity parameter of the voice emoticon package message can be set in the social software group. When the number of voice emoticon package messages in the social software group is 5, the form of the merged voice emoticon package message under different synthesis intensity parameters will also change. When the synthesis intensity parameter is 30%, the sound of the merged voice emoticon package message is a multi-person harmony synthesized from the original sound. When the synthesis intensity parameter is 90%, in addition to the multi-person harmony synthesized from the original sound, ambient sounds will also be added, such as applause, celebration, insect chirping, bird calls and other ambient sounds.

[0398] In some embodiments, when the number of voice meme messages in a social software group changes, the forms presented by the merged voice meme messages under the action of different synthesis strength parameters will also change simultaneously with the change in the number and the change in the synthesis strength parameters.

[0399] In some embodiments, the message merging method provided by the embodiments of the present application is executed collaboratively by a terminal and a server.

[0400] In some embodiments, as Fig.42 shown, the execution steps of the terminal include:

[0401] Step 41: Receive multimedia messages;

[0402] Step 42: Determine whether the merge display condition is satisfied;

[0403] Step 43: Display the merged message when the merge display condition is satisfied;

[0404] Step 44: Determine whether the user account has read the merged message;

[0405] Step 45: When the user account has not read the merged message, display a special effect floating layer and display the merged avatar;

[0406] Step 46: Display the multimedia message when the merge display condition is not satisfied.

[0407] In some embodiments, as Fig.43 shown, the execution steps of the server include:

[0408] Step 51: Filter multimedia messages;

[0409] Step 52: Find that the number of consecutive and identical multimedia messages is greater than the number threshold;

[0410] In some embodiments, assuming that the sending time of the first voice meme message is t1, the sending time of the second voice meme message is t2, and there are a different other messages between the first voice meme message and the second voice meme message, it can be set that if t2 – t1 <3600000> ms and a < 5, it is a consecutive message; when the voice meme messages accumulate to 5 consecutive messages, the same voice meme messages can be merged and a merged voice meme message can be generated. The value of a is a positive integer.

[0411] It is generally believed that a similarity greater than or equal to 90% can be considered to be the same voice emoticon package message. For example, obtain the first picture information P1 corresponding to the first voice emoticon package message, and obtain the second picture information P2 corresponding to the second voice emoticon package message. Get the arrays of the three color channels of red, yellow and blue of P1 and P2 respectively; calculate the histogram information of each channel; compare the overlap of the three color channels corresponding to P1 and P2 respectively: take the average value of the similarity of the three color channels, and obtain the similarity between the first voice emoticon package message and the second voice emoticon package message.

[0412] Step 53: Trigger message merging and generate a merged message.

[0413] The server continuously filters and calculates whether the received multimedia messages meet the merged display conditions. If it is calculated that the merged display conditions are met, it is accumulated once until 5 messages are accumulated, which can trigger the generation of a merged voice emoticon package message.

[0414] After the server generates the merged voice emoticon package message, it sends it to the terminal for display. After the terminal receives the merged voice emoticon package message and finds that it is a merged message, it first cancels the display of the merged original voice emoticon package message and then displays the merged voice emoticon package message.

[0415] In some embodiments, Fig.44 As shown, the message merging method provided in the embodiment of the present application is implemented based on an overall generation algorithm model. The multimedia message, message quantity, synthesis intensity parameter, original picture, and original sound are input into the generation algorithm model, and after a series of processing such as picture processing, decoration processing, and voice processing, new pictures and new sounds are output.

[0416] Fig.45 A block diagram of a message merging device provided by an exemplary embodiment of the present application is shown. The device includes:

[0417] Display module 4510 is used to display n multimedia messages in the chat window, where n is a positive integer.

[0418] The receiving module 4520 is used to receive the (n+1)th multimedia message.

[0419] The display module 4510 is further used to combine and display the n+1 multimedia messages into one combined message in response to the n+1 multimedia messages satisfying the combined display condition, wherein the message content of the combined message is obtained based on the combination of the n+1 multimedia messages.

[0420] The n+1 multimedia messages include n multimedia messages and the n+1th multimedia message.

[0421] The display module 4510 is further configured to combine and display the n+1 multimedia messages into one combined message in response to the number of the n+1 multimedia messages reaching a number threshold and satisfying a continuous message condition.

[0422] The continuous message condition means that the sending time interval between two adjacent multimedia messages is less than a first threshold, and the number of other messages between the two adjacent multimedia messages is less than a second threshold.

[0423] The display module 4510 is further configured to merge and display the n+1 multimedia messages into one merged message in response to the number of the n+1 multimedia messages reaching a number threshold and satisfying a continuous message condition and the n+1 multimedia messages being the same message.

[0424] Display module 4510 is also used to merge n+1 multimedia messages into one merged message in response to the number of n+1 multimedia messages reaching a number threshold and satisfying a continuous message condition and the n+1 multimedia messages are messages whose similarity reaches a threshold.

[0425] Display module 4510 is also used to merge and display the n+1 multimedia messages into one merged message in response to the number of n+1 multimedia messages reaching a number threshold and satisfying a continuous message condition and the n+1 multimedia messages are complementary type messages.

[0426] In some embodiments, the complementary type of message includes at least one of the following:

[0427] The message contents are combined into multimedia messages of friends' intimate activities;

[0428] The message contents are combined with each other into a multimedia message of the couple's intimate activities;

[0429] The message contents are combined with each other into multimedia messages for group entertainment activities;

[0430] The message contents are combined into a multimedia message for group blessing activities.

[0431] The receiving module 4520 is further used to receive the (n+2)th multimedia message.

[0432] The display module 4510 is further used to display an updated merged message in response to n+2 multimedia messages satisfying a merged display condition, wherein the message content of the updated merged message is obtained based on the merger of the n+2 multimedia messages.

[0433] The n+2 multimedia messages include the n+1 multimedia message and the n+2th multimedia message.

[0434] In some embodiments, the visual content of the merged message is merged based on the visual contents of n+1 multimedia messages; and / or, the voice content of the merged message is merged based on the voice contents of n+1 multimedia messages.

[0435] In some embodiments, the message content of the merged message includes: a common part and a group part.

[0436] In some embodiments, the common portion is obtained by merging at least one identical content in n+1 multimedia messages.

[0437] In some embodiments, the group part is obtained by rearranging individual contents in n+1 multimedia messages into n+1 individual contents representing the group.

[0438] In some embodiments, the message content of the merged message also includes: a background atmosphere part.

[0439] In some embodiments, the background atmosphere portion is message content that is added as the background atmosphere of n+1 individual contents in addition to the message content of n+1 multimedia messages.

[0440] In some embodiments, the display elements in the merged message are related to the number of n+1 multimedia messages.

[0441] In some embodiments, the display element includes at least one of the following:

[0442] The apparent size of the merged message;

[0443] Merge numbers in messages;

[0444] The number of individual contents in the merged message;

[0445] The number of decorations in the merged message;

[0446] Merge decoration levels in messages;

[0447] The presentation method of n+1 individual contents used to represent the group in the merged message.

[0448] In some embodiments, the merged message is generated by an artificial intelligence (AI) model, and the display elements in the merged message are related to the synthesis strength parameters of the AI ​​model.

[0449] The display module 4510 is also used to display adjustment controls, which are used to adjust the synthesis intensity parameters of the AI ​​model.

[0450] In some embodiments, the apparatus further comprises:

[0451] The determination module 4530 is used to determine the synthesis force parameters of the AI ​​model in response to the trigger operation on the adjustment control.

[0452] In some embodiments, the apparatus further comprises:

[0453] The sending module 4540 is used to send the synthesis strength parameters of the AI ​​model to the server.

[0454] The display module 4510 is further configured to display the sender avatar corresponding to the merged message as a merged avatar, where the merged avatar is obtained by merging all or part of the avatars of the senders of n+1 multimedia messages.

[0455] Display module 4510 is also used to display a special effect floating layer on the chat window for displaying the merged avatar, and the special effect floating layer is used to prompt that a merged message is displayed on the chat window.

[0456] The display module 4510 is also used to respond to a trigger operation on the merged avatar to display the n+1 avatars after the splitting, and the n+1 avatars correspond one-to-one to the avatars of the senders of the n+1 multimedia messages.

[0457] The display module 4510 is further used to display the split n+1 multimedia messages in response to a trigger operation on the merged message.

[0458] The display module 4510 is also used to cancel the display of n multimedia messages.

[0459] In some embodiments, the multimedia message includes at least one of an expression message, a voice message, a voice expression message, a picture message, and a video message.

[0460] Fig.46 A block diagram of a message merging device provided by an exemplary embodiment of the present application is shown. The device includes:

[0461] The receiving module 4610 is used to receive n+1 multimedia messages, where n is a positive integer.

[0462] The merging module 4620 is used to merge n+1 multimedia messages into one merged message when the n+1 multimedia messages meet the merged display condition, and the message content of the merged message is obtained based on the merger of the n+1 multimedia messages.

[0463] The sending module 4630 is used to send the merged message to the chat client.

[0464] The merging module 4620 is further configured to merge the n+1 multimedia messages into one merged message when the number of the n+1 multimedia messages reaches a number threshold and satisfies a continuous message condition.

[0465] The continuous message condition means that the sending time interval between two adjacent multimedia messages is less than a first threshold, and the number of other messages between the two adjacent multimedia messages is less than a second threshold.

[0466] The merging module 4620 is further configured to merge n+1 multimedia messages into one merged message when the number of n+1 multimedia messages reaches a number threshold and satisfies a continuous message condition and the n+1 multimedia messages are the same message.

[0467] The merging module 4620 is also used to merge n+1 multimedia messages into one merged message when the number of n+1 multimedia messages reaches a number threshold and satisfies a continuous message condition and the n+1 multimedia messages are messages whose similarity reaches a threshold.

[0468] The merging module 4620 is further configured to merge n+1 multimedia messages into one merged message when the number of n+1 multimedia messages reaches a number threshold and satisfies a continuous message condition and the n+1 multimedia messages are messages of complementary types.

[0469] In some embodiments, the complementary type of message includes at least one of the following:

[0470] The message contents are combined into multimedia messages of friends' intimate activities;

[0471] The message contents are combined with each other into a multimedia message of the couple's intimate activities;

[0472] The message contents are combined with each other into multimedia messages for group entertainment activities;

[0473] The message contents are combined into a multimedia message for group blessing activities.

[0474] The receiving module 4610 is further used to receive the (n+2)th multimedia message.

[0475] The merging module 4620 is also used to merge the n+2 multimedia messages into an updated merged message when the n+2 multimedia messages meet the merged display conditions, and the message content of the updated merged message is obtained based on the merger of the n+2 multimedia messages.

[0476] The sending module 4630 is further configured to send the updated merged message to the chat client.

[0477] The n+2 multimedia messages include the n+1 multimedia message and the n+2th multimedia message.

[0478] The merging module 4620 is further configured to merge the visual contents of n+1 multimedia messages to obtain the visual content of a merged message.

[0479] The merging module 4620 is further used to merge the voice contents of n+1 multimedia messages to obtain the voice content of the merged message.

[0480] In some embodiments, the message content of the merged message includes: a common part and a group part.

[0481] The merging module 4620 is further used to merge at least one identical content in the n+1 multimedia messages to obtain a common part.

[0482] The merging module 4620 is further used to rearrange the individual contents in the n+1 multimedia messages into n+1 individual contents representing a group to obtain a group part.

[0483] In some embodiments, the message content of the merged message also includes: a background atmosphere part.

[0484] The merging module 4620 is further used to add message contents serving as background atmospheres of n+1 individual contents in addition to the message contents of the n+1 multimedia messages, to obtain a background atmosphere part.

[0485] In some embodiments, the display element in the merged message is related to the number of n+1 multimedia messages, and the display element includes at least one of the following:

[0486] The apparent size of the merged message;

[0487] Merge numbers in messages;

[0488] The number of individual contents in the merged message;

[0489] The number of decorations in the merged message;

[0490] Merge decoration levels in messages;

[0491] A presentation method for combining at least two individual contents in a message to represent a group.

[0492] In some embodiments, the display element in the merged message is related to a synthesis strength parameter of the AI ​​model.

[0493] The merging module 4620 is also used to input n+1 multimedia messages and synthesis intensity parameters into the AI ​​model.

[0494] The merging module 4620 is also used to generate a merge message based on the AI ​​model.

[0495] The receiving module 4610 is also used to receive synthesis strength parameters.

[0496] The merging module 4620 is further used to generate a merged avatar based on the sender avatar corresponding to the merged message. The merged avatar is obtained by merging all or part of the avatars of the senders of n+1 multimedia messages.

[0497] The sending module 4630 is also used to send the merged avatar to the chat client.

[0498] Fig.47 The schematic diagram of the structure of a computer device provided by an exemplary embodiment of the present application is shown. Schematically, the computer device 4700 includes a central processing unit (CPU) 4701, a system memory 4704 including a random access memory (RAM) 4702 and a read-only memory (ROM) 4703, and a system bus 4705 connecting the system memory 4704 and the central processing unit 4701. The computer device 4700 also includes a basic input / output system 4706 that helps transmit information between various devices in the computer, and a large-capacity storage device 4707 for storing an operating system 4713, an application program 4714, and other program modules 4715.

[0499] The basic input / output system 4706 includes a display 4708 for displaying information and an input device 4709 such as a mouse and a keyboard for inputting information into a user account. The display 4708 and the input device 4709 are connected to the central processing unit 4701 via an input / output controller 4710 connected to the system bus 4705. The basic input / output system 4706 may also include an input / output controller 4710 for receiving and processing inputs from a plurality of other devices such as a keyboard, a mouse, or an electronic stylus. Similarly, the input / output controller 4710 also provides output to a display screen, a printer, or other types of output devices.

[0500] The mass storage device 4707 is connected to the central processing unit 4701 via a mass storage controller (not shown) connected to the system bus 4705. The mass storage device 4707 and its associated computer readable medium provide non-volatile storage for the computer device 4700. That is, the mass storage device 4707 may include a computer readable medium (not shown) such as a hard disk or a compact disc read-only memory (CD-ROM) drive.

[0501] The computer readable medium may include computer storage media and communication media. Computer storage media include volatile and non-volatile, removable and non-removable media implemented by any method or technology for storing information such as computer readable instructions, data structures, program modules or other data. Computer storage media include RAM, ROM, Erasable Programmable Read-Only Memory (EPROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), flash memory or other solid-state storage technology, CD-ROM, Digital Versatile Disc (DVD) or other optical storage, cassettes, tapes, disk storage or other magnetic storage devices. Of course, those skilled in the art will know that the computer storage medium is not limited to the above. The above-mentioned system memory 4704 and mass storage device 4707 can be collectively referred to as memory.

[0502] According to various embodiments of the present application, the computer device 4700 can also be connected to a remote computer on the network through a network such as the Internet. That is, the computer device 4700 can be connected to the network 4712 through the network interface unit 4711 connected to the system bus 4705, or the network interface unit 4711 can be used to connect to other types of networks or remote computer systems (not shown).

[0503] An exemplary embodiment of the present application further provides a computer-readable storage medium, in which at least one program is stored. The at least one program is loaded and executed by a processor to implement the message merging methods provided by the above-mentioned various method embodiments.

[0504] An exemplary embodiment of the present application also provides a computer program product, which includes at least one program, and the at least one program is stored in a readable storage medium; the processor of the communication device reads the signaling from the readable storage medium, and the processor executes the signaling, so that the communication device executes to implement the message merging method provided by the above-mentioned various method embodiments.

[0505] It should be understood that the "plurality" mentioned in this article refers to two or more. Those skilled in the art will easily think of other embodiments of the present application after considering the specification and practicing the invention disclosed here. The present application is intended to cover any modification, use or adaptation of the present application, which follows the general principles of the present application and includes common knowledge or customary technical means in the art that are not disclosed in the present application. The description and examples are only regarded as exemplary, and the true scope and spirit of the present application are indicated by the following claims.

[0506] A person skilled in the art will understand that all or part of the steps to implement the above embodiments may be accomplished by hardware or by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a disk or an optical disk, etc.

[0507] The above description is only an optional embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent switching, improvements, etc. made within the spirit and principles of the present application shall be included in the protection scope of the present application.

Claims

1. A message merging method, characterized in that: The method is executed by a chat client, and comprises: Display n multimedia messages in the chat window, where n is a positive integer; Receive the n+1th multimedia message; In response to n+1 multimedia messages satisfying a merge display condition, the n+1 multimedia messages are merged and displayed as a merged message, wherein the message content of the merged message is obtained by merging the n+1 multimedia messages; The n+1 multimedia messages include the n multimedia messages and the n+1th multimedia message.

2. The method according to claim 1, characterized in that In response to the n+1 multimedia messages satisfying the merged display condition, merging and displaying the n+1 multimedia messages into one merged message includes: In response to the number of the n+1 multimedia messages reaching a number threshold and satisfying a continuous message condition, merging the n+1 multimedia messages into one merged message; The continuous message condition refers to that the sending time interval between two adjacent multimedia messages is less than a first threshold, and the number of other messages between the two adjacent multimedia messages is less than a second threshold.

3. The method according to claim 2, characterized in that In response to the number of the n+1 multimedia messages reaching a number threshold and satisfying a continuous message condition, merging and displaying the n+1 multimedia messages into a merged message includes: In response to the number of the n+1 multimedia messages reaching a number threshold and satisfying a continuous message condition and the n+1 multimedia messages being the same message, merging the n+1 multimedia messages into one merged message; or, In response to the number of the n+1 multimedia messages reaching a number threshold and satisfying a continuous message condition and the n+1 multimedia messages being messages whose similarity reaches a threshold, the n+1 multimedia messages are combined and displayed as one combined message.

4. The method according to claim 2, characterized in that: In response to the number of the n+1 multimedia messages reaching a number threshold and satisfying a continuous message condition, merging and displaying the n+1 multimedia messages into a merged message includes: In response to the number of the n+1 multimedia messages reaching a number threshold and satisfying a continuous message condition and the n+1 multimedia messages being messages of complementary types, the n+1 multimedia messages are combined and displayed as one combined message.

5. The method according to claim 4, characterized in that The complementary type of message includes at least one of the following: The message contents are combined into multimedia messages of friends' intimate activities; The message contents are combined with each other into a multimedia message of the couple's intimate activities; The message contents are combined with each other into multimedia messages for group entertainment activities; The message contents are combined into a multimedia message for group blessing activities.

6. The method according to any one of claims 1 to 5, characterized in that: The method further comprises: Receive the (n+2)th multimedia message; In response to n+2 multimedia messages satisfying a merge display condition, displaying an updated merged message, wherein the message content of the updated merged message is obtained by merging the n+2 multimedia messages; The n+2 multimedia messages include the n+1 multimedia message and the n+2th multimedia message.

7. The method according to any one of claims 1 to 5, characterized in that: The visual content of the merged message is obtained by merging the visual contents of the n+1 multimedia messages; and / or, The voice content of the merged message is merged based on the voice contents of the n+1 multimedia messages.

8. The method according to any one of claims 1 to 5, characterized in that: The message content of the merged message includes: a public part and a group part; The common part is obtained by merging at least one identical content in the n+1 multimedia messages; The group part is obtained by rearranging individual contents in the n+1 multimedia messages into n+1 individual contents representing a group.

9. The method according to claim 8, characterized in that The message content of the merged message also includes: a background atmosphere part; The background atmosphere part is the message content that is added to the message content of the n+1 multimedia messages as the background atmosphere of the n+1 individual contents.

10. The method according to any one of claims 1 to 5, characterized in that: The display element in the merged message is related to the number of the n+1 multimedia messages, and the display element includes at least one of the following: the apparent size of the merged message; A number in the merged message; the number of individual contents in the merged message; the number of decorations in the merged message; the level of decorations in the merged message; The combined message is used to present n+1 individual contents representing a group.

11. The method according to any one of claims 1 to 5, characterized in that: The combined message is generated by an artificial intelligence (AI) model, and the display element in the combined message is related to the synthesis strength parameter of the AI ​​model. The display element includes at least one of the following: the apparent size of the merged message; A number in the merged message; the number of individual contents in the merged message; the number of decorations in the merged message; the level of decorations in the merged message; The combined message is used to present n+1 individual contents representing a group.

12. The method according to claim 11, characterized in that The method further comprises: Displaying an adjustment control, wherein the adjustment control is used to adjust the synthesis strength parameter of the AI ​​model; In response to a trigger operation on the adjustment control, the synthetic force parameter of the AI ​​model is determined.

13. The method according to any one of claims 1 to 5, characterized in that: The method further comprises: The sender avatar corresponding to the merged message is displayed as a merged avatar, where the merged avatar is obtained by merging all or part of the avatars of the senders of the n+1 multimedia messages.

14. A message merging method, characterized in that: The method is executed by a server, and comprises: Receive n+1 multimedia messages, where n is a positive integer; In the case where the n+1 multimedia messages meet the merge display condition, the n+1 multimedia messages are merged into one merged message, the message content of the merged message is obtained based on the merging of the n+1 multimedia messages; The combined message is sent to the chat client.

15. The method according to claim 14, characterized in that When the n+1 multimedia messages meet the merge display condition, merging the n+1 multimedia messages into one merged message includes: When the number of the n+1 multimedia messages reaches a number threshold and satisfies a continuous message condition, merging the n+1 multimedia messages into one merged message; The continuous message condition refers to that the sending time interval between two adjacent multimedia messages is less than a first threshold, and the number of other messages between the two adjacent multimedia messages is less than a second threshold.

16. The method according to claim 15, characterized in that When the number of the n+1 multimedia messages reaches a number threshold and satisfies a continuous message condition, merging the n+1 multimedia messages into one merged message includes: When the number of the n+1 multimedia messages reaches a number threshold and satisfies a continuous message condition and the n+1 multimedia messages are the same message, merging the n+1 multimedia messages into one merged message; or, When the number of the n+1 multimedia messages reaches a number threshold and satisfies a continuous message condition and the n+1 multimedia messages are messages whose similarity reaches a threshold, the n+1 multimedia messages are merged into one merged message.

17. The method according to claim 15, characterized in that When the number of the n+1 multimedia messages reaches a number threshold and satisfies a continuous message condition, merging the n+1 multimedia messages into one merged message includes: In a case where the number of the n+1 multimedia messages reaches a number threshold and satisfies a continuous message condition and the n+1 multimedia messages are messages of complementary types, the n+1 multimedia messages are merged into one merged message.

18. The method according to any one of claims 14 to 17, characterized in that: The method further comprises: Receive the (n+2)th multimedia message; In the case where n+2 multimedia messages meet the merge display condition, the n+2 multimedia messages are merged into an updated merged message, where the message content of the updated merged message is obtained based on the merge of the n+2 multimedia messages; Sending the updated merged message to the chat client; The n+2 multimedia messages include the n+1 multimedia message and the n+2th multimedia message.

19. The method according to any one of claims 14 to 17, characterized in that: The display elements in the merged message are related to the synthesis strength parameters of the AI ​​model; The step of merging the n+1 multimedia messages into one merged message includes: Inputting the n+1 multimedia messages and the synthesis intensity parameter into the AI ​​model; The merged message is generated based on the AI ​​model.

20. The method according to any one of claims 14 to 17, characterized in that: The method further comprises: generating a combined avatar based on the sender avatar corresponding to the combined message, wherein the combined avatar is obtained by combining all or part of the avatars of the senders of the n+1 multimedia messages; The combined avatar is sent to the chat client.

21. A message merging device, characterized in that: The device comprises: A display module, used for displaying n multimedia messages in the chat window, where n is a positive integer; A receiving module, used for receiving the (n+1)th multimedia message; The display module is further configured to, in response to n+1 multimedia messages satisfying a merge display condition, merge and display the n+1 multimedia messages into one merged message, wherein the message content of the merged message is obtained by merging the n+1 multimedia messages; The n+1 multimedia messages include the n multimedia messages and the n+1th multimedia message.

22. A message merging device, characterized in that: The device comprises: A receiving module, used for receiving n+1 multimedia messages, where n is a positive integer; a merging module, configured to merge the n+1 multimedia messages into one merged message if the n+1 multimedia messages meet a merge display condition, wherein the message content of the merged message is obtained by merging the n+1 multimedia messages; The sending module is used to send the merged message to the chat client.

23. A computer device, characterized in that: The computer device comprises: a processor and a memory, wherein the memory stores a computer program, and the computer program is loaded and executed by the processor to implement the message merging method according to any one of claims 1 to 13 or the message merging method according to any one of claims 14 to 20.

24. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and the computer program is loaded and executed by a processor to implement the message merging method according to any one of claims 1 to 13 or the message merging method according to any one of claims 14 to 20.

25. A computer program product, characterized in that The computer program product includes computer instructions, which are stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes to implement the message merging method described in any one of claims 1 to 13 or the message merging method described in any one of claims 14 to 20.

Images