Message processing method and device, electronic equipment and storage medium

Abstract

The invention provides a message processing method and device, electronic equipment and a storage medium, and belongs to the technical field of artificial intelligence. The method comprises the following steps: displaying an interaction page between a first user account and a second user account; in response to the obtained new multimedia message, displaying the multimedia message on the interactive page; and under the condition that the multimedia message is in a non-voice form, displaying a voice synthesis result of the multimedia message, and broadcasting the voice synthesis result based on the voice characteristics of the target role. For a private message scene, the multimedia message processing method and the multimedia message processing device support converting multimedia messages in a non-voice form into voice and broadcasting the voice according to voice features of a specific role. The voice conversion function enriches man-machine interaction modes in a private message scene, and meets diversified conversion requirements of users. In addition, based on the voice conversion function, the message content sent by the opposite side can be quickly and conveniently obtained, and thus the communication efficiency can be improved.

Description

Technical Field

[0001] The present disclosure relates to the field of artificial intelligence technology, and in particular to a message processing method, device, electronic device and storage medium. Background Art

[0002] With the development of Internet technology and the popularization of smart terminals, more and more interactive methods have emerged, such as private message interactions based on social networks. Among them, private message interaction methods include one-to-one private message interactions and one-to-many private message interactions. However, whether it is one-to-one private message interaction or one-to-many private message interaction, currently only voice-to-text functions are provided, such as supporting users to convert received voice messages into text. Since only voice-to-text is supported in the current private message scenario, the function is single and there is a problem that it cannot meet the diverse conversion needs of users, and the human-computer interaction effect is poor. Summary of the invention

[0003] The present disclosure provides a message processing method, device, electronic device and storage medium. The technical solution of the present disclosure is as follows:

[0004] According to a first aspect of an embodiment of the present disclosure, a message processing method is provided, including:

[0005] displaying an interaction page between the first user account and the second user account;

[0006] In response to acquiring a new multimedia message, displaying the multimedia message on the interactive page;

[0007] In the case that the multimedia message is in a non-voice form, a speech synthesis result of the multimedia message is displayed, and the speech synthesis result is announced based on the voice feature of the target character.

[0008] In some embodiments, a setting control is displayed on the interactive page, and the method further includes:

[0009] In response to a triggering operation on the setting control, a first setting page is displayed, wherein a plurality of role options are displayed on the first setting page;

[0010] In response to a selection operation on any one of the multiple role options, the selected role is used as the target role.

[0011] In some other embodiments, in response to the triggering operation on the setting control, displaying the first setting page includes:

[0012] In response to a triggering operation on the setting control, a second setting page is displayed, on which a target setting option is displayed, and the target setting option is used to indicate whether automatic voice broadcast is turned on;

[0013] When the target setting option indicates that the automatic voice broadcast is not turned on, in response to the turning on operation of the automatic voice broadcast, the plurality of role options are displayed on the first setting page.

[0014] In some other embodiments, when the target setting option indicates that the automatic voice broadcast is not turned on, in response to the operation of turning on the automatic voice broadcast, displaying the multiple role options on the first setting page includes:

[0015] In a case where the target setting option indicates that automatic voice broadcast is not turned on, in response to a selection operation of the target setting option, displaying a first control on the first setting page;

[0016] In response to the opening operation based on the first control, the plurality of role options are displayed on the first setting page.

[0017] In some other embodiments, the method further comprises:

[0018] For each character category, display the character options that are to be unlocked under the character category;

[0019] In response to a triggering operation on any character option in the to-be-unlocked state, displaying prompt information;

[0020] The prompt information is used to prompt that the role option can be unlocked under the premise of meeting preset conditions.

[0021] In some other embodiments, the preset condition includes any one of the following:

[0022] Unlocking said character options by transferring a preset amount of virtual resources;

[0023] Unlock said character options by completing the target missions;

[0024] The role option is unlocked after the cumulative number of interactions between the first user account and the second user account reaches a preset threshold.

[0025] In some other embodiments, the method further comprises:

[0026] Displaying a second control, where the second control is used to prompt others to invite others to record sound;

[0027] In response to the triggering operation on the second control, sending a sound recording request to a third user account;

[0028] Receiving the recorded audio feedback from the third user account;

[0029] The voice feature of the third user account is obtained based on the recorded audio, and the role option of the third user account is added to the multiple role options.

[0030] In some other embodiments, in response to the triggering operation on the second control, sending a sound recording request to a third user account includes:

[0031] In response to a triggering operation on the second control, displaying an account selection list, wherein the account selection list includes the third user account;

[0032] In response to the selection operation of the third user account, the account identification of the third user account is displayed on the first setting page, and the sound recording request is sent to the third user account.

[0033] In some other embodiments, displaying the speech synthesis result of the multimedia message and announcing the speech synthesis result based on the voice characteristics of the target character includes:

[0034] Displaying a voice broadcast mark of the multimedia message on the interactive page;

[0035] In response to a triggering operation on the voice broadcast mark, a voice synthesis result of the multimedia message is displayed, and the voice synthesis result is broadcast based on the voice feature of the target character.

[0036] In some other embodiments, displaying the speech synthesis result of the multimedia message and announcing the speech synthesis result based on the voice characteristics of the target character includes:

[0037] In response to a triggering operation on the multimedia message, displaying a function panel on the interactive page, the function panel including a voice broadcast control;

[0038] In response to a triggering operation on the voice broadcast control, a voice synthesis result of the multimedia message is displayed, and the voice synthesis result is broadcast based on the voice feature of the target character.

[0039] In some other embodiments, performing speech synthesis on the multimedia message to obtain a speech synthesis result includes:

[0040] When the multimedia message is in text form, converting the multimedia message into speech to obtain the speech synthesis result;

[0041] In the case where the multimedia message is an image, performing image semantic recognition on the multimedia message to obtain an image semantic recognition result; performing speech synthesis based on the image semantic recognition result to obtain the speech synthesis result;

[0042] In the case that the multimedia message is a video, a content summary is performed on the multimedia message to obtain a content summary; and speech synthesis is performed based on the content summary to obtain the speech synthesis result.

[0043] According to a second aspect of an embodiment of the present disclosure, a message processing device is provided, including:

[0044] A first display module is configured to display an interactive page between the first user account and the second user account; in response to obtaining a new multimedia message, display the multimedia message on the interactive page;

[0045] The speech synthesis module is configured to display the speech synthesis result of the multimedia message when the multimedia message is in a non-speech form, and announce the speech synthesis result based on the voice characteristics of the target character.

[0046] In some embodiments, a setting control is displayed on the interactive page, and the apparatus further comprises:

[0047] A second display module is configured to display a first setting page in response to a triggering operation on the setting control, wherein the first setting page displays a plurality of role options;

[0048] The processing module is configured to, in response to a selection operation on any one of the multiple role options, use the selected role as the target role.

[0049] In some other embodiments, the second display module is further configured as:

[0050] In response to a triggering operation on the setting control, a second setting page is displayed, on which a target setting option is displayed, and the target setting option is used to indicate whether automatic voice broadcast is turned on;

[0051] When the target setting option indicates that the automatic voice broadcast is not turned on, in response to the turning on operation of the automatic voice broadcast, the plurality of role options are displayed on the first setting page.

[0052] In some other embodiments, the second display module is further configured as:

[0053] In a case where the target setting option indicates that automatic voice broadcast is not turned on, in response to a selection operation of the target setting option, displaying a first control on the first setting page;

[0054] In response to the opening operation based on the first control, the plurality of role options are displayed on the first setting page.

[0055] In some other embodiments, the device further comprises a third display module;

[0056] The third display module is configured as follows:

[0057] For each character category, display the character options that are to be unlocked under the character category;

[0058] In response to a triggering operation on any character option in the to-be-unlocked state, displaying prompt information;

[0059] The prompt information is used to prompt that the role option can be unlocked under the premise of meeting preset conditions.

[0060] In some other embodiments, the preset condition includes any one of the following:

[0061] Unlocking said character options by transferring a preset amount of virtual resources;

[0062] Unlock said character options by completing the target missions;

[0063] The role option is unlocked after the cumulative number of interactions between the first user account and the second user account reaches a preset threshold.

[0064] In some other embodiments, the device further comprises:

[0065] A fourth display module is configured to display a second control, where the second control is used to prompt to invite others to record sound;

[0066] A sending module, configured to send a sound recording request to a third user account in response to a triggering operation on the second control;

[0067] A receiving module, configured to receive the recorded audio fed back by the third user account;

[0068] The processing module is further configured to obtain a voice feature of the third user account based on the recorded audio, and add a role option of the third user account to the multiple role options.

[0069] In some other embodiments, the sending module is further configured to:

[0070] In response to a triggering operation on the second control, displaying an account selection list, wherein the account selection list includes the third user account;

[0071] In response to the selection operation of the third user account, the account identification of the third user account is displayed on the first setting page, and the sound recording request is sent to the third user account.

[0072] In some other embodiments, the speech synthesis module is configured to:

[0073] Displaying a voice broadcast mark of the multimedia message on the interactive page;

[0074] In response to a triggering operation on the voice broadcast mark, a voice synthesis result of the multimedia message is displayed, and the voice synthesis result is broadcast based on the voice feature of the target character.

[0075] In some other embodiments, the speech synthesis module is configured to:

[0076] In response to a triggering operation on the multimedia message, displaying a function panel on the interactive page, the function panel including a voice broadcast control;

[0077] In response to a triggering operation on the voice broadcast control, a voice synthesis result of the multimedia message is displayed, and the voice synthesis result is broadcast based on the voice feature of the target character.

[0078] In some other embodiments, the speech synthesis module is configured to:

[0079] When the multimedia message is in text form, converting the multimedia message into speech to obtain the speech synthesis result;

[0080] In the case where the multimedia message is an image, performing image semantic recognition on the multimedia message to obtain an image semantic recognition result; performing speech synthesis based on the image semantic recognition result to obtain the speech synthesis result;

[0081] In the case that the multimedia message is a video, a content summary is performed on the multimedia message to obtain a content summary; and speech synthesis is performed based on the content summary to obtain the speech synthesis result.

[0082] According to a third aspect of an embodiment of the present disclosure, an electronic device is provided, the electronic device comprising:

[0083] one or more processors;

[0084] A memory for storing program codes executable by the processor;

[0085] The processor is configured to execute the program code to implement the above-mentioned message processing method.

[0086] According to a fourth aspect of an embodiment of the present disclosure, a computer-readable storage medium is provided, and when a program code in the computer-readable storage medium is executed by a processor of an electronic device, the electronic device is enabled to execute the above-mentioned message processing method.

[0087] According to a fifth aspect of an embodiment of the present disclosure, a computer program product is provided, including a computer program, which implements the above-mentioned message processing method when executed by a processor of an electronic device.

[0088] For private messaging scenarios, the disclosed embodiments provide a new human-computer interaction method, which supports converting non-voice multimedia messages into voice and broadcasting them with the voice characteristics of a specific character. This voice-to-speech function enriches the human-computer interaction method in private messaging scenarios, making it possible to convert messages in the form of text, pictures, or videos into voice for broadcast, meeting the user's diverse conversion needs and significantly improving the human-computer interaction effect. In addition, based on the voice-to-speech function, the content of the message sent by the other party can be quickly and conveniently obtained, thereby improving communication efficiency.

[0089] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0090] The drawings herein are incorporated into and constitute a part of the specification, illustrate embodiments consistent with the present disclosure, and together with the description are used to explain the principles of the present disclosure, and do not constitute improper limitations on the present disclosure.

[0091] Figure 1 It is a schematic diagram of an implementation environment of a message processing method according to an exemplary embodiment.

[0092] Figure 2 The figure is a flowchart of a message processing method according to an exemplary embodiment.

[0093] Figure 3 The figure is a flowchart of another message processing method according to an exemplary embodiment.

[0094] Figure 4 It is a schematic diagram of an interactive page according to an exemplary embodiment.

[0095] Figure 5 It is a schematic diagram of another interactive page according to an exemplary embodiment.

[0096] Figure 6 The figure is a flowchart of another message processing method according to an exemplary embodiment.

[0097] Figure 7 It is a schematic diagram of another interactive page according to an exemplary embodiment.

[0098] Figure 8 It is a schematic diagram of another interactive page according to an exemplary embodiment.

[0099] Fig. 9 It is a schematic diagram of another interactive page according to an exemplary embodiment.

[0100] Fig.10 It is a schematic diagram of another interactive page according to an exemplary embodiment.

[0101] Fig.11 It is a schematic diagram of another interactive page according to an exemplary embodiment.

[0102] Fig.12 It is a schematic diagram of another interactive page according to an exemplary embodiment.

[0103] Fig.13 It is a schematic diagram of another interactive page according to an exemplary embodiment.

[0104] Fig.14 It is a schematic diagram of another interactive page according to an exemplary embodiment.

[0105] Fig.15 It is a schematic diagram of another interactive page according to an exemplary embodiment.

[0106] Fig.16 The invention is a block diagram of a message processing device according to an exemplary embodiment.

[0107] Fig.17 It is a block diagram of a terminal according to an exemplary embodiment. DETAILED DESCRIPTION

[0108] In order to enable ordinary persons in the art to better understand the technical solutions of the present disclosure, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings.

[0109] It should be noted that the terms "first", "second", etc. in the specification and claims of the present disclosure and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present disclosure described herein can be implemented in an order other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0110] The information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, stored data, displayed data, etc.) and signals involved in this disclosure are all authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant laws, regulations and standards of relevant countries and regions.

[0111] Figure 1 FIG. 1 is a schematic diagram of an implementation environment of a message processing method according to an exemplary embodiment. Figure 1 , the implementation environment includes: a first terminal 101, a second terminal 102 and a server 103.

[0112] The first terminal 101 is an electronic device used by a first user, and a first user account is logged into the first terminal 101. The second terminal 102 is an electronic device used by a second user, and a second user account is logged into the second terminal 102.

[0113] In the embodiment of the present disclosure, a target application is installed on the first terminal 101 and the second terminal 102. The target application is an application that provides online social services, such as instant messaging applications, microblog applications, etc., which is not limited in the present disclosure. The first user account and the second user account are user accounts registered by the first user and the second user when using the target application.

[0114] In some embodiments, the first terminal 101 and the second terminal 102 are devices such as smart phones, desktop computers, and laptops. Figure 1 The first terminal 101 and the second terminal 102 are merely taken as smartphones for illustration.

[0115] In addition, those skilled in the art will appreciate that the number of the above terminals may be more or less. For example, the above terminals may be only a few, or the above devices may be dozens or hundreds, or more. The embodiments of the present disclosure do not limit the number and type of terminals.

[0116] In other embodiments, the server 103 provides background services for the target application. In addition, the server 103 is connected to the first terminal 101 and the second terminal 102 via a wireless network or a wired network. In addition, the server involved in the embodiment of the present disclosure may also include other functional servers to provide more comprehensive and diversified services.

[0117] The message processing solution provided by the embodiment of the present disclosure is described in detail through the following embodiments.

[0118] Figure 2 is a flowchart of a message processing method according to an exemplary embodiment. Figure 2As shown, the message processing method is applied to electronic devices, such as Figure 1 In the first terminal 101 or the second terminal 102 shown. The message processing method includes the following steps:

[0119] In 201 , the electronic device displays an interaction page between a first user account and a second user account.

[0120] Among them, the speech synthesis scheme of the embodiment of the present disclosure is applicable to both one-to-one single chat scenarios and one-to-many group chat scenarios. For the single chat scenario, the number of the first user account and the second user account are 1 respectively, and there is a follow relationship between the first user account and the second user account, and the above-mentioned interactive page is a single chat page. For the group chat scenario, the number of the first user account is two or more, and the number of the second user account is 1, wherein multiple first user accounts and the second user account are in the same group, and the above-mentioned interactive page is a group chat page.

[0121] In the disclosed embodiment, the attention relationship includes a two-way attention relationship and a one-way attention relationship. Among them, the two-way attention is also called mutual attention, so the two-way attention relationship is also called a friend relationship. And the one-way attention includes: the user account of the other party appears in one's attention list, and one's user account appears in the other party's fan list; or one's user account appears in the other party's attention list, and the other party's user account appears in one's fan list.

[0122] Based on the above interactive page, the first user account and the second user account can make voice calls, video calls, send multimedia messages, etc., which are not limited in this disclosure. Among them, multimedia messages include voice messages and non-voice messages. Non-voice messages include but are not limited to text, images and videos, which are also not limited in this disclosure.

[0123] In 202, in response to obtaining a new multimedia message, the electronic device displays the multimedia message on an interactive page; and, when the multimedia message is in a non-voice form, displays a speech synthesis result of the multimedia message and announces the speech synthesis result based on the voice characteristics of the target character.

[0124] In the embodiment of the present disclosure, the multimedia message can be sent by the first user account or the second user account, and the present disclosure does not limit this. That is, in response to obtaining a new multimedia message, the multimedia message is displayed on the interactive page, including the following two situations:

[0125] Case 1: In response to obtaining a multimedia message sent by a first user account, the multimedia message is displayed on an interactive page. For a group chat, the first user account here refers to any first user account among multiple first user accounts. For example, if the electronic device is a device logged in with a second user account, this case is receiving a new message from the other party.

[0126] Case 2: in response to obtaining a multimedia message sent by the second user account, displaying the multimedia message on the interactive page. Taking the electronic device as an example, the electronic device is a device with the second user account logged in, and this case is receiving a new local message.

[0127] The first point to be explained is that, considering that voice reception experience is better, for example, users can chat with each other in a more immersive way without reading threshold, the disclosed embodiment supports converting non-voice multimedia messages into voice. The following describes how to convert non-voice multimedia messages into voice.

[0128] In some embodiments, the embodiments of the present disclosure use the following method to perform speech synthesis on the multimedia message to obtain a speech synthesis result:

[0129] 2021. When the multimedia message is in text form, convert the multimedia message into speech to obtain a speech synthesis result.

[0130] In the private messaging scenario, text messages account for the largest proportion of messages sent. In order to lower the reading threshold of users, the disclosed embodiment will convert text-based multimedia messages into speech. For example, after word segmentation and punctuation removal of text-based multimedia messages, TTS (Text To Speech) speech synthesis technology can be used to complete text-to-speech conversion, thereby obtaining the speech synthesis result of the text-based multimedia message.

[0131] 2022. When the multimedia message is an image, perform image semantic recognition on the multimedia message to obtain an image semantic recognition result; and perform speech synthesis based on the image semantic recognition result to obtain a speech synthesis result.

[0132] In this case, the speech synthesis result is used to introduce the content of the image. Exemplarily, after preprocessing the acquired image, the embodiment of the present disclosure performs image semantic recognition on the preprocessed image based on deep learning, which is not limited in the present disclosure.

[0133] Image semantics refers to the meaning of the image content. In some embodiments, the semantics of an image are divided into a visual layer, an object layer, and a conceptual layer. The visual layer is the bottom layer commonly understood, and features such as color, texture, or shape are all bottom-level semantics; the object layer is the middle layer, which usually contains features such as attributes and is used to characterize the state of an object at a certain moment; the conceptual layer is the high layer, which is the image expression that is closest to human understanding.

[0134] For example, suppose an image includes sand, blue sky, sea water, etc., then the visual layer of the image is divided into pieces, the object layer is sand, blue sky, sea water, etc., and the concept layer is the beach, which is the semantics expressed by the image.

[0135] 2023. When the multimedia message is a video, perform content summary on the multimedia message to obtain a content summary; perform speech synthesis based on the content summary to obtain a speech synthesis result.

[0136] In this case, the speech synthesis result is used to introduce the main content of the video. Exemplarily, the embodiment of the present disclosure summarizes the content of the video based on a large pre-trained model, and the present disclosure does not limit this.

[0137] Summarizing the content of a video is also called summarizing the content of a video, which means summarizing the main content of the video in concise language. It usually extracts key information from the video, including major events, core ideas, important characters, etc., so that people can understand the general situation of the video in a short time. In other words, the focus of the video content summary is to refine and summarize the specific content of the video, and to present the events, plots, ideas, etc. shown in the video in a highly condensed manner. It directly reflects the core essence of the video, allowing users to quickly understand what the video is about.

[0138] The second point to be explained is that in order to read out different types of multimedia messages in the form of voice, the disclosed embodiment will broadcast the obtained voice synthesis result based on the voice characteristics of the target character. The voice characteristics include at least one of timbre, volume, tone or speech speed. That is, the electronic device will broadcast the obtained voice synthesis result based on at least one of the timbre, volume, tone or speech speed of the target character.

[0139] In the disclosed embodiment, the target role is selected by the user. Taking the electronic device as a device logged in with a first user account as an example, the target role is selected by the first user. Taking the electronic device as a device logged in with a second user account as an example, the target role is selected by the second user. For the selection of the target role, please refer to the following description.

[0140] In other embodiments, in order to increase the fun of voice reading, when broadcasting the voice synthesis result, the electronic device can also display a three-dimensional virtual image of the target character on the interactive page. The lip shape and movement of the three-dimensional virtual image are synchronized with the playback progress of the voice synthesis result. In other words, the three-dimensional virtual image broadcasts the voice synthesis result as a virtual anchor.

[0141] In other embodiments, in order to make the voice broadcast fit the state of the user when sending the multimedia message, the present embodiment will also perform sentiment analysis on the multimedia message, and adjust the voice characteristics of the target character based on the sentiment analysis results, and then broadcast the voice synthesis result of the multimedia message based on the adjusted voice characteristics of the target character.

[0142] In the case where the multimedia message is text, the above sentiment analysis is text sentiment analysis. Among them, text sentiment analysis is a natural language processing technology that aims to identify and understand the emotional tendency or emotional state in the text. It involves computer processing and analysis of the text to determine the type and degree of the emotions or emotions contained therein. In addition, in order to achieve text sentiment analysis, commonly used methods include machine learning methods and deep learning methods. Among them, machine learning methods and deep learning methods automatically learn the relationship between text and emotions by training models.

[0143] In the case where the multimedia message is an image, the above sentiment analysis is image sentiment analysis. Image sentiment analysis is a technology that aims to extract and understand human emotions from images. In addition, in order to implement image sentiment analysis, commonly used methods include machine learning methods and deep learning methods. Machine learning methods and deep learning methods automatically learn the relationship between images and emotions by training models.

[0144] In the case where the multimedia message is a video, the above sentiment analysis is video sentiment analysis. Among them, video sentiment analysis is a technology that aims to extract and understand human emotions from videos. In addition, in order to implement video sentiment analysis, commonly used methods include machine learning methods and deep learning methods. Among them, machine learning methods and deep learning methods automatically learn the relationship between videos and emotions by training models.

[0145] In other embodiments, the goal of sentiment analysis is to automatically determine the emotional color of multimedia messages, which is usually divided into the following aspects: sentiment classification, which classifies multimedia messages into different sentiment categories, such as positive, negative, or neutral. Sentiment polarity analysis, which determines the sentiment polarity of multimedia messages, that is, whether they are positive, negative, or neutral. Sentiment intensity analysis, which measures the intensity or degree of sentiment in multimedia messages, such as determining whether the sentiment expressed in the text is strong or weak. Sentiment target identification, which identifies the specific object or subject to which the sentiment in the multimedia message is directed.

[0146] In summary, for private messaging scenarios, the disclosed embodiments provide a new human-computer interaction method, that is, supporting the conversion of non-voice multimedia messages into voice, and broadcasting them with the voice characteristics of a specific character. This voice-to-speech function enriches the human-computer interaction method in private messaging scenarios, making it possible to convert messages in the form of text, pictures, or videos into voice for broadcast, meeting the user's diverse conversion needs, thereby increasing the user's frequency of sending messages and significantly improving the human-computer interaction effect. In addition, based on the voice-to-speech function, the content of the message sent by the other party can be quickly and conveniently obtained, thereby improving communication efficiency.

[0147] In addition, after completing the speech synthesis, the embodiment of the present disclosure will announce the speech synthesis result based on at least one of the timbre, volume, tone or speech speed of the target character. This speech reading method is more realistic and lifelike, and has a good human-computer interaction effect.

[0148] In addition, after completing the speech synthesis, the embodiment of the present disclosure supports broadcasting the speech synthesis results through a three-dimensional virtual image. This method of using a three-dimensional virtual image as a virtual anchor to broadcast the speech makes the speech conversion function more interesting and visual, thereby improving the efficiency of human-computer interaction.

[0149] In addition, by performing sentiment analysis on multimedia messages and adjusting the voice characteristics of the target character based on the sentiment analysis results, the voice broadcast can be more in line with the user's state when sending the multimedia message, ensuring the voice reading effect.

[0150] In addition, no matter which party in the chat sends a multimedia message, if the multimedia message is in a non-voice format, the embodiments of the present disclosure support converting the multimedia message into voice processing, which has a wide range of applications and strong universality.

[0151] In addition, the embodiments of the present disclosure also introduce in detail how to convert text, images and videos into speech, which provides basic technical support for the speech conversion function in private message scenarios.

[0152] Figure 3 is a flowchart of another message processing method according to an exemplary embodiment. Figure 3 As shown, the message processing method is applied to electronic devices, such as Figure 1 In the second terminal 102 shown. The message processing method includes the following steps:

[0153] In 301, the electronic device displays a setting control on an interactive page between a first user account and a second user account; in response to a triggering operation of the second user account on the setting control, the electronic device displays a second setting page.

[0154] Exemplarily, the setting control is displayed in the upper right corner of the interactive page, and the present disclosure does not limit this. After the second user triggers (such as clicking) the setting control, the electronic device will display the following Figure 4 The second settings page is shown.

[0155] See also Figure 4 , the second setting page displays a target setting option (in a black box). The target setting option is used to indicate whether the automatic voice broadcast (automatic reading of messages) function has been enabled. Figure 4 The automatic voice announcement function is currently disabled (also known as not enabled).

[0156] Exemplarily, the second setting page is displayed in a half-screen form floating on the interactive page, which is not limited in the present disclosure.

[0157] In 302, when the target setting option on the second setting page indicates that the automatic voice broadcast is not turned on, in response to the operation of turning on the automatic voice broadcast, the electronic device displays a first setting page, wherein a plurality of role options are displayed on the first setting page.

[0158] In some embodiments, when the target setting option indicates that the automatic voice broadcast is not turned on, after the second user selects (for example, clicks) the target setting option, it is determined that the operation of turning on the automatic voice broadcast is detected, and the electronic device will jump to the page. Figure 4 The second setting page shown switches to Figure 5 The first setting page shown. Exemplarily, the first setting page is displayed in a half-screen form suspended on the interactive page, which is not limited in the present disclosure.

[0159] In other embodiments, see Figure 5 , the first setting page displays the first control 1. In response to the second user account's operation of turning on the automatic voice broadcast based on the first control 1, the electronic device displays a plurality of role options for the user to select on the first setting page. Figure 5 As shown, the first control 1 includes a text description, such as Figure 5As shown, “When automatic message reading is turned on, when you receive a new message from a user in a conversation, it will be automatically read aloud.” In addition, the first control 1 also includes a switch option, through which the user turns on or off the automatic voice broadcast function.

[0160] It should be noted that Figure 5 10 role options are shown, namely role 1 to role 10. Of course, the roles available for the second user to select may include more or less than the number shown in the figure, and the embodiment of the present disclosure is only described by taking the example that 10 role options are currently displayed on the first setting page.

[0161] In some embodiments, the electronic device displays the role options on the first setting page according to the categories to which the multiple role options belong. The role categories include but are not limited to male voice, female voice or animation, etc., which are not limited in the present disclosure.

[0162] In other embodiments, the disclosed embodiments also support users to unlock more characters. That is, the method provided by the disclosed embodiments also includes: for each character category, displaying the character options in the to-be-unlocked state under the character category; in response to the triggering operation of the second user account on any character option in the to-be-unlocked state, displaying prompt information. The prompt information is used to prompt that the character option can be unlocked under the premise of meeting the preset conditions. In addition, after unlocking the character option, the electronic device displays that the character option switches from the to-be-unlocked state to the unlocked state.

[0163] In some other embodiments, the above-mentioned preset condition includes any one of the following:

[0164] 1. Unlock this character option by transferring a preset amount of virtual resources.

[0165] In this case, the system sets a value for each character to be unlocked, and the second user can unlock the character option by transferring virtual resources equal to the preset value.

[0166] 2. Unlock the role option by performing the target task. For example, the target task may be an invitation task, which is not limited in the present disclosure.

[0167] 3. After the cumulative number of interactions between the first user account and the second user account reaches a preset threshold, the role option is unlocked. For example, the number of interactions here can be the number of messages sent within a preset time period, the number of days for sending messages continuously, etc., which is not limited in the present disclosure.

[0168] In 303 , in response to the second user account selecting any one of the multiple role options, the electronic device uses the selected role as a target role.

[0169] In some embodiments, a second control 2 is also displayed on the first setting page. The second control 2 is used to prompt to invite others to record sound. In response to the second user's triggering operation on the second control, the electronic device sends a sound recording request to the third user account. Exemplarily, there is a two-way attention relationship between the third user account and the second user account, that is, the second user can invite friends to record sound for him. In addition, the third user account can also be the first user account, which is not limited in this disclosure.

[0170] In other embodiments, in response to the second user's triggering operation on the second control 2, the electronic device displays an account selection list, wherein the account selection list includes the third user account. Next, in response to the second user's selection operation on the third user account, the electronic device displays the account identification of the third user account on the first setting page and sends a sound recording request to the third user account.

[0171] For example, Figure 5 As shown, the second control 2 includes an account selection control 21 and an invitation control 22. Accordingly, in response to the second user's response to the triggering operation of the account selection control 21, the electronic device displays an account selection list; in response to the second user's selection operation of the third user account, the electronic device displays the account identification of the third user account on the first setting page. For example, the electronic device displays the account identification of the third user account on the first setting page in a manner of replacing the account selection control 21, that is, displays the avatar of the third user account at the display position of the account selection control 21. Next, in response to the second user's triggering operation of the invitation control 22, the electronic device sends a sound recording request to the third user account.

[0172] In other embodiments, after receiving the recorded audio fed back by the third user account, the electronic device obtains the voice features of the third user account based on the recorded audio, and Figure 5 The role option of the third user account is added to the multiple role options shown, that is, the role of the third user account is added to the role library.

[0173] In other embodiments, the embodiments of the present disclosure also support the user himself to record the sound. That is, a third control is also displayed on the first setting page, wherein the third control is used to prompt the second user account to record the sound. Accordingly, the method provided by the embodiments of the present disclosure also includes:

[0174] In response to the triggering operation of the third control by the second user, the electronic device displays a sound recording page for the second user to record sound. After receiving the recorded audio of the second user, the electronic device obtains the sound characteristics of the second user account based on the recorded audio, and Figure 5 The role option of the second user account is added to the multiple role options shown, that is, the role of the second user account is added to the role library.

[0175] In summary, the user can complete the selection of the target role by triggering the setting control on the chat page without leaving the chat page. The user operation path is short, the cost of human-computer interaction is reduced, and the human-computer interaction efficiency is high.

[0176] In addition, by displaying the role options by categories on the first setting page, the display of the role options is more orderly, which is convenient for users to quickly complete the role selection and improves the efficiency of human-computer interaction.

[0177] In addition, the disclosed embodiment also supports users to unlock more characters, which not only enriches the human-computer interaction mode in the private message scenario, but also enhances the user's sense of participation, and the human-computer interaction effect is good.

[0178] In addition, the disclosed embodiment supports users to unlock characters in a variety of ways, further enriching the human-computer interaction mode in the private message scenario.

[0179] In addition, the disclosed embodiment also supports users to invite others to record voices for them, which realizes personalized customization of voice features and has a good human-computer interaction effect.

[0180] In addition, the embodiment of the present disclosure provides controls so that users can arbitrarily and conveniently invite others to record sounds for them, and the human-computer interaction efficiency is high.

[0181] In addition, the disclosed embodiment supports the user to quickly turn on or off the function of automatic voice broadcasting, which is convenient to operate, reduces the cost of human-computer interaction, and improves the efficiency of human-computer interaction.

[0182] In addition, the disclosed embodiment also supports the user himself to record the sound, which further realizes the personalized customization of the sound characteristics and has a good human-computer interaction effect.

[0183] Figure 6 is a flowchart of another message processing method according to an exemplary embodiment. Figure 6 As shown, the message processing method is applied to electronic devices, such as Figure 1 In the second terminal 102 shown. The message processing method includes the following steps:

[0184] In 601 , the electronic device displays an interaction page between a first user account and a second user account.

[0185] This step is the same as the above step 201 and will not be described again here.

[0186] In 602, in response to obtaining a new multimedia message, and the multimedia message is in a non-voice format, the electronic device displays the multimedia message and a voice broadcast mark of the multimedia message on an interactive page.

[0187] In the case where the multimedia message is a video, the voice broadcast mark of the multimedia message is as follows: Figure 7 shown.

[0188] In the case where the multimedia message is an image, the voice broadcast mark of the multimedia message is as follows: Figure 8 shown.

[0189] In the case where the multimedia message is text, the voice broadcast mark of the multimedia message is as follows: Fig. 9 shown.

[0190] In 603, in response to the triggering operation of the second user account on the voice broadcast mark, the electronic device displays the voice synthesis result of the multimedia message and broadcasts the voice synthesis result based on the voice characteristics of the target character.

[0191] Exemplarily, the triggering operation for the forecast broadcast mark is a click operation, which is not limited in the present disclosure.

[0192] In 604, in response to the triggering operation of the second user account on the multimedia message, the electronic device displays a function panel on the interactive page, and the function panel includes a voice broadcast control.

[0193] Exemplarily, the triggering operation of the multimedia message is a long press operation, which is not limited in the present disclosure.

[0194] In the case where the multimedia message is a video, see Fig.10 and Fig.11 After the second user long presses the multimedia message, a function panel will be displayed on the interactive page, wherein the function panel includes a voice broadcast control.

[0195] In the case where the multimedia message is an image, see Fig.12 and Fig.13 After the second user long presses the multimedia message, a function panel will be displayed on the interactive page, wherein the function panel includes a voice broadcast control.

[0196] In the case where the multimedia message is text, see Fig.14 and Fig.15 After the second user long presses the multimedia message, a function panel will be displayed on the interactive page, wherein the function panel includes a voice broadcast control.

[0197] In 605, in response to the triggering operation of the second user account on the voice broadcast control, the electronic device displays the voice synthesis result of the multimedia message and broadcasts the voice synthesis result based on the voice characteristics of the target character.

[0198] Exemplarily, the triggering operation of the voice broadcast control is a click operation, which is not limited in the present disclosure.

[0199] In some embodiments, after the second user closes the interactive page and opens it again, the electronic device will display the historical multimedia message and the voice broadcast mark of the historical multimedia message on the interactive page. Among them, the historical multimedia message can be one or more, and the present disclosure does not limit this. In response to the second user's triggering operation on any voice broadcast mark, if the historical multimedia message corresponding to the voice broadcast mark is in non-voice form, the electronic device will perform voice synthesis on the historical multimedia message, and broadcast the voice synthesis result of the historical multimedia message based on the voice characteristics of the target character.

[0200] In summary, by displaying the voice broadcast mark, the embodiment of the present disclosure realizes the user manually triggering the voice conversion function, which avoids the disturbance to the user caused by automatic voice broadcast in unnecessary situations, and has a good human-computer interaction effect.

[0201] In addition, in addition to displaying the voice broadcast mark, the embodiment of the present disclosure also implements another method of manually triggering the voice-to-speech function, that is, the user can trigger the voice-to-speech function by long pressing the multimedia title message. This not only avoids the disturbance to the user caused by automatic voice broadcast in unnecessary situations, but also enriches the method of manually triggering the voice-to-speech function, and has a good human-computer interaction effect.

[0202] In addition, after the user closes the chat page and reopens it, the embodiment of the present disclosure enables the user to quickly view historical multimedia messages by displaying a voice broadcast mark, thereby improving the efficiency of human-computer interaction.

[0203] Fig.16 is a block diagram of a message processing device according to an exemplary embodiment. Fig.16 , the device comprises:

[0204] The first display module 1601 is configured to display an interactive page between the first user account and the second user account; in response to obtaining a new multimedia message, display the multimedia message on the interactive page;

[0205] The speech synthesis module 1602 is configured to display the speech synthesis result of the multimedia message when the multimedia message is in a non-speech form, and announce the speech synthesis result based on the voice characteristics of the target character.

[0206] For private messaging scenarios, the disclosed embodiments provide a new human-computer interaction method, which supports converting non-voice multimedia messages into voice and broadcasting them with the voice characteristics of a specific character. This voice-to-speech function enriches the human-computer interaction method in private messaging scenarios, making it possible to convert messages in the form of text, pictures, or videos into voice for broadcast, meeting the user's diverse conversion needs and significantly improving the human-computer interaction effect. In addition, based on the voice-to-speech function, the content of the message sent by the other party can be quickly and conveniently obtained, thereby improving communication efficiency.

[0207] In some embodiments, the interactive page displays a setting control, and the device further includes:

[0208] A second display module is configured to display a first setting page in response to a triggering operation on the setting control, wherein the first setting page displays a plurality of role options;

[0209] The processing module is configured to, in response to a selection operation on any one of the multiple role options, use the selected role as the target role.

[0210] In some other embodiments, the second display module is further configured as:

[0211] In response to a triggering operation on the setting control, a second setting page is displayed, on which a target setting option is displayed, and the target setting option is used to indicate whether automatic voice broadcast is turned on;

[0212] When the target setting option indicates that the automatic voice broadcast is not turned on, in response to the turning on operation of the automatic voice broadcast, the plurality of role options are displayed on the first setting page.

[0213] In some other embodiments, the second display module is further configured as:

[0214] In a case where the target setting option indicates that automatic voice broadcast is not turned on, in response to a selection operation of the target setting option, displaying a first control on the first setting page;

[0215] In response to the opening operation based on the first control, the plurality of role options are displayed on the first setting page.

[0216] In some other embodiments, the device further comprises a third display module;

[0217] The third display module is configured as follows:

[0218] For each character category, display the character options that are to be unlocked under the character category;

[0219] In response to a triggering operation on any character option in the to-be-unlocked state, displaying prompt information;

[0220] The prompt information is used to prompt that the role option can be unlocked under the premise of meeting preset conditions.

[0221] In some other embodiments, the preset condition includes any one of the following:

[0222] Unlocking said character options by transferring a preset amount of virtual resources;

[0223] Unlock said character options by completing the target missions;

[0224] The role option is unlocked after the cumulative number of interactions between the first user account and the second user account reaches a preset threshold.

[0225] In some other embodiments, the device further comprises:

[0226] A fourth display module is configured to display a second control, where the second control is used to prompt to invite others to record sound;

[0227] A sending module, configured to send a sound recording request to a third user account in response to a triggering operation on the second control;

[0228] A receiving module, configured to receive the recorded audio fed back by the third user account;

[0229] The processing module is further configured to obtain a voice feature of the third user account based on the recorded audio, and add a role option of the third user account to the multiple role options.

[0230] In some other embodiments, the sending module is further configured to:

[0231] In response to a triggering operation on the second control, displaying an account selection list, wherein the account selection list includes the third user account;

[0232] In response to the selection operation of the third user account, the account identification of the third user account is displayed on the first setting page, and the sound recording request is sent to the third user account.

[0233] In some other embodiments, the speech synthesis module is configured to:

[0234] Displaying a voice broadcast mark of the multimedia message on the interactive page;

[0235] In response to a triggering operation on the voice broadcast mark, a voice synthesis result of the multimedia message is displayed, and the voice synthesis result is broadcast based on the voice feature of the target character.

[0236] In some other embodiments, the speech synthesis module is configured to:

[0237] In response to a triggering operation on the multimedia message, displaying a function panel on the interactive page, the function panel including a voice broadcast control;

[0238] In response to a triggering operation on the voice broadcast control, a voice synthesis result of the multimedia message is displayed, and the voice synthesis result is broadcast based on the voice feature of the target character.

[0239] In some other embodiments, the speech synthesis module is configured to:

[0240] When the multimedia message is in text form, converting the multimedia message into speech to obtain the speech synthesis result;

[0241] In the case where the multimedia message is an image, performing image semantic recognition on the multimedia message to obtain an image semantic recognition result; performing speech synthesis based on the image semantic recognition result to obtain the speech synthesis result;

[0242] In the case that the multimedia message is a video, a content summary is performed on the multimedia message to obtain a content summary; and speech synthesis is performed based on the content summary to obtain the speech synthesis result.

[0243] All the above optional technical solutions can be arbitrarily combined to form optional embodiments of the present disclosure, which will not be described in detail here.

[0244] It should be noted that the speech synthesis device provided in the above embodiment only uses the division of the above functional units as an example when performing speech synthesis. In actual applications, the above functions can be assigned to different functional units as needed, that is, the internal structure of the electronic device is divided into different functional units to complete all or part of the functions described above. In addition, the message processing device provided in the above embodiment and the message processing method embodiment belong to the same concept. The specific implementation process is detailed in the method embodiment and will not be repeated here.

[0245] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0246] In some embodiments, an electronic device is further provided, the electronic device comprising:

[0247] one or more processors;

[0248] a memory for storing program code executable by the processor;

[0249] The processor is configured to execute the program code to implement the above-mentioned message processing method.

[0250] In which, in response to the electronic device being provided as a terminal, Fig.17 It is a block diagram of a terminal 1700 according to an exemplary embodiment.

[0251] Typically, the terminal 1700 includes a processor 1701 and a memory 1702 .

[0252] The processor 1701 includes one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 1701 is implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). Alternatively, the processor 1701 includes a main processor and a coprocessor. The main processor is a processor for processing data in the awake state, also called a CPU (Central Processing Unit); the coprocessor is a low-power processor for processing data in the standby state.

[0253] In some embodiments, the processor 1701 is integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 1701 also includes an AI (Artificial Intelligence) processor, which is used to process computing operations related to machine learning.

[0254] The memory 1702 includes one or more computer-readable storage media, which are non-transitory. The memory 1702 also includes a high-speed random access memory and a non-volatile memory, such as one or more disk storage devices and flash storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 1702 is used to store at least one program code, and the at least one program code is used to be executed by the processor 1701 to implement the message processing method provided in the method embodiment of the present disclosure.

[0255] In some embodiments, the terminal 1700 further includes: a peripheral device interface 1703 and at least one peripheral device. The processor 1701, the memory 1702 and the peripheral device interface 1703 are connected via a bus or a signal line. Each peripheral device is connected to the peripheral device interface 1703 via a bus, a signal line or a circuit board. The peripheral device includes: at least one of a radio frequency circuit 1704, a display screen 1705, a camera assembly 1706, an audio circuit 1707 and a power supply 1708.

[0256] The peripheral device interface 1703 is used to connect at least one peripheral device related to I / O (Input / Output) to the processor 1701 and the memory 1702. In some embodiments, the processor 1701, the memory 1702, and the peripheral device interface 1703 are integrated on the same chip or circuit board; in other embodiments, any one or two of the processor 1701, the memory 1702, and the peripheral device interface 1703 are implemented on a separate chip or circuit board, which is not limited in the present disclosure.

[0257] The radio frequency circuit 1704 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The radio frequency circuit 1704 communicates with the communication network and other communication devices through electromagnetic signals. The radio frequency circuit 1704 converts electrical signals into electromagnetic signals for transmission, or converts received electromagnetic signals into electrical signals. In some embodiments, the radio frequency circuit 1704 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, and the like. The radio frequency circuit 1704 communicates with other terminals through at least one wireless communication protocol. Wireless communication protocols include, but are not limited to: the World Wide Web, a metropolitan area network, an intranet, various generations of mobile communication networks (2G, 3G, 4G and 5G), a wireless local area network and / or a WiFi (Wireless Fidelity) network. In some embodiments, the radio frequency circuit 1704 also includes circuits related to NFC (Near Field Communication), which is not limited in the present disclosure.

[0258] The display screen 1705 is used to display the UI (User Interface). The UI includes graphics, text, icons, videos and any combination thereof. In the case where the display screen 1705 is a touch display screen, the display screen 1705 also has the ability to collect touch signals on the surface or above the surface of the display screen 1705. The touch signal is input to the processor 1701 as a control signal for processing. At this time, the display screen 1705 is also used to provide virtual buttons and / or virtual keyboards, also known as soft buttons and / or soft keyboards. In some embodiments, the display screen 1705 is one, which is set on the front panel of the terminal 1700; in other embodiments, the display screen 1705 is at least two, which are respectively set on different surfaces of the terminal 1700 or are folded; in other embodiments, the display screen 1705 is a flexible display screen, which is set on the curved surface or folded surface of the terminal 1700. Alternatively, the display screen 1705 is set to a non-rectangular irregular shape, that is, a special-shaped screen. The display screen 1705 is made of materials such as LCD (Liquid Crystal Display) and OLED (Organic Light-Emitting Diode).

[0259] The camera assembly 1706 is used to capture images or videos. In some embodiments, the camera assembly 1706 includes a front camera and a rear camera. Typically, the front camera is disposed on the front panel of the terminal, and the rear camera is disposed on the back of the terminal. In some embodiments, there are at least two rear cameras, which are any one of a main camera, a depth of field camera, a wide-angle camera, and a telephoto camera, so as to realize the fusion of the main camera and the depth of field camera to realize the background blur function, the fusion of the main camera and the wide-angle camera to realize the panoramic shooting and VR (Virtual Reality) shooting function or other fusion shooting functions. In other embodiments, the camera assembly 1706 also includes a flash. The flash is a single-color temperature flash or a dual-color temperature flash. A dual-color temperature flash refers to a combination of a warm light flash and a cold light flash, which is used for light compensation at different color temperatures.

[0260] The audio circuit 1707 includes a microphone and a speaker. The microphone is used to collect sound waves from the user and the environment, and convert the sound waves into electrical signals and input them into the processor 1701 for processing, or input them into the radio frequency circuit 1704 to achieve voice communication. For the purpose of stereo acquisition or noise reduction, there are multiple microphones, which are respectively arranged at different parts of the terminal 1700. Alternatively, the microphone is an array microphone or an omnidirectional acquisition microphone. The speaker is used to convert the electrical signal from the processor 1701 or the radio frequency circuit 1704 into sound waves. The speaker is a traditional film speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, not only can the electrical signal be converted into sound waves audible to humans, but also the electrical signal can be converted into sound waves inaudible to humans for purposes such as ranging. In some embodiments, the audio circuit 1707 also includes a headphone jack.

[0261] The power supply 1708 is used to power various components in the terminal 1700. The power supply 1708 is an alternating current, a direct current, a disposable battery, or a rechargeable battery. In the case where the power supply 1708 includes a rechargeable battery, the rechargeable battery is a wired rechargeable battery or a wireless rechargeable battery. A wired rechargeable battery is a battery that is charged through a wired line, and a wireless rechargeable battery is a battery that is charged through a wireless coil. The rechargeable battery is also used to support fast charging technology.

[0262] Those skilled in the art will understand that Fig.17 The structure shown in the figure does not constitute a limitation on the terminal 1700, and the terminal 1700 may include more or less components than those shown in the figure, or combine certain components, or adopt a different component arrangement.

[0263] In some embodiments, a computer-readable storage medium including instructions is also provided, such as a memory including instructions, and the instructions are executed by a processor of an electronic device to implement the message processing method. In other embodiments, the computer-readable storage medium is a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0264] In some embodiments, a computer program product is also provided, including a computer program, which is executed by a processor of an electronic device to implement the above-mentioned message processing method.

[0265] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. The present disclosure is intended to cover any variations, uses or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The description and examples are to be considered exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.

[0266] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A message processing method, characterized in that: The method comprises: displaying an interaction page between the first user account and the second user account; In response to acquiring a new multimedia message, displaying the multimedia message on the interactive page; In the case that the multimedia message is in a non-voice form, a speech synthesis result of the multimedia message is displayed, and the speech synthesis result is announced based on the voice feature of the target character.

2. The message processing method according to claim 1, characterized in that: The interactive page displays a setting control, and the method further includes: In response to a triggering operation on the setting control, a first setting page is displayed, wherein a plurality of role options are displayed on the first setting page; In response to a selection operation on any one of the multiple role options, the selected role is used as the target role.

3. The message processing method according to claim 2, characterized in that: The step of displaying a first setting page in response to a triggering operation on the setting control comprises: In response to a triggering operation on the setting control, a second setting page is displayed, on which a target setting option is displayed, and the target setting option is used to indicate whether automatic voice broadcast is turned on; When the target setting option indicates that the automatic voice broadcast is not turned on, in response to the turning on operation of the automatic voice broadcast, the plurality of role options are displayed on the first setting page.

4. The message processing method according to claim 3, characterized in that: In the case where the target setting option indicates that the automatic voice broadcast is not turned on, in response to the operation of turning on the automatic voice broadcast, displaying the multiple role options on the first setting page includes: In a case where the target setting option indicates that automatic voice broadcast is not turned on, in response to a selection operation of the target setting option, displaying a first control on the first setting page; In response to the opening operation based on the first control, the plurality of role options are displayed on the first setting page.

5. The message processing method according to claim 2, characterized in that: The method further comprises: For each character category, display the character options that are to be unlocked under the character category; In response to a triggering operation on any character option in the to-be-unlocked state, displaying prompt information; The prompt information is used to prompt that the role option can be unlocked under the premise of meeting preset conditions.

6. The message processing method according to claim 5, characterized in that: The preset condition includes any of the following: Unlocking said character options by transferring a preset amount of virtual resources; Unlock said character options by completing the target missions; The role option is unlocked after the cumulative number of interactions between the first user account and the second user account reaches a preset threshold.

7. The message processing method according to claim 2, characterized in that: The method further comprises: Displaying a second control, where the second control is used to prompt others to invite others to record sound; In response to the triggering operation on the second control, sending a sound recording request to a third user account; Receiving the recorded audio feedback from the third user account; The voice feature of the third user account is obtained based on the recorded audio, and the role option of the third user account is added to the multiple role options.

8. The message processing method according to claim 7, characterized in that: The sending a sound recording request to a third user account in response to the triggering operation on the second control includes: In response to a triggering operation on the second control, displaying an account selection list, wherein the account selection list includes the third user account; In response to the selection operation of the third user account, the account identification of the third user account is displayed on the first setting page, and the sound recording request is sent to the third user account.

9. The message processing method according to claim 1, characterized in that: The displaying of the speech synthesis result of the multimedia message and broadcasting the speech synthesis result based on the voice feature of the target character includes: Displaying a voice broadcast mark of the multimedia message on the interactive page; In response to a triggering operation on the voice broadcast mark, a voice synthesis result of the multimedia message is displayed, and the voice synthesis result is broadcast based on the voice feature of the target character.

10. The message processing method according to claim 1, characterized in that: The step of displaying the speech synthesis result of the multimedia message and announcing the speech synthesis result based on the voice feature of the target character includes: In response to a triggering operation on the multimedia message, displaying a function panel on the interactive page, the function panel including a voice broadcast control; In response to a triggering operation on the voice broadcast control, a voice synthesis result of the multimedia message is displayed, and the voice synthesis result is broadcast based on the voice feature of the target character.

11. The message processing method according to any one of claims 1 to 10, characterized in that: The speech synthesis result is obtained in the following manner: When the multimedia message is in text form, converting the multimedia message into speech to obtain the speech synthesis result; In the case where the multimedia message is an image, performing image semantic recognition on the multimedia message to obtain an image semantic recognition result; Perform speech synthesis based on the image semantic recognition result to obtain the speech synthesis result; In the case that the multimedia message is a video, a content summary is performed on the multimedia message to obtain a content summary; and speech synthesis is performed based on the content summary to obtain the speech synthesis result.

12. A message processing device, characterized in that: The device comprises: A first display module is configured to display an interactive page between the first user account and the second user account; in response to obtaining a new multimedia message, display the multimedia message on the interactive page; The speech synthesis module is configured to display the speech synthesis result of the multimedia message when the multimedia message is in a non-speech form, and announce the speech synthesis result based on the voice characteristics of the target character.

13. An electronic device, characterized in that: The electronic device comprises: one or more processors; a memory for storing program code executable by the processor; The processor is configured to execute the program code to implement the message processing method according to any one of claims 1 to 11.

14. A computer-readable storage medium, characterized in that: When the instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the message processing method according to any one of claims 1 to 11.

15. A computer program product, characterized in that It comprises a computer program, which implements the message processing method according to any one of claims 1 to 11 when being executed by a processor of an electronic device.

Images