Information interaction method and device, storage medium and electronic equipment

Abstract

The invention relates to an information interaction method and device, a storage medium and electronic equipment. The method is applied to a client corresponding to a first account. The method comprises the following steps: displaying a session page between the first account and a second account; and under the condition that the session page displays a first message, playing a first voice corresponding to the first message, the first message being a video, image or expression message sent by the second account to the first account, and the content of the first voice being obtained based on visual information in the first message. In the information interaction interface between accounts, if the video, image or expression message sent by the account of the opposite side is received, the message can be displayed, and the message can be subjected to voice playing, so that the information in the video, image or expression message is converted into the information in the voice mode, and the user experience is improved. The information is displayed in a voice playing mode, multi-mode information interaction is achieved, and information expressive force and interaction efficiency are improved.

Description

Technical Field

[0001] The present disclosure relates to the field of computer technology, and in particular to an information interaction method, device, storage medium and electronic device. Background Art

[0002] Applications in related technologies can provide instant messaging services between different accounts. In these applications, different accounts can interact with each other in two ways, such as text, images, and videos. However, these applications are not capable of converting cross-modal information, making it difficult to provide users with multi-modal information interaction services, thus affecting the effect of information interaction. Summary of the invention

[0003] In order to solve at least one of the above technical problems, the present disclosure provides an information interaction method, device, storage medium and electronic device. The technical solution of the present disclosure is as follows:

[0004] According to a first aspect of an embodiment of the present disclosure, there is provided an information interaction method, which is applied to a client corresponding to a first account, and includes:

[0005] Displaying a conversation page between the first account and the second account;

[0006] When the first message is displayed on the conversation page, a first voice corresponding to the first message is played, where the first message is a video, image or emoticon message sent from the second account to the first account, and the content of the first voice is obtained based on the visual information in the first message.

[0007] In an exemplary embodiment, before playing the first voice corresponding to the first message, the method further includes:

[0008] Displaying at least one first control on the account configuration interface corresponding to the second account, each of the first controls corresponds to a voice mode, and the voice mode is a voice playback method including at least one of timbre information, speech speed information, and tone information;

[0009] When any of the first controls is selected, the voice mode corresponding to the triggered first control is used as the current voice mode of the second account, and the current voice mode is the voice mode used for playing the first voice.

[0010] In an exemplary embodiment, the method further comprises:

[0011] Displaying a second control on the account configuration interface;

[0012] When the second control is triggered, a second message is sent to the second account, where the second message is used to notify the second account to record a preset voice, and the preset voice is used to extract a voice pattern corresponding to the second account;

[0013] The displaying of at least one first control on the account configuration interface corresponding to the second account includes: upon receiving a notification indicating that a preset voice recording is successful, displaying a first control corresponding to the voice mode corresponding to the second account.

[0014] In an exemplary embodiment, the method further comprises:

[0015] Display the third control;

[0016] When the third control is set to the on state, when the first message is displayed on the conversation page, playing the first voice corresponding to the first message includes: when the first message is displayed on the conversation page, playing the first voice synchronously;

[0017] In the case where the third control is set to a closed state, the first voice corresponding to the first message is played when the first message is displayed on the conversation page, including: when a preset operation for the first message is received, displaying a playback control control corresponding to the first message on the conversation page; when the playback control control is triggered, playing the first voice; or, displaying a playback control control corresponding to the first message on the conversation page, and playing the first voice when the playback control control is triggered.

[0018] In an exemplary embodiment, the method further comprises:

[0019] Displaying a playback function control on an account configuration interface corresponding to the second account;

[0020] The playing of the first voice corresponding to the first message includes: when the play function control is configured to be in an on state, playing the first voice corresponding to the first message;

[0021] The method further comprises:

[0022] When the play function control is configured to be in a closed state, the first voice corresponding to the first message is not played.

[0023] In an exemplary embodiment, the method further comprises:

[0024] When the conversation page receives a video, image or emoticon message input by the first account, displaying a fourth control;

[0025] When the fourth control is triggered, a third message is displayed on the conversation page, where the third message is a voice message sent from the first account to the second account and obtained based on the video, image or emoticon message input by the first account.

[0026] In an exemplary embodiment, the method further comprises:

[0027] Displaying at least one fifth control, each of the fifth controls corresponding to a voice mode;

[0028] When any of the fifth controls is triggered, the voice mode corresponding to the triggered fifth control is used as the voice mode corresponding to the third message.

[0029] In an exemplary embodiment, the method further comprises:

[0030] Displaying the current voice mode of the second account on the account configuration interface;

[0031] When other first controls except the first control corresponding to the current voice mode are selected, the current voice mode of the second account is switched to the voice mode corresponding to the selected first control.

[0032] In an exemplary embodiment, the speech rate information of the current voice mode includes at least two speech rate modes, and the tone information of the current voice mode includes at least two tone modes; when the first message is an image or emoticon message, playing the first voice corresponding to the first message includes:

[0033] Determining a target speech rate mode in the speech rate information based on the emotion information in the first message;

[0034] Determining a target tone pattern in the tone information based on the emotion information in the first message;

[0035] Based on the timbre information of the current voice mode, the target speech rate mode and the target tone mode, the first voice corresponding to the first message is played.

[0036] In an exemplary implementation, when the first message is a video, playing the first voice corresponding to the first message includes:

[0037] Determining the emotion category of each image frame according to the emotion information of each image frame in the video;

[0038] determining at least one video segment, wherein image frames in each of the video segments belong to the same emotion category;

[0039] For each of the video segments, based on the corresponding emotion category, a target speech rate mode is determined in the speech rate information, and a target tone mode is determined in the tone information; based on the timbre information of the current voice mode, the target speech rate mode and the target tone mode, the voice corresponding to the video segment is played.

[0040] In an exemplary embodiment, the method further comprises:

[0041] If the conversation page receives a fourth message while the first voice is being played, the first voice continues to be played, and after the first voice is finished playing, the voice corresponding to the fourth message continues to be played, where the fourth message is a video, image or emoticon message sent from the second account to the first account after the first message;

[0042] If the first message is out of the conversation page while the first voice is being played, stop playing the first voice; if the first message is re-displayed on the conversation page, continue playing the first voice;

[0043] When the first voice is played and the first message is separated from the conversation page, if the first message is re-displayed on the conversation page, a playback control control corresponding to the first message is displayed, and the playback control control is used to control the playback of the first voice;

[0044] If the conversation page receives N fourth messages continuously in the first time interval, N is greater than a preset number threshold, and the N+1th fourth message is not received in the second time interval, the voices corresponding to the N fourth messages are played sequentially.

[0045] According to a second aspect of an embodiment of the present disclosure, there is provided an information interaction device, which is applied to a client corresponding to a first account, and the device includes:

[0046] A display module, configured to display a session page between the first account and the second account;

[0047] The interaction module is configured to play a first voice corresponding to a first message when the first message is displayed on the conversation page, wherein the first message is a video, image or emoticon message sent from the second account to the first account, and the content of the first voice is obtained based on the visual information in the first message.

[0048] In an exemplary embodiment, the interaction module is configured to execute:

[0049] Displaying at least one first control on the account configuration interface corresponding to the second account, each of the first controls corresponds to a voice mode, and the voice mode is a voice playback method including at least one of timbre information, speech speed information, and tone information;

[0050] When any of the first controls is selected, the voice mode corresponding to the triggered first control is used as the current voice mode of the second account, and the current voice mode is the voice mode used for playing the first voice.

[0051] In an exemplary embodiment, the interaction module is configured to execute:

[0052] Displaying a second control on the account configuration interface;

[0053] When the second control is triggered, a second message is sent to the second account, where the second message is used to notify the second account to record a preset voice, and the preset voice is used to extract a voice pattern corresponding to the second account;

[0054] The displaying of at least one first control on the account configuration interface corresponding to the second account includes: upon receiving a notification indicating that a preset voice recording is successful, displaying a first control corresponding to the voice mode corresponding to the second account.

[0055] In an exemplary embodiment, the interaction module is configured to execute:

[0056] Display the third control;

[0057] When the third control is set to the on state, when the first message is displayed on the conversation page, playing the first voice corresponding to the first message includes: when the first message is displayed on the conversation page, playing the first voice synchronously;

[0058] In the case where the third control is set to a closed state, the first voice corresponding to the first message is played when the first message is displayed on the conversation page, including: when a preset operation for the first message is received, displaying a playback control control corresponding to the first message on the conversation page; when the playback control control is triggered, playing the first voice; or, displaying a playback control control corresponding to the first message on the conversation page, and playing the first voice when the playback control control is triggered.

[0059] In an exemplary embodiment, the interaction module is configured to execute:

[0060] Displaying a playback function control on an account configuration interface corresponding to the second account;

[0061] The playing of the first voice corresponding to the first message includes: when the play function control is configured to be in an on state, playing the first voice corresponding to the first message;

[0062] When the play function control is configured to be in a closed state, the first voice corresponding to the first message is not played.

[0063] In an exemplary embodiment, the interaction module is configured to execute:

[0064] When the conversation page receives a video, image or emoticon message input by the first account, displaying a fourth control;

[0065] When the fourth control is triggered, a third message is displayed on the conversation page, where the third message is a voice message sent from the first account to the second account and obtained based on the video, image or emoticon message input by the first account.

[0066] In an exemplary embodiment, the interaction module is configured to execute:

[0067] Displaying at least one fifth control, each of the fifth controls corresponding to a voice mode;

[0068] When any of the fifth controls is triggered, the voice mode corresponding to the triggered fifth control is used as the voice mode corresponding to the third message.

[0069] In an exemplary embodiment, the interaction module is configured to execute:

[0070] Displaying the current voice mode of the second account on the account configuration interface;

[0071] When other first controls except the first control corresponding to the current voice mode are selected, the current voice mode of the second account is switched to the voice mode corresponding to the selected first control.

[0072] In an exemplary embodiment, the speech rate information of the current voice mode includes at least two speech rate modes, and the tone information of the current voice mode includes at least two tone modes; when the first message is an image or emoticon message, playing the first voice corresponding to the first message includes:

[0073] Determining a target speech rate mode in the speech rate information based on the emotion information in the first message;

[0074] Determining a target tone pattern in the tone information based on the emotion information in the first message;

[0075] Based on the timbre information of the current voice mode, the target speech rate mode and the target tone mode, the first voice corresponding to the first message is played.

[0076] In an exemplary implementation, when the first message is a video, playing the first voice corresponding to the first message includes:

[0077] Determining the emotion category of each image frame according to the emotion information of each image frame in the video;

[0078] determining at least one video segment, wherein image frames in each of the video segments belong to the same emotion category;

[0079] For each of the video segments, based on the corresponding emotion category, a target speech rate mode is determined in the speech rate information, and a target tone mode is determined in the tone information; based on the timbre information of the current voice mode, the target speech rate mode and the target tone mode, the voice corresponding to the video segment is played.

[0080] In an exemplary embodiment, the interaction module is configured to execute:

[0081] If the conversation page receives a fourth message while the first voice is being played, the first voice continues to be played, and after the first voice is finished playing, the voice corresponding to the fourth message continues to be played, where the fourth message is a video, image or emoticon message sent from the second account to the first account after the first message;

[0082] If the first message is out of the conversation page while the first voice is being played, stop playing the first voice; if the first message is re-displayed on the conversation page, continue playing the first voice;

[0083] When the first voice is played and the first message is separated from the conversation page, if the first message is re-displayed on the conversation page, a playback control control corresponding to the first message is displayed, and the playback control control is used to control the playback of the first voice;

[0084] If the conversation page receives N fourth messages continuously in the first time interval, N is greater than a preset number threshold, and the N+1th fourth message is not received in the second time interval, the voices corresponding to the N fourth messages are played sequentially.

[0085] According to a third aspect of an embodiment of the present disclosure, a computer-readable storage medium is provided. When instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute any one of the methods in the first aspect of the embodiment of the present disclosure.

[0086] According to a fourth aspect of an embodiment of the present disclosure, an electronic device is provided, comprising: a processor; and a memory for storing instructions executable by the processor; wherein the processor is configured to execute the instructions to implement any one of the methods in the first aspect of the embodiment of the present disclosure.

[0087] According to the fifth aspect of an embodiment of the present disclosure, a computer program product is provided, the computer program product comprising a computer program, the computer program being stored in a readable storage medium, at least one processor of a computer device reading and executing the computer program from the readable storage medium, so that the computer device performs any one of the methods in the first aspect of the embodiment of the present disclosure.

[0088] The technical solution provided by the embodiments of the present disclosure brings at least the following beneficial effects:

[0089] In the interface for information exchange between accounts, if you receive a video, image or emoticon message sent by the other account, you can not only display the message, but also play the message by voice, thereby converting the information in the video, image or emoticon message into voice mode information and presenting it in the form of voice playback, realizing multimodal information interaction and improving information expressiveness and interaction efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0090] The drawings herein are incorporated into and constitute a part of the specification, illustrate embodiments consistent with the present disclosure, and together with the description are used to explain the principles of the present disclosure, and do not constitute improper limitations on the present disclosure.

[0091] Figure 1 is a schematic diagram of an implementation environment of an information interaction method according to an exemplary embodiment;

[0092] Figure 2 is a flow chart of an information interaction method according to an exemplary embodiment;

[0093] Figure 3 is a schematic diagram of an information interaction interface according to an exemplary embodiment Figure 1 ;

[0094] Figure 4 is a schematic diagram of an information interaction interface according to an exemplary embodiment Figure 2 ;

[0095] Figure 5is a schematic diagram of a setting interface corresponding to a second account according to an exemplary embodiment;

[0096] Figure 6 is a block diagram of an information interaction device according to an exemplary embodiment;

[0097] Figure 7 A computer device according to an exemplary embodiment is provided. Figure 1 ;

[0098] Figure 8 A computer device according to an exemplary embodiment is provided. Figure 2 . DETAILED DESCRIPTION

[0099] In order to enable ordinary persons in the art to better understand the technical solutions of the present disclosure, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings.

[0100] It should be noted that the terms "first", "second", etc. in the specification and claims of the present disclosure and the above-mentioned drawings are used to distinguish similar first objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present disclosure described herein can be implemented in an order other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0101] Before describing the embodiments of the present disclosure in detail, the relevant technical background related to the embodiments of the present disclosure is introduced to facilitate understanding by those skilled in the art in the field of the present disclosure.

[0102] It should be emphasized that all information involved in this disclosure is authorized by the user or fully authorized by all parties.

[0103] Figure 1 FIG. 1 is a schematic diagram of an implementation environment of an information interaction method according to an exemplary embodiment. Taking the electronic device implementing the information interaction method as a terminal as an example, see Figure 1 , the implementation environment specifically includes: a terminal 101 and a server 102.

[0104] The terminal 101 may be at least one of a smart phone, a smart watch, a desktop computer, a laptop computer, and a portable computer. An application supporting information interaction may be installed and run on the terminal 101, and a user may log in to the application through the terminal 101 to obtain an information interaction service, which may be a service providing information interaction for media content. The terminal 101 may generally refer to one of a plurality of terminals, and this embodiment is only illustrated by the terminal 101. Those skilled in the art may know that the number of the above-mentioned terminals may be more or less. For example, the above-mentioned terminals may be only a few, or the above-mentioned terminals may be dozens or hundreds, or a greater number. The embodiment of the present disclosure does not limit the number of terminals and device types.

[0105] The server 102 may be at least one of a single server, multiple servers, a cloud computing platform, and a virtualization center. The server 102 may be connected to the terminal 101 and other terminals via a wireless network or a wired network. The server 102 may support the information interaction method disclosed herein and enable the information interaction method to be implemented in multiple terminals.

[0106] Figure 2 FIG. 1 is a flow chart of an information interaction method according to an exemplary embodiment. Figure 2 As shown, the above method at least includes the following steps S210-S220, which are applied to the client corresponding to the first account, and the first account is any account using the aforementioned application.

[0107] In step S210, a conversation page between the first account and the second account is displayed.

[0108] In the present disclosure, the conversation page may be an instant messaging interface of the first account and the second account. The present disclosure does not limit the application to which the instant messaging interface belongs. For example, the application may be an instant messaging application, a short video application, a smart office application, etc. The conversation page is an interface displayed on the client corresponding to the first account when the first account and the second account are communicating instantly. The present disclosure does not limit the second account, which may be any account different from the first account.

[0109] In step S220, when the first message is displayed on the conversation page, a first voice corresponding to the first message is played, where the first message is a video, image or emoticon message sent from the second account to the first account, and the content of the first voice is obtained based on the visual information in the first message.

[0110] The second account can send an instant messaging message to the first account. If the instant messaging message is a video, image or emoticon message, it is called a first message. The present disclosure can extract the visual information in the video, image or emoticon message sent by the second account and play it in the form of a first voice, so as to provide the first account with an auditory experience of the visual information in the video, image or emoticon message, so that the user corresponding to the first account can not only see the video, image or emoticon message, but also hear the visual information in the video, image or emoticon message, so that the user corresponding to the first account can feel more diverse and rich, improve the fun and convenience of information interaction, thereby promoting the first account to reply to the first message, which is conducive to further promoting information interaction.

[0111] Please refer to Figure 3 , which shows the interface diagram of information interaction Figure 1 . Figure 3 (1) shows an information interaction interface between a first account (user A) and a second account (user B) on the client where user A is located, i.e., a conversation page. The first message received by the conversation page is an emoticon message. In this case, the content of the first voice is the Chinese meaning corresponding to the emoticon in the emoticon message, such as "crying loudly", "shedding tears", "cute", and "squinting smile". Figure 3 In (1), a play control control 301 may be displayed next to the first message, and when the play control control 301 is triggered, the first voice may be played. Figure 3 In (2), the first message received by the conversation page is an image. In this case, the content of the first voice includes the content obtained by understanding the content of the image. A playback control widget 301 can be displayed next to the first message. When the playback control widget 301 is triggered, the first voice can be played. Figure 3 In (3), the first message received by the conversation page is a video. In this case, the content of the first voice includes the content obtained by understanding the content and extracting the theme of the video. A playback control widget 301 can be displayed next to the first message, and when the playback control widget 301 is triggered, the first voice can be played.

[0112] Of course, the present disclosure does not limit the display timing of the playback control widget 301. For example, it can be displayed around the first message when the conversation page displays the first message. It can also be displayed in response to a preset operation. For example, if a trigger operation is received for the first message, the playback control widget 301 can be displayed. The present disclosure does not limit the trigger operation. For example, it can be a long press, a click, etc.

[0113] The present disclosure can process the visual information of the first message to obtain the text content corresponding to the first message, and the text content can be played by the voice playback to realize the playback of the first voice. Specifically, if the first message is an image, it can be processed by image-to-text processing, and the image-to-text processing can understand the content of the image and output it as text content. If the first message is a video, it can be processed by image-to-text combined with video theme extraction, and the image-to-text processing can understand the content of the image in the video. The video theme extraction can extract the theme content of the video according to each image of the video, and output the content of the image and the theme content as text content, so as to obtain the first voice based on the text content. The present disclosure does not limit the implementation details of various technical means such as image-to-text processing, video theme extraction, and visual information processing, and does not constitute an implementation obstacle. The present disclosure provides corresponding processing methods for various first messages to obtain corresponding first voices, thereby supporting the voice playback of various first messages, expanding the applicable scenarios of voice playback, and providing users with diversified voice playback services.

[0114] Before playing the first message, the present disclosure also supports the first account to independently select the voice package used to play the first voice. In the present disclosure, each voice package corresponds to a voice mode, and the voice package selection is achieved by selecting the voice mode. In an exemplary embodiment, before playing the first voice corresponding to the first message, the method also includes: displaying at least one first control in the account configuration interface corresponding to the second account, each of the first controls corresponding to a voice mode, and the voice mode is a voice playback method including at least one of timbre information, speech speed information, and tone information; when any of the first controls is selected, the voice mode corresponding to the triggered first control is used as the current voice mode of the second account, and the current voice mode is the voice mode used to play the first voice.

[0115] Please refer to Figure 4 , which shows the interface diagram of information interaction Figure 2 . Figure 4 (1) Displaying an account configuration interface 401 corresponding to the second account, the account configuration interface 401 includes at least one first control 402, each of which corresponds to a voice mode. The voice mode corresponding to the first control displayed in the account configuration interface 401 can be a preset voice mode in the application, or a voice mode recorded by other accounts associated with the first account, that is, a personalized voice mode, which is not limited in the present disclosure. Figure 4 For any first control in (1), if the first control is triggered, the first voice can be played using its corresponding voice mode. Figure 4 (2) Shown in Figure 4Schematic diagram of using "voice mode 1" to play the first voice when the first first control in (1) is triggered.

[0116] Of course, the present disclosure does not limit the display timing of the account configuration interface 401. For example, the relevant control of the second account can be clicked to trigger the display of the account configuration interface 401. The present disclosure realizes personalized voice playback, improves information interaction efficiency, and optimizes voice playback experience by supporting the user corresponding to the first account to independently select the voice mode.

[0117] In an exemplary embodiment, the application can support inviting a second account that is communicating with the first account to record a voice package, thereby achieving the technical effect of using the voice package recorded by the user corresponding to the second account to play the first voice corresponding to the first message sent by the second account when interacting with the second account, thereby enhancing the realism of real-person interaction. By inviting the user corresponding to the second account to record a voice package, the interaction method between the first account and the second account is expanded, and the interaction willingness of the user corresponding to the second account is promoted. In order to achieve this technical purpose, in this embodiment, the method also includes: displaying a second control on the account configuration interface;

[0118] When the second control is triggered, a second message is sent to the second account, where the second message is used to notify the second account to record a preset voice, and the preset voice is used to extract a voice pattern corresponding to the second account;

[0119] The displaying of at least one first control on the account configuration interface corresponding to the second account includes: upon receiving a notification indicating that a preset voice recording is successful, displaying a first control corresponding to the voice mode corresponding to the second account.

[0120] Figure 4 (3) Displaying the account configuration interface 401, the account configuration interface 401 also includes a second control 403, the second control 403 can also display the prompt information "Invite friends to record voice", triggering the second control 403 can generate an invitation message, the invitation message is the second message, the second message is used to notify the second account to record the preset voice, so as to obtain the voice mode corresponding to the second account. Please refer to Figure 4 (4) The second message can be sent to the second account and displayed on the conversation page where the first account and the second account interact with each other. After seeing the second message, the user corresponding to the second account can trigger the application to generate a voice pattern corresponding to the second account by recording a preset voice, and send a notification indicating that the preset voice recording is successful to the clients corresponding to the first account and the second account respectively.

[0121] Please refer to Figure 4(5) shows that when the client corresponding to the first account receives a notification indicating that the preset voice recording is successful, the first control 404 corresponding to the voice mode corresponding to the second account can be displayed in the account configuration interface 401. If the user clicks the first control 404, the voice mode corresponding to the second account can be set to the voice mode used for playing the first voice.

[0122] In an exemplary embodiment, the method further includes: displaying a third control; when the third control is set to an on state, when the first message is displayed on the conversation page, playing a first voice corresponding to the first message, including: synchronously playing the first voice when the first message is displayed on the conversation page; when the third control is set to a off state, when the first message is displayed on the conversation page, playing the first voice corresponding to the first message, including: when a preset operation for the first message is received, displaying a playback control control corresponding to the first message on the conversation page; when the playback control control is triggered, playing the first voice; or, displaying a playback control control corresponding to the first message on the conversation page, and playing the first voice when the playback control control is triggered.

[0123] When the third control is set to the on state, the present disclosure can support automatic playback of the first voice, and the user does not need to trigger the playback of the first voice, which saves the user's operation path and improves the efficiency of information interaction. When the third control is set to the off state, the present disclosure can support controlling the playback of the first voice by using the playback control control, so that the user corresponding to the first account can more accurately control the playback process of the first voice, for example, control the first voice to start playback, stop playback, or display the playback status, thereby improving user participation and optimizing user experience.

[0124] The present disclosure does not limit the display position of the third control, for example, it can be displayed in the account configuration interface 401. Figure 4 (1) It shows a third control 405, and the third control 405 displays a prompt message "Automatically read message". The third control 405 can be used as the aforementioned third control.

[0125] Please refer to Figure 5, which shows a schematic diagram of the setting interface corresponding to the second account in the client corresponding to the first account. When the user corresponding to the first account opens the schematic diagram of the setting interface corresponding to the second account, a third control "automatically read messages" can be displayed in the schematic diagram of the setting interface. The third control can quickly turn on or off the function of automatically reading messages. If the function is turned on, the first voice can be automatically played when the first message is displayed. If the function is turned off, after the first message is displayed, the user can start playing the first voice by triggering the corresponding playback control control.

[0126] In an exemplary embodiment, a playback function control is displayed on an account configuration interface corresponding to the second account; the playing of the first voice corresponding to the first message includes: when the playback function control is configured to be in an on state, playing the first voice corresponding to the first message; the method also includes: when the playback function control is configured to be in a off state, not playing the first voice corresponding to the first message.

[0127] In the present disclosure, the playback function control control can be understood as a master switch for starting the playback function of the first voice. If the master switch is turned on, the first voice can be played automatically or in response to the triggering of the playback control control. If the master switch is turned off, the function of playing the first voice is hidden, and neither the first voice will be played nor the playback control control related to playing the first voice will be displayed. The user can choose to start or hide the first voice playback function by manipulating the playback function control control to improve the user experience.

[0128] In an exemplary embodiment, the method further includes: displaying a fourth control when the conversation page receives a video, image or emoticon message input by the first account; and displaying a third message on the conversation page when the fourth control is triggered, wherein the third message is a voice message sent by the first account to the second account based on the video, image or emoticon message input by the first account.

[0129] This solution supports displaying a fourth control when a user of a first account actively sends a video, image or emoticon message to a second account. The fourth control implements the function of converting a video, image or emoticon message to voice, thereby directly sending a voice message corresponding to the video, image or emoticon message, that is, a third message. The third message is displayed, and both the client corresponding to the first account and the client corresponding to the second account can play the third message, thereby implementing the function of converting a video, image or emoticon message to voice in the message sending stage.

[0130] In an exemplary embodiment, the method further includes: displaying at least one fifth control, each of the fifth controls corresponding to a voice mode; when any of the fifth controls is triggered, the voice mode corresponding to the triggered fifth control is used as the voice mode corresponding to the third message. The display scheme of the fifth control is based on the same inventive concept as the display scheme of the aforementioned first control, and no further explanation is given here. By displaying and triggering the fifth control, the user of the first account can independently select the voice mode used when converting the video, image or emoticon message to voice, thereby realizing a personalized video, image or emoticon message to voice function. Regardless of the client corresponding to the first account or the client corresponding to the second account, when the third message is played, the voice mode corresponding to the third message can be used to play it.

[0131] In an exemplary embodiment, the method further includes: displaying the current voice mode of the second account on the account configuration interface; when other first controls except the first control corresponding to the current voice mode are selected, switching the current voice mode of the second account to the voice mode corresponding to the selected first control. The present disclosure supports that the user corresponding to the first account can switch the voice mode used when playing the first message at any time, increasing the flexibility of voice mode playback and improving user experience.

[0132] In an exemplary embodiment, the speech rate information of the current voice mode includes at least two speech rate modes, and the tone information of the current voice mode includes at least two tone modes; when the first message is an image or expression message, playing the first voice corresponding to the first message includes: determining a target speech rate mode in the speech rate information based on the emotional information in the first message; determining a target tone mode in the tone information based on the emotional information in the first message; playing the first voice corresponding to the first message based on the timbre information of the current voice mode, the target speech rate mode and the target tone mode.

[0133] For example, the current voice mode includes three speech speed modes: slow, medium, and fast, and the current voice mode also includes three tone modes: low, medium, and high. For an image, it can be input into an emotion analysis model to obtain the emotion category to which it belongs, and the emotion category is used as the aforementioned emotion information. For an expression message, the emotion category to which it belongs can be directly obtained based on its corresponding Chinese meaning, and the emotion category is used as the aforementioned emotion information. If the emotion category is pessimistic or depressed, a slow target speech speed mode and a low target tone mode can be used to play the first voice. If the emotion category is optimistic or excited, a faster target speech speed mode and a high target tone mode can be used to play the first voice. Of course, the present disclosure does not limit the method for obtaining the emotion category and the specific training method of the emotion analysis model, and does not constitute an implementation obstacle. The present disclosure determines the appropriate target tone mode and target speech speed mode by using emotion information, so that the playback effect of the first voice is more consistent with the content of the first message itself, and the user can immediately determine the emotional information of the first message itself upon hearing it, thereby significantly improving the user experience and also improving the information content in the playback effect of the first voice.

[0134] In an exemplary embodiment, in the case where the first message is a video, the playing of the first voice corresponding to the first message includes: determining the emotion parameters corresponding to each image frame in the video based on the emotion information of each image frame; determining the emotion category of each image frame based on the emotion parameters corresponding to each image frame; determining at least one video segment, and the image frames in each video segment belong to the same emotion category; for each video segment, based on the corresponding emotion category, determining a target speech rate mode in the speech rate information, and determining a target tone mode in the tone information; and playing the voice corresponding to the video segment based on the timbre information of the current voice mode, the target speech rate mode and the target tone mode.

[0135] The method for determining the emotion category of each image frame, the method for determining the target tone mode, and the method for determining the target speech rate mode in the present disclosure are based on the same inventive concept as the aforementioned content, and no further elaboration is given here. The difference is that the video can be divided into video segments based on the emotion category, so that the image frames in each of the video segments belong to the same emotion category. For each video segment, a target tone mode and a target speech rate mode are determined and played. For different video segments, the target tone mode and the target speech rate mode will also be different, so the corresponding voices will also be different in playback effects, thereby achieving the technical purpose of different video segments having different playback effects. Users can perceive the emotional changes of different video segments from the playback effects, bringing users a rich emotional experience.

[0136] In an exemplary embodiment, the method further comprises:

[0137] If the conversation page receives a fourth message while the first voice is being played, the first voice continues to be played, and after the first voice is finished playing, the voice corresponding to the fourth message continues to be played, where the fourth message is a video, image or emoticon message sent from the second account to the first account after the first message;

[0138] If the first message is out of the conversation page while the first voice is being played, stop playing the first voice; if the first message is re-displayed on the conversation page, continue playing the first voice;

[0139] When the first voice is played and the first message is separated from the conversation page, if the first message is re-displayed on the conversation page, a playback control control corresponding to the first message is displayed, and the playback control control is used to control the playback of the first voice;

[0140] If the conversation page receives N fourth messages continuously in the first time interval, N is greater than a preset number threshold, and the N+1th fourth message is not received in the second time interval, the voices corresponding to the N fourth messages are played sequentially.

[0141] Under this implementation, the playback process of the first voice can be automatically controlled according to the association between the first message and the conversation page. If the user slides the message in the conversation page, the first message may leave the conversation page or re-enter the conversation page. Accordingly, in conjunction with the departure or re-display of the first message, the playback process of the first voice can be adaptively controlled. For example, if the first message is swiped away and not displayed on the current conversation page when the first voice is played, the first voice can be paused, and the first voice can be continued when the first message is re-displayed. If the first message is re-displayed after the first voice is played and leaves the conversation page, the first voice may not be automatically re-played, and only the playback control controls may be displayed, and the user may decide whether to play the first voice. By adaptively adjusting the playback control logic of the first voice in combination with the display logic of the first voice, the playback control process of the first voice is more in line with user needs.

[0142] In this implementation, if the next message (fourth message) is received before the first voice is played, continuous voice playback can be automatically triggered. The playback method of the voice corresponding to the fourth message is based on the same inventive concept as the playback method of the first voice, and no further explanation is given here. Automatically triggering continuous voice playback saves user operations and improves user experience.

[0143] Under this implementation mode, when a large number of fourth messages are obtained in a short time (first time interval), the fourth messages can be played in a centralized manner (when no new fourth messages are received in the second time interval). The centralized playback method can enable users to focus on the substantive content of the batch of messages, thereby improving the playback efficiency. Of course, the present disclosure does not limit the specific values ​​of the first time interval, the second time interval, and N. N is an integer greater than the preset number threshold, and the present disclosure does not limit the specific value of the preset number threshold.

[0144] Figure 6 This is a block diagram of an information interaction device according to an exemplary embodiment, which is applied to a client corresponding to a first account. The device includes:

[0145] A display module 601 is configured to display a conversation page between the first account and the second account;

[0146] The interaction module 602 is configured to play a first voice corresponding to a first message when the first message is displayed on the conversation page. The first message is a video, image or emoticon message sent from the second account to the first account, and the content of the first voice is obtained based on the visual information in the first message.

[0147] In an exemplary embodiment, the interaction module 602 is configured to execute:

[0148] Displaying at least one first control on the account configuration interface corresponding to the second account, each of the first controls corresponds to a voice mode, and the voice mode is a voice playback method including at least one of timbre information, speech speed information, and tone information;

[0149] When any of the first controls is selected, the voice mode corresponding to the triggered first control is used as the current voice mode of the second account, and the current voice mode is the voice mode used for playing the first voice.

[0150] In an exemplary embodiment, the interaction module 602 is configured to execute:

[0151] Displaying a second control on the account configuration interface;

[0152] When the second control is triggered, a second message is sent to the second account, where the second message is used to notify the second account to record a preset voice, and the preset voice is used to extract a voice pattern corresponding to the second account;

[0153] The displaying of at least one first control on the account configuration interface corresponding to the second account includes: upon receiving a notification indicating that a preset voice recording is successful, displaying a first control corresponding to the voice mode corresponding to the second account.

[0154] In an exemplary embodiment, the interaction module 602 is configured to execute:

[0155] Display the third control;

[0156] When the third control is set to the on state, when the first message is displayed on the conversation page, playing the first voice corresponding to the first message includes: when the first message is displayed on the conversation page, playing the first voice synchronously;

[0157] In the case where the third control is set to a closed state, the first voice corresponding to the first message is played when the first message is displayed on the conversation page, including: when a preset operation for the first message is received, displaying a playback control control corresponding to the first message on the conversation page; when the playback control control is triggered, playing the first voice; or, displaying a playback control control corresponding to the first message on the conversation page, and playing the first voice when the playback control control is triggered.

[0158] In an exemplary embodiment, the interaction module 602 is configured to execute:

[0159] Displaying a playback function control on an account configuration interface corresponding to the second account;

[0160] The playing of the first voice corresponding to the first message includes: when the play function control is configured to be in an on state, playing the first voice corresponding to the first message;

[0161] When the play function control is configured to be in a closed state, the first voice corresponding to the first message is not played.

[0162] In an exemplary embodiment, the interaction module 602 is configured to execute:

[0163] When the conversation page receives a video, image or emoticon message input by the first account, displaying a fourth control;

[0164] When the fourth control is triggered, a third message is displayed on the conversation page, where the third message is a voice message sent from the first account to the second account and obtained based on the video, image or emoticon message input by the first account.

[0165] In an exemplary embodiment, the interaction module 602 is configured to execute:

[0166] Displaying at least one fifth control, each of the fifth controls corresponding to a voice mode;

[0167] When any of the fifth controls is triggered, the voice mode corresponding to the triggered fifth control is used as the voice mode corresponding to the third message.

[0168] In an exemplary embodiment, the interaction module 602 is configured to execute:

[0169] Displaying the current voice mode of the second account on the account configuration interface;

[0170] When other first controls except the first control corresponding to the current voice mode are selected, the current voice mode of the second account is switched to the voice mode corresponding to the selected first control.

[0171] In an exemplary embodiment, the speech rate information of the current voice mode includes at least two speech rate modes, and the tone information of the current voice mode includes at least two tone modes; when the first message is an image or emoticon message, playing the first voice corresponding to the first message includes:

[0172] Determining a target speech rate mode in the speech rate information based on the emotion information in the first message;

[0173] Determining a target tone pattern in the tone information based on the emotion information in the first message;

[0174] Based on the timbre information of the current voice mode, the target speech rate mode and the target tone mode, the first voice corresponding to the first message is played.

[0175] In an exemplary implementation, when the first message is a video, playing the first voice corresponding to the first message includes:

[0176] Determining the emotion category of each image frame according to the emotion information of each image frame in the video;

[0177] determining at least one video segment, wherein image frames in each of the video segments belong to the same emotion category;

[0178] For each of the video segments, based on the corresponding emotion category, a target speech rate mode is determined in the speech rate information, and a target tone mode is determined in the tone information; based on the timbre information of the current voice mode, the target speech rate mode and the target tone mode, the voice corresponding to the video segment is played.

[0179] In an exemplary embodiment, the interaction module 602 is configured to execute:

[0180] If the conversation page receives a fourth message while the first voice is being played, the first voice continues to be played, and after the first voice is finished playing, the voice corresponding to the fourth message continues to be played, where the fourth message is a video, image or emoticon message sent from the second account to the first account after the first message;

[0181] If the first message is out of the conversation page while the first voice is being played, stop playing the first voice; if the first message is re-displayed on the conversation page, continue playing the first voice;

[0182] When the first voice is played and the first message is separated from the conversation page, if the first message is re-displayed on the conversation page, a playback control control corresponding to the first message is displayed, and the playback control control is used to control the playback of the first voice;

[0183] If the conversation page receives N fourth messages continuously in the first time interval, N is greater than a preset number threshold, and the N+1th fourth message is not received in the second time interval, the voices corresponding to the N fourth messages are played sequentially.

[0184] Regarding the device in the above embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment of the relevant method, and will not be elaborated here.

[0185] Please refer to Figure 7 , which shows a structural frame of a computer device provided by an exemplary embodiment of the present disclosure Figure 1 The computer device may be a terminal. The computer device is used to implement the information interaction method provided in the above embodiment. Specifically:

[0186] Typically, the computer device 70 includes a processor 71 and a memory 72 .

[0187] The processor 71 may include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 71 may be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field Programmable Gate Array), and PLA (Programmable Logic Array). The processor 71 may also include a main processor and a coprocessor. The main processor is a processor for processing data in the awake state, also known as a CPU (Central Processing Unit); the coprocessor is a low-power processor for processing data in the standby state. In an exemplary embodiment, the processor 71 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the display screen. In an exemplary embodiment, the processor 71 may also include an AI (Artificial Intelligence) processor, which is used to process computing operations related to machine learning.

[0188] The memory 72 may include one or more computer-readable storage media, which may be non-transitory. The memory 72 may also include high-speed random access memory, and non-volatile memory, such as one or more disk storage devices, flash memory storage devices. In an exemplary embodiment, the non-transitory computer-readable storage medium in the memory 72 is used to store at least one instruction, at least one program, code set or instruction set, and the at least one instruction, at least one program, code set or instruction set is configured to be executed by one or more processors to implement the above-mentioned information interaction method.

[0189] In an exemplary embodiment, the computer device 70 may further optionally include: a peripheral device interface 73 and at least one peripheral device. The processor 71, the memory 72 and the peripheral device interface 73 may be connected via a bus or a signal line. Each peripheral device may be connected to the peripheral device interface 73 via a bus, a signal line or a circuit board. Specifically, the peripheral device includes: at least one of a radio frequency circuit 74, a touch display screen 75, a camera control 76, an audio circuit 77, a positioning component 78 and a power supply 79.

[0190] Those skilled in the art will understand that Figure 7 The structure shown in the figure does not constitute a limitation on the computer device 70, and the computer device 70 may include more or less controls than those shown in the figure, or combine some controls, or adopt a different control arrangement.

[0191] Please refer to Figure 8 , which shows a structural frame of a computer device provided by another exemplary embodiment of the present disclosure Figure 2 The computer device can be used to execute the above information interaction method. Specifically:

[0192] The computer device 800 includes a central processing unit (CPU) 801, a system memory 804 including a random access memory (RAM) 802 and a read only memory (ROM) 803, and a system bus 805 connecting the system memory 804 and the central processing unit 801. The computer device 800 also includes a basic input / output system (I / O (Input / Output) system) 806 that helps to transfer information between various components in the computer, and a large-capacity storage device 807 for storing an operating system 813, application programs 814 and other program modules 815.

[0193] The basic input / output system 806 includes a display 808 for displaying information and an input device 809 such as a mouse and a keyboard for user inputting information. The display 808 and the input device 809 are connected to the central processing unit 801 through an input / output controller 810 connected to the system bus 805. The basic input / output system 806 may also include an input / output controller 810 for receiving and processing inputs from a plurality of other devices such as a keyboard, a mouse, or an electronic stylus. Similarly, the input / output controller 810 also provides output to a display screen, a printer, or other types of output devices.

[0194] The mass storage device 807 is connected to the central processing unit 801 through a mass storage controller (not shown) connected to the system bus 805. The mass storage device 807 and its associated computer readable medium provide non-volatile storage for the computer device 800. That is, the mass storage device 807 may include a computer readable medium (not shown) such as a hard disk or a CD-ROM (Compact Disc Read-Only Memory) drive.

[0195] Without loss of generality, computer readable media may include computer storage media and communication media. Computer storage media include volatile and non-volatile, removable and non-removable media implemented by any method or technology for storing information such as computer readable instructions, data structures, program modules or other data. Computer storage media include RAM, ROM, EPROM (Erasable Programmable Read Only Memory), EEPROM (Electrically Erasable Programmable Read Only Memory), flash memory or other solid-state storage technologies, CD-ROM, DVD (Digital Video Disc) or other optical storage, cassettes, magnetic tapes, disk storage or other magnetic storage devices. Of course, those skilled in the art will appreciate that computer storage media are not limited to the above. The above-mentioned system memory 804 and mass storage device 807 can be collectively referred to as memory.

[0196] According to various embodiments of the present disclosure, the computer device 800 can also be connected to a remote computer on the network through a network such as the Internet. That is, the computer device 800 can be connected to the network 812 through the network interface unit 811 connected to the system bus 805, or the network interface unit 811 can be used to connect to other types of networks or remote computer systems (not shown).

[0197] The above-mentioned memory also includes a computer program, which is stored in the memory and is configured to be executed by one or more processors to implement the above-mentioned information interaction method.

[0198] In an exemplary embodiment, a computer-readable storage medium is further provided, wherein the storage medium stores at least one instruction, at least one program, code set or instruction set, and the at least one instruction, at least one program, code set or instruction set is executed by a processor to implement the above-mentioned information interaction method. The above-mentioned information interaction method is applied to a client corresponding to the first account, and the method includes:

[0199] Displaying a conversation page between the first account and the second account;

[0200] When the first message is displayed on the conversation page, a first voice corresponding to the first message is played, where the first message is a video, image or emoticon message sent from the second account to the first account, and the content of the first voice is obtained based on the visual information in the first message.

[0201] In an exemplary embodiment, before playing the first voice corresponding to the first message, the method further includes:

[0202] Displaying at least one first control on the account configuration interface corresponding to the second account, each of the first controls corresponds to a voice mode, and the voice mode is a voice playback method including at least one of timbre information, speech speed information, and tone information;

[0203] When any of the first controls is selected, the voice mode corresponding to the triggered first control is used as the current voice mode of the second account, and the current voice mode is the voice mode used for playing the first voice.

[0204] In an exemplary embodiment, the method further comprises:

[0205] Displaying a second control on the account configuration interface;

[0206] When the second control is triggered, a second message is sent to the second account, where the second message is used to notify the second account to record a preset voice, and the preset voice is used to extract a voice pattern corresponding to the second account;

[0207] The displaying of at least one first control on the account configuration interface corresponding to the second account includes: upon receiving a notification indicating that a preset voice recording is successful, displaying a first control corresponding to the voice mode corresponding to the second account.

[0208] In an exemplary embodiment, the method further comprises:

[0209] Display the third control;

[0210] When the third control is set to the on state, when the first message is displayed on the conversation page, playing the first voice corresponding to the first message includes: when the first message is displayed on the conversation page, playing the first voice synchronously;

[0211] In the case where the third control is set to a closed state, the first voice corresponding to the first message is played when the first message is displayed on the conversation page, including: when a preset operation for the first message is received, displaying a playback control control corresponding to the first message on the conversation page; when the playback control control is triggered, playing the first voice; or, displaying a playback control control corresponding to the first message on the conversation page, and playing the first voice when the playback control control is triggered.

[0212] In an exemplary embodiment, the method further comprises:

[0213] Displaying a playback function control on an account configuration interface corresponding to the second account;

[0214] The playing of the first voice corresponding to the first message includes: when the play function control is configured to be in an on state, playing the first voice corresponding to the first message;

[0215] The method further comprises:

[0216] When the play function control is configured to be in a closed state, the first voice corresponding to the first message is not played.

[0217] In an exemplary embodiment, the method further comprises:

[0218] When the conversation page receives a video, image or emoticon message input by the first account, displaying a fourth control;

[0219] When the fourth control is triggered, a third message is displayed on the conversation page, where the third message is a voice message sent from the first account to the second account and obtained based on the video, image or emoticon message input by the first account.

[0220] In an exemplary embodiment, the method further comprises:

[0221] Displaying at least one fifth control, each of the fifth controls corresponding to a voice mode;

[0222] When any of the fifth controls is triggered, the voice mode corresponding to the triggered fifth control is used as the voice mode corresponding to the third message.

[0223] In an exemplary embodiment, the method further comprises:

[0224] Displaying the current voice mode of the second account on the account configuration interface;

[0225] When other first controls except the first control corresponding to the current voice mode are selected, the current voice mode of the second account is switched to the voice mode corresponding to the selected first control.

[0226] In an exemplary embodiment, the speech rate information of the current voice mode includes at least two speech rate modes, and the tone information of the current voice mode includes at least two tone modes; when the first message is an image or emoticon message, playing the first voice corresponding to the first message includes:

[0227] Determining a target speech rate mode in the speech rate information based on the emotion information in the first message;

[0228] Determining a target tone pattern in the tone information based on the emotion information in the first message;

[0229] Based on the timbre information of the current voice mode, the target speech rate mode and the target tone mode, the first voice corresponding to the first message is played.

[0230] In an exemplary implementation, when the first message is a video, playing the first voice corresponding to the first message includes:

[0231] Determining the emotion category of each image frame according to the emotion information of each image frame in the video;

[0232] determining at least one video segment, wherein image frames in each of the video segments belong to the same emotion category;

[0233] For each of the video segments, based on the corresponding emotion category, a target speech rate mode is determined in the speech rate information, and a target tone mode is determined in the tone information; based on the timbre information of the current voice mode, the target speech rate mode and the target tone mode, the voice corresponding to the video segment is played.

[0234] In an exemplary embodiment, the method further comprises:

[0235] If the conversation page receives a fourth message while the first voice is being played, the first voice continues to be played, and after the first voice is finished playing, the voice corresponding to the fourth message continues to be played, where the fourth message is a video, image or emoticon message sent from the second account to the first account after the first message;

[0236] If the first message is out of the conversation page while the first voice is being played, stop playing the first voice; if the first message is re-displayed on the conversation page, continue playing the first voice;

[0237] When the first voice is played and the first message is separated from the conversation page, if the first message is re-displayed on the conversation page, a playback control control corresponding to the first message is displayed, and the playback control control is used to control the playback of the first voice;

[0238] If the conversation page receives N fourth messages continuously in the first time interval, N is greater than a preset number threshold, and the N+1th fourth message is not received in the second time interval, the voices corresponding to the N fourth messages are played sequentially.

[0239] Optionally, the computer readable storage medium may include: ROM (Read Only Memory), RAM (Random Access Memory), SSD (Solid State Drives) or optical disks, etc. Among them, the random access memory may include ReRAM (Resistance Random Access Memory) and DRAM (Dynamic Random Access Memory).

[0240] In an exemplary embodiment, a computer-readable storage medium including a program code is also provided, such as a memory including the program code, and the program code can be executed by a processor to complete the above-mentioned information interaction method. Optionally, the computer-readable storage medium can be a read-only memory (ROM), a random access memory (RAM), a compact-disc read-only memory (CD-ROM), a magnetic tape, a floppy disk, an optical data storage device, etc.

[0241] In an exemplary embodiment, a computer program product is also provided, including a computer program, and when the computer program is executed by a processor, the above-mentioned information interaction method is implemented.

[0242] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. The present disclosure is intended to cover any variations, uses or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The description and examples are to be considered exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.

[0243] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. An information interaction method, characterized in that: Applied to a client corresponding to the first account, the method includes: Displaying a conversation page between the first account and the second account; When the first message is displayed on the conversation page, a first voice corresponding to the first message is played, where the first message is a video, image or emoticon message sent from the second account to the first account, and the content of the first voice is obtained based on the visual information in the first message.

2. The information interaction method according to claim 1, characterized in that: Before playing the first voice corresponding to the first message, the method further includes: Displaying at least one first control on the account configuration interface corresponding to the second account, each of the first controls corresponds to a voice mode, and the voice mode is a voice playback method including at least one of timbre information, speech speed information, and tone information; When any of the first controls is selected, the voice mode corresponding to the triggered first control is used as the current voice mode of the second account, and the current voice mode is the voice mode used for playing the first voice.

3. The information interaction method according to claim 2, characterized in that: The method further comprises: Displaying a second control on the account configuration interface; When the second control is triggered, a second message is sent to the second account, where the second message is used to notify the second account to record a preset voice, and the preset voice is used to extract a voice pattern corresponding to the second account; The displaying of at least one first control on the account configuration interface corresponding to the second account includes: upon receiving a notification indicating that a preset voice recording is successful, displaying a first control corresponding to the voice mode corresponding to the second account.

4. The information interaction method according to claim 1, characterized in that: The method further comprises: Display the third control; When the third control is set to the on state, when the first message is displayed on the conversation page, playing the first voice corresponding to the first message includes: when the first message is displayed on the conversation page, playing the first voice synchronously; In the case where the third control is set to a closed state, the first voice corresponding to the first message is played when the first message is displayed on the conversation page, including: when a preset operation for the first message is received, displaying a playback control control corresponding to the first message on the conversation page; when the playback control control is triggered, playing the first voice; or, displaying a playback control control corresponding to the first message on the conversation page, and playing the first voice when the playback control control is triggered.

5. The information interaction method according to claim 1, characterized in that: Displaying a playback function control on an account configuration interface corresponding to the second account; The playing of the first voice corresponding to the first message includes: when the play function control is configured to be in an on state, playing the first voice corresponding to the first message; The method further comprises: When the play function control is configured to be in a closed state, the first voice corresponding to the first message is not played.

6. The information interaction method according to claim 1, characterized in that: The method further comprises: When the conversation page receives a video, image or emoticon message input by the first account, displaying a fourth control; When the fourth control is triggered, a third message is displayed on the conversation page, where the third message is a voice message sent from the first account to the second account and obtained based on the video, image or emoticon message input by the first account.

7. The information interaction method according to claim 6, characterized in that: The method further comprises: Displaying at least one fifth control, each of the fifth controls corresponding to a voice mode; When any of the fifth controls is triggered, the voice mode corresponding to the triggered fifth control is used as the voice mode corresponding to the third message.

8. The information interaction method according to claim 2, characterized in that: The method further comprises: Displaying the current voice mode of the second account on the account configuration interface; When other first controls except the first control corresponding to the current voice mode are selected, the current voice mode of the second account is switched to the voice mode corresponding to the selected first control.

9. The information interaction method according to claim 2, characterized in that: The speech rate information of the current speech mode includes at least two speech rate modes, and the tone information of the current speech mode includes at least two tone modes; In the case where the first message is an image or emoticon message, the playing of the first voice corresponding to the first message includes: Determining a target speech rate mode in the speech rate information based on the emotion information in the first message; Determining a target tone pattern in the tone information based on the emotion information in the first message; Based on the timbre information of the current voice mode, the target speech rate mode and the target tone mode, the first voice corresponding to the first message is played.

10. The information interaction method according to claim 9, characterized in that: In the case where the first message is a video, the playing of the first voice corresponding to the first message includes: Determining the emotion category of each image frame according to the emotion information of each image frame in the video; determining at least one video segment, wherein image frames in each of the video segments belong to the same emotion category; For each of the video segments, based on the corresponding emotion category, a target speech rate mode is determined in the speech rate information, and a target tone mode is determined in the tone information; based on the timbre information of the current voice mode, the target speech rate mode and the target tone mode, the voice corresponding to the video segment is played.

11. The information interaction method according to claim 1, characterized in that: The method further comprises: If the conversation page receives a fourth message while the first voice is being played, the first voice continues to be played, and after the first voice is finished playing, the voice corresponding to the fourth message continues to be played, where the fourth message is a video, image or emoticon message sent from the second account to the first account after the first message; If the first message is out of the conversation page while the first voice is being played, stop playing the first voice; if the first message is re-displayed on the conversation page, continue playing the first voice; When the first voice is played and the first message is separated from the conversation page, if the first message is re-displayed on the conversation page, a playback control control corresponding to the first message is displayed, and the playback control control is used to control the playback of the first voice; If the conversation page receives N fourth messages continuously in the first time interval, N is greater than a preset number threshold, and the N+1th fourth message is not received in the second time interval, the voices corresponding to the N fourth messages are played sequentially.

12. An information interaction device, characterized in that: Applied to a client corresponding to the first account, the device includes: A display module, configured to display a session page between the first account and the second account; The interaction module is configured to play a first voice corresponding to a first message when the first message is displayed on the conversation page, wherein the first message is a video, image or emoticon message sent from the second account to the first account, and the content of the first voice is obtained based on the visual information in the first message.

13. An electronic device, characterized in that: include: processor; a memory for storing instructions executable by the processor; The processor is configured to execute the instructions to implement the information interaction method as described in any one of claims 1 to 11.

14. A computer-readable storage medium, characterized in that: When the instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the information interaction method as described in any one of claims 1 to 11.

15. A computer program product, characterized in that The computer program product includes a computer program, which is stored in a readable storage medium. At least one processor of a computer device reads and executes the computer program from the readable storage medium, so that the device executes the information interaction method according to any one of claims 1 to 11.

Images