Method, apparatus, terminal, and computer program for playing an audio message

Abstract

Embodiments of the present application disclose a method, apparatus, terminal, and storage medium for playing an audio message in the field of human-computer interaction technology. The method includes: displaying a virtual image corresponding to at least one social account in a virtual social scene, where the virtual social scene is a virtual scene for the virtual image to perform social interaction (step 201); when a social message sent from a target social account is received and the social message includes an audio message, displaying an audio message playback control at a message presentation position corresponding to the target virtual image in the virtual social scene, where the target virtual image is the virtual image corresponding to the target social account (step 202); and in response to a trigger operation on the audio message playback control, playing the audio message in the virtual social scene without displaying a message processing interface corresponding to the target social account (step 203). According to the technical means of the embodiments of the present application, the convenience of the playback operation of the audio message can be improved.

Description

[Technical field]

[0001] [CROSS REFERENCE TO RELATED APPLICATIONS] This application claims the benefit of priority to Chinese Patent Application No. 202210726517.3, entitled "Method, device, terminal and storage medium for playing voice messages," filed with the State Intellectual Property Office of the People's Republic of China on June 23, 2022, the entire contents of which are incorporated herein by reference.

[0002] The embodiments of the present application relate to the field of human-computer interaction technology, and in particular to a method, device, terminal, and storage medium for playing a voice message. [Background technology]

[0003] Social Platform (Social Networking Service, Social During social interactions via Social Networking Service (SNS), social messages often include text, image messages, and many voice messages.

[0004] In the related technology, when a social message is received, a notification of an unread message is displayed on a message list screen, and by tapping the notification of an unread message, the unread message can be processed in a message processing interface, for example, by displaying a text message or an image message or playing an audio message.

[0005] However, with the above method, it is necessary to switch to the message processing interface to check the specific type of unread message, which means that in the case of social messages with strong interaction attributes such as voice messages, the process of retrieving social messages is cumbersome and convenience is reduced. Summary of the Invention

Means for Solving the Problem

[0006] Embodiments of the present application provide a method, apparatus, terminal, and storage medium for playing an audio message, which can improve the convenience of the playback operation of the audio message. The technical means are as follows.

[0007] According to one aspect, embodiments of the present application provide a method for playing an audio message executed by a terminal. The method includes: displaying a virtual image (also called an avatar) corresponding to at least one social account in a virtual social scene, where the virtual social scene is a virtual scene for the virtual image to perform social interaction; when a social message sent from a target social account is received and the social message includes an audio message, displaying an audio message playback control at a message presentation position corresponding to a target virtual image in the virtual social scene, where the target virtual image is a virtual image corresponding to the target social account; responding to a trigger operation of the audio message playback control, and playing the audio message in the virtual social scene without displaying a message processing interface corresponding to the target social account.

[0008] According to another aspect, embodiments of the present application provide a playback device for an audio message. The device includes: a display module configured to execute a step of displaying a virtual image corresponding to at least one social account in a virtual social scene, where the virtual social scene is a virtual scene for the virtual image to perform social interaction; When a social message sent from a target social account among at least one of the social accounts is received and the social message includes an audio message, a step of displaying an audio message playback control at a message presentation position corresponding to a target virtual image in the virtual social scene, where the target virtual image is a virtual image corresponding to the target social account, and the display module is further configured to execute the step. An audio playback module configured to execute a step of playing the audio message in the virtual social scene without displaying a message processing interface corresponding to the target social account in response to a trigger operation of the audio message playback control.

[0009] According to another aspect, an embodiment of the present application provides a terminal including a processor and a memory. At least one instruction for being executed by the processor to implement the method for playing an audio message according to one aspect above is stored in the memory.

[0010] According to another aspect, an embodiment of the present application provides a computer-readable storage medium. At least one program instruction for being loaded and executed by a processor to implement the method for playing an audio message according to one aspect above is stored in the computer-readable storage medium.

[0011] According to another aspect, an embodiment of the present application provides a computer program product including computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and by executing the computer instructions, causes the computer device to execute the method for playing an audio message according to each embodiment of one aspect above.

[0012] In an embodiment of the present application, a virtual image corresponding to at least one social account constructs a virtual social scene for performing social interactions. In the virtual social scene, when a social message including an audio message sent from a target social account is received, an audio message playback control is displayed at a message presentation position corresponding to the target virtual image to trigger the user, so that the audio message can be played in the virtual social scene without displaying a message processing interface corresponding to the target social account. According to the technical method according to the embodiment of the present application, in the virtual social scene, the audio message sent from the target social account is prominently displayed, and an audio message playback control for triggering the user is provided, so that the audio message in the virtual social scene can be quickly played. Therefore, the procedure of jumping to and then displaying the message processing interface corresponding to the target social account is eliminated, the playback operation procedure of the audio message is simplified, and the convenience of the playback operation of the audio message can be expected to be improved.

Brief Description of the Drawings

[0013]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Embodiments for Carrying Out the Invention

[0014] In order to make the object, technical means, and advantages of the present application clearer, the embodiments of the present application will be described in more detail below with reference to the accompanying drawings.

[0015] Referring to FIG. 1, it shows a schematic diagram of an implementation environment according to an embodiment of the present application. This implementation environment can include a first terminal 110, a server 120, and a second terminal 130.

[0016] The first terminal 110 and the second terminal 130 are electronic devices having a virtual social scene display function. Here, this virtual social scene display function may be realized by one function module in an application program having social properties, or may be realized by an independent desktop client terminal or a web client terminal. For example, this virtual social scene display function is realized as one function module of an instant communication application for registered users to perform social interactions in a virtual social scene through virtual images. This electronic device may be a smartphone, a tablet, a personal computer, a wearable device, or an in-vehicle terminal, etc.

[0017] As an option, the application programs installed on the first terminal 110 and the second terminal 130 are the same, or the application programs installed on the two terminals are the same type of application programs on different operating system platforms (Android or IOS). The first terminal 110 can refer to one of the plurality of terminals, and the second terminal 130 can refer to another one of the plurality of terminals. However, in this embodiment, only the first terminal 110 and the second terminal 130 will be described as examples. The device types of the first terminal 110 and the second terminal 130 may be the same or different, and this device type includes at least one of a smartphone, a tablet, an e-book reader, an MP3 player, an MP4 player, a laptop portable computer, and a desktop computer.

[0018] In FIG. 1, an example will be given in which the first terminal 110 and the second terminal 130 are smartphones and an application program having a virtual social scene display function is installed, but it is not limited thereto.

[0019] Although only two terminals are shown in FIG. 1, in different embodiments, there may be a plurality of other terminals that can access the server 120. The first terminal 110, the second terminal 130, and the other terminals are connected to the server 120 via a wireless network or a wired network.

[0020] Server 120 includes at least one of a single server, a server cluster consisting of multiple servers, a cloud computing platform, and a virtualization center. Server 120 is used to provide background services for application programs that support virtual social scenes. Optionally, Server 120 undertakes major computing tasks and the terminal undertakes secondary computing tasks, or Server 120 undertakes secondary computing tasks and the terminal undertakes major computing tasks, or collaborative computing is performed between Server 120 and the terminal using a distributed computing architecture.

[0021] Server 120 may be an independent physical server, or may be a server cluster or distributed system consisting of multiple physical servers. Furthermore, it may be a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain services, security services, content delivery networks (Content Delivery Network, CDN), and big data and artificial intelligence platforms.

[0022] In an exemplary example, Server 120 includes a memory 121, a processor 122, a user account database 123, a virtual image database 124, an input / output interface for users (Input / Output It includes an Interface and an I / O interface 125. Among them, the processor 122 loads instructions stored in the server 120 and is used to process the user account database 123 and the virtual image database 124. The user account database 123 is used to store data of user accounts used by the first terminal 110, the second terminal 130, and other terminals, such as avatars of user accounts and user names of user accounts. The virtual image database 124 is used to store image data of virtual images created by each user account. The I / O interface 125 for users is used to realize the sending and receiving of social messages between accounts by establishing communication and exchanging data with the first terminal 110 and / or the second terminal 130 via a wireless network or a wired network.

[0023] Referring to FIG. 2, a flowchart of a method for playing an audio message according to an exemplary embodiment of the present application is shown. In this embodiment, this method will be described by taking the terminal shown in FIG. 1 as an example. This method can include the following steps.

[0024] In step 201, a virtual image corresponding to at least one social account is displayed in a virtual social scene. The virtual social scene is a virtual scene for virtual images to perform social interactions.

[0025] Different from the social account list display interface in the related art, in the embodiment of the present application, the virtual social scene includes virtual images corresponding to different social accounts. These virtual images are made to perform social interactions on behalf of social accounts.

[0026] As an option, in the virtual social scene, a virtual image corresponding to this social account and the social account with which the social relationship has been established may be displayed, or a virtual image corresponding to another social account with which the social relationship has not been established may be displayed, but the embodiments of the present application do not limit this.

[0027] As an option, this virtual social scene can be customized by the user, that is, the virtual social scenes displayed by logging in to different social accounts may be the same or different. For example, the social account "Zhang San" may set the virtual social scene to a virtual park, and the social account "Li Si" may set the virtual social scene to a virtual restaurant.

[0028] As an option, the virtual social scene includes an installation interface provided for constructing a virtual image. By designing or decorating the virtual image, the virtual images corresponding to different social accounts may be the same or different. At the same time, in order to make it easier to distinguish the virtual images corresponding to each social account, a unique label for indicating the virtual image is displayed around the virtual image in the virtual social scene. This label may be the account name of the social account or other labels that can be distinguished.

[0029] Exemplarily, as shown in FIG. 3, the terminal displays a first virtual image 302 corresponding to the first social account and a second virtual image 303 corresponding to the second social account in the virtual social scene 301. In order to make it easier to distinguish the virtual images corresponding to different social accounts, the account name of the first social account is displayed around the first virtual image 302, and the account name of the second social account is displayed around the second virtual image 303.

[0030] In step 202, when a social message sent from a target social account is received and the social message includes an audio message, an audio message playback control is displayed at a message presentation position corresponding to a target virtual image in a virtual social scene. The target virtual image is a virtual image corresponding to the target social account.

[0031] Optionally, social messages sent between social accounts may include text messages, image messages, video messages, hyperlinks, audio messages, and the like.

[0032] In some embodiments, there is a corresponding message presentation position for each virtual image. When a social message arrives at a social account, a reception notification of the social message is displayed at the message presentation position of the virtual image corresponding to the social message sending account, so that direct social interaction through the virtual image can be achieved.

[0033] In one implementable form, the current account receives a social message sent from a target social account among at least one social account. Since a target virtual image corresponding to this target social account is set and this social message includes an audio message, the terminal is configured to display an audio message playback control at a message presentation position corresponding to the target virtual image in a virtual social scene.

[0034] Optionally, the received social message may include only an audio message, may include only a non-audio message, or may include both an audio message and a non-audio message.

[0035] Optionally, the message presentation position may be above the target virtual image, may be to the left of the target virtual image, or may be any other position that can reflect the correspondence between the voice message playback control and the target virtual image. However, the embodiments of the present application do not limit this.

[0036] Optionally, the voice playback control can display the received voice duration, the number of voice messages, the playback button for the voice message, etc. When the voice duration is displayed, the length of the voice playback control can be adjusted according to the voice duration. When a voice message is received, since the voice message has reached the current account, in order to notify that a reply should be made early for this voice message, the voice playback control can be set to a vibration notification pattern.

[0037] Exemplarily, as shown in FIG. 4, in the virtual social scene 401 corresponding to the current account, the current account corresponds to the virtual image 402, and the target social account corresponds to the target virtual image 403. When a social message sent from the target social account is received and this social message contains a voice message, the terminal causes the voice message playback control 404 to be displayed at a position above the target virtual image 403.

[0038] In step 203, in response to the trigger operation of the voice message playback control, the voice message is played back in the virtual social scene without displaying the message processing interface corresponding to the target social account.

[0039] In order to simplify the steps of the voice message playback operation, in response to the trigger operation of the voice playback control in the virtual social scene, without jumping to the message processing interface corresponding to the target social account, the terminal directly plays back the voice message in the virtual social scene.

[0040] Here, the message processing interface includes voice messages and other non-voice messages sent from the received target social account. Also, through the message processing interface, the current account can send social messages to the target social account. This social message may include text messages, voice messages, image messages, video messages, and the like.

[0041] Exemplarily, as shown in FIG. 4, in response to a trigger operation of the voice message playback control 404, the terminal directly plays the voice message in the virtual social scene 401 without displaying the message processing interface.

[0042] According to the above, in the embodiments of the present application, a virtual image corresponding to at least one social account constructs a virtual social scene for performing social interactions. In that virtual social scene, when a social message including a voice message sent from the target social account is received, a voice message playback control is displayed at the message presentation position corresponding to the target virtual image to trigger the user, so that the voice message can be played in the virtual social scene without displaying the message processing interface corresponding to the target social account. According to the technical method according to the embodiments of the present application, in the virtual social scene, by making the voice message sent from the target social account be prominently displayed and providing a voice message playback control for triggering the user, the voice message in the virtual social scene can be quickly played. Therefore, the procedure of jumping to and then displaying the message processing interface corresponding to the target social account is eliminated, the playback operation procedure of the voice message is simplified, and it can be expected to improve the convenience of the playback operation of the voice message.

[0043] In addition to voice messages, the received social messages include non-voice messages such as text messages, image messages, and video messages. Therefore, when both voice messages and non-voice messages are received, in the message presentation position corresponding to the target virtual image in the virtual social scene, three different social message display methods are proposed in the embodiments of the present application. Hereinafter, the three social message display methods will be described respectively.

[0044] 1. Display a voice message playback control and a first message presentation control at the message presentation position corresponding to the target virtual image. Here, the number of unread social messages is displayed on the first message presentation control.

[0045] In one possible embodiment, when a social message sent from a target social account is received and the social message includes a voice message, the terminal is configured to display a voice message playback control and a first message presentation control at the message presentation position corresponding to the target virtual image in the virtual social scene.

[0046] In one possible embodiment, the number of unread voice messages is not displayed on the voice message playback control, or the number of unread voice messages is displayed on the voice message playback control. Here, since the unread social messages include various types of social messages, the number of unread social messages is greater than or equal to the number of unread voice messages.

[0047] Exemplarily, as shown in FIG. 5, when four social messages sent from the target social account are received and two voice messages are included in the social messages, in the virtual social scene 501 corresponding to the current account, the terminal causes the voice message playback control 503 and the first message presentation control 504 to be displayed at the message presentation position corresponding to the target virtual image 502 corresponding to the target social account. Here, the number of unread social messages is displayed as four in the first message presentation control 504.

[0048] In one feasible form, in response to a trigger operation of the voice message playback control, without displaying the message processing interface corresponding to the target social account, the terminal plays the voice message in the virtual social scene. When the playback of the current voice message ends, a decrement operation is performed on the number of unread social messages displayed in the first message presentation control.

[0049] Exemplarily, as shown in FIG. 5, in response to a trigger operation of the voice message playback control 503, without displaying the message processing interface corresponding to the target social account, the terminal starts playing the voice message in the virtual social scene 501. When the playback of the first voice message ends, the terminal performs a decrement operation on the number of unread social messages displayed in the first message presentation control 504, so that the number of unread social messages is displayed as three in the first message presentation control 504.

[0050] In one possible implementation, in order to enhance the simplicity of the screen display in the virtual social scene, when the playback of the current voice message ends and there is no next unread voice message, the terminal hides the voice message playback control. When all the received social messages are voice messages, the terminal hides the first message presentation control while hiding the voice message playback control.

[0051] Exemplarily, as shown in FIG. 5, when the playback of the last voice message ends, the terminal hides the voice message playback control 503 in the virtual social scene 501 and performs a decrement operation on the number of unread social message counts displayed in the first message presentation control 504, so that the number of unread non-voice message counts displayed in the first message presentation control 504 becomes 2.

[0052] In one possible implementation, in order to display the number of voice messages included in the unread social messages, the terminal causes the number of unread voice messages to be displayed in the voice message playback control and plays the voice message in response to a trigger operation on the voice message playback control. When the playback of the current voice message ends and there is a next voice message, the terminal is configured to perform a decrement operation on the number of unread voice messages displayed in the voice message playback control.

[0053] Exemplarily, as shown in FIG. 6, when four social messages sent from the target social account are received and two voice messages are included in the social messages, in the virtual social scene 601 corresponding to the current account, the terminal causes the voice message playback control 603 and the first message presentation control 604 to be displayed at the message presentation position corresponding to the target virtual image 602 corresponding to the target social account. Here, the number of unread voice messages is displayed as two in the voice message playback control 603, and the number of unread social messages is displayed as four in the first message presentation control 604. In response to a trigger operation on the voice message playback control 603, the terminal starts playing the voice message in the virtual social scene 601. When the playback of the first voice message ends, since there is also a second voice message, the terminal performs a decrement operation on the number of unread voice messages displayed in the voice message playback control 603, and at the same time performs a decrement operation on the number of unread social messages displayed in the first message presentation control 604, so that the number of unread voice messages is displayed as one in the voice message playback control 603, and the number of unread social messages is displayed as three in the first message presentation control 604. When the playback of the last voice message ends, the terminal hides the voice message playback control 603 and at the same time performs a decrement operation on the number of unread social messages displayed in the first message presentation control 604, so that the number of unread non-voice messages is displayed as two in the first message presentation control 604.

[0054] 2. Display the voice message playback control and the second message presentation control at the message presentation position corresponding to the target virtual image. Here, the number of unread voice messages is displayed in the voice message playback control, and the number of unread non-voice messages is displayed in the second message presentation control.

[0055] In one possible implementation, in order to intuitively allow the user to visually recognize the number of voice messages and non-voice messages in social messages, when a social message sent from a target social account is received and the social message contains a voice message, the terminal is configured to display a voice message playback control and a second message presentation control at a message presentation position corresponding to a target virtual image in a virtual social scene.

[0056] Exemplarily, as shown in FIG. 7, when four social messages sent from a target social account are received and the social messages contain two voice messages and two non-voice messages, in a virtual social scene 701 corresponding to the current account, the terminal is configured to display a voice message playback control 703 and a second message presentation control 704 at a message presentation position corresponding to a target virtual image 702 corresponding to the target social account. Here, the number of unread voice messages is displayed as two in the voice message playback control 703, and the number of unread non-voice messages is displayed as two in the second message presentation control 704.

[0057] In one possible implementation, in response to a trigger operation on the voice message playback control, without displaying a message processing interface corresponding to the target social account, the terminal plays back a voice message in a virtual social scene. When the playback of the current voice message ends and there is no next unread voice message, the terminal hides the voice message playback control.

[0058] Exemplarily, as shown in FIG. 7, in response to a trigger operation on the voice message playback control 703, without displaying a message processing interface corresponding to the target social account, the terminal plays a voice message in the virtual social scene 701. When the playback of the last voice message ends, the terminal hides the voice message playback control 703 within the virtual social scene 701 and only displays the second message presentation control 704.

[0059] In one possible implementation, when a social message sent from a target social account is received and the social message contains only a voice message, the terminal is configured to display only the voice message playback control at a message presentation position corresponding to the target virtual image.

[0060] Exemplarily, as shown in FIG. 8, when the received social message sent from the target social account contains only a voice message, the terminal is configured to display only the voice message playback control 803 at a message presentation position corresponding to the target virtual image 802 in the virtual social scene 801.

[0061] In one possible implementation, when a social message sent from a target social account is received and the social message contains only a non-voice message, the terminal is configured to display only the second voice message playback control at a message presentation position corresponding to the target virtual image.

[0062] Exemplarily, as shown in FIG. 9, when the received social message sent from the target social account contains only a non-voice message, the terminal is configured to directly display the second message presentation control 903 at a message presentation position corresponding to the target virtual image 902 in the virtual social scene 901.

[0063] Note that since the voice message playback control and the second message presentation control are each used to indicate the number of unread social messages of different types, during the process of triggering the voice message playback control to play a voice message, the number of unread voice messages displayed on the voice message playback control gradually decreases, and the number of unread non-voice messages displayed on the second message presentation control does not change.

[0064] FIG. 10 shows a schematic diagram of control display when different numbers of voice messages and non-voice messages are received according to an exemplary embodiment of the present application.

[0065] When one voice message is received, the terminal displays a voice message playback control in the virtual social scene, and the number of unread voice messages displayed on this voice message playback control is shown as 1. In response to the trigger operation of the voice message playback control, this voice message is played, and when the playback of this voice message ends, this voice message playback control is hidden.

[0066] When three voice messages are received, the terminal displays a voice message playback control in the virtual social scene, and the number of unread voice messages displayed on this voice message playback control is shown as 3. In response to the trigger operation of the voice message playback control, the voice message is played, and after one voice message is played, the terminal automatically plays the next voice message and performs a decrement operation on the number of unread voice messages displayed on the voice message playback control.

[0067] When multiple non-voice messages are received, the terminal displays a second message presentation control in the virtual social scene, and the number of unread non-voice messages is displayed on this second message presentation control.

[0068] When a plurality of non-audio messages and an audio message are received, the terminal simultaneously displays an audio message playback control and a second message presentation control in a virtual social scene. Here, the number of unread audio messages is displayed on the audio message playback control, and the number of unread non-audio messages is displayed on the second message presentation control. In response to a trigger operation on the audio message playback control, the terminal plays the audio message. After playing one audio message, the terminal automatically plays the next message and performs a decrement operation on the displayed number of unread audio messages. After all the audio messages have been played, the terminal hides the audio message playback control and keeps the second message presentation control displayed.

[0069] During the playback of an audio message, if one non-audio message is received, the terminal performs an increment operation on the number of unread non-audio messages displayed on the second message presentation control. Since the number of audio messages and the number of non-audio messages are displayed separately, the terminal performs a decrement operation or an increment operation on each of them.

[0070] 3. After displaying the audio message playback control at the message presentation position corresponding to the target virtual image, display the second message presentation control. Here, the duration of the first received audio message is displayed on the audio message playback control, and the number of unread non-audio messages is displayed on the second message presentation control.

[0071] In one possible implementation, in order to simplify the virtual social scene screen and reduce the number of controls displayed therein, when a social message including a voice message is received, the terminal first displays a voice message playback control. When the playback of the current voice message ends and there is no next voice message and the social message includes a non-voice message, the voice message playback control is updated to a second message presentation control, and the number of unread non-voice messages is displayed on the second message presentation control.

[0072] Exemplarily, as shown in FIG. 11, when a plurality of social messages are received and the social messages include a plurality of voice messages and two non-voice messages, the terminal displays a voice message playback control 1103 at the corresponding message presentation position of the target virtual image 1102 in the virtual social scene 1101, and the duration of the first voice message reaching the voice message playback control 1103 is displayed (optionally, only the number of unread voice messages may be displayed without displaying the duration of the voice, or both the number of unread voice messages and the duration of the voice may be displayed simultaneously). In response to a trigger operation on the voice message playback control 1103, the terminal plays the received voice message. When the playback of all voice messages ends, the voice message playback control 1103 is updated to a second message presentation control 1104, and the number of unread non-voice messages is displayed as two on the second message presentation control 1104.

[0073] FIG. 12 shows a schematic diagram of the implementation of control switching when different numbers of voice messages and non-voice messages are received according to an exemplary embodiment of the present application.

[0074] When one voice message is received, the terminal displays a voice message playback control in the virtual social scene, displays the voice duration of the unread voice message on this voice message playback control, plays the voice message in response to a trigger operation on the voice message playback control, and when the playback of the voice message ends, the voice message playback control is hidden.

[0075] When multiple voice messages are received, the terminal displays a voice message playback control in the virtual social scene, displays the voice duration of the first voice message on the voice message playback control, and plays the voice message in response to a trigger operation on the voice message playback control. After playing the first voice message, the terminal automatically plays the next voice message and displays the voice duration of the currently playing voice message on the voice message playback control.

[0076] When multiple non-voice messages are received, the terminal displays a second message presentation control in the virtual social scene, and the number of unread non-voice messages is displayed on the second message presentation control.

[0077] When multiple non-voice messages and voice messages are received, the terminal first displays a voice message playback control in the virtual social scene and displays the voice duration of the first voice message on the voice message playback control. In response to a trigger operation on the voice message playback control, the terminal plays the voice message. After playing the first voice message, the terminal automatically plays the next message and displays the voice duration of the currently playing voice message on the voice message playback control. When the playback of all voice messages ends, the terminal updates the voice message playback control to a second message presentation control.

[0078] During the playback of a voice message, if a new voice message is received, the terminal maintains the appearance of the current voice message playback control unchanged and continues to play the new voice message after all the previous voice messages have been played. If the playback of all voice messages is completed, the terminal updates the voice message playback control to a second message presentation control.

[0079] During the playback of a voice message, if a new non-voice message is received, the terminal maintains the appearance of the current voice message playback control unchanged. If the playback of all voice messages is completed, the terminal updates the voice message playback control to a second message presentation control and causes the second message presentation control to display the number of all unread non-voice messages received after the new non-voice message was received.

[0080] In the above-described embodiment, by providing a voice message playback control and a first message presentation control, or a second message presentation control, at the corresponding message presentation position of the target virtual image, the number of unread voice messages and the number of unread non-voice messages included in the unread social messages can be more clearly displayed. Also, by updating the voice message playback control to the second message presentation control, the control in the virtual social scene can be more concisely displayed, and the problem of accidental touches caused by the simultaneous display of a large number of controls in the virtual social scene can be avoided.

[0081] Since the received social message may include a plurality of voice messages, in order to embody the logic between each voice message, in response to the trigger operation of the voice message playback control, the terminal can sequentially play the received voice messages according to the reception date and time order of each voice message.

[0082] As an option, when the terminal receives a single trigger operation for the voice message playback control, it can play all unread voice messages in sequence. Alternatively, the single trigger operation for the voice message playback control may be used to trigger the playback of one unread voice message. Accordingly, the user can make the terminal play multiple unread voice messages by triggering the voice message playback control multiple times.

[0083] In one possible embodiment, when there are at least two voice messages, the terminal obtains the reception time of each received voice message, and in the virtual social scene, according to the reception date and time order of at least two voice messages, based on the interval between the reception time of the voice message and the current time, plays the voice messages in descending order.

[0084] To further improve the convenience of obtaining social messages, when the received social message includes a text message among voice messages and non-voice messages, the terminal can convert the text message into a voice message by voice synthesis technology, so that it is easy for the user to directly receive the text message in the virtual social scene. The steps of the method will be described in detail below.

[0085] 1. When there are at least two voice messages and there is a text message between at least two voice messages, convert the text message into a voice synthesis message.

[0086] In one possible embodiment, when at least two voice messages are included in the received social message and a text message exists between at least two voice messages, if the terminal plays the voice messages alone, it may not be able to maintain consistency between the two voice messages. Therefore, in order to check the text message between the two voice messages, the user needs to switch to the message processing interface.

[0087] In an embodiment of the present application, in order to receive social messages more conveniently in a virtual social scene, when a text message exists between at least two voice messages (that is, the sending time of the text message is between the sending times of at least two voice messages), the terminal converts the text message into a voice synthesis message.

[0088] In some embodiments, when the text message does not exist between the voice messages, for example, when the text message arrives earlier than all the voice messages or the text message arrives later than all the voice messages, the terminal does not perform voice conversion on the voice message.

[0089] In one possible embodiment, the terminal may locally convert the text message into voice by Text To Speech (TTS) technology to obtain a voice synthesis message, or the terminal may convert the text message into voice on the server and send the converted voice synthesis message to the terminal. However, this embodiment does not limit this.

[0090] Furthermore, in one possible implementation, to enhance the authenticity of the converted voice synthesis message, the terminal or the server trains a model used for text-to-speech conversion based on the voice message sent from the target social account, and generates a voice synthesis message by using the trained text-to-speech conversion model, so that the generated voice synthesis message can be made to match the pronunciation of the user corresponding to the target social account.

[0091] In the above-described embodiments, the purpose of converting the text message into voice was to enhance the consistency of the context during voice playback. However, it has been found that in actual applications, there may be no contextual relationship between continuously transmitted voice messages and text messages. Therefore, to convert a text message without a contextual relationship into a voice synthesis message and avoid wasting processing resources, in one possible implementation, the terminal determines the message relevance between the text message and at least two voice messages. When the message relevance is greater than the relevance threshold, the terminal converts the text message into a voice synthesis message. On the other hand, when the message relevance is less than the relevance threshold, the terminal plays the voice messages in sequence in a virtual social scene.

[0092] Optionally, the message relevance between the text message and at least two voice messages may be determined for each message reception time by the terminal, may be determined for each content relevance between the messages, or may be determined for both the message reception time and the content of the message. However, the embodiments of the present application do not limit this.

[0093] In one possible implementation, the terminal determines the message relevance and the relevance threshold for each message reception time. First, based on the reception times of a text message and at least two voice messages, the terminal determines the reception time interval between the text message and each voice message. Next, based on the reception time interval, the terminal determines the message relevance between the text message and each voice message. Here, the message relevance and the reception time interval show a negative correlation.

[0094] In an exemplary example, the terminal determines the relevance threshold such that the two message reception times are separated by one minute. When two voice messages are received and one text message is included between the two voice messages, the terminal determines the reception time interval between the text message and the two voice messages. If both reception time intervals are less than one minute, the terminal converts the text message into a voice synthesis message. On the other hand, if one of the reception time intervals is one minute or more, the terminal does not convert the text message.

[0095] In one possible implementation, the terminal determines the message relevance and the relevance threshold for each content of each message. First, the terminal determines to perform text conversion on at least two voice messages to obtain text conversion messages. Next, the terminal determines the content correlation between the text message and the text conversion message, and determines the message relevance based on the content correlation. Here, the message relevance and the content correlation show a positive correlation.

[0096] Optionally, the terminal can determine the message relevance based on the relevance between keywords by extracting keywords from the text. Also, an enhanced sequence inference model (ESIM) or other natural language processing (Natural Sequential Inference Model, ESIM) or other natural language processing (Natural It is also possible to determine the message relevance between text messages using a (language processing, NLP) model, but this embodiment is not limited thereto.

[0097] Of course, in other possible embodiments, the server may execute the above steps of converting voice to text and determining the content correlation between texts, or the terminal and the server may cooperate to execute them, but this embodiment is not limited thereto.

[0098] In one example, the terminal determines the relevance threshold such that the content relevance between messages reaches 80%. When two voice messages are received and one text message is included between the two voice messages, the terminal converts the two voice messages to text to obtain text-converted messages, and determines the content relevance between the text message and its text-converted message. If the content relevance is greater than 80%, the terminal converts the text message to a voice synthesis message. On the other hand, if the content relevance of one of them is less than 80%, the terminal does not convert the text message.

[0099] 2. Sequentially play the voice messages and voice synthesis messages in the virtual social scene according to the reception date and time order of at least two voice messages and the text message.

[0100] Furthermore, according to the reception date and time order of at least two voice messages and the text message, the terminal plays the voice messages and voice synthesis messages in descending order based on the interval from the reception time of the voice message to the current time in the virtual social scene.

[0101] In one possible implementation, when the playback of the voice synthesis message ends, instead of updating the number of unread voice messages displayed in the voice message playback control, the terminal updates the number of unread social messages displayed in the first message presentation control or updates the number of unread non-voice messages displayed in the second message presentation control.

[0102] In the above-described embodiment, when at least two voice messages are received and there is a text message between at least two voice messages, the terminal can appropriately perform voice synthesis conversion on the text message based on the message relevance between the text message and at least two voice messages. Therefore, the voice synthesis message obtained in the virtual social scene can be directly played back, that is, while enhancing the context consistency of the voice played back in the virtual social scene, the operation of checking messages can be simplified, so that the convenience when checking messages can be improved.

[0103] To facilitate the user to check and process non-voice messages, the terminal can set a message processing interface in the virtual social scene. Through this message processing interface, the user can directly check and process the received non-voice messages. The steps of the method will be described in detail below.

[0104] 1. When a message processing operation is received and there is a target voice message being played, obtain the playback progress status of the target voice message.

[0105] In one possible implementation, to ensure the smoothness of voice message playback during message processing, when a message processing operation is received and there is a target voice message being played, the terminal obtains the playback progress status of the target voice message.

[0106] Optionally, the message processing operation may be a trigger operation on the first message presentation control and the second message presentation control in the above-described embodiment, or may be a trigger operation on the target virtual image, but the embodiments of the present application do not limit this.

[0107] Exemplarily, as shown in FIG. 13, at the corresponding message presentation position of the target virtual image 1301, there are an audio message playback control 1302 and a first message presentation control 1303. Here, the audio message playback control 1302 is in a state of playing an audio message and displays the playback progress status of the currently playing target audio message. In response to the trigger operation of the first message presentation control 1303, the terminal acquires the playback progress status of the target audio message.

[0108] 2. Display the message processing interface corresponding to the target social account, and continue to play the target audio message in the message processing interface based on the playback progress status.

[0109] Furthermore, the terminal can ensure the continuity of the audio message playback during the display of the message processing interface by displaying the message processing interface corresponding to the target social account and continuing to play the target audio message in the message processing interface based on the acquired playback progress status.

[0110] Exemplarily, as shown in FIG. 13, in response to the trigger operation of the first message presentation control 1303, the terminal displays the message processing interface 1304 corresponding to the target social account and continues to play the target audio message in the message processing interface 1304 based on the playback progress status.

[0111] 3. In response to the end operation of the message processing interface, hide the audio message playback control.

[0112] In one possible embodiment, when displaying the message processing interface, all unread social messages appear. Therefore, after displaying all the social messages received in the message processing interface, in response to the end operation of the message processing interface, the terminal hides its voice message playback control and the first message presentation control.

[0113] Exemplarily, as shown in FIG. 13, in response to the end operation of the message processing interface 1304, the terminal hides its voice message playback control 1302 and the first message presentation control 1303, and only displays the target virtual image 1301.

[0114] In the above-described embodiment, the terminal provides a message processing interface in the virtual social scene. When the user checks and processes social messages through this message processing interface, if there is a target voice message being played, the terminal can obtain the playback progress status of the target voice message and can smoothly play the target voice message during the display of the message processing interface, thus ensuring the smooth playback of the voice message.

[0115] To facilitate the user to continue directly receiving the voice message from the previously interrupted voice playback after interrupting the playback of the voice message, the terminal provides a pause and play button on the voice message playback control. By triggering the pause or play button, even if the playback of the voice message is interrupted, the voice message can continue to be played continuously. The steps of the method will be described below.

[0116] 1. In response to the trigger operation of the voice message playback control, display a pause button on the voice message playback control.

[0117] In one possible embodiment, in response to a trigger operation for voice message playback control, the terminal plays the voice message and causes the voice message playback control to display a pause button for pausing the currently playing voice message.

[0118] Exemplarily, as shown in FIG. 14, at the corresponding message presentation position of the target virtual image 1401, there are a voice message playback control 1402 and a first message presentation control 1403. In response to a trigger operation on the voice message playback control 1402, the terminal plays the voice message and causes the voice message playback control 1402 to display a pause button.

[0119] 2. In response to a trigger operation on the pause button, update the pause button to a play button and stop the playback of the current voice message.

[0120] In one possible embodiment, during the playback of a voice message, it is necessary to interrupt the currently playing voice message. In response to a trigger operation on the pause button, the terminal updates the pause button to a play button, stops the playback of the current voice message, and at the same time records the playback progress status of the current voice message.

[0121] Exemplarily, as shown in FIG. 14, in response to a trigger operation on the pause button in the voice message playback control 1402, the terminal updates the pause button to a play button and stops the playback of the current voice message.

[0122] 3. In response to a trigger operation on the play button, update the play button to a pause button and continue playing the voice message based on the recorded playback progress status. The playback progress status is recorded when a trigger operation on the pause button is received.

[0123] Furthermore, to resume the playback of the paused voice message, in response to a trigger operation on the playback button, the terminal continues to play the voice message based on the recorded playback progress status and updates the playback button in the voice message playback control to a pause button.

[0124] Exemplarily, as shown in FIG. 14, in response to a trigger operation on the playback button in the voice message playback control 1402, the terminal continues to play the voice message based on the recorded playback progress status and updates the playback button in the voice message playback control 1402 to a pause button.

[0125] In the above-described embodiments, by providing a playback button and a pause button in the voice message playback control, the terminal can play and pause the voice message according to trigger operations on different buttons by the user and record the playback progress status, thereby ensuring the continuity of voice message playback.

[0126] In some embodiments, when the duration of the voice message is greater than a time threshold (e.g., 30 s), the terminal can also display a progress status adjustment control in the voice message playback control. The user can adjust the playback progress status of the voice message through this progress status adjustment control. Here, the progress status adjustment control may be an audio progress bar.

[0127] In some other embodiments, the terminal can also display a playback speed adjustment control in the voice message playback control. The user can adjust the playback speed of the voice message through this playback speed adjustment control. For example, the playback speed adjustment control may be a variable speed playback control (0.5 times, 1.5 times, etc.).

[0128] In some other embodiments, when receiving a long - press operation on the voice message playback control, the terminal can accelerate the playback of the voice message at a preset playback speed, so as to improve the viewing efficiency of the voice message. For example, when receiving a long - press operation on the voice message playback control, the terminal plays the voice message at 3 times the speed.

[0129] In order to simplify the social interaction between virtual images in the virtual social scene, the terminal can set the display conditions of the voice message playback control, so that only the voice messages sent from some accounts can be presented controllably.

[0130] In one possible embodiment, the terminal determines whether there is a social relationship between social accounts. When a target social relationship is established between the target social account and the current account, the terminal causes the voice message playback control to be displayed at the corresponding message presentation position of the target virtual object in the virtual social scene.

[0131] Optionally, the target social relationship may be either that there is a mutual following relationship between the accounts or that there is a one - way following relationship between the accounts, but the embodiments of the present application do not limit this.

[0132] By having a target social relationship between accounts and restricting the number of virtual images displayed in the virtual social scene, the social interaction between virtual images in the virtual social scene can be simplified and the effectiveness of social work can be improved.

[0133] Referring to the above - described embodiments, FIG. 15 shows a flowchart of a method for playing a voice message according to another exemplary embodiment of the present application. The method includes the following steps.

[0134] In step 1501, receive a social message including an audio message. The terminal receives a social message sent from a target social account. This social message includes an audio message and a non-audio message.

[0135] In step 1502, display the number of unread social messages and the audio message playback control. The terminal displays the audio message playback control and the first message presentation control at the corresponding message presentation position of the target virtual image corresponding to the target social account. Here, the number of unread social messages is displayed on the first message presentation control.

[0136] In step 1503, respond to the trigger operation of the first message presentation control.

[0137] Respond to the trigger operation of the first message presentation control by the user.

[0138] In step 1504, hide the audio message playback control and the first message presentation control.

[0139] The terminal hides the audio message playback control and the first message presentation control in the virtual social scene.

[0140] In step 1505, display the message processing interface.

[0141] The terminal displays the message processing interface in the virtual social scene. The user processes all received social messages through the message processing interface.

[0142] In step 1506, determine whether there is a target audio message being played.

[0143] The terminal determines whether there is a target voice message being played. If there is no target voice message, it proceeds to step 1507. On the other hand, if there is a target voice message, it proceeds to step 1508.

[0144] In step 1507, it ends.

[0145] In step 1508, it continues to play the target voice message.

[0146] By continuously playing the target voice message in the message processing interface, the terminal can ensure the continuity of voice message playback.

[0147] In step 1509, it responds to the trigger operation of the voice message playback control.

[0148] The terminal responds to the trigger operation of the voice message playback control by the user.

[0149] In step 1510, it plays the first unread voice message.

[0150] In step 1511, after the playback of one voice message ends, it performs an operation to subtract one from the number of unread voice messages.

[0151] After the playback of one voice message ends, the terminal performs an operation to subtract one from the number of unread voice messages displayed in the voice message playback control, and at the same time, performs a decrement operation on the number of unread voice messages displayed in the first message presentation control.

[0152] In step 1512, it determines whether there is a next voice message.

[0153] The terminal determines whether the following voice message exists. If it exists, it proceeds to step 1516. On the other hand, if it does not exist, it proceeds to step 1513.

[0154] In step 1513, it is determined whether there is an unread non-voice message. The terminal determines whether there is an unread non-voice message. If it exists, it proceeds to step 1515. On the other hand, if it does not exist, it proceeds to step 1514.

[0155] In step 1514, this voice message playback control and the first message presentation control are made invisible.

[0156] If there is no unread non-voice message, after the playback of all voice messages is completed, the terminal makes this voice message playback control and the first message presentation control invisible.

[0157] In step 1515, this voice message playback control is made invisible.

[0158] If there is an unread non-voice message, after the playback of all voice messages is completed, the terminal makes this voice message playback control invisible.

[0159] In step 1516, the following voice message is played back.

[0160] If the following voice message exists, the terminal returns to step 1511, continues to play back the following voice message, and performs a decrement operation on the number of unread voice messages displayed in the voice message playback control.

[0161] Referring to FIG. 16, an interaction sequence diagram between the user layer, the presentation layer, and the background logic layer according to an exemplary embodiment of the present application is shown. This interaction process can include the following steps.

[0162] In step 1601, the terminal receives new voice messages and non-voice messages from the background.

[0163] When the target social account sends a social message to the current account, the terminal receives a new social message including voice messages and non-voice messages from the background.

[0164] In step 1602, the terminal displays a voice message playback control and a first message presentation control to the user.

[0165] Based on the received unread social messages, the terminal displays a voice message playback control and a first message presentation control. Here, the number of unread social messages is displayed on the first message presentation control.

[0166] In step 1603, the user taps the first message presentation control.

[0167] When the user taps the first message presentation control, the terminal responds to this tap operation.

[0168] In step 1604, the terminal hides the voice message playback control and the first message presentation control.

[0169] In response to the trigger operation of the first message presentation control, the terminal hides the voice message playback control and the first message presentation control.

[0170] In step 1605, the terminal displays a message processing interface.

[0171] The terminal displays a message processing interface and waits for the user to process social messages through the message processing interface.

[0172] In step 1606, the terminal determines whether it is playing a voice message.

[0173] The terminal determines whether there is a voice message being played. If so, it proceeds to step 1607.

[0174] In step 1607, if there is a target voice message being played, the playback progress status of the target voice message is saved in the background.

[0175] If there is a target voice message being played, to ensure the continuity of the voice message playback, the playback progress status of the target voice message is saved in the background.

[0176] In step 1608, the terminal obtains the playback progress status of the target voice message.

[0177] Furthermore, the terminal obtains the playback progress status of the target voice message from the background.

[0178] In step 1609, the terminal continues to play the target voice message in the message processing interface.

[0179] Thereby, the terminal continues to play the target voice message in the message processing interface.

[0180] In step 1610, the user taps the voice message playback control.

[0181] When the user taps the voice message playback control, the terminal responds to this tap operation.

[0182] In step 1611, the terminal requests the first voice message data among the unread voice messages from the background.

[0183] To play the voice message, the terminal requests the first voice message data among the unread voice messages in the background.

[0184] In step 1612, the background returns the corresponding voice message data to the terminal.

[0185] In step 1613, the terminal plays the voice message.

[0186] Based on the obtained voice message data, the terminal plays the voice message.

[0187] In step 1614, the terminal ends the playback of the voice message.

[0188] In step 1615, the terminal performs an operation to subtract one from the number of unread social messages.

[0189] When the playback of this voice message ends, the terminal performs a decrement operation on the number of unread social messages displayed in the first message presentation control.

[0190] In step 1616, the terminal determines whether it is the last voice message.

[0191] The terminal determines whether the currently playing voice message is the last voice message. If not, it proceeds to step 1617, while if it is the last, it proceeds to step 1618.

[0192] In step 1617, if it is not the last, the terminal requests the next voice message data in the background.

[0193] If the currently playing voice message is not the last voice message, the terminal continues to request the next voice message data in the background and returns to step 1611.

[0194] In step 1618, if it is the last one, the terminal hides this voice message playback control.

[0195] If the currently playing voice message is the last voice message, the terminal hides this voice message playback control.

[0196] In step 1619, the terminal determines whether the number of unread social messages is 0.

[0197] The terminal determines whether the number of unread social messages is 0. If the number of unread social messages is 0, it proceeds to step 1620; otherwise, it proceeds to step 1621.

[0198] In step 1620, if the number of unread social messages is 0, the terminal hides the first message presentation control.

[0199] In step 1621, if the number of unread social messages is not 0, the terminal displays the number of unread social messages.

[0200] If the number of unread social messages is not 0, the terminal causes the number of unread social messages to be displayed on the first message presentation control.

[0201] It should be noted that all the information (including but not limited to user device information, user personal information, etc.), data (including but not limited to analysis data, stored data, displayed data, etc.) and signals mentioned in this application are obtained with the permission of the user or sufficient permission from each party, and the collection, use and handling of relevant data must comply with the relevant laws, regulations and standards of the relevant countries and regions. For example, the voice messages, non-voice messages, etc. of the social accounts mentioned in this application are obtained after obtaining sufficient permission.

[0202] Referring to FIG. 17, a block diagram of a playback device for voice messages according to an exemplary embodiment of the present application is shown. This device has the following structure: A step of displaying a virtual image corresponding to at least one social account in a virtual social scene, wherein the virtual social scene is a virtual scene for the virtual image to perform social interaction, and a display module 1701 configured to execute this step; When a social message sent from a target social account is received and the social message includes a voice message, a step of displaying a voice message playback control at a message presentation position corresponding to a target virtual image in the virtual social scene, wherein the target virtual image is a virtual image corresponding to the target social account, and the display module 1701 further configured to execute this step; A voice playback module 1702 configured to execute a step of playing the voice message in the virtual social scene without displaying a message processing interface corresponding to the target social account in response to a trigger operation of the voice message playback control, and can include this.

[0203] Optionally, the voice playback module 1702 When there are at least two of the voice messages, it is configured to execute a step of sequentially playing the voice messages in the virtual social scene according to the reception date and time order of the at least two voice messages.

[0204] Optionally, the voice playback module 1702 When there are at least two of the voice messages and there is a text message between the at least two voice messages, a voice synthesis unit configured to execute a step of converting the text message into a voice synthesis message; A voice playback unit configured to execute a step of sequentially playing back the voice message and the voice synthesis message in the virtual social scene according to the reception dates and times of at least two of the voice messages and the text message, is included.

[0205] Optionally, the voice synthesis unit executes a step of determining a message relevance degree between the text message and at least two of the voice messages, and is configured to execute a step of converting the text message into a voice synthesis message when the message relevance degree is greater than a relevance threshold value. When the message relevance degree is less than the relevance threshold value, the voice playback module 1702 is further configured to execute a step of sequentially playing back the voice messages in the virtual social scene.

[0206] Optionally, the voice synthesis unit determines a reception time interval based on the reception times of the text message and at least two of the voice messages, and determines the message relevance degree indicating a negative correlation with the reception time interval based on the reception time interval. At least two of the voice messages are text-converted to obtain a text-converted message, a content correlation between the text message and the text-converted message is determined, and the message relevance degree is determined based on the content correlation indicating a positive correlation with the message relevance degree.

[0207] Optionally, when the number of unread voice messages is displayed in the voice message playback control, the device further includes a quantity recording module configured to execute a step of performing a decrement operation on the number of unread voice messages displayed in the voice message playback control when the playback of the current voice message ends and there is a next voice message.

[0208] Optionally, a first message presentation control is further displayed at the message presentation position, the number of unread social messages is displayed on the first message presentation control, and when the number of unread social messages is greater than or equal to the number of unread voice messages, when the playback of the current voice message ends, the quantity recording module is further configured to perform a decrement operation on the number of unread social messages displayed on the first message presentation control.

[0209] Optionally, a first message presentation control or a second message presentation control is further displayed at the message presentation position, the number of unread social messages is displayed on the first message presentation control, and the number of unread non-voice messages is displayed on the second message presentation control. The apparatus further includes a control hiding module configured to hide the voice message playback control when the playback of the current voice message ends and there is no next voice message.

[0210] Optionally, the apparatus further includes a control updating module configured to update the voice message playback control to the second message presentation control when the playback of the current voice message ends, there is no next voice message, and the social message includes a non-voice message, and the number of unread non-voice messages is displayed on the second message presentation control.

[0211] Optionally, the apparatus further includes When a message processing operation is received and there is a target voice message being played, it is configured to execute a step of obtaining the playback progress status of the target voice message. A progress status obtaining module It includes an interface display module configured to display the message processing interface corresponding to the target social account and, based on the playback progress status, execute a step of continuously playing the target voice message in the message processing interface.

[0212] Optionally, the control hiding module is further configured to execute a step of hiding the voice message playback control in response to an end operation of the message processing interface.

[0213] Optionally, the device further It includes a button display module configured to execute a step of displaying a pause button on the voice message playback control in response to a trigger operation of the voice message playback control. It includes a button update module configured to execute a step of updating the pause button to a play button and stopping the playback of the current voice message in response to a trigger operation of the pause button. The voice playback module 1702 is further configured to execute a step of updating the play button to the pause button in response to a trigger operation of the play button and continuously playing the voice message based on the recorded playback progress status, where the playback progress status is recorded when a trigger operation of the pause button is received.

[0214] Optionally, the display module 1701 further When a target social relationship is constructed between the target social account and the current account, it is configured to execute a step of displaying the voice message playback control at a message presentation position corresponding to the target virtual image in the virtual social scene.

[0215] It should be noted that the device according to the above-described embodiment is described by taking only the classification of each of the above-described functional modules as an example. In actual applications, if necessary, in order to complete all or part of the above-described functions, the above-described functions can be assigned to be completed by different functional modules, that is, in order to complete all or part of the above-described functions, the internal structure of the device can be divided into different functional modules. In addition, the embodiments of the device and method according to the above-described embodiment belong to the same concept, and the implementation process thereof may be referred to the embodiment of the method in detail, so no further description will be given here.

[0216] Referring to FIG. 18, a schematic configuration diagram of a terminal according to an embodiment example of the present application is shown. This terminal may be the server or terminal in the above-described embodiment. Specifically, the terminal 1800 includes a central processing unit (CPU) 1801, a system memory 1804 including a random access memory 1802 and a read-only memory 1803, and a system bus 1805 connecting the system memory 1804 and the central processing unit 1801. The terminal 1800 also includes a basic input / output system (Input / Output, I / O system) 1806 that assists in information transmission between each device in the computer, and a mass storage device 1807 that stores an operating system 1813, an application program 1814, and other program modules. Processing Unit, CPU) 1801, a system memory 1804 including a random access memory 1802 and a read-only memory 1803, and a system bus 1805 connecting the system memory 1804 and the central processing unit 1801. The terminal 1800 also includes a basic input / output system (Input / Output, I / O system) 1806 that assists in information transmission between each device in the computer, and a mass storage device 1807 that stores an operating system 1813, an application program 1814, and other program modules.

[0217] The basic input / output system 1806 includes a display 1808 for displaying information and input devices 1809 such as a mouse and a keyboard for the user to input information. Here, both the display 1808 and the input device 1809 are connected to the central processing unit 1801 via an input / output controller 1810 connected to the system bus 1805. The basic input / output system 1806 can further include an input / output controller 1810 for receiving and processing inputs from a plurality of other devices such as a keyboard, a mouse, or an electronic touch pen. Similarly, the input / output controller 1810 also provides a display, a printer, or other types of output devices.

[0218] The mass storage device 1807 is connected to the central processing unit 1801 via a mass storage controller (not shown) connected to the system bus 1805. The mass storage device 1807 and the associated computer-readable medium provide non-volatile memory for the terminal 1800. That is, the mass storage device 1807 can include a computer-readable medium (not shown) such as a hard disk or a drive.

[0219] Without loss of generality, the computer-readable medium can include computer storage media and communication media. Computer storage media includes volatile and non-volatile, removable and non-removable media implemented by any method or technology for storing information such as computer-readable instructions, data structures, program modules, or other data. Computer storage media includes random access memory (Random Access Memory, RAM), read only memory (Read Only Memory, ROM), flash memory or other solid state storage technologies, compact disc read only memory (Compact Disc Read-Only Memory, CD-ROM), digital versatile disc (Digital It includes Versatile Disc, DVD or other optical storage devices, magnetic cassettes, magnetic tapes, magnetic disk storage or other magnetic storage devices. Of course, as those skilled in the art can recognize, the computer storage medium is not limited to several of the above. The system memory 1804 and the mass storage device 1807 described above can be called memory.

[0220] One or more programs are stored in the memory, and the one or more programs are configured to be executed by one or more central processing units 1801, and the one or more programs include instructions for implementing the methods described above. By executing one or more programs, the central processing unit 1801 implements the methods according to the embodiments of each of the above methods.

[0221] According to various embodiments of the present application, the terminal 1800 may operate via a remote computer connected to the network via a network such as the Internet. That is, the terminal 1800 can be connected to the network 1812 via a network interface unit 1811 connected to the system bus 1805, or can be connected to another type of network or a remote computer system (not shown) using the network interface unit 1811.

[0222] Embodiments of the present application further provide a computer-readable storage medium. At least one instruction that is loaded and executed by a processor to implement the method for playing an audio message according to the above-described embodiment is stored in this readable storage medium.

[0223] Embodiments of the present application provide a computer program product or a computer program including computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions to cause the computer device to execute the method for playing an audio message according to the above-described embodiments.

[0224] The above are only selectable examples of the present application and do not limit the present application. Any modifications, substitutions, improvements, etc. made without departing from the spirit and principles of the present application should all be included in the protection scope of the present application.

Claims

1. A method for playing an audio message executed by a terminal, comprising: displaying a virtual image corresponding to at least one social account in a virtual social scene, wherein the virtual social scene is a virtual scene for the virtual image to perform social interaction; when a social message sent from a target social account is received and the social message includes an audio message, displaying an audio message playback control at a message presentation position corresponding to a target virtual image in the virtual social scene, wherein the target virtual image is a virtual image corresponding to the target social account; responding to a trigger operation of the audio message playback control, playing the audio message in the virtual social scene without displaying a message processing interface corresponding to the target social account.

2. The step of playing the audio message in the virtual social scene in claim 1 includes: when there are at least two audio messages, sequentially playing the audio messages in the virtual social scene according to the reception date and time order of the at least two audio messages.

3. The step of sequentially playing the audio messages in the virtual social scene according to the reception date and time order of the at least two audio messages in claim 2 includes: when there are at least two audio messages and there is a text message between the at least two audio messages, converting the text message into an audio synthesized message; sequentially playing the audio messages and the audio synthesized messages in the virtual social scene according to the reception date and time order of the at least two audio messages and the text message.

4. The step of converting the text message into an audio synthesized message in claim 3 includes: Determining a message relevance degree between the text message and at least two of the voice messages; When the message relevance degree is greater than a relevance threshold, converting the text message into a voice synthesized message; The method for playing the voice message further includes: When the message relevance degree is less than the relevance threshold, sequentially playing the voice messages in the virtual social scene. The method for playing a voice message according to claim 3.

5. The step of determining the message relevance degree between the text message and at least two of the voice messages includes determining a reception time interval based on the reception times of the text message and at least two of the voice messages, and determining the message relevance degree that shows a negative correlation with the reception time interval based on the reception time interval; At least two of the voice messages are text-converted to obtain a text-converted message, determining a content correlation between the text message and the text-converted message, and determining the message relevance degree that shows a positive correlation with the content correlation based on the content correlation. The method for playing a voice message according to claim 4 includes at least one of the above methods.

6. When the number of unread voice messages is displayed on the voice message playback control; The method for playing the voice message further includes: When the playback of the current voice message ends and there is a next voice message, performing a decrement operation on the number of unread voice messages displayed on the voice message playback control. The method for playing a voice message according to claim 1.

7. A first message presentation control is further displayed at the message presentation position, the number of unread social messages is displayed on the first message presentation control, and when the number of unread social messages is greater than or equal to the number of unread voice messages; The method for playing the voice message further includes: When the playback of the current voice message ends, performing a decrement operation on the number of unread social messages displayed on the first message presentation control. The method for playing a voice message according to claim 6.

8. When a first message presentation control or a second message presentation control is further displayed at the message presentation position, an unread social message count is displayed on the first message presentation control, and an unread non-audio message count is displayed on the second message presentation control, The method for playing the voice message further includes The method for playing a voice message according to claim 1, further comprising the step of hiding the voice message playback control when the playback of the current voice message ends and there is no next voice message.

9. The method for playing a voice message according to claim 1, further comprising the step of updating the voice message playback control to a second message presentation control when the playback of the current voice message ends, there is no next voice message, and the social message includes a non-audio message, and an unread non-audio message count is displayed on the second message presentation control.

10. When a message processing operation is received and there is a target voice message being played, obtaining the playback progress of the target voice message; The method for playing a voice message according to claim 1, further comprising the step of displaying the message processing interface corresponding to the target social account and continuing to play the target voice message on the message processing interface based on the playback progress.

11. The method for playing a voice message according to claim 10, further comprising the step of hiding the voice message playback control in response to an end operation of the message processing interface.

12. In response to a trigger operation of the voice message playback control, displaying a pause button on the voice message playback control; In response to a trigger operation of the pause button, updating the pause button to a play button and stopping the playback of the current voice message. In response to a trigger operation on the playback button, updating the playback button to the pause button and continuing to play the voice message based on the recorded playback progress status, where the playback progress status is recorded when a trigger operation on the pause button is received, and further including the step of: a method for playing a voice message according to claim 1.

13. The step of displaying a voice message playback control at a message presentation position corresponding to a target virtual image in the virtual social scene, When a target social relationship is established between the target social account and the current account, the method for playing a voice message according to claim 1 includes the step of displaying the voice message playback control at a message presentation position corresponding to the target virtual image in the virtual social scene.

14. A step of displaying virtual images corresponding to at least one social account in a virtual social scene, where the virtual social scene is configured to execute a step where the virtual image is a virtual scene for performing social interactions, and a display module, When a social message sent from a target social account is received and the social message includes a voice message, the display module is further configured to execute a step of displaying a voice message playback control at a message presentation position corresponding to a target virtual image in the virtual social scene, where the target virtual image is a virtual image corresponding to the target social account. A voice message playback apparatus including: a voice playback module configured to execute a step of playing the voice message in the virtual social scene without displaying a message processing interface corresponding to the target social account in response to a trigger operation on the voice message playback control.

15. A terminal including a processor and a memory, where the memory stores at least one instruction to be executed by the processor to implement the method for playing a voice message according to any one of claims 1 to 13.

16. A computer program including computer instructions stored in a computer-readable storage medium, wherein a processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions to cause the computer device to execute the method for playing an audio message according to any one of claims 1 to 13.

Images