Interactive control method, device and electronic equipment for playing audio

Abstract

The application provides an interactive control method, device and electronic equipment for playing audio, wherein the method comprises: in response to a movement control operation, controlling a controlled virtual object to move in a virtual scene; in response to the controlled virtual object moving to a first specified position of a target virtual object, displaying audio playing information of the target virtual object; wherein the target virtual object is located in the virtual scene, and the target virtual object is controlled by a second terminal device; and in response to an audio follow-up listening instruction, controlling the first terminal device to play target audio corresponding to the audio playing information. In this way, the virtual object controlled by the user is arranged in the virtual scene, and the sharing interaction of audio playing is realized through the interaction between the virtual objects, so that the interaction mode between the users is more diversified, the interaction between the users is closer, and the immersion of the user interaction in the audio playing scene is improved.

Description

Technical Field

[0001] This invention relates to the field of audio playback technology, and in particular to an interactive control method, apparatus, and electronic device for playing audio. Background Technology

[0002] Audio playback software provides playback functions for various types of audio, including music. In audio playback software, user interaction often uses a flat, two-dimensional interface. For example, when playing music, a user can invite friends to listen together; the software interface will then display the user's and friend's avatars, the music title, lyrics, and other information. This flat interface approach results in relatively simple user interaction and a weak sense of immersion. Summary of the Invention

[0003] In view of this, the purpose of the present invention is to provide an interactive control method, device and electronic device for playing audio, so as to enrich the interaction between users, make the interaction between users closer, and improve the immersion of user interaction in audio playback scenarios.

[0004] In a first aspect, embodiments of the present invention provide an interactive control method for playing audio, which provides a graphical user interface through a first terminal device; the graphical user interface includes a scene screen of a virtual scene; a controlled virtual object is located in the virtual scene; the controlled virtual object is controlled through the first terminal device; the method includes: in response to a movement control operation, controlling the controlled virtual object to move in the virtual scene; in response to the controlled virtual object moving to a first designated position of a target virtual object, displaying audio playback information of the target virtual object; wherein the target virtual object is located in the virtual scene, and the target virtual object is controlled through a second terminal device; in response to an audio follow-up command, controlling the first terminal device to play the target audio corresponding to the audio playback information.

[0005] Secondly, embodiments of the present invention provide an interactive control method for playing audio, the method being applied to a server; the method includes: receiving a scene creation instruction from a first terminal device to create a virtual scene; wherein a controlled virtual object is located in the virtual scene; the controlled virtual object is controlled through the first terminal device; sending a scene image of the virtual scene to the first terminal device; providing an interface control for entering the virtual scene to a second terminal device other than the first terminal device, so as to control a target virtual object to enter the virtual scene through the interface control; in the virtual scene, in response to the controlled virtual object moving to a first specified position of the target virtual object, controlling the first terminal device to display audio playback information of the target virtual object; and in response to an audio follow-up instruction, controlling the first terminal device to play the target audio corresponding to the audio playback information.

[0006] Thirdly, embodiments of the present invention provide an interactive control device for playing audio, which provides a graphical user interface through a first terminal device; the graphical user interface includes a scene screen of a virtual scene; a controlled virtual object is located in the virtual scene; the controlled virtual object is controlled through the first terminal device; the device includes: a movement control module, used to control the controlled virtual object to move in the virtual scene in response to a movement control operation; an information display module, used to display audio playback information of the target virtual object in response to the controlled virtual object moving to a first designated position of the target virtual object; wherein the target virtual object is located in the virtual scene and is controlled through a second terminal device; and an audio playback module, used to control the first terminal device to play the target audio corresponding to the audio playback information in response to an audio follow-up command.

[0007] Fourthly, embodiments of the present invention provide an interactive control device for playing audio, the device comprising: a scene creation module, configured to receive a scene creation instruction from a first terminal device and create a virtual scene; wherein a controlled virtual object is located in the virtual scene; the controlled virtual object is controlled by the first terminal device; a screen sending module, configured to send a scene screen of the virtual scene to the first terminal device; a control providing module, configured to provide an interface control for entering the virtual scene to a second terminal device other than the first terminal device, so as to control a target virtual object to enter the virtual scene through the interface control; in the virtual scene, in response to the controlled virtual object moving to a first specified position of the target virtual object, controlling the first terminal device to display audio playback information of the target virtual object; and in response to an audio follow-up instruction, controlling the first terminal device to play the target audio corresponding to the audio playback information.

[0008] Fifthly, embodiments of the present invention provide an electronic device, including a processor and a memory, wherein the memory stores machine-executable instructions that can be executed by the processor, and the processor executes the machine-executable instructions to implement the above-described interactive control method for playing audio.

[0009] In a sixth aspect, embodiments of the present invention provide a machine-readable storage medium storing machine-executable instructions. When the machine-executable instructions are invoked and executed by a processor, the machine-executable instructions cause the processor to implement the above-described interactive control method for playing audio.

[0010] The embodiments of the present invention bring the following beneficial effects: The aforementioned interactive control method, device, and electronic device for playing audio provides a graphical user interface (GUI) through a first terminal device. The GUI includes a scene view of a virtual scene. A controlled virtual object is located within the virtual scene. The controlled virtual object is controlled via the first terminal device. In response to a movement control operation, the controlled virtual object is moved within the virtual scene. In response to the controlled virtual object moving to a first designated position of a target virtual object, audio playback information of the target virtual object is displayed. The target virtual object is located within the virtual scene and is controlled via a second terminal device. In response to an audio follow-up command, the first terminal device is controlled to play the target audio corresponding to the audio playback information. In this method, the user-controlled virtual object is set within the virtual scene. Through interaction between virtual objects, shared interaction in audio playback is achieved. This enriches the interaction methods between users, strengthens the interaction between users, and enhances the immersive experience of user interaction in the audio playback scenario.

[0011] Other features and advantages of the invention will be set forth in the description which follows, and will be apparent in part from the description, or may be learned by practicing the invention. The objects and other advantages of the invention are realized and obtained in accordance with the structures particularly pointed out in the description, claims and drawings.

[0012] To make the above-mentioned objects, features and advantages of the present invention more apparent and understandable, preferred embodiments are described below in detail with reference to the accompanying drawings. Attached Figure Description

[0013] To more clearly illustrate the specific embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the specific embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present invention. For those skilled in the art, other drawings can be obtained from these drawings without creative effort.

[0014] Figure 1 A schematic diagram of the interactive interface of a music playback software provided in an embodiment of the present invention; Figure 2 A flowchart illustrating an interactive control method for playing audio, provided in an embodiment of the present invention; Figure 3 This is a schematic diagram illustrating the display of audio playback information provided in an embodiment of the present invention; Figure 4 This is a schematic diagram illustrating the display of a first identifier provided in an embodiment of the present invention; Figure 5 This is a schematic diagram illustrating the display of a second identifier according to an embodiment of the present invention; Figure 6This is a schematic diagram illustrating the display of object information provided in an embodiment of the present invention; Figure 7 This is a schematic diagram illustrating the display of dialogue information provided in an embodiment of the present invention; Figure 8 A flowchart of another interactive control method for playing audio provided in an embodiment of the present invention; Figure 9 A schematic diagram of an interactive control device for playing audio provided in an embodiment of the present invention; Figure 10 A schematic diagram of another interactive control device for playing audio provided in an embodiment of the present invention; Figure 11 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present invention. Detailed Implementation

[0015] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0016] To make it easier to understand, we will use music software as an example. Figure 1 The image shows the interactive interface of a music playback software in related technologies. The top of the interface displays music information, which may include the name of the currently playing song, the artist's name, etc. The upper half of the interface displays the avatars and usernames of the two users currently listening to the music. In practice, User 1 can send an invitation to User 2. After User 2 accepts the invitation, the interface displays the avatars of both Users 1 and 2, indicating that they are listening to the same song together. The central area of ​​the interface displays the music album art, and the bottom area displays various music controls, such as favorites, downloads, comments, playback controls, and playback mode controls. The bottom of the interface also displays the playback progress bar for the current song.

[0017] In the aforementioned flat, interface-based interaction methods, user interactions and states are represented through text, avatars, and other information, resulting in a weak sense of immersion. Furthermore, the emotional expression of users when sharing music lacks vividness in the interaction. Additionally, the forms of these interaction methods are relatively simple, primarily involving sending text messages and emoticons, leading to a persistent sense of distance between users and a lack of expression of individual user personas.

[0018] Based on the above, the interactive control method, device, and electronic device for playing audio provided in this embodiment of the invention can be applied to music and other audio playback software, APPs, websites, and other audio playback scenarios.

[0019] In one embodiment of this disclosure, the interactive control method for playing audio can run on a local terminal device or a server. When the interactive control method for playing audio runs on a server, the method can be implemented and executed based on a cloud interactive system, wherein the cloud interactive system includes a server and a client device.

[0020] In an optional implementation, various cloud applications, such as cloud gaming, can run under the cloud interaction system. Taking cloud gaming as an example, cloud gaming refers to a gaming method based on cloud computing. In the cloud gaming operating mode, the game program and the game screen presentation are separated. The storage and execution of the interactive control methods for playing audio are completed on the cloud gaming server. The client device is used for receiving and sending data and presenting the game screen. For example, the client device can be a display device with data transmission capabilities located close to the user, such as a mobile terminal, television, computer, or PDA; however, the information processing is performed by the cloud gaming server in the cloud. When playing the game, the player operates the client device to send operation commands to the cloud gaming server. The cloud gaming server runs the game according to the operation commands, encodes and compresses the game screen and other data, returns it to the client device via the network, and finally, the client device decodes and outputs the game screen.

[0021] In an optional implementation, taking a game as an example, the local terminal device stores the game program and is used to display the game screen. The local terminal device is used to interact with the player through a graphical user interface (GUI), i.e., conventionally by downloading, installing, and running the game program via an electronic device. The local terminal device can provide the GUI to the player in various ways, such as rendering it on the terminal's display screen or providing it to the player via holographic projection. For example, the local terminal device can include a display screen for displaying the GUI, which includes game screens, and a processor for running the game, generating the GUI, and controlling the display of the GUI on the display screen.

[0022] In one possible implementation, this invention provides an interactive control method for playing audio. A graphical user interface (GUI) is provided through a first terminal device, which can be either a local terminal device or a client device in a cloud interactive system. The GUI includes a virtual scene; a controlled virtual object is located within the virtual scene; the controlled virtual object is controlled via the first terminal device; the virtual scene can be a virtual club scene, party scene, beach scene, etc. The controlled virtual object is located within the virtual scene, and the user can control the controlled virtual object to move, perform actions, and interact with other virtual objects within the virtual scene via the first terminal device. A virtual camera can be set within the virtual scene to capture images of the virtual scene.

[0023] like Figure 2 As shown, the interactive control method for playing audio includes the following steps: Step S202: In response to the movement control operation, control the movement of the controlled virtual object in the virtual scene; The movement control operation can be implemented through controls, such as sliding a virtual joystick to control the movement of the controlled virtual object in the virtual scene; the movement control operation can also be implemented by triggering the virtual scene, such as clicking a position in the virtual scene to control the controlled virtual object to move from the current position to the clicked position.

[0024] Step S204: In response to the controlled virtual object moving to the first designated position of the target virtual object, the audio playback information of the target virtual object is displayed; wherein, the target virtual object is located in a virtual scene, and the target virtual object is controlled through a second terminal device; Multiple virtual objects can exist simultaneously in a virtual scene. Each virtual object corresponds to a user account, and different virtual objects are controlled by different terminal devices. The first specified location of the target virtual object can be a location within a first distance range from the target virtual object, a location with a specific relative direction and relative distance from the target virtual object, or a specified location around the target virtual object, such as the location of the virtual seats around the target virtual object.

[0025] After the controlled virtual object moves to the first designated position, the graphical user interface displays the audio playback information of the target virtual object. This audio playback information may include the name of the audio being played by the second terminal device controlling the target virtual object, the audio author, and other information.

[0026] Step S206: In response to the audio listening command, control the first terminal device to play the target audio corresponding to the audio playback information.

[0027] The audio follow-up command is used to control the first terminal device to play the audio that the second terminal device is currently playing. This audio follow-up command can be triggered by various operations. For example, when displaying the audio playback information of the target virtual object, a playback control can be displayed simultaneously. Triggering this playback control can play the target audio, which is the audio currently playing on the second terminal device of the target virtual object. When the user triggers this control, the aforementioned audio follow-up command is generated, at which point the current audio playback can be stopped and the target audio playback can begin, thereby enabling the controlled virtual object and the user corresponding to the target virtual object to share audio.

[0028] In addition, audio follow-up commands can also be generated when the controlled virtual object reaches a specific position. For example, the controlled virtual object can be moved to a preset position, which may be the same as or different from the first specified position. In this case, the above-mentioned audio follow-up command is generated, and then the target audio is played.

[0029] The aforementioned interactive control method for playing audio provides a graphical user interface (GUI) through a first terminal device. The GUI includes a virtual scene; a controlled virtual object is located within the virtual scene; the controlled virtual object is controlled via the first terminal device; in response to a movement control operation, the controlled virtual object is moved within the virtual scene; in response to the controlled virtual object moving to a first designated position of a target virtual object, the audio playback information of the target virtual object is displayed; wherein, the target virtual object is located within the virtual scene and is controlled via a second terminal device; in response to an audio follow-up command, the first terminal device is controlled to play the target audio corresponding to the audio playback information. In this method, the user-controlled virtual object is set within the virtual scene, and through interaction between virtual objects, shared interaction in audio playback is achieved. This enriches the interaction methods between users, strengthens the interaction between users, and enhances the immersive experience of user interaction in the audio playback scenario.

[0030] The following embodiments further describe the movement control method of the controlled virtual object in the virtual scene, as well as the interaction method between the controlled virtual object and the virtual scene.

[0031] In one approach, in response to a trigger operation targeting a first scene location within a virtual scene, the controlled virtual object is moved from its current position to that first scene location. This first scene location can be any location within the virtual scene or a pre-defined triggerable location. The current position can be understood as the location of the controlled virtual object when the trigger operation for the first scene location is executed. The trigger operation can be a single click, a double click, etc. For example, if a user clicks location point A in the virtual scene, the controlled virtual object moves from its current position to location point A.

[0032] In practical implementation, a virtual scene can accommodate a certain number of virtual objects. An upper limit can be set for the number of virtual objects a virtual scene can hold, for example, 10 people. Users can customize the appearance of the controlled virtual objects, such as face shape, hairstyle, clothing, and accessories. Controlled virtual objects can exhibit actions within the virtual scene, such as sitting, standing, walking, shaking their heads, or performing dance poses. To enable users to quickly identify the controlled virtual object from among multiple virtual objects, it can be marked with specific markers in the graphical user interface displayed on the first terminal device, such as highlighted feet, highlighted foot rings, or highlighted head markers.

[0033] In another approach, in response to a trigger operation targeting a first scene location in the virtual scene, the preset object behavior for the first scene location is determined; the controlled virtual object is controlled to move from its current location to the first scene location, and the controlled virtual object is controlled to perform object behavior at the first scene location.

[0034] Specifically, object behaviors for certain locations within the virtual scene can be preset. The preset object behavior for the first scene location is usually related to the attributes of that location. For example, if scene location A has a chair, the preset object behavior for scene location A is to sit down; similarly, if scene location B has a stage, the preset behavior for scene location B is a specific dance pose. After the user triggers the first scene location, the controlled virtual object is first moved from its current position to the first scene location. Once the moved virtual object is detected, the virtual object is controlled to execute its object behavior.

[0035] The above methods can enable interaction between virtual objects and virtual scenes, thereby enhancing the richness of the interaction.

[0036] In another approach, in response to a trigger operation targeting a first scene location in a virtual scene, a preset associated dynamic element for the first scene location is determined; wherein the associated dynamic element is located at the first scene location, or an associated location of the first scene location; the controlled virtual object is controlled to move from its current location to the first scene location; and the associated dynamic element's display state is changed according to the current audio played by the first terminal device.

[0037] The aforementioned associated dynamic elements can be decorations, placed items, etc., in the virtual scene; for example, lights, screens, and speakers. These associated dynamic elements can be located in the first scene location or other locations, such as the area surrounding the first scene location. The association between the first scene location and the associated locations, or the association between the first scene location and the associated dynamic elements at those locations, can be pre-defined. After the controlled virtual object moves to the first scene location, it obtains the audio being played on the first terminal device and, based on the rhythm, style, and other factors of the audio, controls the display state of the associated dynamic elements to change. For example, if the associated dynamic element is a screen, it can display style images, lyrics, etc., of the audio; or, if the associated dynamic element is a light fixture, its color can change according to the rhythm of the audio.

[0038] Additionally, when the user switches the currently playing audio, the display state of the associated dynamic elements will change accordingly. When the controlled virtual object leaves the first scene position, these associated dynamic elements can revert to their default display state. It should also be noted that if other virtual objects move to the first scene position, the interface will also display associated dynamic elements that change their display state accordingly.

[0039] The above method associates the display state of the virtual scene with the audio played by the user, thereby enhancing the user's immersion when listening to audio.

[0040] The following examples further describe how a user can listen to other users' audio.

[0041] In the foregoing embodiments, when the controlled virtual object moves to the first designated position of the target virtual object, the audio playback information of the target virtual object is displayed. This audio playback information can provide information about the audio currently being played by the user corresponding to the target virtual object. In this embodiment, the audio playback information includes: the target audio played by the second terminal device corresponding to the target virtual object, and a playback control for controlling the first terminal device to play the target audio; in response to a trigger operation on the playback control, an audio follow-up command is generated; after the audio follow-up command is generated, the first terminal device can be controlled to play the target audio corresponding to the audio playback information.

[0042] The audio playback information mentioned above can specifically display information such as the audio name and author of the target audio, as well as the audio status of the second terminal device playing the target audio, such as playback status, pause status, and playback progress.

[0043] Figure 3 As an example, after the controlled virtual object moves to a position near the target virtual object, a bubble-shaped information box appears on top of the target virtual object. This information box is used to display the aforementioned audio playback information; Figure 3 The audio playback information displays the audio name of the target audio being played by the user corresponding to the target virtual object, along with a playback control labeled "Listen." When the user triggers this playback control, an audio follow-up command is generated, and the first terminal device can then play the target audio being played by the user corresponding to the target virtual object. If the first terminal device is currently playing the current audio, triggering the playback control will pause the current audio and gradually resume playing the target audio. Alternatively, if a portion of the target audio corresponding to the target virtual object has already played, clicking the playback control will allow the first terminal device to play the target audio according to the playback progress of the target virtual object, ensuring that the playback progress of the target audio heard by the user for both the target virtual object and the controlled virtual object is the same. In another approach, clicking the playback control will restart the target audio from the beginning.

[0044] This embodiment also provides other audio tracking methods. In one method, in response to the controlled virtual object moving to a second designated position of the target virtual object, an audio tracking command is generated, and the first terminal device is controlled to play the target audio corresponding to the audio playback information through the audio tracking command. The second designated position includes the aforementioned first designated position, or a position other than the aforementioned first designated position; that is, the second designated position here may be the same as or different from the aforementioned first designated position.

[0045] When the second specified position includes the aforementioned first specified position, it can be understood that the second specified position is the same as the first specified position. In this case, when the controlled virtual object moves to the first specified position of the target virtual object, audio playback information is displayed, and an audio follow-up command is generated simultaneously, thereby controlling the first terminal device to play the target audio corresponding to the audio playback information. That is, the user sees the audio playback information and hears the target audio corresponding to that audio playback information at the same time.

[0046] When the second designated location includes a location other than the first designated location, it can be understood that the second designated location is different from the first designated location. In this case, if the controlled virtual object arrives at the first designated location first and then at the second designated location, the interface will first display audio playback information. Only after the target virtual object arrives at the second designated location will the first terminal device play the target audio; that is, the user will see the audio playback information first, and only after the controlled virtual object arrives at the second designated location will the user hear the target audio. In another case, if the controlled virtual object arrives at the second designated location first and then at the first designated location, the first terminal device will first play the target audio. Only after the target virtual object arrives at the first designated location will the interface display audio playback information; that is, the user will hear the target audio first, and only after the controlled virtual object arrives at the first designated location will the user see the audio playback information.

[0047] In one specific implementation, the second designated position includes positions other than the first designated position; in response to the controlled virtual object moving from the first designated position to the second designated position of the target virtual object, an audio follow-up command is generated. In this method, the controlled virtual object first arrives at the first designated position, and then the interface displays audio playback information; then the controlled virtual object moves from the first designated position to the second designated position, and then the first terminal device plays the target audio. This method allows the user to see the audio playback information first and then hear the target audio during the continuous movement of the controlled virtual object, improving the continuity and convenience of audio follow-up operations.

[0048] Furthermore, the first designated position can be set within a first distance range from the target virtual object, and the second designated position can be set within a second distance range from the target virtual object, with the second distance range being smaller than the first distance range. As the controlled virtual object approaches the target virtual object, it first reaches the first designated position and then the second designated position. This method can further improve the continuity of object movement and enhance the convenience of audio tracking operations.

[0049] In another implementation, the distance between the second specified position and the target virtual object is less than the distance between the first specified position and the target virtual object; in response to the controlled virtual object moving from the first specified position to the second specified position of the target virtual object, the volume of the target audio is gradually increased, and the volume of the currently playing audio on the first terminal device is gradually decreased; in response to the audio follow-up command, the first terminal device is controlled to play the target audio at a preset volume and stop playing the currently playing audio.

[0050] As an example, suppose the currently playing audio on the first terminal device is audio A, and the target audio played by the second terminal device corresponding to the target virtual object is audio B. When the controlled virtual object reaches the first designated position, it starts playing the target audio, i.e., audio B. At this time, the first terminal device continues to play the currently playing audio, i.e., audio A, but the volume of audio B is relatively low, while the volume of audio A is relatively high. As the target virtual object moves towards the second designated position, the volume of audio B gradually increases with the movement of the target virtual object, while the volume of audio A gradually decreases. When it reaches the second designated position, an audio follow-up command is generated. At this time, the first terminal device stops playing audio A and plays audio B at a preset volume.

[0051] When the second designated position is closer to the target virtual object than the first designated position, the controlled virtual object first reaches the first designated position. At this point, audio playback information is displayed. Then, the user can decide whether to continue controlling the controlled virtual object to move to the second designated position based on their level of interest in the audio playback information. If the controlled virtual object continues to move to the second designated position, the first terminal device is controlled to play the target audio corresponding to the audio playback information. In actual implementation, the interface can display a prompt message for the second designated position to guide the user to listen to the target audio by moving to the second designated position.

[0052] In one specific implementation, after the controlled virtual object moves to the second designated position, the volume of the currently playing audio on the first terminal device gradually decreases until the volume is zero, while the volume of the target audio gradually increases. When the controlled virtual object remains at the second designated position, or at a position closer to the target virtual object than the second designated position, the first terminal device continuously plays the target audio and does not play the currently playing audio. When the controlled virtual object leaves the second designated position and moves to a position farther away from the target virtual object than the second designated position, the volume of the target audio played by the first terminal device gradually decreases until it is zero, and the first terminal device resumes playing the currently playing audio, with the volume gradually increasing.

[0053] In another listening method, in response to a trigger operation applied to the target virtual object, the object information of the target virtual object is displayed, and audio listening instructions are generated to control the first terminal device to play the target audio corresponding to the audio playback information. The trigger operation can be a click operation applied to the target virtual object. In this case, the interface can display the object information of the target virtual object. This object information can also be the account information of the user account corresponding to the target virtual object. For example, the object information may include an avatar, the similarity of audio preferences between the user corresponding to the controlled virtual object and the user corresponding to the target virtual object, and the audio currently being played on the terminal device corresponding to the target virtual object.

[0054] After a user clicks on the target virtual object, the object information of the target virtual object will be displayed on the interface, and the target audio will be played on the first terminal device. In another method, the object information can display a playback control for the target audio. After the user clicks on the target virtual object, the object information is displayed, and then the user clicks the playback control in the object information, and the first terminal device begins playing the target audio.

[0055] Furthermore, after the user clicks the play control and starts playing the target audio, a first identifier is displayed, indicating that the first terminal device is playing the target audio; and / or a second identifier is displayed, indicating that the terminal devices corresponding to the controlled virtual object and the target virtual object are playing the target audio together.

[0056] For example Figure 4 In the middle, the user clicks Figure 3 After the playback control with the words "Listen and See" appears, the playback control is hidden and replaced with the first icon that says "Listening Now" to indicate to the user that the target video is currently being played on the first terminal device.

[0057] Additionally, a second identifier can be displayed, for example... Figure 5 In the middle, an information box is displayed on the top of both the target virtual object and the controlled virtual object. The information box displays music symbols. This second identifier is used to prompt the user that they are currently listening to the target music together with the user corresponding to the target virtual object.

[0058] In actual implementation, after the user clicks the play control, one of the first identifier or the second identifier mentioned above can be displayed, or both the first identifier and the second identifier can be displayed simultaneously, or the first identifier can be displayed first, and then the second identifier can be displayed after the first identifier has been displayed for a certain period of time.

[0059] The above-mentioned labeling and prompting methods can enhance the sense of interaction between users and increase the immersion of user interaction.

[0060] The following examples provide alternative ways to interact with controlled virtual objects.

[0061] The graphical user interface includes behavior control controls. Responding to trigger operations on these controls allows the controlled virtual object to perform the target behavior corresponding to the control within the virtual scene. For example, the target behavior could be a dance pose that changes with music, or a head-shaking gesture. By triggering the behavior control controls, the controlled virtual object can perform the corresponding target behavior in the virtual scene. Additionally, some target behaviors may have requirements regarding the controlled virtual object's position within the virtual scene. If the controlled virtual object has not reached the specified position, the corresponding behavior control control can be in an untriggerable state, such as being grayed out. Once the controlled virtual object reaches the specified position, the corresponding behavior control control becomes triggerable.

[0062] Furthermore, multiple virtual objects can also interact with each other. Specifically, in response to a trigger operation on a behavior control control, a behavior interaction object is identified at a preset location of the controlled virtual object; wherein, the behavior interaction object is a virtual object located in the virtual scene; the controlled virtual object is controlled to execute the target behavior corresponding to the behavior control control; the target behavior is associated with the behavior interaction object. The behavior interaction object can be a virtual character controlled by the user or a prop object located in the virtual scene.

[0063] In this embodiment, the target behavior requires the joint completion of a controlled virtual object and a behavior interaction object, such as a hug, a photo-taking action, or a dance-like action. After the user triggers the behavior control control, if a behavior interaction object is present at the preset position of the controlled virtual object, the user can control the controlled virtual object to execute the target behavior. This target behavior is associated with the behavior interaction object; for example, the target behavior requires the joint completion of the controlled virtual object and the behavior interaction object, or the target behavior requires the coordinated completion of the controlled virtual object and the behavior interaction object. The preset position of the controlled virtual object can be a location within a certain distance from the controlled virtual object, or it can be a position in front of, to the side of, or behind the controlled virtual object.

[0064] In one approach, a behavior interaction request is sent to the terminal device corresponding to the behavior interaction object; in response to the confirmation information received from the behavior interaction request, the controlled virtual object is controlled to execute the target behavior; during the process of the controlled virtual object executing the target behavior, the behavior interaction object is controlled by the corresponding terminal device to execute the matching behavior of the target behavior.

[0065] In this approach, the behavior interaction object is a virtual object controlled by other terminal devices. Since the target behavior requires the controlled virtual object and the behavior interaction object to work together, a behavior interaction request needs to be sent to the terminal device corresponding to the behavior interaction object. If a confirmation message for the behavior interaction request is received, it means that the user corresponding to the behavior interaction object agrees to the controlled virtual object executing the target behavior. At this time, the controlled virtual object executes the target behavior, and at the same time, the behavior interaction object executes the matching behavior of the target behavior, thereby realizing the behavior interaction between multiple objects.

[0066] In another approach, behavior control controls can be displayed in association with a behavior interaction object. A user can trigger a behavior control control for a specific behavior interaction object, thereby working together with that object to complete the target behavior. Furthermore, after triggering a behavior control control, the user can send an interaction request to the user account of the behavior interaction object. Once the request is accepted, the controlled virtual object and the behavior interaction object work together to complete the target behavior.

[0067] The above methods enable users to interact through virtual objects, thereby increasing the richness and depth of user interactions.

[0068] This embodiment also provides another interaction method. In response to a trigger operation targeting a target virtual object in the virtual scene, the object information of the target virtual object is displayed; wherein, the object information includes several of the following: the currently playing audio of the terminal device corresponding to the target virtual object, audio preference information, a message sending control, and an invitation control to invite the terminal device of the target virtual object to play shared audio.

[0069] like Figure 6 As shown, after a user clicks on a target virtual object, the object information of the target virtual object is displayed at the bottom of the interface. This object information includes the user's avatar corresponding to the target virtual object. Below the user's avatar, the audio information of the currently playing audio on the terminal device corresponding to the target virtual object is displayed, such as the audio name, author, lyrics, etc. "90% similarity in listening tastes" is an example of audio preference information, which indicates the similarity between the user corresponding to the target virtual object and the user corresponding to the controlled virtual object in their listening habits. The audio preference information may also include information such as the audio type, style, and language preferred by the user corresponding to the target virtual object.

[0070] Figure 6 The object information can also include a message sending control, which can send text messages, emoticons, etc. To the right of the message sending control is an invitation control, used to invite the user corresponding to the target virtual object to play the audio together.

[0071] In one specific implementation, the object information includes: an invitation control that invites the target virtual object's terminal device to play shared audio; in response to a trigger operation acting on the invitation control, a first invitation request is sent to the target virtual object's user account; wherein, the first invitation request is used to: invite the terminal device corresponding to the target virtual object to play the current audio played by the first terminal device; in response to the target virtual object's user account confirming the first invitation request, an information identifier is displayed; the information identifier indicates that the target virtual object and the controlled virtual object's terminal devices are playing the current audio together.

[0072] In actual implementation, after the user clicks the invitation control, a first invitation request is sent to the user account of the target virtual object. This first invitation request is displayed on the terminal device controlling the target virtual object. After the user corresponding to the target virtual object clicks to confirm the first invitation request, a successful invitation message is displayed on the first terminal device of the controlled virtual object. Then, the terminal devices of the target virtual object and the controlled virtual object play the current audio together. This message also instructs the terminal devices of the target virtual object and the controlled virtual object to play the current audio together.

[0073] In another specific implementation, the object information includes: an information sending control; generating target information in response to information editing operations; sending the target information to the user account of the target virtual object in response to a trigger operation acting on the information sending control, and displaying the target information in the graphical user interface.

[0074] Figure 7 As an example, after sending target information to the target virtual object, the target information is displayed in the graphical user interface. When the target virtual object sends a reply, the reply is also displayed in the graphical user interface, thus enabling users to interact through dialogue via virtual objects.

[0075] In addition, users can also send messages to every virtual object in the virtual scene, rather than targeting a specific virtual object. This is equivalent to sending a group message, and the message can be displayed on the interface of the terminal device corresponding to each virtual object. Other virtual objects can also send reply messages in response to the message.

[0076] In the virtual scene, user-sent messages, emoticons, and other visual elements can be displayed on the interface. The display duration can be set; for example, a message can be displayed for 5 seconds and then automatically disappear.

[0077] The following embodiments further describe the interaction method in which the controlled virtual object interacts with all virtual objects in the virtual scene.

[0078] In response to the controlled virtual object moving to a target location in the virtual scene, the current audio being played by the first terminal device is determined; in response to the invitation operation, a second invitation request is sent to the user account of the target virtual object located in the virtual scene; wherein, the target virtual object is: a virtual object in the virtual scene other than the controlled virtual object; the second invitation request is used to: invite the terminal device corresponding to the target virtual object to play the current audio being played by the first terminal device.

[0079] In this approach, the target location can be a prominent or central position within the virtual scene, such as a stage, podium, or lead dancer's position. Once the controlled virtual object reaches the target location, an invitation operation is triggered. This invitation operation can be implemented by triggering relevant controls. After the user executes the invitation operation, a second invitation request is sent to all virtual objects in the virtual scene except for the controlled virtual object. When the target virtual object accepts the second invitation request, the terminal device corresponding to the target virtual object plays the current audio played by the first terminal device.

[0080] The above method enables multiple users corresponding to virtual objects in a virtual scene to play the same audio together, thereby realizing audio interaction among multiple users and improving the user's immersion and participation in listening to audio.

[0081] In addition, for multiple virtual objects other than the controlled virtual object, if interaction occurs between the multiple virtual objects, a relevant identifier can also be displayed on the first terminal device corresponding to the controlled virtual object. Specifically, in response to the distance between the first virtual object and the second virtual object in the virtual scene being less than a preset distance, and the user accounts corresponding to the first virtual object and the second virtual object sending information to each other, a third identifier is displayed; the third identifier indicates that information is being sent between the user accounts corresponding to the first virtual object and the second virtual object; that is, the third identifier is used to indicate that the users corresponding to the first virtual object and the second virtual object are having a conversation.

[0082] In another approach, in response to the distance between the first and second virtual objects in the virtual scene being less than a preset distance, and the terminal devices corresponding to the first and second virtual objects playing the same audio, a fourth identifier is displayed; this fourth identifier indicates that the terminal devices corresponding to the first and second virtual objects are playing the same audio; that is, the fourth identifier is used to indicate that the users corresponding to the first and second virtual objects are sharing audio. Here, the first and second virtual objects are virtual objects in the virtual scene other than the controlled virtual object.

[0083] Furthermore, audio operation controls are displayed above the scene screen; these controls are used to control the audio currently being played on the first terminal device. These audio operation controls can be displayed at the bottom of the graphical user interface and are used to control the audio currently being played on the first terminal device, such as audio pause / play controls, next track controls, audio lyrics display controls, and audio favorites controls.

[0084] See Figure 8 The diagram illustrates an interactive control method for playing audio, applied to a server; the method includes the following steps: Step S802: Receive a scene creation instruction from the first terminal device and create a virtual scene; wherein, the controlled virtual object is located in the virtual scene; the controlled virtual object is controlled through the first terminal device; The foregoing embodiments implement audio interactive control in a virtual scene. This embodiment provides a method for generating a virtual scene. A user can send a scene creation command through a first terminal device to create a corresponding virtual scene on the server. Simultaneously, the controlled virtual object corresponding to the first terminal device enters the virtual scene.

[0085] Step S804: Send the scene image of the virtual scene to the first terminal device; Step S806: Provide an interface control for entering the virtual scene to a second terminal device other than the first terminal device, so as to control the target virtual object to enter the virtual scene through the interface control; in the virtual scene, in response to the controlled virtual object moving to the first specified position of the target virtual object, control the first terminal device to display the audio playback information of the target virtual object; in response to the audio follow-up command, control the first terminal device to play the target audio corresponding to the audio playback information.

[0086] In practical implementation, the server can proactively send the aforementioned interface controls to second terminal devices other than the first terminal device. Users can pre-set certain conditions, and the server, based on these conditions, filters a subset of second terminal devices and sends interface controls to those that meet the conditions. These interface controls can be buttons, links, password input controls, etc., for entering a virtual scene. Once the target virtual object enters the virtual scene through the interface control, the interactive control method described in the aforementioned embodiment can be implemented.

[0087] Furthermore, the second terminal device satisfies one or more of the following conditions: the geographical location of the second terminal device and the geographical location of the first terminal device meet preset location conditions; the audio preferences of the user account corresponding to the second terminal device match the audio preferences of the user account corresponding to the first terminal device; and the second terminal device receives an invitation message from the first terminal device to enter the virtual scene in advance.

[0088] The aforementioned location conditions could be, for example, being located in the same city or region as the first terminal device. The terminal device's geographical location can be determined based on its IP address. The aforementioned audio preferences can be determined based on the types of audio played by the user's account. The user can set keywords for their audio preferences through the first terminal device, and the server will send interface controls to terminal devices with user accounts containing those keywords. The first terminal device can send invitation information to specific second terminal devices. This invitation information can be a link to enter a virtual scene or a scene entry password; the user can enter the virtual scene by clicking the link or entering the scene entry password.

[0089] In the above method, user-controlled virtual objects are set in a virtual scene. Through the interaction between virtual objects, shared interaction of audio playback is realized. The interaction between users is richer and closer, which improves the immersion of user interaction in the audio playback scene.

[0090] For the corresponding method embodiments described above, see [link to relevant documentation]. Figure 9 The diagram illustrates an interactive control device for playing audio, which provides a graphical user interface (GUI) via a first terminal device. The GUI includes a virtual scene; a controlled virtual object is located within the virtual scene; the controlled virtual object is controlled via the first terminal device; the device includes: The motion control module 90 is used to control the movement of the controlled virtual object in the virtual scene in response to motion control operations; The information display module 92 is used to display the audio playback information of the target virtual object in response to the controlled virtual object moving to the first designated position of the target virtual object; wherein the target virtual object is located in a virtual scene and is controlled by a second terminal device; The audio playback module 94 is used to respond to the audio listening command and control the first terminal device to play the target audio corresponding to the audio playback information.

[0091] The aforementioned interactive control device for playing audio provides a graphical user interface (GUI) via a first terminal device. The GUI includes a virtual scene view; a controlled virtual object is located within the virtual scene; the controlled virtual object is controlled via the first terminal device; in response to a movement control operation, the controlled virtual object is moved within the virtual scene; in response to the controlled virtual object moving to a first designated position of a target virtual object, audio playback information of the target virtual object is displayed; wherein, the target virtual object is located within the virtual scene and is controlled via a second terminal device; in response to an audio follow-up command, the first terminal device is controlled to play the target audio corresponding to the audio playback information. In this method, the user-controlled virtual object is set within the virtual scene, and through interaction between virtual objects, shared interaction in audio playback is achieved. This enriches the interaction methods between users, strengthens the interaction between users, and enhances the immersive experience of user interaction in the audio playback scenario.

[0092] The aforementioned movement control module is also used to: respond to a trigger operation targeting a first scene location in the virtual scene, and control the controlled virtual object to move from its current location to the first scene location.

[0093] The aforementioned movement control module is also used to: respond to a trigger operation targeting a first scene location in a virtual scene, determine the preset object behavior for the first scene location; control the controlled virtual object to move from its current location to the first scene location, and control the controlled virtual object to perform object behavior at the first scene location.

[0094] The aforementioned mobile control module is further configured to: respond to a trigger operation targeting a first scene location in a virtual scene, and determine a preset associated dynamic element for the first scene location; wherein the associated dynamic element is located at the first scene location, or an associated location of the first scene location; control the controlled virtual object to move from its current location to the first scene location; and control the associated dynamic element to change its display state according to the current audio played by the first terminal device.

[0095] The aforementioned audio playback information includes: the target audio played by the second terminal device corresponding to the target virtual object, and the playback control that controls the first terminal device to play the target audio; the aforementioned device also includes a first instruction generation module, used to: generate an audio listening instruction in response to a trigger operation on the playback control.

[0096] The aforementioned device further includes: a first identifier display module for: displaying a first identifier, the first identifier indicating that the first terminal device is playing target audio; and / or, displaying a second identifier, the second identifier indicating that the terminal devices corresponding to the controlled virtual object and the target virtual object are jointly playing target audio.

[0097] The aforementioned device further includes a second instruction generation module, configured to: generate an audio listening instruction in response to the controlled virtual object moving to a second designated position of the target virtual object; wherein the second designated position includes the first designated position, or a position other than the first designated position.

[0098] The second designated position includes positions other than the first designated position; the second instruction generation module is further configured to: in response to the controlled virtual object moving from the first designated position to the second designated position of the target virtual object, control the generation of audio follow-up instructions.

[0099] The distance between the second designated position and the target virtual object is less than the distance between the first designated position and the target virtual object; the device further includes a volume control module, used to: in response to the controlled virtual object moving from the first designated position to the second designated position of the target virtual object, control the volume of the target audio to gradually increase and the volume of the currently playing audio on the first terminal device to gradually decrease; the audio playback module is also used to: in response to an audio follow-up command, control the first terminal device to play the target audio at a preset volume and stop playing the currently playing audio.

[0100] The aforementioned device also includes a third instruction generation module, used to: respond to a trigger operation applied to the target virtual object, display the object information of the target virtual object, and control the generation of audio follow-up instructions.

[0101] The graphical user interface described above includes behavior control controls; the device also includes a behavior control module, used to: respond to trigger operations on the behavior control controls and control the controlled virtual object to perform the target behavior corresponding to the behavior control controls in the virtual scene.

[0102] The aforementioned behavior control module is also used to: respond to trigger operations on behavior control controls, determine the behavior interaction object at the preset position of the controlled virtual object; wherein the behavior interaction object is a virtual object located in the virtual scene; control the controlled virtual object to execute the target behavior corresponding to the behavior control control; the target behavior is associated with the behavior interaction object.

[0103] The aforementioned behavior control module is also used to: send a behavior interaction request to the terminal device corresponding to the behavior interaction object; in response to the confirmation information received from the behavior interaction request, control the controlled virtual object to execute the target behavior; and during the process of the controlled virtual object executing the target behavior, the behavior interaction object is controlled by the corresponding terminal device to execute the matching behavior of the target behavior.

[0104] The aforementioned object information includes: an invitation control that invites the terminal device of the target virtual object to play shared audio; the aforementioned device further includes: a first invitation module, used to send a first invitation request to the user account of the target virtual object in response to a trigger operation acting on the invitation control; wherein, the first invitation request is used to: invite the terminal device corresponding to the target virtual object to play the current audio played by the first terminal device; in response to the user account of the target virtual object confirming the first invitation request, displaying an information identifier; the information identifier indicates that the terminal devices of the target virtual object and the controlled virtual object are playing the current audio together.

[0105] The aforementioned object information includes: an information sending control; the aforementioned device further includes an information sending module, used to generate target information in response to an information editing operation; in response to a trigger operation acting on the information sending control, send the target information to the user account of the target virtual object, and display the target information in the graphical user interface.

[0106] The aforementioned device further includes a second invitation module, configured to: determine the current audio being played by the first terminal device in response to the controlled virtual object moving to a target location in the virtual scene; and send a second invitation request to the user account of the target virtual object located in the virtual scene in response to the invitation operation; wherein the target virtual object is: a virtual object in the virtual scene other than the controlled virtual object; and the second invitation request is used to: invite the terminal device corresponding to the target virtual object to play the current audio being played by the first terminal device.

[0107] The aforementioned device further includes a second identifier display module, configured to: display a third identifier in response to the distance between a first virtual object and a second virtual object in a virtual scene being less than a preset distance, and the user accounts corresponding to the first virtual object and the second virtual object sending information to each other; the third identifier indicates that the user accounts corresponding to the first virtual object and the second virtual object are sending information to each other; and display a fourth identifier in response to the distance between a first virtual object and a second virtual object in a virtual scene being less than a preset distance, and the terminal devices corresponding to the first virtual object and the second virtual object playing the same audio; the fourth identifier indicates that the terminal devices corresponding to the first virtual object and the second virtual object are playing the same audio; wherein, the first virtual object and the second virtual object are: virtual objects in the virtual scene other than the controlled virtual object.

[0108] The aforementioned device also includes a control display module for displaying audio operation controls on the scene screen; wherein the audio operation controls are used to control the audio currently being played by the first terminal device.

[0109] See Figure 10 The diagram shows a structural schematic of an interactive control device for playing audio, the device being mounted on a server; the device includes: The scene creation module 1000 is used to receive scene creation instructions from the first terminal device and create a virtual scene; wherein, the controlled virtual object is located in the virtual scene; the controlled virtual object is controlled through the first terminal device; The image sending module 1002 is used to send the scene image of the virtual scene to the first terminal device; The control providing module 1004 is used to provide an interface control for entering a virtual scene to a second terminal device other than the first terminal device, so as to control the target virtual object to enter the virtual scene through the interface control; in the virtual scene, in response to the controlled virtual object moving to the first specified position of the target virtual object, the first terminal device is controlled to display the audio playback information of the target virtual object; in response to the audio follow-up command, the first terminal device is controlled to play the target audio corresponding to the audio playback information.

[0110] The second terminal device meets one or more of the following conditions: the geographical location of the second terminal device and the geographical location of the first terminal device meet preset location conditions; the audio preferences of the user account corresponding to the second terminal device match the audio preferences of the user account corresponding to the first terminal device; the second terminal device receives an invitation message from the first terminal device to enter the virtual scene in advance.

[0111] This embodiment also provides an electronic device, including a processor and a memory. The memory stores machine-executable instructions that can be executed by the processor. The processor executes the machine-executable instructions to implement the above-described interactive control method for playing audio. This electronic device can be a server or a touch-screen terminal device.

[0112] See Figure 11 As shown, the electronic device includes a processor 100 and a memory 101. The memory 101 stores machine-executable instructions that can be executed by the processor 100. The processor 100 executes the machine-executable instructions to implement the above-described interactive control method for playing audio.

[0113] Furthermore, Figure 11 The electronic device shown also includes a bus 102 and a communication interface 103, with the processor 100, the communication interface 103 and the memory 101 connected via the bus 102.

[0114] The memory 101 may include high-speed random access memory (RAM) and may also include non-volatile memory, such as at least one disk storage device. Communication between this system network element and at least one other network element is achieved through at least one communication interface 103 (which can be wired or wireless), such as the Internet, wide area network, local area network, metropolitan area network, etc. The bus 102 may be an ISA bus, PCI bus, or EISA bus, etc. The bus can be divided into address bus, data bus, control bus, etc. For ease of representation, Figure 11 The symbol is represented by a single double-headed arrow, but this does not mean that there is only one bus or one type of bus.

[0115] Processor 100 may be an integrated circuit chip with signal processing capabilities. In implementation, each step of the above method can be completed by the integrated logic circuitry in the hardware of processor 100 or by instructions in software form. Processor 100 may be a general-purpose processor, including a Central Processing Unit (CPU), a Network Processor (NP), etc.; it may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field-Programmable Gate Array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. It can implement or execute the methods, steps, and logic block diagrams disclosed in the embodiments of this invention. The general-purpose processor may be a microprocessor or any conventional processor. The steps of the methods disclosed in the embodiments of this invention can be directly manifested as execution by a hardware decoding processor, or execution by a combination of hardware and software modules in the decoding processor. The software module can reside in a readily available storage medium in the art, such as random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, or registers. This storage medium is located in memory 101, and the processor 100 reads the information from memory 101 and, in conjunction with its hardware, completes the steps of the method described in the foregoing embodiments.

[0116] The processor in the aforementioned electronic device, by executing machine-executable instructions, can perform the following operations in the aforementioned interactive audio playback control method: A graphical user interface is provided through a first terminal device; the graphical user interface includes a scene screen of a virtual scene; a controlled virtual object is located in the virtual scene; the controlled virtual object is controlled through the first terminal device; in response to a movement control operation, the controlled virtual object is controlled to move in the virtual scene; in response to the controlled virtual object moving to a first specified position of a target virtual object, audio playback information of the target virtual object is displayed; wherein, the target virtual object is located in the virtual scene and is controlled through a second terminal device; in response to an audio follow-up command, the first terminal device is controlled to play the target audio corresponding to the audio playback information.

[0117] In response to a trigger operation targeting the first scene location in the virtual scene, control the controlled virtual object to move from its current location to the first scene location.

[0118] Respond to the triggered operation for the first scene position in the virtual scene, determine the preset object behavior for the first scene position; control the controlled virtual object to move from the current position to the first scene position, and control the controlled virtual object to perform object behavior at the first scene position.

[0119] In response to a trigger operation targeting a first scene location in a virtual scene, determine the preset associated dynamic element for the first scene location; wherein the associated dynamic element is located at the first scene location, or at an associated location of the first scene location; control the controlled virtual object to move from its current location to the first scene location; and control the associated dynamic element to change its display state according to the current audio played by the first terminal device.

[0120] The audio playback information includes: the target audio played by the second terminal device corresponding to the target virtual object, and the playback control that controls the first terminal device to play the target audio; in response to the trigger operation of the playback control, the audio follow-up command is generated.

[0121] Display a first identifier indicating that the first terminal device is playing the target audio; and / or display a second identifier indicating that the terminal devices corresponding to the controlled virtual object and the target virtual object are playing the target audio together.

[0122] In response to the controlled virtual object moving to a second specified position of the target virtual object, an audio follow-up command is generated; wherein the second specified position includes the first specified position, or a position other than the first specified position.

[0123] The second designated location includes locations other than the first designated location; in response to the controlled virtual object moving from the first designated location to the second designated location of the target virtual object, an audio follow-up command is generated.

[0124] The distance between the second designated position and the target virtual object is less than the distance between the first designated position and the target virtual object; in response to the controlled virtual object moving from the first designated position to the second designated position of the target virtual object, the volume of the target audio is gradually increased, and the volume of the currently playing audio on the first terminal device is gradually decreased; in response to the audio follow-up command, the step of controlling the first terminal device to play the target audio corresponding to the audio playback information includes: in response to the audio follow-up command, controlling the first terminal device to play the target audio at a preset volume, and stopping the playback of the currently playing audio.

[0125] In response to a trigger operation applied to the target virtual object, display the object information of the target virtual object, and control the generation of audio and listening commands.

[0126] The graphical user interface includes behavior control controls; responding to trigger operations on the behavior control controls, the controlled virtual object executes the target behavior corresponding to the behavior control control in the virtual scene.

[0127] In response to a trigger operation on a behavior control control, determine the behavior interaction object at a preset position of the controlled virtual object; wherein, the behavior interaction object is a virtual object located in the virtual scene; control the controlled virtual object to execute the target behavior corresponding to the behavior control control; the target behavior is associated with the behavior interaction object.

[0128] Send a behavior interaction request to the terminal device corresponding to the behavior interaction object; in response to the confirmation information received from the behavior interaction request, control the controlled virtual object to execute the target behavior; during the process of the controlled virtual object executing the target behavior, the behavior interaction object is controlled by the corresponding terminal device to execute the matching behavior of the target behavior.

[0129] The object information includes: an invitation control that invites the target virtual object's terminal device to play shared audio; in response to a trigger operation on the invitation control, a first invitation request is sent to the target virtual object's user account; wherein, the first invitation request is used to: invite the terminal device corresponding to the target virtual object to play the current audio played by the first terminal device; in response to the target virtual object's user account confirming the first invitation request, an information identifier is displayed; the information identifier indicates that the target virtual object and the controlled virtual object's terminal devices are playing the current audio together.

[0130] The object information includes: an information sending control; generating target information in response to information editing operations; sending target information to the user account of the target virtual object in response to a trigger operation applied to the information sending control, and displaying the target information in the graphical user interface.

[0131] In response to the controlled virtual object moving to a target location in the virtual scene, the current audio being played by the first terminal device is determined; in response to the invitation operation, a second invitation request is sent to the user account of the target virtual object located in the virtual scene; wherein, the target virtual object is: a virtual object in the virtual scene other than the controlled virtual object; the second invitation request is used to: invite the terminal device corresponding to the target virtual object to play the current audio being played by the first terminal device.

[0132] In response to the distance between the first virtual object and the second virtual object in the virtual scene being less than a preset distance, and the user accounts corresponding to the first virtual object and the second virtual object sending information to each other, a third identifier is displayed; the third identifier indicates that the user accounts corresponding to the first virtual object and the second virtual object are sending information to each other; in response to the distance between the first virtual object and the second virtual object in the virtual scene being less than a preset distance, and the terminal devices corresponding to the first virtual object and the second virtual object playing the same audio, a fourth identifier is displayed; the fourth identifier indicates that the terminal devices corresponding to the first virtual object and the second virtual object are playing the same audio; wherein, the first virtual object and the second virtual object are: virtual objects in the virtual scene other than the controlled virtual object.

[0133] Audio operation controls are displayed on the scene screen; the audio operation controls are used to control the audio currently being played on the first terminal device.

[0134] The system receives a scene creation command from a first terminal device and establishes a virtual scene. A controlled virtual object resides within the virtual scene. The controlled virtual object is controlled via the first terminal device. Scene images of the virtual scene are sent to the first terminal device. An interface control for entering the virtual scene is provided to a second terminal device (other than the first terminal device), allowing the target virtual object to enter the virtual scene via the interface control. Within the virtual scene, in response to the controlled virtual object moving to a first designated position of the target virtual object, the system controls the first terminal device to display audio playback information of the target virtual object. In response to an audio follow-up command, the system controls the first terminal device to play the target audio corresponding to the audio playback information.

[0135] The second terminal device meets one or more of the following conditions: the geographical location of the second terminal device and the geographical location of the first terminal device meet preset location conditions; the audio preferences of the user account corresponding to the second terminal device match the audio preferences of the user account corresponding to the first terminal device; the second terminal device has received an invitation message from the first terminal device to enter the virtual scene in advance.

[0136] In the above method, user-controlled virtual objects are set in a virtual scene. Through the interaction between virtual objects, shared interaction of audio playback is realized. The interaction between users is richer and closer, which improves the immersion of user interaction in the audio playback scene.

[0137] This embodiment also provides a machine-readable storage medium storing machine-executable instructions. When the machine-executable instructions are called and executed by a processor, the machine-executable instructions cause the processor to implement the above-described interactive control method for playing audio.

[0138] The machine-executable instructions stored in the aforementioned machine-readable storage medium can be executed to perform the following operations in the aforementioned interactive audio playback control method: A graphical user interface is provided through a first terminal device; the graphical user interface includes a scene screen of a virtual scene; a controlled virtual object is located in the virtual scene; the controlled virtual object is controlled through the first terminal device; in response to a movement control operation, the controlled virtual object is controlled to move in the virtual scene; in response to the controlled virtual object moving to a first specified position of a target virtual object, audio playback information of the target virtual object is displayed; wherein, the target virtual object is located in the virtual scene and is controlled through a second terminal device; in response to an audio follow-up command, the first terminal device is controlled to play the target audio corresponding to the audio playback information.

[0139] In response to a trigger operation targeting the first scene location in the virtual scene, control the controlled virtual object to move from its current location to the first scene location.

[0140] Respond to the triggered operation for the first scene position in the virtual scene, determine the preset object behavior for the first scene position; control the controlled virtual object to move from the current position to the first scene position, and control the controlled virtual object to perform object behavior at the first scene position.

[0141] In response to a trigger operation targeting a first scene location in a virtual scene, determine the preset associated dynamic element for the first scene location; wherein the associated dynamic element is located at the first scene location, or at an associated location of the first scene location; control the controlled virtual object to move from its current location to the first scene location; and control the associated dynamic element to change its display state according to the current audio played by the first terminal device.

[0142] The audio playback information includes: the target audio played by the second terminal device corresponding to the target virtual object, and the playback control that controls the first terminal device to play the target audio; in response to the trigger operation of the playback control, the audio follow-up command is generated.

[0143] Display a first identifier indicating that the first terminal device is playing the target audio; and / or display a second identifier indicating that the terminal devices corresponding to the controlled virtual object and the target virtual object are playing the target audio together.

[0144] In response to the controlled virtual object moving to a second specified position of the target virtual object, an audio follow-up command is generated; wherein the second specified position includes the first specified position, or a position other than the first specified position.

[0145] The second designated location includes locations other than the first designated location; in response to the controlled virtual object moving from the first designated location to the second designated location of the target virtual object, an audio follow-up command is generated.

[0146] The distance between the second designated position and the target virtual object is less than the distance between the first designated position and the target virtual object; in response to the controlled virtual object moving from the first designated position to the second designated position of the target virtual object, the volume of the target audio is gradually increased, and the volume of the currently playing audio on the first terminal device is gradually decreased; in response to the audio follow-up command, the step of controlling the first terminal device to play the target audio corresponding to the audio playback information includes: in response to the audio follow-up command, controlling the first terminal device to play the target audio at a preset volume, and stopping the playback of the currently playing audio.

[0147] In response to a trigger operation applied to the target virtual object, display the object information of the target virtual object, and control the generation of audio and listening commands.

[0148] The graphical user interface includes behavior control controls; responding to trigger operations on the behavior control controls, the controlled virtual object executes the target behavior corresponding to the behavior control control in the virtual scene.

[0149] In response to a trigger operation on a behavior control control, determine the behavior interaction object at a preset position of the controlled virtual object; wherein, the behavior interaction object is a virtual object located in the virtual scene; control the controlled virtual object to execute the target behavior corresponding to the behavior control control; the target behavior is associated with the behavior interaction object.

[0150] Send a behavior interaction request to the terminal device corresponding to the behavior interaction object; in response to the confirmation information received from the behavior interaction request, control the controlled virtual object to execute the target behavior; during the process of the controlled virtual object executing the target behavior, the behavior interaction object is controlled by the corresponding terminal device to execute the matching behavior of the target behavior.

[0151] The object information includes: an invitation control that invites the target virtual object's terminal device to play shared audio; in response to a trigger operation on the invitation control, a first invitation request is sent to the target virtual object's user account; wherein, the first invitation request is used to: invite the terminal device corresponding to the target virtual object to play the current audio played by the first terminal device; in response to the target virtual object's user account confirming the first invitation request, an information identifier is displayed; the information identifier indicates that the target virtual object and the controlled virtual object's terminal devices are playing the current audio together.

[0152] The object information includes: an information sending control; generating target information in response to information editing operations; sending target information to the user account of the target virtual object in response to a trigger operation applied to the information sending control, and displaying the target information in the graphical user interface.

[0153] In response to the controlled virtual object moving to a target location in the virtual scene, the current audio being played by the first terminal device is determined; in response to the invitation operation, a second invitation request is sent to the user account of the target virtual object located in the virtual scene; wherein, the target virtual object is: a virtual object in the virtual scene other than the controlled virtual object; the second invitation request is used to: invite the terminal device corresponding to the target virtual object to play the current audio being played by the first terminal device.

[0154] In response to the distance between the first virtual object and the second virtual object in the virtual scene being less than a preset distance, and the user accounts corresponding to the first virtual object and the second virtual object sending information to each other, a third identifier is displayed; the third identifier indicates that the user accounts corresponding to the first virtual object and the second virtual object are sending information to each other; in response to the distance between the first virtual object and the second virtual object in the virtual scene being less than a preset distance, and the terminal devices corresponding to the first virtual object and the second virtual object playing the same audio, a fourth identifier is displayed; the fourth identifier indicates that the terminal devices corresponding to the first virtual object and the second virtual object are playing the same audio; wherein, the first virtual object and the second virtual object are: virtual objects in the virtual scene other than the controlled virtual object.

[0155] Audio operation controls are displayed on the scene screen; the audio operation controls are used to control the audio currently being played on the first terminal device.

[0156] The system receives a scene creation command from a first terminal device and establishes a virtual scene. A controlled virtual object resides within the virtual scene. The controlled virtual object is controlled via the first terminal device. Scene images of the virtual scene are sent to the first terminal device. An interface control for entering the virtual scene is provided to a second terminal device (other than the first terminal device), allowing the target virtual object to enter the virtual scene via the interface control. Within the virtual scene, in response to the controlled virtual object moving to a first designated position of the target virtual object, the system controls the first terminal device to display audio playback information of the target virtual object. In response to an audio follow-up command, the system controls the first terminal device to play the target audio corresponding to the audio playback information.

[0157] The second terminal device meets one or more of the following conditions: the geographical location of the second terminal device and the geographical location of the first terminal device meet preset location conditions; the audio preferences of the user account corresponding to the second terminal device match the audio preferences of the user account corresponding to the first terminal device; the second terminal device has received an invitation message from the first terminal device to enter the virtual scene in advance.

[0158] In the above method, user-controlled virtual objects are set in a virtual scene. Through the interaction between virtual objects, shared interaction of audio playback is realized. The interaction between users is richer and closer, which improves the immersion of user interaction in the audio playback scene.

[0159] The computer program products of the interactive control method, apparatus and electronic device for playing audio provided in the embodiments of the present invention include a computer-readable storage medium storing program code. The instructions included in the program code can be used to execute the methods described in the preceding method embodiments. For specific implementation, please refer to the method embodiments, which will not be repeated here.

[0160] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working process of the system and apparatus described above can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0161] Furthermore, in the description of the embodiments of the present invention, unless otherwise explicitly specified and limited, the terms "installation," "connection," and "linking" should be interpreted broadly. For example, they can refer to a fixed connection, a detachable connection, or an integral connection; they can refer to a mechanical connection or an electrical connection; they can refer to a direct connection or an indirect connection through an intermediate medium; and they can refer to the internal connection of two components. Those skilled in the art can understand the specific meaning of the above terms in the present invention based on the specific circumstances.

[0162] If the aforementioned functions are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this invention, essentially, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0163] In the description of this invention, it should be noted that the terms "center," "upper," "lower," "left," "right," "vertical," "horizontal," "inner," and "outer," etc., indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings. They are used only for the convenience of describing the invention and for simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, they should not be construed as limitations on the invention. Furthermore, the terms "first," "second," and "third" are used for descriptive purposes only and should not be construed as indicating or implying relative importance.

[0164] Finally, it should be noted that the above embodiments are merely specific implementations of the present invention, used to illustrate the technical solutions of the present invention, and not to limit it. The scope of protection of the present invention is not limited thereto. Although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that any person skilled in the art can still modify or easily conceive of changes to the technical solutions described in the foregoing embodiments within the technical scope disclosed in the present invention, or make equivalent substitutions for some of the technical features; and these modifications, changes, or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention, and should all be covered within the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be determined by the scope of the claims.

Claims

1. An interactive control method for playing audio, characterized in that, A graphical user interface is provided through a first terminal device; the graphical user interface includes scene images of a virtual scene; The controlled virtual object is located in the virtual scene; The controlled virtual object is controlled through the first terminal device; the method includes: In response to a movement control operation, the controlled virtual object is moved within the virtual scene; In response to the controlled virtual object moving to a first designated position of the target virtual object, audio playback information of the target virtual object is displayed; wherein the target virtual object is located in the virtual scene, and the target virtual object is controlled through a second terminal device; In response to the controlled virtual object moving from the first designated position to the second designated position of the target virtual object, the volume of the target audio is gradually increased, and the volume of the currently playing audio on the first terminal device is gradually decreased; wherein, the distance between the second designated position and the target virtual object is less than the distance between the first designated position and the target virtual object; In response to the controlled virtual object moving to the second designated position, an audio tracking command is generated. In response to an audio follow-up command, the first terminal device is controlled to play the target audio corresponding to the audio playback information; the step of controlling the first terminal device to play the target audio corresponding to the audio playback information in response to the audio follow-up command includes: in response to the audio follow-up command, controlling the first terminal device to play the target audio at a preset volume, and stopping the playback of the currently playing audio.

2. The method according to claim 1, characterized in that, The step of controlling the movement of the controlled virtual object in the virtual scene in response to a movement control operation includes: In response to a trigger operation targeting a first scene location in the virtual scene, the controlled virtual object is controlled to move from its current location to the first scene location.

3. The method according to claim 2, characterized in that, The step of responding to a trigger operation targeting a first scene location in the virtual scene and controlling the controlled virtual object to move from its current location to the first scene location includes: In response to a trigger operation targeting a first scene location in the virtual scene, determine a preset object behavior for the first scene location; Control the controlled virtual object to move from its current position to the first scene position, and control the controlled virtual object to perform the object behavior at the first scene position.

4. The method according to claim 2, characterized in that, The step of responding to a trigger operation targeting a first scene location in the virtual scene and controlling the controlled virtual object to move from its current location to the first scene location includes: In response to a trigger operation targeting a first scene location in the virtual scene, a preset associated dynamic element for the first scene location is determined; wherein the associated dynamic element is located at the first scene location, or at an associated location of the first scene location; Control the controlled virtual object to move from its current position to the first scene position; Based on the current audio being played by the first terminal device, the display state of the associated dynamic elements is controlled to change.

5. The method according to claim 1, characterized in that, The audio playback information includes: the target audio played by the second terminal device corresponding to the target virtual object, and the playback control that controls the first terminal device to play the target audio; Before the step of controlling the first terminal device to play the target audio corresponding to the audio playback information in response to the audio listening command, the method further includes: In response to a trigger operation on the playback control, the audio follow-up command is generated.

6. The method according to claim 1, characterized in that, After the step of controlling the first terminal device to play the target audio corresponding to the audio playback information in response to the audio listening command, the method further includes: A first identifier is displayed, indicating that the first terminal device is playing the target audio. And / or, display a second identifier, the second identifier indicating that the controlled virtual object and the terminal device corresponding to the target virtual object are jointly playing the target audio.

7. The method according to claim 1, characterized in that, Before the step of controlling the first terminal device to play the target audio corresponding to the audio playback information in response to an audio listening command, the method includes: In response to a trigger operation applied to the target virtual object, the object information of the target virtual object is displayed, and the audio follow-up command is generated.

8. The method according to claim 1, characterized in that, The graphical user interface includes behavior control controls; the method further includes: In response to a trigger operation on the behavior control control, the controlled virtual object is controlled to perform the target behavior corresponding to the behavior control control in the virtual scene.

9. The method according to claim 8, characterized in that, The steps of responding to a trigger operation on the behavior control control and controlling the controlled virtual object to perform the target behavior corresponding to the behavior control control in the virtual scene include: In response to a trigger operation on the behavior control control, a behavior interaction object is determined at a preset position of the controlled virtual object; wherein, the behavior interaction object is a virtual object located in the virtual scene; The controlled virtual object is controlled to execute the target behavior corresponding to the behavior control control; the target behavior is associated with the behavior interaction object.

10. The method according to claim 9, characterized in that, The steps of controlling the controlled virtual object to execute the target behavior corresponding to the behavior control control include: Send a behavior interaction request to the terminal device corresponding to the behavior interaction object; In response to receiving confirmation information for the behavior interaction request, the controlled virtual object is controlled to execute the target behavior; during the execution of the target behavior by the controlled virtual object, the behavior interaction object is controlled by the corresponding terminal device to execute the matching behavior of the target behavior.

11. The method according to claim 7, characterized in that, The object information includes: an invitation control that invites the terminal device of the target virtual object to play a shared audio; The method further includes: In response to a triggering operation applied to the invitation control, a first invitation request is sent to the user account of the target virtual object; wherein, the first invitation request is used to: invite the terminal device corresponding to the target virtual object to play the currently played audio on the first terminal device; In response to the user account confirmation of the first invitation request of the target virtual object, an information identifier is displayed; the information identifier indicates that the terminal devices of the target virtual object and the controlled virtual object play the current audio together.

12. The method according to claim 7, characterized in that, The object information includes: an information sending control; the method further includes: In response to information editing operations, generate the target information; In response to a trigger operation applied to the information sending control, the target information is sent to the user account of the target virtual object and displayed in the graphical user interface.

13. The method according to claim 1, characterized in that, The method further includes: In response to the controlled virtual object moving to the target position in the virtual scene, the current audio being played by the first terminal device is determined; In response to the invitation operation, a second invitation request is sent to the user account of the target virtual object located in the virtual scene; wherein, the target virtual object is: a virtual object in the virtual scene other than the controlled virtual object; the second invitation request is used to: invite the terminal device corresponding to the target virtual object to play the current audio played by the first terminal device.

14. The method according to claim 1, characterized in that, The method further includes: In response to the distance between the first virtual object and the second virtual object in the virtual scene being less than a preset distance, and information being sent between the user accounts corresponding to the first virtual object and the second virtual object, a third identifier is displayed; the third identifier indicates that information is being sent between the user accounts corresponding to the first virtual object and the second virtual object. In response to the distance between the first virtual object and the second virtual object in the virtual scene being less than a preset distance, and the terminal devices corresponding to the first virtual object and the second virtual object playing the same audio, a fourth identifier is displayed; the fourth identifier indicates that the terminal devices corresponding to the first virtual object and the second virtual object are playing the same audio; Wherein, the first virtual object and the second virtual object are: virtual objects in the virtual scene other than the controlled virtual object.

15. The method according to claim 1, characterized in that, The method further includes: An audio operation control is displayed on the scene screen; wherein the audio operation control is used to control the audio currently being played by the first terminal device.

16. An interactive control method for playing audio, characterized in that, The method is applied to a server; the method includes: A scene creation instruction is received from a first terminal device to create a virtual scene; wherein a controlled virtual object is located in the virtual scene; the controlled virtual object is controlled through the first terminal device. Send the scene image of the virtual scene to the first terminal device; An interface control is provided to a second terminal device other than the first terminal device to enter the virtual scene, so as to control a target virtual object to enter the virtual scene through the interface control; in the virtual scene, in response to the controlled virtual object moving to a first designated position of the target virtual object, the first terminal device is controlled to display the audio playback information of the target virtual object; in response to the controlled virtual object moving from the first designated position to a second designated position of the target virtual object, the volume of the target audio is controlled to gradually increase, and the volume of the currently playing audio on the first terminal device is controlled to gradually decrease; wherein, the distance between the second designated position and the target virtual object is less than the distance between the first designated position and the target virtual object; in response to the controlled virtual object moving to the second designated position, an audio follow-up command is generated; in response to the audio follow-up command, the first terminal device is controlled to play the target audio corresponding to the audio playback information; the step of controlling the first terminal device to play the target audio corresponding to the audio playback information in response to the audio follow-up command includes: in response to the audio follow-up command, controlling the first terminal device to play the target audio at a preset volume, and stopping the playback of the currently playing audio.

17. The method according to claim 16, characterized in that, The second terminal device meets one or more of the following conditions: The geographical locations of the second terminal device and the first terminal device meet preset location conditions; The audio preferences of the user account corresponding to the second terminal device match the audio preferences of the user account corresponding to the first terminal device; The second terminal device receives in advance an invitation from the first terminal device to enter the virtual scene.

18. An interactive control device for playing audio, characterized in that, A graphical user interface is provided through a first terminal device; the graphical user interface includes scene images of a virtual scene; The controlled virtual object is located in the virtual scene; The controlled virtual object is controlled through the first terminal device; the device includes: The motion control module is used to control the movement of the controlled virtual object in the virtual scene in response to a motion control operation; An information display module is used to display audio playback information of the target virtual object in response to the controlled virtual object moving to a first designated position of the target virtual object; wherein the target virtual object is located in the virtual scene and is controlled by a second terminal device; The instruction generation module is used to respond to the controlled virtual object moving from the first designated position to the second designated position of the target virtual object, control the generation of an audio follow-up instruction, control the volume of the target audio to gradually increase, and control the volume of the currently playing audio on the first terminal device to gradually decrease; wherein, the distance between the second designated position and the target virtual object is less than the distance between the first designated position and the target virtual object; An audio playback module is used to control the first terminal device to play the target audio corresponding to the audio playback information in response to an audio follow-up command; specifically, the audio playback module is used to: control the first terminal device to play the target audio at a preset volume in response to an audio follow-up command, and stop playing the currently playing audio.

19. An interactive control device for playing audio, characterized in that, The device is located on the server; the device includes: A scene creation module is used to receive a scene creation instruction from a first terminal device and create a virtual scene; wherein a controlled virtual object is located in the virtual scene; the controlled virtual object is controlled through the first terminal device; The image sending module is used to send the scene image of the virtual scene to the first terminal device; A control providing module is used to provide an interface control to a second terminal device other than the first terminal device to enter the virtual scene, so as to control a target virtual object to enter the virtual scene through the interface control; in the virtual scene, in response to the controlled virtual object moving to a first designated position of the target virtual object, the first terminal device is controlled to display the audio playback information of the target virtual object; in response to the controlled virtual object moving from the first designated position to a second designated position of the target virtual object, an audio follow-up command is generated, controlling the volume of the target audio to gradually increase and the volume of the currently playing audio on the first terminal device to gradually decrease; wherein, the distance between the second designated position and the target virtual object is less than the distance between the first designated position and the target virtual object; in response to the audio follow-up command, the first terminal device is controlled to play the target audio corresponding to the audio playback information; the step of controlling the first terminal device to play the target audio corresponding to the audio playback information in response to the audio follow-up command includes: in response to the audio follow-up command, controlling the first terminal device to play the target audio at a preset volume and stopping the playback of the currently playing audio.

20. An electronic device, characterized in that, The device includes a processor and a memory, the memory storing machine-executable instructions that can be executed by the processor, the processor executing the machine-executable instructions to implement the interactive control method for playing audio as described in any one of claims 1-15, or to implement the interactive control method for playing audio as described in claim 16 or 17.

21. A machine-readable storage medium, characterized in that, The machine-readable storage medium stores machine-executable instructions, which, when invoked and executed by a processor, cause the processor to implement the interactive control method for playing audio as described in any one of claims 1-15, or to implement the interactive control method for playing audio as described in claim 16 or 17.

Images