Interaction method and device in real-time communication, storage medium and electronic equipment

Abstract

The application discloses an interactive method and device in real-time communication, a storage medium and an electronic device. The method comprises the following steps: displaying a video picture; wherein a first object in the video picture is controlled by a player account; an object control instruction corresponding to a spectator account is acquired; and the control right of the first object is obtained based on the object control instruction. The application solves the technical problem of low interactive efficiency in real-time communication.

Description

Technical Field

[0001] This invention relates to the field of computers, and more specifically, to an interactive method and apparatus, storage medium and electronic device for real-time communication. Background Technology

[0002] Currently, real-time communication typically incorporates various interactive elements to enhance its interactive effect. For example, in live streaming, viewers can interact with the streamer through games to improve the overall interaction between them.

[0003] However, viewers, as those watching the streamer's game, can only communicate with the streamer in real time through inefficient methods such as commenting or sending gifts. Therefore, existing technologies suffer from low efficiency in real-time communication.

[0004] There is currently no effective solution to the above problems. Summary of the Invention

[0005] This invention provides an interaction method and apparatus, storage medium and electronic device for real-time communication, to at least solve the technical problem of low interaction efficiency in real-time communication.

[0006] According to one aspect of the present invention, an interactive method in real-time communication is provided, comprising: displaying a video frame; wherein a first object in the video frame is controlled by a player account; obtaining an object control instruction corresponding to a viewer account; and obtaining control over the first object based on the object control instruction.

[0007] According to one aspect of the present invention, an interactive device for real-time communication is also provided, comprising: a display unit for displaying a video frame; wherein a first object in the video frame is controlled by a player account; a first acquisition unit for acquiring object control instructions corresponding to a viewer account; and a second acquisition unit for acquiring control rights over the first object based on the object control instructions.

[0008] As an optional solution, the above-mentioned device further includes: a third acquisition unit 602, configured to acquire an influence command for the second object after the video frame is displayed; wherein the influence command is used to assist and / or influence the movement of the second object, wherein the second object is an object in the video frame.

[0009] As an optional solution, the above-mentioned display unit includes: a first display module, used to display the video screen of the player account in the viewing interface of the above-mentioned viewer account; the above-mentioned first acquisition unit includes: an acquisition module, used to acquire target interaction information input by the above-mentioned viewer account in the interaction area of ​​the above-mentioned viewing interface, wherein the above-mentioned interaction area is used to display the interaction information of each account; and a generation module, used to generate the above-mentioned object control instructions corresponding to the above-mentioned target interaction information.

[0010] As an optional solution, the acquisition module includes: a first display submodule, configured to display first interactive information input by the audience account in an input sub-area in response to an input trigger operation performed on the interactive area, wherein the input sub-area is an area for receiving the audience account input information; a second display submodule, configured to display instruction prompt information when the first interactive information matches target interactive information in the interactive information template, wherein the instruction prompt information is used to confirm the conversion of the first interactive information into the target interactive information; and an acquisition submodule, configured to acquire the target interactive information in response to an instruction confirmation operation performed on the instruction prompt information.

[0011] As an optional solution, the device further includes: a determining module, configured to determine the amount of virtual resources spent on the target interaction information after obtaining the target interaction information entered by the viewer account in the interaction area of ​​the viewing interface, wherein the instruction parameter includes the amount of the virtual resources; and a generating module, comprising: an adding submodule, configured to add a parameter identifier indicating the amount of the virtual resources to the object control instruction.

[0012] As an optional solution, the above-mentioned device further includes: a second display module, used to display game interaction controls in the interaction area of ​​the viewing interface before generating the object control instructions corresponding to the target interaction information, wherein the game interaction controls are interaction controls that match the operation controls for controlling the first object in the target game; the generation module includes: a generation submodule, used to generate the object control instructions corresponding to the game interaction controls in response to the trigger operation performed by the viewer account on the game interaction controls.

[0013] As an optional embodiment, the above-mentioned device further includes at least one of the following: a first control unit, configured to, after obtaining control of the first object based on the object control command, control the first object to adjust from an initial position to a target position when the object control command instructs an operation to adjust the position of the first object; a second control unit, configured to, after obtaining control of the first object based on the object control command, control the first object to perform a target action when the object control command instructs an action control operation to be performed on the first object; and a third control unit, configured to, after obtaining control of the first object based on the object control command, add a game screen of the third object to the video screen when the object control command instructs an addition of a third object to the target game.

[0014] According to another aspect of the present invention, a computer-readable storage medium is also provided, wherein a computer program is stored therein, wherein the computer program is configured to execute the interaction method in the above-described real-time communication at runtime.

[0015] According to another aspect of the present invention, an electronic device is also provided, including a memory and a processor, wherein the memory stores a computer program and the processor is configured to execute the interaction method in the real-time communication described above through the computer program.

[0016] In this embodiment of the invention, a video frame is displayed; wherein, the first object in the video frame is controlled by a player account; an object control instruction corresponding to a viewer account is obtained; based on the object control instruction, control over the first object is obtained; and the first object controlled by the player account is controlled by the object control instruction initiated by the viewer account, thereby achieving the goal of the viewer account participating in the control of the first object and improving the viewer account's sense of participation in the game being played during real-time communication with the player account. This achieves the technical effect of improving the interaction efficiency in real-time communication, and thus solves the technical problem of low interaction efficiency in real-time communication. Attached Figure Description

[0017] The accompanying drawings, which are included to provide a further understanding of the invention and form part of this application, illustrate exemplary embodiments of the invention and, together with their description, serve to explain the invention and do not constitute an undue limitation thereof. In the drawings:

[0018] Figure 1 This is a schematic diagram of an application environment for an optional real-time communication interaction method according to an embodiment of the present invention.

[0019] Figure 2This is a flowchart illustrating an optional real-time communication interaction method according to an embodiment of the present invention.

[0020] Figure 3 This is a flowchart illustrating an optional real-time communication interaction method according to an embodiment of the present invention.

[0021] Figure 4 This is an interactive diagram of an optional real-time communication according to an embodiment of the present invention;

[0022] Figure 5 This is a schematic diagram of the structure of an optional interactive device in real-time communication according to an embodiment of the present invention.

[0023] Figure 6 This is a schematic diagram of the structure of an alternative interactive device in real-time communication according to an embodiment of the present invention;

[0024] Figure 7 This is a schematic diagram of the structure of an optional electronic device according to an embodiment of the present invention. Detailed Implementation

[0025] To enable those skilled in the art to better understand the present invention, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of the present invention.

[0026] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of the invention described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0027] According to one aspect of the present invention, an interaction method in real-time communication is provided, which is widely used in live streaming scenarios. Optionally, in this embodiment, the above-mentioned interaction method in real-time communication can be applied to, for example... Figure 1The hardware environment shown consists of viewing terminal 102 and target terminal 104. Figure 1 As shown, the viewing terminal 102 connects to the target terminal 104 via a network. Optionally, the network connection is not limited to being implemented through the server of a live streaming application and / or a game application. The server is used to provide a server for running real-time communication applications and / or game applications. A database can be set up on the server or independently of the server to provide data storage services for the server. Cloud computing and / or edge computing services can be configured on the server or independently of the server to provide data processing services for the server.

[0028] The interactive application in the aforementioned real-time communication is implemented in the viewing terminal 102 and the target terminal 104, but is not limited to the execution of S102 to S106 sequentially by the viewing terminal 102 and the execution of S112 to S116 sequentially by the target terminal 104. The viewing terminal 102 initiates a real-time communication request via the network. Upon receiving the real-time communication request, the target terminal 104 pushes the player's video feed to the viewer's account. The player's video feed includes the game screen of the target game associated with the player's account, and the first object in the target game is controlled by the second user corresponding to the player's account.

[0029] The target terminal 104 pushes video footage to the viewing terminal 102, which is logged into a viewer account, via the network. Upon receiving the video footage, the viewing terminal 102 displays the player's video footage on the viewer account's viewing interface. The target terminal 104 then acquires object control instructions. These instructions, which are used to instruct a first object in the target game to perform a target operation, are obtained from the viewing interface. The target terminal 104 receives the object control instructions. Upon receiving the object control instructions, the target terminal 104 determines the game execution instruction to be executed based on the instruction parameters. If the object control instructions are determined to be game execution instructions, the target terminal 104 acquires and pushes the target game footage in response. The target game footage generated by controlling the first object to perform the target operation in the target game is acquired and pushed to the viewer account. Finally, the target game footage is pushed to the viewing terminal 102 via the network, and upon receiving it, the viewing terminal 102 displays the target game footage.

[0030] The aforementioned network may include, but is not limited to, at least one of the following: wired network, wireless network. The aforementioned wired network may include, but is not limited to, at least one of the following: wide area network, metropolitan area network, local area network. The aforementioned wireless network may include, but is not limited to, at least one of the following: Wi-Fi (Wireless Fidelity), Bluetooth. The viewing terminal 102 and the target terminal 104 are not limited to any terminal device such as a PC, mobile phone, or tablet computer that can run applications with live streaming capabilities and games.

[0031] As an optional implementation method, such as Figure 2 As shown, the interaction methods in the above real-time communication include:

[0032] S202, Display video feed; the first object in the video feed is controlled by the player's account;

[0033] S204, Obtain the object control command corresponding to the audience account;

[0034] S206, based on object control instructions, obtains control over the first object.

[0035] Viewer accounts and player accounts are not limited to user accounts within the same account group. The account group is not limited to a virtual account group built based on real-time communication; it includes at least viewer accounts and player accounts, and may also include other user accounts. During real-time communication between viewer accounts and player accounts, this includes, but is not limited to, viewer accounts initiating real-time communication requests with player accounts. In real-time communication scenarios, player accounts are not limited to initiating video sharing to share gameplay footage of the target game with viewer accounts.

[0036] Taking a live streaming scenario as an example of real-time communication, the live streaming room is not limited to the virtual live streaming room assigned to a player account by the live streaming server when the player account initiates a live streaming request based on the target terminal, or the virtual live streaming room bound to the player account on the live streaming server. In the live streaming room, all accounts other than the player account are viewing accounts, and the viewer account is not limited to any viewing account currently located in the live streaming room.

[0037] The video feed may be displayed on the viewing interface, but is not limited to. The first object may be, but is not limited to, a virtual object in the target game controlled by the player's account. The first object may also be an object in the live stream scene whose changes can be controlled by the player's account; for example, the first object may be the streamer's cup in the live stream scene, but it is not limited to these.

[0038] The game screen displayed on the viewing interface is the game screen of the target game associated with the player's account. The target game can be a game related to an instant messaging application, or it can be another game not related to an instant messaging application. The target game associated with the player's account can be a game associated with the player's account at the terminal level, such as a game running on the target terminal where the player's account is logged in, or a game associated with the player's account at the account level, such as a game being played by the game account associated with the player's account on a non-target terminal. It should be noted that in this scenario, the game terminal running the target game is located in the video screen.

[0039] The target game can be, but is not limited to, any game capable of receiving control commands. These control commands can be, but are not limited to, commands received by the terminal where the target game is located. The video feed is related to whether the target game is running on the target terminal where the player's account is logged in. If the target game is running directly on the target terminal where the player's account is logged in, the video feed is not limited to the game screen. If the target game is not running on the target terminal, for example, if it is running on a game terminal, the video feed is not limited to the screen of the second user corresponding to the player's account playing the target game, nor is it limited to including the second user, the game screen, and the screen of the second user controlling the first object. In fact, it is not limited to the second user operating a game terminal logged in with a game account to play the target game, and the target terminal recording the second user playing the target game; in this case, the video feed is the screen captured by the target terminal running the player's account.

[0040] When the target game is running on a game terminal other than the target terminal, the object control commands generated by the viewer's account are not limited to being sent to the game terminal via the target terminal, so that the game terminal can respond to the object control commands to control the first object to perform the target operation. The target terminal forwards the object control commands to the game terminal not limited to the network where the target terminal and the game terminal are located, such as LAN, WAN, etc., but can also be any other terminal communication method between the target terminal and the game terminal.

[0041] Object control commands are game commands generated by the viewer account based on the viewing interface, used to control a first object in the target game to perform a target operation. The viewer account's control of the first object in the target game based on object control commands can be one or more operations, or it can control the first object within a continuous time period. In one implementation, while the first object is executing the target operation indicated by the viewer account, the first object can also receive game control commands from the player account on the target terminal, thus enabling the viewer account and the player account to jointly control the same first object in the target game during real-time communication, increasing the game interaction effect during real-time communication. In another implementation, while the first object is executing the target operation indicated by the viewer account, the first object is prohibited from executing game control commands from the player account on the target terminal. When the viewer account pauses or exits the operation of the first object, the first object is then allowed to execute game control commands from the player account on the target terminal.

[0042] Further assuming that the game screen displayed on the viewer's account is the real-time game screen of the target game running on the target terminal, and the viewer's account is a viewing account located in the player's account's live stream room, then if none of the viewing accounts in the player's account's live stream room generate object control commands, the game screen is not limited to the game screen where the player's account controls the first object. If a viewing account generates an object control command, the object control command is not limited to being forwarded to the game process through the target terminal, thereby enabling the target game to respond to the object control command and instruct the first object to play the game according to the viewing account's object control command. The target terminal can receive one or more object control commands sent by one or more viewing accounts at the same time or within the same time period, and can also receive one or more game control commands sent by the player's account at the same time or within the same time period.

[0043] Simultaneously or within the same time period, it can receive object control commands sent by spectator accounts and game control commands sent by player accounts. It can also receive object control commands sent by other user accounts in the same account group as the spectator and player accounts. When multiple object control commands and / or game control commands are received simultaneously or within the same time period, it is not limited to determining the game execution command to be executed from the multiple object control commands and / or game control commands, and instructing the first object in the target game to execute the game operation indicated by the game execution command.

[0044] Specifically, the game execution instruction can be determined from multiple object control instructions and / or game control instructions based on the instruction parameters of each game instruction (including object control instructions and game control instructions), and object control instructions and game control instructions that are not determined to be game execution instructions are discarded.

[0045] It can also be multiple object control commands and game control commands whose execution priority is determined by the command parameters. The object control command or game control command with the highest execution priority is the game execution command. The object control commands or game control commands are executed in sequence according to the execution priority to drive the game process and push the game screen corresponding to the game process to each viewing account.

[0046] In this embodiment, a video frame is displayed; wherein, the first object in the video frame is controlled by the player account; the object control command corresponding to the viewer account is obtained; based on the object control command, control over the first object is obtained, and the first object controlled by the player account is controlled by the object control command initiated by the viewer account, thereby achieving the goal of the viewer account participating in the control of the first object and improving the viewer account's sense of participation in the game being played during real-time communication with the player account, and realizing the technical effect of improving the interaction efficiency in real-time communication.

[0047] As an optional implementation, after displaying the video image, the method further includes:

[0048] Obtain an influence command for a second object; wherein the influence command is used to assist and / or influence the movement of the second object, wherein the second object is an object in the video frame.

[0049] Optionally, in this embodiment, the second object is an object in the video frame. Similar to the first object, the second object may be, but is not limited to, a virtual object controlled by a player account or a viewer account, or an object in the live broadcast scene. The instruction to affect the second object may be, but is not limited to, triggered by a player account or a viewer account. In other words, various types of accounts may participate in controlling objects controlled by other accounts.

[0050] By influencing the movement of the second object through the influence command in this embodiment, the technical objectives of expanding the influence range of the control command and increasing the number of objects that can be triggered by the control command are achieved, thereby realizing the technical effect of improving the interaction efficiency in real-time communication.

[0051] As an optional implementation, displaying video footage includes: displaying the player's video footage in the viewer's account's viewing interface;

[0052] As an optional implementation, obtaining the object control instructions corresponding to the viewer's account includes:

[0053] S1, obtain the target interaction information entered by the audience account in the interaction area of ​​the viewing interface, wherein the interaction area is used to display the interaction information of each account;

[0054] S2 generates object control instructions corresponding to the target interaction information.

[0055] Optionally, in this embodiment, the interactive area is not limited to the area in the viewing interface used to obtain and display interactive information. The interactive information is not limited to game interactive information related to the target game and interactive information between player accounts and various accounts or between various accounts. When the target interactive information input by the viewer account is obtained in the interactive area, object control instructions are generated according to the target interactive information.

[0056] Optionally, in this embodiment, obtaining the target interaction information input in the interaction area is not limited to identifying the target interaction information from the input target information, selecting the target interaction information from the interaction information template, or other input acquisition methods.

[0057] As an optional implementation, obtaining the target interaction information entered by the viewer's account in the interactive area of ​​the viewing interface includes:

[0058] S1, in response to an input triggering operation performed on the interaction area, displays the first interaction information entered by the audience account in the input sub-area, wherein the input sub-area is an area used to receive the audience account input information;

[0059] S2, if the first interaction information matches the target interaction information in the interaction information template, display the instruction prompt information, wherein the instruction prompt information is used to confirm that the first interaction information is converted into the target interaction information;

[0060] S3, in response to the instruction confirmation operation performed on the instruction prompt information, obtains the target interaction information.

[0061] Optionally, in this embodiment, the interaction area is not limited to including an input sub-area for receiving and displaying input information. By inputting interaction information in the input area, if target interaction information matching the interaction information template is identified from the interaction information, a prompt message is used to determine whether to convert the target information into target interaction information. If a confirmation operation is performed on the prompt message, it is determined that the interaction information will be converted into target interaction information, and the target interaction information is displayed in the input sub-area to indicate that an object control command will be generated based on the target interaction information.

[0062] Optionally, in this embodiment, the interaction information template is not limited to containing game interaction information corresponding to multiple object control commands. The identification of interaction information in the input sub-region is not limited to real-time identification. When game interaction information is identified from the interaction information, the conversion of the target interaction information is determined through command prompt information. After converting the interaction information into the target interaction information, the interaction information is cleared in the input sub-region, and the converted target interaction information is displayed.

[0063] As an optional implementation, after obtaining the target interaction information entered by the viewer's account in the interaction area of ​​the viewing interface, the method further includes: determining the amount of virtual resources spent on the target interaction information, wherein the instruction parameter includes the amount of virtual resources;

[0064] As an optional implementation, generating object control instructions corresponding to the target interaction information includes adding a parameter identifier indicating the quantity of virtual resources to the object control instructions.

[0065] Optionally, in this embodiment, the target interactive information can also be game interactive information determined from the interactive information panel by triggering the interactive information control in the input sub-area. The interactive information panel is not limited to displaying various game interactive information in the interactive information template. The target interactive information is determined from multiple game interactive information through a selection operation and displayed in the input sub-area.

[0066] Optionally, in this embodiment, after displaying the target interactive information in the input sub-area, the method further includes: in response to a send trigger operation performed on the send control in the input sub-area, generating an object control instruction corresponding to the target interactive information, and displaying the target interactive information in the display sub-area of ​​the interaction area, wherein the display sub-area is the area in the interaction area used to display the interactive information.

[0067] Optionally, in this embodiment, the input sub-area is not limited to having a sending control for determining the generation of object control instructions, used to determine the generation of object control instructions based on the target interaction information displayed in the input sub-area, and to display the target interaction information in the display sub-area. The display sub-area displays the interaction information generated by each viewing account and between the viewing account or player account.

[0068] Optionally, in this embodiment, before performing a send trigger operation on the send control, the target interactive information to be displayed is not limited to being adjusted through an interactive information control or an input trigger operation, including specific operations such as deletion and modification.

[0069] In this embodiment of the application, the target interactive information can be input directly through input or control selection in the interactive area of ​​the viewing interface, and an object control instruction for controlling the first object in the target game controlled by the player account can be generated based on the target interactive information, so as to achieve game interaction based on live streaming by controlling the same object as the player account.

[0070] As an optional implementation, before generating object control instructions corresponding to the target interaction information, the method further includes: displaying game interaction controls in the interaction area of ​​the viewing interface, wherein the game interaction controls are interaction controls that match the operation controls controlling the first object in the target game;

[0071] As an optional implementation, generating object control instructions corresponding to the target interaction information includes: generating object control instructions corresponding to the game interaction control in response to a trigger operation performed by a viewer's account on the game interaction control.

[0072] Optionally, in this embodiment, the game interaction control is not limited to the interaction control rendered in the viewing interface corresponding to the operation control of the first object in the target game when the viewing account initiates a game interaction request based on the viewing interface. The game interaction control is used to generate object control instructions. Based on the object control instructions, the target terminal controls the first object to perform the target operation and forwards the object control instructions to the game terminal to control the first object to perform the target operation.

[0073] Optionally, in this embodiment, while generating object control instructions in response to the triggering operation performed on the game interactive controls, the target interactive information corresponding to the object control instructions is displayed in the display sub-area of ​​the interactive area.

[0074] In this embodiment, a game interaction control identical to the operation control of the target game is rendered in the viewing interface through a game interaction request. This triggers the generation of object control instructions by the game interaction control. By rendering the game interaction control, the viewing account's sense of participation in the target game controlled by the player account is enhanced, thereby improving the interactive effect.

[0075] Optionally, the object control instructions executed by obtaining the viewer's account in the viewing interface include:

[0076] S1, the first viewing screen is displayed in the behavior detection area of ​​the viewing interface, wherein the first viewing screen includes the first user who uses the viewer account to watch the game screen;

[0077] S2, upon detecting interactive behavior characteristics from the first viewing screen, generates object control instructions corresponding to the interactive behavior characteristics.

[0078] Optionally, in this embodiment, the behavior detection area in the viewing interface is used to display the viewing screen of the first user watching the game using a viewer account, that is, the real-time behavior screen of the first user. When interactive behavior features are detected from the viewing screen, an object control command corresponding to the interactive behavior features is generated, and the target interaction information corresponding to the object control command is displayed in the display sub-area of ​​the interaction area.

[0079] Optionally, in this embodiment, the interactive behavior features are not limited to the behavior features corresponding to each game interaction information in the interactive information template, nor are they limited to constructing a behavior feature template. When the user's behavior features in the viewing screen match the interactive behavior features in the behavior feature template, it is determined that interactive behavior features have been detected from the viewing screen.

[0080] Optionally, in this embodiment, the viewing screen displayed in the behavior detection area is not limited to the screen obtained by the image acquisition device of the viewing terminal logged in by the user account, which captures the user's real-time behavior. Behavior detection is not limited to using any method that can realize user behavior detection, thereby determining whether the user's behavior hits the interactive behavior feature.

[0081] In this embodiment, user behavior detection generates object control instructions for game interaction with the player account, thereby enabling the first object controlled by the player account to execute target operations in response to the object control instructions. This achieves game interaction through real-time communication by observing behavior, thus improving the effect of game interaction.

[0082] As an optional implementation, after obtaining the target interaction information entered by the viewer's account in the interaction area of ​​the viewing interface, the method further includes: determining the amount of virtual resources spent on the target interaction information, wherein the instruction parameter includes the amount of virtual resources;

[0083] Optionally, in this embodiment, generating object control instructions corresponding to the target interaction information includes adding a parameter identifier indicating the quantity of virtual resources to the object control instructions.

[0084] Optionally, in this embodiment, after the viewer account determines the target interaction information for game interaction with the player account in real-time communication, it is not limited to adding any number of virtual resources to the target interaction information. A parameter indicating the number of virtual resources is added to the object control command when generating the object control command. The virtual resources spent on the target interaction information are not limited to being deducted from the virtual resources owned by the viewer account. When the virtual resources owned by the viewer account are greater than or equal to the virtual resources spent on the target interaction information, the deduction is not limited to being made directly during the confirmation operation. When the virtual resources owned by the viewer account are less than the virtual resources spent on the target interaction information, the viewer account is not limited to being prompted that the number of virtual resources is insufficient, so that the viewer account can reduce the selected number of virtual resources or increase the number of virtual resources owned by the viewer account.

[0085] Optionally, in this embodiment, the number of virtual resources added to the object control instruction is not limited to the instruction parameters of the object control instruction in the virtual resource dimension. Instruction parameters may also include parameters such as the generation time of the object control instruction. The instruction identifier is not limited to increasing the execution priority of the object control instruction or increasing the probability of the object control instruction being executed. If the target operation indicated by the object control instruction is determined not to be executed by the target game, or if the object control instruction is determined not to be a game execution instruction, the method is not limited to returning the number of virtual resources indicated in the object control instruction to the viewer's account.

[0086] Optionally, in this embodiment, by adding virtual resources, the user account can have the space to autonomously control the command parameters of the object control command. This increases the likelihood that the object control command will be identified as a game execution command, thereby further increasing the interaction methods.

[0087] As an optional implementation, after obtaining control over the first object based on object control instructions, the method further includes at least one of the following:

[0088] S1, when the object control command instructs to perform a position adjustment operation on the first object, control the first object to be adjusted from the initial position to the target position;

[0089] S2, when the object control instruction indicates that action control should be performed on the first object, control the first object to perform the target action;

[0090] S3, when the object control command instructs to add a third object to the target game, adds the game screen of the third object to the video screen.

[0091] Optionally, in this embodiment, the object control instructions are not limited to instructing the first object to perform a position adjustment operation, performing an action control operation on the first object, or adding a third object. Taking the first object as a virtual track in a racing game as an example, the object control instructions are not limited to adjusting the position of the track, but can also adjust the curvature of the track. Taking the first object as a virtual vehicle in a racing game as an example, the object control instructions are not limited to controlling the vehicle to start moving forward, controlling the vehicle to stop, or controlling the vehicle to climb over obstacles. Taking the target game as a racing game as an example, the object control instructions can also be to add virtual vehicles to create a competitive relationship with the virtual vehicles controlled by the player's account. Taking the target game as a racing game as an example, adding a third object at the target position can also be adding virtual obstacles on the track.

[0092] As an optional implementation, the target game screen displayed on the viewing interface, generated by the first object performing the target operation in the target game, includes:

[0093] The game screen displayed in the viewing interface of the target game controls the first element of the first object to perform the first operation and at least one second element to perform the second operation. The first operation is the target operation performed by the first element by the object control instruction executed by the viewer account. The second operation is the operation performed by the at least one second element by the object control instruction executed by at least one third user account. The at least one third user account is the user account that is watching the video screen of the player account. The execution time interval between the object control instruction executed by the viewer account and the object control instruction executed by the at least one third user account is less than a preset time threshold.

[0094] Optionally, in this embodiment, within the same time period when a viewer account issues an object control command, a third user account in the same account group can also issue an object control command. The third user account can be any number of user accounts within the same account group, excluding the viewer account. Here, the account group is still a virtual group constructed based on real-time communication, such as a virtual user group composed of user accounts in the same virtual live streaming room. If the first element of the first object controlled by the viewer account and the second element of the first object controlled by the third user account are different elements, the first element of the first object is controlled to respond to the viewer account's object control command, performing a first operation, while the second element responds to the third user account's object control command, performing a second operation.

[0095] Optionally, in this embodiment, if two or more third user accounts also issue object control commands within the same time period when the viewer account issues the object control command, and the multiple object control commands correspond to multiple different elements of the first object, then each element is controlled to execute the operation indicated by the corresponding object control command. Similarly, the upper limit of user accounts that can simultaneously control the first object is related to the number of elements that the first object can control individually. This can be achieved by assigning different elements to each user account, or by assigning two or more elements to the same user account, thereby realizing game interaction between accounts based on real-time communication.

[0096] Optionally, in this embodiment, when at least two user accounts initiate object control commands at the same time or within the same time period, the elements allocated to the user accounts are not limited to those determined based on the object control commands. Elements can also be allocated to the player account simultaneously, thereby enabling real-time interaction between multiple user accounts and the player account based on the game. The specific method of element allocation is not limited here.

[0097] Optionally, in this embodiment, taking a character object in a dance game as an example, the first element is not limited to the character object's upper limb, and the second element is not limited to the character object's lower limb. The first element can also be the character object's left upper limb, and the second element can be the character object's right upper limb. Meanwhile, other elements, such as the left lower limb and the right lower limb, can also respond to the player's account's game control commands or other user account's object control commands to perform corresponding operations.

[0098] Optionally, in this embodiment, while displaying the game screen of the first element controlling the first object to perform the first operation and the second element performing the second operation, the target interaction information corresponding to the first operation and at least one second operation is not limited to being displayed in the display sub-area of ​​the interaction area.

[0099] In this embodiment, multiple user accounts and player accounts can simultaneously control the same first object, thereby enabling game interaction between multiple user accounts and between multiple user accounts and player accounts based on the live broadcast room, improving the effect of game interaction in real-time communication.

[0100] Optionally, after displaying the player's video feed in the viewing interface of the viewer's account, the method further includes: displaying the game screen generated by controlling the first object to perform the third operation in the target game in the viewing interface, wherein the third operation is the operation indicated by the object control command executed by the third user account, and the third user account is a user account in the account group to which the viewer's account and the player's account belong.

[0101] Optionally, in this embodiment, the real-time game screen of the target game running on the target terminal is displayed in the viewing interface of the viewer account. This is not limited to the game screen generated by the player account controlling the first object, the game screen generated by the player account and the viewer account jointly controlling the first object, the game screen generated by the player account and other user accounts jointly controlling the first object, the game screen generated by the player account, the viewer account, and other user accounts jointly controlling the first object, the game screen generated by the viewer account controlling the first object, the game screen generated by other user accounts (e.g., a third user account) controlling the first object, or the game screen generated by the viewer account and other user accounts (e.g., a third user account) jointly controlling the first object. Other user accounts are any number of user accounts other than the player account and the viewer account in the same account group.

[0102] Optionally, the game screen displayed in the viewing interface as a result of controlling the first object to perform the third operation in the target game includes: displaying third interactive information corresponding to the object control command executed by the third user account in the interactive area of ​​the viewing interface, wherein the interactive area is used to display interactive information generated by user accounts in the user account group.

[0103] Optionally, in this embodiment, the interactive area is used to display interactive information corresponding to game commands in the target game, including interactive information generated by player accounts controlling the target game and interactive information generated by spectator accounts, third-party user accounts, etc., controlling the target game. When at least two accounts are controlling the target game simultaneously, it is not limited to displaying multiple pieces of interactive information simultaneously in the interactive area. The information display in the interactive area is not limited to a scrolling format, in order to achieve a timely update effect.

[0104] According to another aspect of the present invention, an interaction method in real-time communication is provided, applied to a target terminal, as an optional implementation method, such as... Figure 3 As shown, the interaction methods in the above real-time communication include:

[0105] S302, push the video screen of the player account to the viewer account and at least one third user account, wherein the video screen of the player account is displayed in the respective viewing interface of the viewer account and at least one third user account, and the video screen of the player account includes the game screen of the target game associated with the player account, and the first object in the target game is controlled by the second user corresponding to the player account.

[0106] S304, receiving object control instructions executed by a viewer account and at least one third-party user account in their respective viewing interfaces, wherein the object control instructions are used to instruct a first object in the target game to perform game operations;

[0107] S306, based on the instruction parameters of the object control instructions, determine the game execution instruction from at least two object control instructions, wherein the game execution instruction instructs the first object in the target game to perform the target operation;

[0108] S308, acquire the target game screen generated by the first object performing the target operation in the target game and push it to the audience account and at least one third user account.

[0109] Optionally, in this embodiment, when the target terminal receives a viewing request initiated by a viewer account and / or at least one third-party user account or a video sharing request initiated by a player account, it pushes the video image to the viewing terminal where the viewer account and / or at least one third-party user account is located, so as to display the video image on the viewing interface of the viewing terminal.

[0110] Optionally, in this embodiment, if the target terminal does not receive a stop request to stop real-time communication, it is not limited to synchronously pushing the real-time game screen to the terminal where the user account of the real-time communication is located, regardless of whether the real-time game screen is generated by the object control command of the user account.

[0111] Optionally, in this embodiment, the terminal where the target game is located can receive object control commands sent by multiple user accounts viewing the video screen of the player's account at the same time or within the same time period. It can also receive game control commands sent by the player's account, and determine the game execution command to be executed from the multiple object control commands and game control commands. For object control commands and game control commands that are not determined to be game execution commands, they can be discarded or executed sequentially according to execution priority after the game execution command is executed, according to the command parameters.

[0112] In this embodiment, a method is employed whereby video footage of a player's account is pushed to a viewer's account and at least one third-party user account. The player's video footage is displayed in the respective viewing interfaces of the viewer's account and at least one third-party user account. The player's video footage includes game footage of a target game associated with the player's account, and a first object in the target game is controlled by a second user corresponding to the player's account. The method involves receiving object control instructions executed by the viewer's account and at least one third-party user account in their respective viewing interfaces. These object control instructions instruct the first object in the target game to perform game operations. If a game execution instruction is determined from the object control instructions, the method acquires the target game footage generated by the first object performing the target operation in the target game and pushes it to the viewer's account and at least one third-party user account. This is achieved by receiving object control instructions initiated by the user account in the viewing interface. The system responds to object control commands by controlling the first object in the target game associated with the player account. It controls the first object in the target game, which is being controlled by the player account, to perform a target operation. The target game screen showing the first object performing the target operation is then pushed to the user account and displayed in the user account's viewing interface. This achieves the goal of responding to object control commands initiated by the user account through the viewing interface, allowing multiple user accounts and the player account to jointly control the first object in the game associated with the player account via real-time communication. This enables multiple user accounts and the player account to jointly operate the same first object in the ongoing game to complete the game, increasing the player account's participation in the game during real-time communication. This technical effect enhances the interactivity and fun of game interaction based on real-time communication, thereby solving the technical problem of low interaction efficiency in real-time communication.

[0113] As an optional implementation, the above-mentioned method, before pushing the player's account's video feed to the viewer account and at least one third-party user account, further includes:

[0114] When the target game is running on the target terminal where the player's account is logged in, the game screen of the target game will be identified as a video screen;

[0115] When the target game is running on a game terminal, the screen captured by the target terminal logged into the player's account is determined as the video screen. The game terminal is logged into a game account associated with the player's account, and the video screen includes the second user, the game screen of the target game, and the screen of the second user controlling the first object.

[0116] Optionally, in this embodiment, the target game associated with the player account can be a game running on the target terminal where the player account is located, or it can be a game running on a non-target terminal, such as a game terminal. The game account associated with the player account is used to log in to the game terminal to achieve association at the account level.

[0117] Optionally, in this embodiment, when the target game is running on the target terminal where the player's account is located, it is not limited to directly using the game screen of the target game running on the target terminal as the video screen. When the target game is running on a game terminal, that is, when a live broadcast is initiated using the target terminal and the game terminal, it is not limited to using the target terminal to capture the interface of the second user and the game terminal running the target game, thereby using the screen captured by the target terminal as the video screen.

[0118] Optionally, in this embodiment, if the target game runs on the target terminal, it is not limited to forwarding object control instructions to the game process through the target terminal to control the first object. If the target game runs on the game terminal, it is not limited to forwarding object control instructions sequentially through the target terminal and the game terminal to control the first object. Furthermore, the communication between the target terminal and the game terminal is not limited to forwarding object control instructions via network communication. Alternatively, an interaction channel can be directly established between the game terminal and the live streaming service, allowing the game terminal to directly receive object control instructions.

[0119] As an optional implementation, after pushing the player's account's video feed to the viewer account and at least one third-party user account, the method further includes:

[0120] S1, upon receiving object control instructions and game control instructions sent by the player account, determine the instruction priority parameters corresponding to the object control instructions and game control instructions respectively;

[0121] S2, when there are multiple object control instructions, determine the interaction priority parameter corresponding to each object control instruction among the multiple object control instructions;

[0122] S3 determines the game execution commands based on the command priority parameter and the interaction priority parameter.

[0123] Optionally, in this embodiment, the player account's control over the target game directly affects the target terminal. Therefore, while the target terminal receives object control instructions from other user accounts, it can also receive game control instructions from the player account.

[0124] Optionally, in this embodiment, when game control commands from a player's account and object control commands from user accounts within the same account group are received within the same time period, the command parameters of each command are determined separately to determine the game execution command to be executed. Specifically, this is not limited to determining the game command sequence of object control commands and game control commands based on the command parameters, identifying the first command in the game command sequence as the game execution command, and then executing the remaining game commands sequentially according to the game command sequence. The method for determining the command parameters of game control commands from player accounts and object control commands from other user accounts is not limited here. For example, the command generation time or command sending time can be used as the command parameter. It is also possible to set the execution priority of game control command parameters at the same time to be higher than that of game control commands, or to set the execution priority of object control command parameters at the same time to be higher.

[0125] Optionally, in this embodiment, if multiple object control commands are received simultaneously within the same time period, these multiple object control commands can be sent by multiple user accounts or by a single user account. In this case, the execution priority of the multiple object control commands can be determined according to the command parameters, and then the execution priority of the multiple object control commands and the player account's game control commands can be determined. Alternatively, the final execution priority can be determined for both the multiple object control commands and the game control commands. For example, the generation time of the game command can be used as the command parameter to form a sequence of commands corresponding to the multiple object control commands and the game control commands. Furthermore, in addition to time-type parameters, other types of parameters can be combined, such as the quantity of virtual resources corresponding to the object control command. When a viewing account initiates an object control command, it is not limited to adding a certain number of virtual resources to the object control command to increase its execution priority.

[0126] In this embodiment, the target terminal can simultaneously receive object control instructions from multiple user accounts and game control instructions from player accounts. The game execution instructions are determined based on the execution priority and executed sequentially, so as to enable user accounts and player accounts to jointly control the first object to perform the target game.

[0127] Optionally, the above-mentioned acquisition of the target game screen generated by controlling the first object to perform the target operation in the target game and pushing it to the viewer account and at least one third-party user account includes:

[0128] S1, sequentially acquire the current game screen generated by controlling the first object to perform the current target operation in the target game, wherein the current target operation is the target operation indicated by the current game instruction in the game instruction sequence;

[0129] S2 pushes the current game screen to the viewer account and at least one third-party user account in sequence.

[0130] Optionally, in this embodiment, when a sequence of game commands for multiple object control commands and game control commands within the current time period is determined, the current game screen for executing the current game command is obtained sequentially, and the current game screen is pushed to the user account sequentially.

[0131] Optionally, in this embodiment, the first object in the target game running the target terminal executes game instructions sequentially and pushes the game screen obtained from executing the game instructions to the user account, so that the user account can keep track of the current progress of the target game in a timely manner. This allows the user account to promptly receive feedback on the game screen of the first object jointly controlled by the user account and the player account, increasing the user account's participation in the target game controlled by the player account, thereby improving the effect of game interaction in real-time communication.

[0132] As an optional implementation, after pushing the player's account's video feed to the viewer account and at least one third-party user account, the method further includes:

[0133] S1, when multiple object control instructions are received from multiple user accounts during the target time period, determine the instruction identifier carried in each object control instruction, wherein the multiple user accounts include a viewer account and at least one third user account, and the instruction identifier indicates the instruction parameter of the object control instruction;

[0134] S2 determines the game execution command from multiple object control commands based on the command parameters.

[0135] Optionally, in this embodiment, for multiple object control commands sent by multiple user accounts, the final target object control command to be executed can be determined based on the number of virtual resources added in the object control command. That is, when the target terminal receives multiple object control commands sent by multiple user accounts, a user account for game interaction is determined based on the number of virtual resources, so that the target game responds to the object control command of that user account to perform game interaction.

[0136] Optionally, in this embodiment, the user account that interacts with the player account in the game within a certain period of time can be determined based on the number of virtual resources added in the object control command. During this period of time, the target game is not limited to responding only to the object control commands sent by the determined user account, or responding only to the object control commands of the user account and the game control commands of the player account.

[0137] In this embodiment, the number of virtual resources added to the object control instructions determines the game execution instructions from the object control instructions, thereby further enriching the gameplay of game interaction and improving the effect of game interaction.

[0138] As an optional implementation, after pushing the player's account's video feed to the viewer account and at least one third-party user account, the method further includes:

[0139] S1, in response to the game interaction request initiated by the viewer account on the viewing interface, determine the game interaction control group corresponding to the viewer account, wherein the game interaction control group includes at least one game interaction control, and the at least one game interaction control corresponds to at least one operation control controlling the first object in the target game;

[0140] S2, send rendering data of the game interaction control group to the viewer's account to render at least one game interaction control in the viewer's viewing interface.

[0141] Optionally, in this embodiment, when a user account initiates a game interaction request on the viewing interface, the target terminal determines a game interaction control group matching the user account. This game interaction control group includes at least one game interaction control. The target terminal's determination of the game interaction control matching the user account is not limited to determining the allocation of control over the first object in the target game between the player account and the user account within the same time period. The specific allocation method is not limited here. For example, the first object can be completely controlled by the user account, and the corresponding game interaction control group includes interaction controls corresponding to each of the operation controls. Alternatively, some elements of the first object can be controlled by the user account, while the remaining elements are still controlled by the player account. The corresponding game interaction control group includes interaction controls corresponding to the operation controls of some of the elements.

[0142] Optionally, in this embodiment, the game interaction control is an interaction control determined according to the game type and corresponding to the operation control of the first object in the target game, used to generate object control instructions. Upon receiving the object control instructions generated by the game interaction control, the target terminal sends the object control instructions to the game process of the target game, so that the target game responds to the object control instructions generated by the user account watching the video screen through the game interaction control.

[0143] Optionally, in this embodiment, when the target terminal determines the game interaction control corresponding to the user account, it is not limited to determining the rendering conditions of the game interaction control group. The rendering conditions can be determined based on the virtual resources carried in the game interaction request, or the target terminal can determine them based on the game interaction control group. For example, the rendering duration of the game interaction control can be determined according to the amount of virtual resources spent by the user account in initiating the game interaction request. Alternatively, if no other user account has initiated a game interaction request, the game interaction control can always be rendered on the user account's viewing interface.

[0144] Optionally, in this embodiment, the game interaction control group pushed to the user account based on the response to the game interaction request is only one way for the user account to generate object control instructions. The user account can also generate object control instructions directly in the interaction area of ​​the viewing interface by inputting interaction information, or by detecting interaction behavior. Different methods of generating object control instructions can be combined if they do not conflict. To improve the accuracy of object control instructions, the interaction method is not limited to being determined by the user account. Inputting interaction information in the interaction area and detecting interaction behavior are not limited to being implemented directly when the user account's terminal obtains the corresponding template. The game interaction control group requires the user account's terminal to send a game interaction request to the target terminal to obtain the rendering data pushed by the target terminal before rendering the game interaction control group in the viewing interface.

[0145] Optionally, after sending the rendering data of the game interaction control group to the audience account, the method further includes: when the rendering data of the game interaction control group carries rendering conditions and the rendering conditions are met, pushing an interaction stop message to the audience account, wherein the interaction stop message is used to instruct the game interaction control group to be adjusted to an invalid state, and the game interaction control group is hidden and displayed in the viewing interface of the audience account in the invalid state.

[0146] Optionally, in this embodiment, when the rendering conditions of the game interaction control group are met, rendering of the game interaction control group in the user account's viewing interface is stopped, the game interaction control group is adjusted to an invalid state, and it cannot generate object control commands and is hidden.

[0147] Optionally, in this embodiment, when the game interaction control group reaches the rendering condition, it is not limited to returning the first object controlled by the user account to the player account for control, but also to continuing to realize the user account's control over the first object through the object control instructions received by the target terminal.

[0148] Optionally, in this embodiment, when the rendering condition indicates a duration, the first object or a portion of the first object indicated by the game interaction control group is controlled by the user account during the duration indicated by the rendering condition. During this duration, the first object or a portion of the first object no longer accepts object control commands initiated by other user accounts.

[0149] Optionally, in this embodiment, when multiple user accounts initiate game interaction requests simultaneously, either game interaction control groups can be assigned to each user account individually, or corresponding rendering conditions can be determined for each user account. Whether assigning game interaction control groups to each user account individually or determining corresponding rendering conditions for multiple user accounts, it can be based on the number of virtual resources carried in the game interaction request or the initiation time of the game interaction request. For example, the user accounts can be interacted with sequentially according to the order of their initiation times to determine the elements that each user account needs to control. Alternatively, the rendering duration and rendering order of user accounts can be determined according to the quantity of virtual resources carried in the game interaction request. When the rendering conditions are met by the previous user account, the game interaction control group is rendered in the viewing interface of the next user account. This allows multiple user accounts to take turns controlling the first object in the game, thereby jointly completing the target game.

[0150] As an optional implementation, after pushing the player's account's video feed to the viewer account and at least one third-party user account, the method further includes:

[0151] S1, in response to the game interaction request initiated by the audience account and at least one third user account, a first game interaction control and at least one second game interaction control are determined by the audience account and at least one third user account respectively, wherein the game interaction request initiated by the audience account and at least one third user account is used to request simultaneous control of the first object, and the first game interaction control and at least one second game interaction control correspond to at least two operation controls of the first object respectively.

[0152] S2, send the rendering data of the first game interaction control to the audience account, and send the rendering data of the corresponding second game interaction control to at least one third user account, so as to render the first game interaction control in the viewing interface of the audience account and render the second game interaction control in the viewing interface of the third user account.

[0153] Optionally, in this embodiment, the third user account is any one or more user accounts other than the player account and the viewer account in the account group where the viewer account and the player account are located. That is, it is a user account other than the viewer account that is watching the video screen of the player account. Taking the example that both the viewer account and the third user account initiate game interaction requests to the target terminal at the same time, the target terminal determines the corresponding game interaction control or game interaction control group for the viewer account and each third user account according to the control type and number of the operation control used to control the first object.

[0154] Optionally, in this embodiment, determining the corresponding game interaction controls or game interaction control groups for the viewer account and each third user account is not limited to determining the corresponding game interaction controls for the viewer account and each third user account based on the number of virtual resources carried in the game interaction request or based on the time when the game interaction request is initiated. When at least two user accounts initiate game interactions within the same time period, the interaction controls corresponding to all operation controls of the target virtual operation can be packaged into multiple game interaction control groups and then distributed to multiple viewing accounts, enabling multiple user accounts to jointly control the first object to play the game. Alternatively, the interaction controls corresponding to the operation controls of some elements of the first object can be packaged into multiple game interaction control groups and then distributed to multiple user accounts, while the operation controls of the remaining elements are still controlled by the player account, thereby enabling the player account and multiple user accounts watching the video screen to jointly control the first object to play the game. It should be noted that each game interaction control group includes at least one game interaction control corresponding to the operation control.

[0155] As an optional implementation, after sending the rendering data of the first game interaction control to the viewer's account and the rendering data of the corresponding second game interaction control to at least one third user account, the method further includes:

[0156] S1, respectively receive a first object control instruction sent by the audience account based on the first game interaction control and a second object control instruction sent by the third user account based on the second game interaction control, wherein the first object control instruction is used to instruct the first element of the first object to perform a first operation, and the second object control instruction is used to instruct the second element of the first object to perform a second operation;

[0157] S2, obtain the game screen generated when the first element controlling the first object in the target game performs the first operation and the second element controlling the first object performs the second operation, and push it to the audience account and the third user account.

[0158] Optionally, in this embodiment, multiple user accounts may initiate object control commands simultaneously through interactive controls on their respective viewing interfaces. This is not limited to using different interactive controls to control different virtual elements of the first object. By having multiple user accounts control multiple virtual elements of the first object simultaneously, multiple user accounts can control the first object controlled by a player account in real-time communication, enabling game interaction between multiple user accounts during real-time communication. Furthermore, a player account can control one or more virtual elements, and one or more user accounts can control one or more virtual elements, allowing a player account to simultaneously control the first object with multiple user accounts during real-time communication, thus achieving game interaction between a player account and multiple user accounts simultaneously.

[0159] Optionally, in this embodiment, taking the target game as an example of controlling a virtual character to dance, the target game contains operation controls for controlling the virtual character's arms, legs, and body. Responding to a user account's game interaction request, if the number of user accounts initiating game interaction in the current time period is 2, then it is not limited to sending the interaction controls corresponding to the arm and leg operation controls to the two user accounts respectively. Thus, in one user account's viewing interface, an arm interaction control corresponding to the arm control operation control is rendered to generate object control instructions for arm control. In the other user account's viewing interface, an interaction control corresponding to the leg control operation control is rendered to generate object control instructions for leg control. For body control, the player account directly receives the control instructions for the body operation controls in the game. This allows the player account to control the body, and the two user accounts to control the arms and legs respectively, thus jointly controlling the virtual character to play the game, improving the game's interactive effect. The above is merely an example; the operation controls for controlling the virtual character can also have other controls or other operation division methods.

[0160] As an optional implementation, after sending the rendering data of the first game interaction control to the viewer's account and the rendering data of the corresponding second game interaction control to at least one third user account, the method further includes:

[0161] S1, in the target game, control the first object to perform the first operation, and the second object control instruction is used to instruct the first object in the target game to perform the second operation;

[0162] S2, acquire the game screen generated by controlling the first object to perform the first operation and simultaneously perform the second operation in the target game, and push it to the audience account and the third user account, wherein the target game is set to allow the control of the target object to perform the first operation and the second operation simultaneously.

[0163] Optionally, in this embodiment, the player account and other user accounts, as well as multiple other user accounts, can simultaneously control the first object to perform different operations. These different operations are not limited to controlling different parameters of the first object. The user account's control of the parameters is not limited to implementation through game interaction controls rendered in the viewing interface. Rendering data of game interaction controls corresponding to different parameters is sent to different user accounts, thereby enabling multiple user accounts to jointly control the first object to perform the game by controlling different parameters of the first object. When the player account and other user accounts control different parameters of the first object, the player account's control of the first object's parameters is not limited to implementation through operation controls in the target game.

[0164] Optionally, in this embodiment, taking the control of a virtual vehicle to complete a target track in the target game as an example, the operations that can be controlled separately are not limited to speed adjustment, turning control, and position adjustment. Speed ​​adjustment is not limited to controlling the speed of the virtual vehicle; turning control is used to control the direction of travel of the virtual vehicle; and position adjustment is used to control the position of the virtual vehicle relative to the track, such as to the left, right, or center. These three operations can be controlled by three user accounts or a player account and two user accounts respectively, thereby enabling a player account and multiple user accounts to jointly control the virtual vehicle to complete the target track. Similarly, each of the three operations is not limited to including at least one operation control. Taking speed adjustment as an example, assuming that speed adjustment includes acceleration and deceleration operation controls, theoretically, the interactive controls corresponding to the two operation controls can be sent to two user accounts, thereby further increasing the number of viewing accounts that can simultaneously interact with the game. This allows more user accounts to truly participate in the control of the first object in the target game, further improving the interactive effect of the game in real-time communication.

[0165] Optionally, in this embodiment, taking real-time communication as the live streaming scenario and object control commands as the acquisition of the chat area (interaction area) of the viewing interface as an example, the interaction between the target terminal and the viewing terminal in real-time communication is not limited to, for example, the following. Figure 4As shown. Target terminal 410 starts a live stream of the target game through a player account, pushing an audio and video stream containing the game's visuals to server 420. Upon a viewing request from viewing terminal 430, the audio stream containing the game's visuals is synchronously transmitted to viewing terminal 430 via audio and video distribution system 422. Viewing terminal 430 is logged into a viewer account (or any viewing account such as a third-party user account), and displays the game's visuals on its viewing interface. User accounts send chat messages in the chat area of ​​the viewing interface. When the chat system 424 in server 420 detects an interaction command in the chat message, it sends the interaction command to target terminal 410. Target terminal 410 renders the game visuals based on the interaction command, obtaining the visuals corresponding to the object control command, and then pushes them to viewing terminal 430 via audio and video distribution system 422 for display on viewing terminal 430's viewing interface. This enables user accounts to control the first object controlled by the player account on the target terminal through the chat area of ​​the live stream viewing interface, completing the target game through joint control of the first object, thus improving the interactive effect of the game during the live stream.

[0166] Taking the control of a virtual vehicle to complete a target track in a game as an example, the object control command can be determined by inputting information such as "accelerate," "decelerate," "keep right," "keep left," and "brake" in the chat area. This object control command is then forwarded to the game process via the target terminal to control the virtual vehicle to execute the command. To prioritize the object control commands sent by the user account watching the game (e.g., to execute them earlier), a certain amount of virtual currency (virtual resources) can be invested when sending interactive information. The amount of virtual currency can be determined by the user account, can be set differently depending on the game progress, or can be set differently based on the specific object control command.

[0167] Continuing with the example of controlling a virtual vehicle to complete a target track in a game, the game typically aims to accelerate the virtual vehicle as quickly as possible to finish the track. Simultaneously, "deceleration" commands can be set to create obstacles for the virtual vehicle. Depending on the game's progress, not limited to the first half of the game, a user account can use 10 virtual coins to "accelerate" the game and 15 virtual coins to "decelerate" the virtual vehicle. In the second half of the game, the user account can use 15 virtual coins for both actions. The amounts of virtual currency mentioned above are merely examples and should not be considered definitive limits or relationships.

[0168] Object control commands can also be commands determined by interactive controls rendered in the viewing interface through interaction requests. Continuing with the example of controlling a virtual vehicle to complete a target track in a target game, the control controls for the virtual vehicle in the target game are not limited to speed controls, position controls, and direction controls. Upon receiving an interaction request from a user account, assuming two user accounts initiate game interaction requests and determine that the interactive controls corresponding to the speed and direction controls are rendered for each user account respectively, this is not limited to rendering the interactive control corresponding to the speed control in the viewing interface of the spectator account and the interactive control corresponding to the direction control in the viewing interface of a third user account.

[0169] The interactive controls rendered in the viewing interface, taking the speed control mentioned above as an example, are not limited to being visually consistent with the speed control. For example, they may both be displayed as "accelerate" and "decelerate" buttons. The difference is that the operation controls running in the target game on the target terminal directly generate "accelerate" and "decelerate" game commands to act on the virtual vehicle, while the "accelerate" and "decelerate" buttons of the interactive controls generate acceleration and deceleration interaction commands. When the target terminal receives the acceleration or deceleration interaction command, it forwards it to the game process of the target game so that the game process can control the virtual vehicle to accelerate or decelerate.

[0170] After rendering the interactive controls corresponding to the operation controls to the viewing terminal, the corresponding operation controls in the target game are temporarily disabled, or the priority of the object control instructions generated by the interactive controls is set to be higher than the priority of the game control instructions generated by the corresponding operation controls, thereby avoiding operation confusion caused by multiple accounts controlling the same operation.

[0171] With speed interaction controls rendered in the viewing interface of the audience account and direction interaction controls rendered in the viewing interface of the third user account, the target terminal controls the virtual vehicle to play the game by receiving speed interaction commands from the audience account, direction interaction commands from the third user account, and position control commands generated by the player account on the target terminal.

[0172] In a game, the target terminal can be in a state of constantly receiving object control commands, and can receive multiple object control commands initiated by multiple user accounts within the same or multiple time periods. It can also set time periods for user account game interactions, such as adding a rendering time limit to rendered game interaction controls. After the rendering time is reached, control of the first object is returned to the player account or the next user account. The rendering time can be determined by the target terminal based on the amount of virtual currency carried in the interaction request, or it can be a fixed duration; no limitation is made here.

[0173] Object control commands can also be generated based on detected user behavior characteristics. Taking controlling a virtual character to dance in a target game as an example, the virtual character can be controlled to perform various actions through interactive information in the chat area, through rendered interactive controls, or by displaying the user's body movements in real time in the detection area of ​​the viewing interface. When the body movements are detected to match the interactive action template, corresponding interactive commands are generated to control the virtual character to perform the corresponding actions. Similarly, in other games, such as racing games, object control commands can also be generated based on user behavior characteristics to enable the user account to control the primary object.

[0174] It should be noted that, for the sake of simplicity, the foregoing method embodiments are all described as a series of actions. However, those skilled in the art should understand that the present invention is not limited to the described order of actions, because according to the present invention, some steps can be performed in other orders or simultaneously. Furthermore, those skilled in the art should also understand that the embodiments described in the specification are preferred embodiments, and the actions and modules involved are not necessarily essential to the present invention.

[0175] According to another aspect of the present invention, an interactive device for implementing the interactive method in real-time communication described above is also provided, which is not limited to applications in real-time communication. Figure 1 The viewing terminal shown. (As shown) Figure 5 As shown, the device includes:

[0176] Display unit 502 is used to display video footage; wherein, the first object in the video footage is controlled by the player account;

[0177] The first acquisition unit 504 is used to acquire the object control instructions corresponding to the audience account;

[0178] The second acquisition unit 506 is used to acquire control over the first object based on object control instructions.

[0179] For specific implementation examples, please refer to the example shown in the above virtual model lighting rendering method, which will not be repeated here.

[0180] As an optional solution, based on Figure 5 The scenario shown continues as follows Figure 6 As shown, the device also includes:

[0181] The third acquisition unit 602 is used to acquire an influence command for the second object after displaying the video frame; wherein the influence command is used to assist and / or influence the movement of the second object, wherein the second object is an object in the video frame.

[0182] For specific implementation examples, please refer to the example shown in the above virtual model lighting rendering method, which will not be repeated here.

[0183] As an optional solution, the display unit 502 includes: a first display module for displaying the video screen of the player's account in the viewing interface of the viewer's account;

[0184] The first acquisition unit 504 includes: an acquisition module, used to acquire target interactive information entered by the audience account in the interactive area of ​​the viewing interface, wherein the interactive area is used to display the interactive information of each account;

[0185] The generation module is used to generate object control instructions corresponding to the target interaction information.

[0186] For specific implementation examples, please refer to the example shown in the above virtual model lighting rendering method, which will not be repeated here.

[0187] As an optional solution, the acquisition module includes:

[0188] The first display submodule is used to respond to an input trigger operation performed on the interaction area and display the first interactive information entered by the audience account in the input sub-area, wherein the input sub-area is an area used to receive the audience account input information;

[0189] The second display submodule is used to display instruction prompt information when the first interaction information matches the target interaction information in the interaction information template. The instruction prompt information is used to confirm that the first interaction information is converted into the target interaction information.

[0190] The `get` submodule is used to obtain target interaction information in response to the instruction confirmation operation performed on the instruction prompt information.

[0191] For specific implementation examples, please refer to the example shown in the above virtual model lighting rendering method, which will not be repeated here.

[0192] As an optional solution, the device further includes: a determining module, used to determine the amount of virtual resources spent on the target interaction information after obtaining the target interaction information entered by the viewer's account in the interaction area of ​​the viewing interface, wherein the instruction parameter includes the amount of virtual resources;

[0193] The generation module includes an addition submodule, used to add parameter identifiers indicating the number of virtual resources in object control instructions.

[0194] For specific implementation examples, please refer to the example shown in the above virtual model lighting rendering method, which will not be repeated here.

[0195] As an optional solution, the device further includes: a second display module, used to display game interactive controls in the interactive area of ​​the viewing interface before generating object control instructions corresponding to the target interactive information, wherein the game interactive controls are interactive controls that match the operation controls for controlling the first object in the target game;

[0196] The generation module includes a generation submodule, which is used to generate object control instructions corresponding to the game interactive controls in response to the trigger operation performed by the audience account on the game interactive controls.

[0197] For specific implementation examples, please refer to the example shown in the above virtual model lighting rendering method, which will not be repeated here.

[0198] As an optional solution, the device may also include at least one of the following:

[0199] The first control unit is configured to, after obtaining control of the first object based on the object control command, control the first object to adjust from the initial position to the target position when the object control command instructs an operation to adjust the position of the first object.

[0200] The second control unit is used to control the first object to perform a target action after obtaining control over the first object based on the object control command, and when the object control command instructs to perform action control on the first object.

[0201] The third control unit is used to add the game screen of the third object to the video screen after gaining control of the first object based on the object control command, and when the object control command instructs to add the third object to the target game.

[0202] For specific implementation examples, please refer to the example shown in the above virtual model lighting rendering method, which will not be repeated here.

[0203] According to another aspect of the present invention, an electronic device for implementing the interaction method in the above-described real-time communication is also provided. This electronic device may be... Figure 1 The terminal device or server shown. This embodiment uses this electronic device as an example for illustration. Figure 7 As shown, the electronic device includes a memory 702 and a processor 704. The memory 702 stores a computer program, and the processor 704 is configured to execute the steps of any of the above method embodiments through the computer program.

[0204] Optionally, in this embodiment, the aforementioned electronic device may be located in at least one of a plurality of network devices in a computer network.

[0205] Optionally, in this embodiment, the processor can be configured to perform the following steps via a computer program:

[0206] S1 displays a video feed; the first object in the video feed is controlled by the player's account.

[0207] S2, obtain the object control instructions corresponding to the audience account;

[0208] S3, based on object control instructions, gains control over the first object.

[0209] Or it may be configured to perform the following steps via a computer program:

[0210] S1, push the video screen of the player account to the viewer account and at least one third user account, wherein the video screen of the player account is displayed in the respective viewing interface of the viewer account and at least one third user account, and the video screen of the player account includes the game screen of the target game associated with the player account, and the first object in the target game is controlled by the second user corresponding to the player account;

[0211] S2, receiving object control instructions executed by the viewer account and at least one third-party user account in their respective viewing interfaces, wherein the object control instructions are used to instruct the first object in the target game to perform game operations;

[0212] S3, based on the instruction parameters of the object control instructions, determines the game execution instruction from at least two object control instructions, wherein the game execution instruction instructs the first object in the target game to perform the target operation;

[0213] S4, acquire the target game screen generated by the first object performing the target operation in the target game and push it to the audience account and at least one third user account.

[0214] Alternatively, as those skilled in the art will understand, Figure 7 The structure shown is for illustrative purposes only. Electronic devices can also be smartphones (such as Android phones, iOS phones, etc.), tablets, PDAs, mobile internet devices (MIDs), PADs, and other terminal devices. Figure 7 This does not limit the structure of the aforementioned electronic devices. For example, the electronic device may also include components that are more... Figure 7 The more or fewer components shown (such as network interfaces, etc.), or having the same Figure 7 The different configurations shown.

[0215] The memory 702 can be used to store software programs and modules, such as program instructions / modules corresponding to the interactive methods and devices in real-time communication in this embodiment of the invention. The processor 704 executes various functional applications and data processing by running the software programs and modules stored in the memory 702, thereby realizing the interactive methods in real-time communication described above. The memory 702 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory 702 may further include memory remotely located relative to the processor 704, and these remote memories can be connected to the terminal via a network. Examples of such networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof. Specifically, the memory 702 may be used, but is not limited to, to store information such as spectator accounts, player accounts, and object control instructions. As an example, such as... Figure 7 As shown, the memory 702 may include, but is not limited to, the display unit 502, the first acquisition unit 504, or the second acquisition unit 506 in the interactive device of the real-time communication described above. Furthermore, it may include, but is not limited to, other module units in the interactive device of the real-time communication described above, which will not be elaborated upon in this example.

[0216] Optionally, the transmission device 706 described above is used to receive or send data via a network. Specific examples of the network described above may include wired networks and wireless networks. In one example, the transmission device 706 includes a Network Interface Controller (NIC), which can be connected to other network devices and a router via a network cable to communicate with the Internet or a local area network. In another example, the transmission device 706 is a radio frequency (RF) module, used for wireless communication with the Internet.

[0217] In addition, the aforementioned electronic device also includes: a display 708 for displaying the aforementioned video image; and a connection bus 710 for connecting the various module components in the aforementioned electronic device.

[0218] In other embodiments, the aforementioned terminal device or server can be a node in a distributed system, wherein the distributed system can be a blockchain system, which is a distributed system formed by connecting multiple nodes through network communication. The nodes can form a peer-to-peer (P2P) network, and any form of computing device, such as a server, terminal, or other electronic device, can become a node in the blockchain system by joining this peer-to-peer network.

[0219] According to one aspect of this application, a computer program product or computer program is provided, comprising computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the methods provided in various alternative implementations of the interactive aspects of the above-described real-time communication. The computer program is configured to execute the steps in any of the above-described method embodiments at runtime.

[0220] Optionally, in this embodiment, the computer-readable storage medium described above may be configured to store a computer program for performing the following steps:

[0221] S1 displays a video feed; the first object in the video feed is controlled by the player's account.

[0222] S2, obtain the object control instructions corresponding to the audience account;

[0223] S3, based on object control instructions, gains control over the first object.

[0224] Or it may be configured to store a computer program for performing the following steps:

[0225] S1, push the video screen of the player account to the viewer account and at least one third user account, wherein the video screen of the player account is displayed in the respective viewing interface of the viewer account and at least one third user account, and the video screen of the player account includes the game screen of the target game associated with the player account, and the first object in the target game is controlled by the second user corresponding to the player account;

[0226] S2, receiving object control instructions executed by the viewer account and at least one third-party user account in their respective viewing interfaces, wherein the object control instructions are used to instruct the first object in the target game to perform game operations;

[0227] S3, based on the instruction parameters of the object control instructions, determines the game execution instruction from at least two object control instructions, wherein the game execution instruction instructs the first object in the target game to perform the target operation;

[0228] S4: Obtain the target game screen generated by the first object performing the target operation in the target game and push it to the audience account and at least one third-party user account.

[0229] Optionally, in this embodiment, those skilled in the art will understand that all or part of the steps in the various methods of the above embodiments can be implemented by a program instructing the hardware related to the terminal device. The program can be stored in a computer-readable storage medium, which may include: flash drive, read-only memory (ROM), random access memory (RAM), disk or optical disk, etc.

[0230] The sequence numbers of the above embodiments of the present invention are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.

[0231] If the integrated units in the above embodiments are implemented as software functional units and sold or used as independent products, they can be stored in the aforementioned computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause one or more computer devices (which may be personal computers, servers, or network devices, etc.) to execute all or part of the steps of the methods of the various embodiments of the present invention.

[0232] In the above embodiments of the present invention, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0233] In the several embodiments provided in this application, it should be understood that the disclosed client can be implemented in other ways. The device embodiments described above are merely illustrative; for example, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces, indirect coupling or communication connection between units or modules, and may be electrical or other forms.

[0234] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0235] Furthermore, the functional units in the various embodiments of the present invention can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0236] The above description is only a preferred embodiment of the present invention. It should be noted that for those skilled in the art, several improvements and modifications can be made without departing from the principle of the present invention, and these improvements and modifications should also be considered within the scope of protection of the present invention.

Claims

1. An interaction method in real-time communication, characterized in that, include: The video feed is displayed; wherein, the first object in the video feed is controlled by the player's account; Obtain the object control instructions corresponding to the audience account; Based on the object control instructions, control over the first object is obtained; The display of video footage includes: displaying the video footage of the player's account in the viewing interface of the viewer's account; The step of obtaining the object control instruction corresponding to the viewer account includes: obtaining the target interaction information input by the viewer account in the interaction area of ​​the viewing interface, wherein the interaction area is used to display the interaction information of each account; Generate the object control instructions corresponding to the target interaction information; The method further includes, after obtaining the target interaction information input by the audience account in the interaction area of ​​the viewing interface, determining the amount of virtual resources spent on the target interaction information, and returning the amount of virtual resources indicated in the object control instruction to the audience account if the target operation indicated by the object control instruction is determined not to be executed by the target game, or if the object control instruction is determined not to be a game execution instruction. The instruction parameter includes the amount of virtual resources. The step of generating the object control instruction corresponding to the target interaction information includes adding a parameter identifier indicating the quantity of the virtual resource to the object control instruction.

2. The method according to claim 1, characterized in that, After displaying the video image, the method further includes: Obtain an influence command for a second object; wherein the influence command is used to assist and / or influence the movement of the second object, wherein the second object is an object in the video frame.

3. The method according to claim 1, characterized in that, The step of obtaining the target interactive information input by the viewer's account in the interactive area of ​​the viewing interface includes: In response to an input triggering operation performed on the interaction area, first interaction information input by the viewer account is displayed in the input sub-area, wherein the input sub-area is an area for receiving the viewer account input information; When the first interactive information matches the target interactive information in the interactive information template, an instruction prompt is displayed, wherein the instruction prompt is used to confirm that the first interactive information is converted into the target interactive information; In response to the instruction confirmation operation performed on the instruction prompt information, the target interaction information is obtained.

4. The method according to claim 1, characterized in that, Before generating the object control instruction corresponding to the target interaction information, the method further includes: displaying game interaction controls in the interaction area of ​​the viewing interface, wherein the game interaction controls are interaction controls that match the operation controls for controlling the first object in the target game; The step of generating the object control instruction corresponding to the target interaction information includes: generating the object control instruction corresponding to the game interaction control in response to a trigger operation performed by the audience account on the game interaction control.

5. The method according to any one of claims 1 to 4, characterized in that, After obtaining control over the first object based on the object control instructions, the method further includes at least one of the following: When the object control command instructs the first object to be adjusted, the first object is controlled to be adjusted from its initial position to its target position. When the object control instruction instructs the first object to perform action control, the first object is controlled to perform the target action; When the object control command instructs the addition of a third object to the target game, the game screen of the third object is added to the video screen.

6. An interactive device for real-time communication, characterized in that, include: A display unit is used to display video footage; wherein, the first object in the video footage is controlled by the player's account; The first acquisition unit is used to acquire the object control instructions corresponding to the audience account; The second acquisition unit is used to acquire control over the first object based on the object control instructions; The display unit includes: a first display module for displaying the video screen of the player account in the viewing interface of the viewer account; the first acquisition unit includes: an acquisition module for acquiring target interaction information input by the viewer account in the interaction area of ​​the viewing interface, wherein the interaction area is used to display the interaction information of each account; and a generation module for generating the object control instruction corresponding to the target interaction information. The device further includes: a determining module, configured to, after acquiring the target interaction information input by the viewer account in the interaction area of ​​the viewing interface, determine the amount of virtual resources spent on the target interaction information; and, if the target operation indicated by the object control instruction is determined not to be executed by the target game, or if the object control instruction is determined not to be a game execution instruction, return the amount of virtual resources indicated in the object control instruction to the viewer account, wherein the instruction parameter includes the amount of virtual resources; and a generating module, comprising: an adding submodule, configured to add a parameter identifier indicating the amount of virtual resources to the object control instruction.

7. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes a stored program, wherein the program, when executed, performs the method described in any one of claims 1 to 5.

8. An electronic device comprising a memory and a processor, characterized in that, The memory stores a computer program, and the processor is configured to execute the method described in any one of claims 1 to 5 through the computer program.

Images