Game control methods, devices and computer-readable storage media

By transmitting user control commands to the game installation device through a persistent connection channel, the problem of poor applicability of live streaming interaction is solved, enabling interactive support for various game applications and improving interactive performance and user experience.

CN123123593APending Publication Date: 2026-11-17BEIJING ZITIAO NETWORK TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202510621994.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-05-14
Publication Date
2026-11-17

AI Technical Summary

Technical Problem

Live streaming interaction is poorly suited for game applications, resulting in poor interactive performance. Existing technologies require game developers to develop compatible interfaces for different live streaming platforms, which increases development costs and time and limits the types of game applications that support live streaming interaction.

Method used

User control commands are transmitted to the game installation device via a persistent connection channel, eliminating the need for interface adaptation between the game application and the live streaming platform. This supports live streaming interaction for various game applications, including console games, PC games, and cloud games. The persistent connection channel for real-time communication reduces transmission latency of control commands and improves reliability.

Benefits of technology

It improves the applicability and interactive performance of live streaming for game applications, enriches the types of game applications that support live streaming, reduces development costs, and enhances the user's game interaction experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN123123593A_ABST
    Figure CN123123593A_ABST
Patent Text Reader

Abstract

This disclosure relates to a game control method, apparatus, and computer-readable storage medium, belonging to the field of computer technology. The game control method includes: in response to receiving a control command for a game application from at least one user participating in a live interactive session, transmitting the control command to a game installation device via a persistent connection channel; and in response to receiving a first media stream of the game application returned by the game installation device, displaying the first media stream in the interface of the live interactive session, wherein the first media stream is generated based on a game control result corresponding to the control command. The technical solution of this disclosure can improve the applicability of live interactive sessions to games, thereby enhancing the interactive performance of live interactive sessions.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This disclosure relates to the field of computer technology, and in particular to a game control method, apparatus, and computer-readable storage medium. Background Technology

[0002] With the development of internet technology, live streaming has seen increasing development and application. For example, users can watch game live streams interactively and participate in the game with other users during the live stream, thus enriching their leisure time.

[0003] In related technologies, during game live streaming, users can only participate in live interactions with designated game applications adapted to the live streaming platform. Summary of the Invention

[0004] The inventors of this disclosure have discovered the following problems in the above-mentioned related technologies: live streaming interaction is poorly applicable to game applications, resulting in poor interactive performance of live streaming interaction.

[0005] In view of this, this disclosure proposes a game control technology solution that can improve the applicability of live interactive technology to game applications, thereby enhancing interactive performance.

[0006] According to some embodiments of this disclosure, a game control method is provided, comprising: in response to receiving a control command for a game application from at least one user participating in a live interactive session, transmitting the control command to a game installation device via a persistent connection channel; and in response to receiving a first media stream of the game application returned by the game installation device, displaying the first media stream in the interface of the live interactive session, wherein the first media stream is generated based on a game control result corresponding to the control command.

[0007] In some embodiments, the game installation-side device is equipped with the live streaming tool for the live streaming interaction and the game application. The step of transmitting the control command to the game installation-side device via a persistent connection channel in response to receiving a control command for the game application from at least one user participating in the live streaming interaction includes: transmitting the control command to the live streaming tool via the persistent connection channel, wherein the live streaming tool is used to transmit the control command to the game application.

[0008] In some embodiments, the live streaming tool is used to parse the control commands and transmit the parsing results to the game application.

[0009] In some embodiments, displaying the first media stream in the live streaming interface in response to receiving the first media stream returned by the game installation device includes: receiving the first media stream from the streaming media server through the persistent connection channel, wherein the first media stream is pushed to the streaming media server by the game installation device through the persistent connection channel; and displaying the first media stream in the live streaming interface.

[0010] In some embodiments, the game installation device is equipped with a live streaming tool for the live interaction, and the first media stream is pushed to the streaming media server by the live streaming tool through the persistent connection channel.

[0011] In some embodiments, the game installation device is a cloud gaming server or the local device of the live streamer.

[0012] In some embodiments, the step of transmitting the control command to the game installation device via a persistent connection channel in response to receiving a control command for the game application from at least one user participating in the live interaction includes: displaying a second media stream of the game application in the interface of the live interaction, the second media stream being acquired through a live streaming tool of the live interaction, the live streaming tool being installed on the local device of the streamer of the live interaction; and transmitting the control command to the game installation device via the persistent connection channel in response to receiving the control command sent by the at least one user based on the second media stream.

[0013] In some embodiments, the at least one user includes multiple users, the game application includes multiple virtual objects, and each of the multiple users corresponds one-to-one with each of the multiple virtual objects; the game control result includes the control result of the game installation device controlling the corresponding virtual object based on the control instructions of each user for the corresponding virtual object.

[0014] In some embodiments, the game installation-side device is the local device of the streamer in the live interaction, and the at least one user includes participating users who interact with the streamer in the game. The step of transmitting the control command to the game installation-side device through a persistent connection channel in response to receiving the control command for the game from at least one user participating in the live interaction includes: receiving the control command for the game application from the streamer through a physical controller, and receiving the control command for the game application from the participating user through a virtual controller.

[0015] In some embodiments, the at least one user includes a participating user who interacts with the streamer in the live stream and engages in game interaction.

[0016] In some embodiments, the first media stream includes game visuals and game audio generated based on the game control results corresponding to the control instructions.

[0017] In some embodiments, the persistent connection channel includes a persistent connection channel for real-time communication.

[0018] According to some other embodiments of this disclosure, a game control device is provided, comprising: a transmission module configured to transmit the control command to a game installation device via a persistent connection channel in response to receiving a control command for a game application from at least one user participating in a live interactive session; and a display module configured to display the first media stream in the interface of the live interactive session in response to receiving a first media stream returned by the game installation device, wherein the first media stream is generated based on the game control result corresponding to the control command.

[0019] According to further embodiments of this disclosure, an apparatus is provided, comprising: a memory; and a processor coupled to the memory, the processor being configured to execute the game control method of any of the above embodiments based on instructions stored in the memory device.

[0020] According to further embodiments of the present disclosure, a computer-readable storage medium is provided having computer instructions stored thereon that, when executed by a processor, implement the game control method of any of the above embodiments.

[0021] According to further embodiments of this disclosure, a computer program product is also provided, including instructions that, when executed by a processor, cause the processor to perform the game control method according to any of the foregoing embodiments.

[0022] In the above embodiments, control commands for game applications are transmitted via a persistent connection channel, enabling users to participate in live interactive sessions between different game applications. This enhances the applicability of live interactive sessions to game applications, thereby improving the interactive performance of live interactive sessions.

[0023] Other features, aspects, and advantages of this disclosure will become clear from the following detailed description of exemplary embodiments with reference to the accompanying drawings. Attached Figure Description

[0024] Embodiments of this disclosure are described below with reference to the accompanying drawings. It should be understood that the drawings described below are merely illustrative of some embodiments of this disclosure and are not intended to limit the scope of this disclosure. In the drawings:

[0025] Figure 1 Flowcharts illustrating some embodiments of the game control method of this disclosure;

[0026] Figure 2Schematic diagrams illustrating some embodiments of the virtual control panel of this disclosure;

[0027] Figure 3 Schematic diagrams illustrating some embodiments of the game installation side device of this disclosure being a cloud gaming server;

[0028] Figure 4 Schematic diagrams illustrating some embodiments of the game installation side device of this disclosure being a local device of a live interactive broadcaster;

[0029] Figure 5 A schematic architecture diagram illustrating some embodiments of the game control method of this disclosure;

[0030] Figures 6a to 6c Schematic diagrams showing some embodiments of the layout display of the live streaming room of this disclosure;

[0031] Figure 7 Block diagrams showing some embodiments of the game control device of this disclosure;

[0032] Figure 8 Block diagrams illustrating other embodiments of the game control device of this disclosure are shown.

[0033] It should be understood that, for ease of description, the dimensions of the various parts shown in the accompanying drawings are not necessarily drawn to actual scale. The same or similar reference numerals are used in the various drawings to denote the same or similar parts. Therefore, once an item is defined in one drawing, it may not be discussed further in subsequent drawings. Detailed Implementation

[0034] The technical solutions of the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings. It should be understood that this disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein.

[0035] It should be understood that the various steps described in the method embodiments of this disclosure may be performed in different orders and / or in parallel. Furthermore, method embodiments may include additional steps and / or omit the steps shown. The scope of this disclosure is not limited in this respect. Unless otherwise specifically stated, the relative arrangement, numerical expressions, and values ​​of components and steps set forth in these embodiments should be interpreted as merely exemplary and do not limit the scope of this disclosure.

[0036] As used in this disclosure, the term "comprising" and its variations are open-ended terms that include at least the following elements / features but do not exclude other elements / features, i.e., "including but not limited to". The term "based on" means "at least partially based on".

[0037] It should be noted that the concepts of "first," "second," etc., used in this disclosure are used only to distinguish different devices, modules, or units, and are not intended to define the order of functions performed by these devices, modules, or units or their interdependencies. Unless otherwise specified, the concepts of "first," "second," etc., are not intended to imply that the objects described herein must be in a given temporal, spatial, rank, or any other given order.

[0038] It should be noted that the terms "a" and "a plurality of" used in this disclosure are illustrative rather than restrictive, and those skilled in the art should understand that, unless otherwise expressly indicated in the context, they should be understood as "one or more".

[0039] The names of messages or information exchanged between multiple devices in the embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.

[0040] The user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, data stored, data displayed, etc.) involved in this disclosure are all information and data authorized by the user or fully authorized by all parties. Furthermore, the collection, use and processing of the relevant data shall comply with the relevant laws, regulations and standards of the relevant countries and regions, and corresponding operation portals shall be provided for users to choose to authorize or refuse.

[0041] The embodiments of this disclosure are described in detail below with reference to the accompanying drawings; however, this disclosure is not limited to these specific embodiments. These specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments. Furthermore, in one or more embodiments, specific features, structures, or characteristics can be combined in any suitable manner that will be apparent to those skilled in the art from this disclosure.

[0042] As mentioned earlier, during game live streaming, participating users (also known as "guests") and viewers (also known as "viewers") can send commands such as likes, comments, and gifts through the interactive space (e.g., the live stream room). For example, cloud gaming xxx is a game application adapted to the live streaming platform corresponding to the live stream room; the streamer and participating users can jointly participate in cloud gaming xxx and interact with the game. Cloud gaming audio and video, as well as other audio and video, can be pushed to the viewer's device for display via live streaming.

[0043] Although live streaming platforms can provide live streaming services for spaces where live interaction takes place (such as live streaming rooms), allowing users to participate in the game together with other users during the live stream, such game applications that support live interaction need to have an interface that is compatible with the live streaming platform in order to receive game control commands from users participating in the live interaction.

[0044] Due to limitations in the compatibility of interfaces between game applications and live streaming platforms, game developers need to create a specific version of their game with an adapted interface for each of the multiple live streaming platforms to support live interaction. This results in high development costs and long development cycles for game applications. Consequently, this approach limits the variety of game applications that support user interaction in live streams, making live streaming interaction less suitable for game applications and leading to poor interactive performance.

[0045] In view of this, the present disclosure provides a technical solution for game control that eliminates the need for game manufacturers to develop different game versions with interfaces adapted to different live streaming platforms, while still supporting the live interactiveness of game applications. This enriches the variety of game applications that support live interactiveness at a lower cost and improves the live interactive performance of game applications.

[0046] Figure 1 Flowcharts illustrating some embodiments of the game control method of this disclosure are shown.

[0047] like Figure 1 As shown, in step 110, in response to receiving a control command for the game application from at least one user participating in the live interaction, the control command is transmitted to the game installation device via a persistent connection channel.

[0048] In some embodiments, the game application may include one or more of console games, personal computer games (PC games), and games on a PC with an arcade emulator mounted.

[0049] In step 120, in response to receiving the first media stream of the game application returned by the game installation device, the first media stream is displayed in the live interactive interface. For example, the first media stream can be generated based on the game control result corresponding to the control command.

[0050] In some embodiments, the first media stream may include game visuals and game audio generated based on the game control results corresponding to control commands.

[0051] In the above embodiments, even if the game application lacks an interface compatible with the live streaming platform for interactive live streaming, the game installation device can still receive control commands sent by the user during the live stream interaction via a persistent connection channel. In this way, live streaming interaction can be adapted to different game applications, enriching the variety of game applications that support live streaming interactivity. Furthermore, game developers do not need to develop different game versions compatible with different live streaming platform interfaces, improving the applicability of live streaming interaction to game applications at a lower cost, thereby enhancing the interactive performance of live streaming interaction.

[0052] In some embodiments, the persistent connection channel (also known as the "long connection channel") includes a persistent connection channel for real-time communication (RTC) (also known as the "RTC channel"). This helps reduce the transmission latency of control commands, improves the reliability of control command transmission, and thus enhances the user's interactive gaming experience during game live streaming.

[0053] In some embodiments, a persistent connection channel may include at least one of a persistent connection channel established based on the WebSocket protocol, a persistent connection channel established based on the Transmission Control Protocol (TCP), and a persistent connection channel established based on the User Datagram Protocol (UDP).

[0054] In some embodiments, the game installation side device can be a cloud gaming server, or it can be the local device of the live streamer. For example, the game installation side device can be the live streamer's computer or mobile phone.

[0055] In other words, the game control method provided in this embodiment can support both cloud gaming services and local gaming services.

[0056] The implementation of step 110 will be illustrated below with reference to some embodiments, in the case that the game installation device is a cloud gaming server.

[0057] In some embodiments, when the game installation device is a cloud gaming server, a virtual controller can receive control commands from the live streamer regarding the game application, as well as control commands from participating users interacting with the streamer regarding the game application.

[0058] In some embodiments, the space for live streaming interaction may include a multi-user interactive space where multiple users engage in online social interaction. For example, the space for live streaming interaction may include a live streaming room or a chat room.

[0059] In some embodiments, at least one user participating in a live stream interaction can include users who interact with the streamer in a game. For example, the space for the live stream interaction can be a live streaming room, where the streamer can broadcast a game. At least one user can include users who interact with the streamer in a game within the live streaming room. For example, participating users can include users who connect with the streamer via voice chat in the live streaming room (also known as "users on microphone").

[0060] In some embodiments, a virtual controller is provided in a live streaming platform that enables live interaction.

[0061] For example, the space for live interaction is a live streaming room. The mobile devices (e.g., smartphones) of the streamer and / or participating users in the live streaming room can connect to a game controller (also known as an "external controller") via Bluetooth. Live streaming software can be installed on the mobile devices of the streamer and / or participating users. The streamer and / or participating users transmit control commands for the game application to the live streaming software via the game controller. The live streaming software transmits the control commands to a virtual controller in the live streaming platform, so that the virtual controller transmits the control commands to the game installation device via a persistent connection channel. That is, in this way, control commands can be generated based on the user's operation of the game controller.

[0062] For example, the mobile devices of the streamer and / or participating users in the live stream may have live streaming software installed. This software can provide a virtual control panel that can be displayed in the live stream. The streamer and / or participating users generate control commands for the game application by operating the virtual control panel. The live streaming software can capture the control commands generated based on the streamer's and / or participating users' operations on the virtual control panel and transmit these commands to a virtual controller in the live streaming platform. This virtual controller then transmits the control commands to the game's installation device via a persistent connection channel. In other words, in this approach, control commands can be generated based on the user's actions on the virtual control panel.

[0063] The following is combined Figure 2 The embodiments described herein exemplify how control commands for a game application are generated based on the user's actions on the virtual control panel.

[0064] Figure 2 Schematic diagrams illustrating some embodiments of the virtual control panel of this disclosure are shown.

[0065] For example, a user's mobile device (such as a mobile phone) may have live streaming software installed. Live streaming software can provide services such as... Figure 2The virtual control panel shown may include directional buttons (e.g., up, down, left, and right buttons) for controlling the movement direction of virtual objects in the game application, and skill buttons (e.g., button 1, button 2, button 3, and button 4) for controlling the game skills of virtual objects in the game application.

[0066] During the game interaction process, the live streaming software installed on the users' mobile devices can display a virtual control panel in the live streaming room. Users can generate control commands for the game application by tapping the directional buttons and / or skill buttons on the virtual control panel.

[0067] It should be understood that, regardless of whether one operates a virtual control panel or a game controller, the core principle is to provide an operation entry point on the user's side. This allows users participating in the live stream interaction to input control commands for the game application through this entry point, thereby enabling remote control of the game application.

[0068] The following is combined Figure 3 The embodiments described herein exemplify how user control commands for a game application are transmitted when the game installation device is a cloud gaming server.

[0069] Figure 3 The diagrams illustrate some embodiments of the game installation side device of this disclosure as a cloud gaming server.

[0070] like Figure 3 As shown, the space for live interaction is schematically represented as a live streaming room, where the host and two participating users ("Guest A" and "Guest B") engage in a game together. The game screen is displayed at the top of the live streaming room. A virtual control panel is displayed below the game screen.

[0071] The streamer can use gestures to operate the buttons on the virtual control panel provided by the live streaming software (such as buttons W, A, S, D, and buttons 1, 2, 3, and 4) to generate control commands for the game application (also known as "operation mapping"). After the live streaming software captures the streamer's control commands, it transmits the control commands to the corresponding virtual controller in the live streaming platform. Figure 3 (Not shown). The virtual controller then transmits the control command via the RTC channel to the game installation device configured on the cloud gaming server.

[0072] Guest A can generate control commands for the game application by gesturing on the virtual control panel provided by the live streaming software (e.g., button up, button down, button left, button right, and buttons 5, 6, 7, and 8). After capturing Guest A's control commands, the live streaming software transmits them to the virtual controller in the corresponding live streaming platform. The virtual controller then transmits the control commands via the RTC channel to the game installation device configured on the cloud gaming server.

[0073] Guest B can generate game control commands by gesturing on the virtual control panel provided by the live streaming software (e.g., buttons U, I, O, P, H, J, K, and L). After capturing Guest B's control commands, the live streaming software transmits them to the virtual controller within the corresponding live streaming platform. The virtual controller then transmits the control commands via the RTC channel to the cloud gaming server, which acts as the game's installation device.

[0074] In the above embodiments, when the game installation device is a cloud gaming server, the virtual controller can receive control commands from the streamer and participating users for the game application and transmit them to the game installation device via a persistent connection channel, so that the participating users and the streamer can jointly operate the game application.

[0075] In this way, game applications installed on the game installation side device configured on the cloud gaming server do not need to have an interface adapted to the live streaming platform corresponding to the live streaming interaction, but can still receive user control commands for the game application in the live streaming interaction, which improves the applicability of the live streaming interaction to the game application and thus improves the interactive performance.

[0076] The implementation of step 110 will be illustrated below with reference to some embodiments, in the case where the game installation device is the local device of the live streamer.

[0077] In some embodiments, when the game installation device is the local device of the live streamer, the control commands of the live streamer for the game application can be received through a physical controller, and the control commands of the participating users who are interacting with the streamer for the game application can be received through a virtual controller.

[0078] For example, the physical controller used to receive control commands from the streamer can be located in an external device (such as a mouse and / or keyboard) connected to the streamer's local device. For instance, the streamer can send control commands for a game application via a mouse and / or keyboard connected to the local device to control the game application.

[0079] For example, a virtual controller can be provided in a live streaming platform for interactive gameplay to receive control commands from participating users who are interacting with the streamer regarding the game application. Specific details about the virtual controller can be found in the descriptions of the foregoing related embodiments. Further elaboration will not be repeated here.

[0080] The following is combined Figure 4 The embodiments described herein exemplify how user control commands for a game application are transmitted when the game installation device is configured on the local device of the streamer engaging in live streaming interaction.

[0081] Figure 4 The diagrams illustrate some embodiments of the game installation side device of this disclosure configured on the local device of a live streamer.

[0082] like Figure 4 As shown, the space for live interaction is schematically represented as a live streaming room, where the host and participating users (i.e., "Guest C") participate in the game together.

[0083] The streamer can send control commands to the game application installed on the game installation side device by using a mouse and / or keyboard connected to a local device (such as a computer).

[0084] Guest C's mobile device can have live streaming software installed. This software provides a virtual control panel that can be displayed in the live stream. Guest C can use gestures to operate the buttons on the virtual control panel (e.g., buttons W, A, S, D, and buttons 1, 2, 3, and 4) to generate control commands for the game application (also known as "operation mapping"). After capturing Guest C's control commands, the live streaming software transmits them to the corresponding virtual controller in the live streaming platform. The virtual controller then transmits these commands to the game installation device via the RTC channel to control the game application installed on that device.

[0085] In the above embodiments, when the game installation device is the local device of the live streamer, the physical controller receives the control commands of the streamer for the game application, while the virtual controller receives the control commands of the participating users for the game application, so that the participating users and the streamer can jointly operate the game application.

[0086] In this way, the game application installed on the streamer's local device, which is the game installation side device, does not need to have an interface adapted to the live streaming platform for live interaction, but can still receive control commands from participating users for the game application, thereby improving the applicability of live interaction to game applications and thus improving the interactive performance of live interaction.

[0087] In some embodiments, the game installation device may have a game application and a live streaming tool for interactive live streaming installed. For example, the space for live streaming interaction can be a live streaming room, and the live streaming tool can be a live streaming companion.

[0088] For example, such as Figure 4 As shown, the live streaming tool can provide interactive tools, interactive methods, and interactive message boxes to enable the streamer and the audience to interact.

[0089] In some embodiments, in response to receiving a control command for the game application from at least one user participating in the live interaction, the control command for the game application from at least one user participating in the live interaction is transmitted to the live streaming tool via a persistent connection channel, wherein the live streaming tool is used to transmit the control command to the game application.

[0090] For example, a streamer can start a game livestream using a livestreaming tool. After receiving control commands from users interacting with the streamer, the tool can transmit these commands to the game application to control it.

[0091] For example, please continue to see Figure 4 If the game installation device is the streamer's local device, the live streaming tool can be installed on the streamer's local device.

[0092] Guest C can connect with the host via the RTC channel. Guest C's control commands for the game application can be transmitted to the live streaming tool via the RTC channel (i.e., "connected RTC"). After transmitting the control commands to the game application, the live streaming tool can receive the game screen generated after controlling the game application based on the control commands. The live streaming tool can then push the game screen to the live stream room for display.

[0093] In this way, live streaming tools do not need to have adapted interfaces. They can receive user control commands through persistent connection channels and transmit the control commands to the game application to control the game application, thereby further helping to improve interactive performance at a lower cost.

[0094] In some embodiments, the live streaming tool can parse control commands and transmit the parsed results to the game application. For example, control commands sent by users to the game application during live streaming interaction cannot be directly executed by the game. The live streaming tool can parse the control commands to convert them into commands that the game application can directly execute before transmitting them to the game application, thereby enabling control of the game application.

[0095] For example, please continue to see Figure 4The live streaming tool may include a keyboard mapping module. After receiving control commands from guest C via the RTC channel, the live streaming tool can parse the control commands through the keyboard mapping module and transmit the parsed results to the game application installed on the game installation side device for control of the game application.

[0096] This ensures that user-defined control commands for the game application enable control over the application, thereby reliably improving the live interactive performance of the game application.

[0097] The following examples, in conjunction with some embodiments, provide further illustrative descriptions of the user's control commands for the game application in step 110.

[0098] In some embodiments, a second media stream of the game application may be displayed in the live interactive interface. In response to receiving a control command for the game application sent by at least one user participating in the live interactive session based on the second media stream, the control command is transmitted to the game installation device via a persistent connection channel. That is, the control command transmitted to the game installation device can be sent by the user based on the second media stream of the game application.

[0099] In some embodiments, the second media stream may be generated based on a launch command of the game application. For example, the second media stream may include game footage and game audio generated after the game application is launched based on the launch command of the game application.

[0100] In some embodiments, the second media stream may be generated based on the result of a previous game control corresponding to a previously transmitted control command. For example, the second media stream may include game visuals and game audio generated based on the result of a previous game control corresponding to a previously transmitted control command.

[0101] It is understood that the second media stream may include game visuals and audio generated before the game application is controlled based on the control instructions received in step 110. The first media stream may include game visuals and audio generated after the game application is controlled based on the control instructions received in step 110.

[0102] In this way, the live interactive interface can display the media stream before and after controlling the game application based on control commands, so that users can control the game application based on the media stream displayed in the live interactive interface, thereby improving the user's interactive experience in the game.

[0103] In some embodiments, the second media stream can be obtained through a live streaming tool for live interaction. This live streaming tool can be installed on the local device of the live streamer.

[0104] For example, the game installation device can be the streamer's local device, with both the live streaming tool and the game application installed on that device. The streamer can launch the game application installed on their local device. In response to the streamer's launch command for the game application, the live streaming tool installed on the streamer's local device can push the game screen and audio (i.e., the second media stream) generated after the game application is launched to the live streaming room for display, thus starting the game live stream.

[0105] In the above embodiments, the second media stream of the game application can be acquired by a live streaming tool and displayed in the live streaming interface. This allows users to send control commands to the game application based on the second media stream, thereby enhancing the user's interactive experience in the game.

[0106] The implementation of step 120 will be illustrated below with reference to some embodiments.

[0107] In some embodiments, a first media stream can be received from a streaming media server via a persistent connection channel and displayed in a live interactive interface. For example, the first media stream can be pushed to the streaming media server by a game installation device via a persistent connection channel.

[0108] For example, the game installation device is a cloud gaming server. The first media stream can be pushed from the cloud gaming server to the streaming media server via a persistent connection channel. Subsequently, the live streaming platform can receive the first media stream returned by the game installation device from the streaming media server via the persistent connection channel and display the first media stream in the live streaming room.

[0109] In some embodiments, the game installation device may have a live streaming tool installed for interactive live streaming. The first media stream can be pushed to the streaming media server by the live streaming tool through a persistent connection channel.

[0110] For example, the game installation device is configured on the local device of the streamer participating in the live broadcast. The first media stream can be pushed to the streaming media server by the live streaming tool installed on this local device. Subsequently, the live streaming platform can receive the first media stream returned by the game installation device from the streaming media server through a persistent connection channel and display the first media stream in the live broadcast room.

[0111] In the above embodiments, the first media stream generated based on the game control result corresponding to the control command can be returned by the game installation device through a persistent connection channel and displayed in the live interactive interface. In this way, the transmission of the first media stream is no longer limited by the compatibility of the interface between the game application and the live streaming platform, thereby further improving the applicability of live interactive streaming to game applications and further enhancing interactive performance.

[0112] Next, combined Figure 5The game control schemes are illustrated in two scenarios: the game installation device is a cloud gaming server, and the game is a local device of a live streamer.

[0113] As previously stated, the game control scheme provided in this disclosure supports live streaming interactions where the host and guests play the same game together, i.e., it supports multi-player simultaneous gaming. Game applications may include cloud gaming and local gaming.

[0114] In the case of cloud gaming, the device on which the game is installed can be a cloud server. The streamer and guests receive control commands for the game via a virtual controller.

[0115] When the game application is a local game, the device on which the game is installed can be the streamer's local device. The streamer receives control commands for the game application through a physical controller, while guests receive control commands through a virtual controller. The game screen can be pushed to the live stream room for display via live streaming tools.

[0116] Figure 5 A schematic architecture diagram illustrating some embodiments of the game control method disclosed herein is shown.

[0117] Figure 5 The illustration shows the live interaction as the live room, the host's local device as a personal computer (also known as the "host PC"), and the persistent connection channel as the RTC channel.

[0118] like Figure 5 As shown, the live streaming platform corresponding to the live streaming room can provide a virtual controller (also known as a "virtual gamepad component").

[0119] For example, a user's mobile device may have live streaming software installed. This software can provide a virtual control panel that can be displayed in the live stream. Users can use gestures to operate the buttons on this virtual control panel (also known as a "mobile user interface") to generate control commands for the game application.

[0120] For example, a user's mobile device can connect to a game controller (also known as an "external controller") via Bluetooth. The user can then use the game controller to generate control commands for the game application, which can be transmitted to the live streaming software via Bluetooth.

[0121] When the game installation device is a cloud gaming server, the game application (also known as a "game program") is installed on the game installation device.

[0122] Both the broadcaster and participating users have live streaming software installed on their mobile devices. The broadcaster and participating users send control commands (also known as "game commands") to the game application through the virtual control panel provided by their respective live streaming software. The live streaming software then transmits the captured control commands from the broadcaster and participating users to the virtual controller in the live streaming platform. Figure 5 (Not shown), and the virtual controller transmits the control commands of the broadcaster and participating users to the cloud gaming server through the RTC channel.

[0123] Cloud gaming servers can parse control commands and transmit the parsed results to the game application for control. Then, the cloud gaming server can push the first media stream (also known as the "game audio / video stream") generated based on the game control results of the control commands to a streaming media server via the RTC channel. Figure 5 (Not shown).

[0124] The live streaming platform can pull the first media stream from the streaming media server through the RTC channel and push the first media stream to the live streaming room for display.

[0125] In the case where the game installation device is the local device of the live streamer, the game installation device has the live streaming tools (also known as "PC Companion") and game applications (such as PC games) installed.

[0126] The streamer sends control commands for the game application via an external device (such as a mouse and / or keyboard) connected to the local device. Participating users send control commands for the game application via a virtual control panel provided by the live streaming software installed on their mobile devices. The live streaming software captures the participating users' control commands and transmits them to a virtual controller in the live streaming platform, which then transmits the commands to the live streaming tool via the RTC channel.

[0127] Live streaming tools can parse the control commands of participating users and transmit the parsed results to the game application to enable control over the game. Then, the live streaming tool can push the first media stream (including game visuals and audio) generated based on the game control results corresponding to the control commands to a streaming media server via the RTC channel. Figure 5 (Not shown).

[0128] The live streaming platform can pull the first media stream from the streaming media server through the RTC channel and push the first media stream to the live streaming room for display.

[0129] The following is combined Figures 6a to 6c The embodiments described herein illustrate the layout and display methods of a live streaming room.

[0130] Figures 6a to 6c Schematic diagrams showing some embodiments of the layout display of the live streaming room disclosed herein.

[0131] like Figure 6a As shown, the game screen (e.g., the game screen in the first media stream) can be displayed at the top of the live stream. The game IDs of the users participating in the game can be displayed below the game screen. Users participating in the game can include the streamer and other users (also known as "users on microphone" or "game players"). Figure 6a The diagram illustrates the eight participating users corresponding to game accounts P1 to P8.

[0132] For example, a user's game account can have two display states: collapsed and expanded. The collapsed state can be switched to the expanded state by swiping a swipe gesture.

[0133] like Figure 6b As shown, the live stream can be displayed in portrait mode. In this mode, the game screen is displayed at the top of the live stream. The virtual control panel provided by the live streaming software can be displayed below the game screen, allowing users to perform game operations during the live stream.

[0134] like Figure 6c As shown, the live stream can be displayed in landscape mode. In this mode, the game screen is centered within the live stream. The virtual control panel provided by the live streaming software can be displayed on either side of the game screen, allowing users to perform game operations during the live stream. For example, the directional buttons in the virtual control panel can be displayed on the left side of the game screen, and the skill buttons can be displayed on the right side.

[0135] In some embodiments, at least one user participating in the live interaction can include multiple users. The game application can include multiple virtual objects. Each user among the multiple users corresponds one-to-one with each virtual object among the multiple virtual objects. The game control result can include the control result of the game installation device controlling the corresponding virtual object based on the control instructions of each user for the corresponding virtual object.

[0136] For example, multiple users can connect to each other via an RTC channel to interact with game application operation information and audio / video information in a low-latency manner. Each user can select a corresponding virtual object in the game application by sending corresponding control commands, and control the selected virtual object by sending corresponding control commands.

[0137] In the above embodiments, the control commands of each user among the multiple users participating in the live interaction for the corresponding virtual object can be transmitted to the game installation device through a persistent connection channel. The game installation device can then control the virtual object corresponding to each user based on their control commands. This improves the interactive experience of multiple users participating in the game application and enhances the interactive performance.

[0138] Figure 7 Block diagrams illustrating some embodiments of the game control device of this disclosure are shown.

[0139] Memory 701 is used to store one or more computer-readable instructions. Memory 701 may include any combination of various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory, including but not limited to random access memory (RAM), dynamic random access memory (DRAM), static random access memory (SRAM), read-only memory (ROM), and flash memory. Memory 701 may, for example, store operating systems, application programs, bootloaders, databases, and other programs, as well as various application programs and various data.

[0140] The processor 702 is used to execute computer-readable instructions to implement the game control method described in any of the foregoing embodiments. Specific implementations of each step of the game control method can be found in the above embodiments; repeated details will not be elaborated here.

[0141] The processor 702 can be configured to execute the steps of the game control method in any of the above embodiments. The processor 702 can be embodied in various processing devices, such as a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. The central processing unit (CPU) can be based on x86 or ARM architectures, etc.

[0142] The processor 702 and the memory 701 can communicate with each other directly or indirectly. For example, the processor 702 and the memory 701 can communicate via a network. The network can include a wireless network, a wired network, and / or any combination of wireless and wired networks. The processor 702 and the memory 701 can also communicate with each other via a system bus, which is not limited in this disclosure.

[0143] It should be noted that Figure 7The components of the game controller 700 shown are merely exemplary and not limiting; the game controller 700 may have other components as needed for the actual application. The processor 702 can control other components in the game controller 700 to perform desired functions.

[0144] The game controller 700 can be implemented by software, firmware and / or hardware, and can be integrated into a device with the relevant application installed.

[0145] Figure 8 Block diagrams illustrating other embodiments of the game control device of this disclosure are shown.

[0146] Figure 8 The game control device 800 shown can be a computer system with a dedicated hardware structure, which can perform corresponding functions when the relevant application is installed.

[0147] The game control device 800 includes, but is not limited to, mobile terminals such as smartphones, laptops, personal digital assistants (PDAs), tablet PCs, portable multimedia players (PMPs), in-vehicle terminals (such as in-vehicle navigation terminals), wearable devices, and fixed terminals such as digital televisions and desktop computers.

[0148] like Figure 8 As shown, the Central Processing Unit (CPU) 801 performs various processes based on a program stored in the Read-Only Memory (ROM) 802 or a program loaded from the storage section 808 into the Random Access Memory (RAM) 803. The RAM 803 stores data required as needed when the CPU 801 performs various processes. The CPU is merely exemplary; it can also be other types of processors, such as the various processors described above. The ROM 802, RAM 803, and storage section 808 can be various forms of computer-readable storage media. It should be noted that although... Figure 8 The diagram shows ROM 802, RAM 803 and storage section 808, but one or more of them may be combined or located in the same or different memory or storage modules.

[0149] CPU 801, ROM 802 and RAM 803 are interconnected via bus 804. Input / output interface 805 is also connected to bus 804.

[0150] The following components are connected to the input / output interface 805: input section 806, such as a touchscreen, touchpad, keyboard, mouse, image sensor, microphone, accelerometer, gyroscope, etc.; output section 807, including displays such as cathode ray tube (CRT), liquid crystal display (LCD), speakers, vibrators, etc.; storage section 808, including hard disks, magnetic tapes, etc.; and communication section 809, including network interface cards such as LAN cards, modems, etc. Communication section 809 allows communication processing via a network such as the Internet. It is easy to understand that, although... Figure 8 The portion of the game controller 800 shown communicates via bus 804, but it can also communicate via a network or other means, wherein the network may include a wireless network, a wired network, and / or any combination of wireless and wired networks.

[0151] As needed, drive 810 is also connected to input / output interface 805. Removable media 811, such as disks, optical disks, magneto-optical disks, semiconductor memories, etc., are installed on drive 810 as needed, so that computer programs read from them can be installed into storage section 808 as needed.

[0152] When the above series of processes are implemented through software, the program constituting the software can be installed from a network such as the Internet or a storage medium such as a removable medium 811.

[0153] According to embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, some embodiments of this disclosure include a computer program product that, when run on a computer, causes the computer to implement the game control method described in any of the foregoing embodiments. The computer program product includes computer instructions carried on a computer-readable medium, containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer instructions can be downloaded and installed from a network via communication section 809, or installed from storage section 808, or installed from ROM 802. When the computer program is executed by CPU 801, the game control method of any embodiment of this disclosure is performed.

[0154] It should be noted that, in the context of this disclosure, a computer-readable medium can be a tangible medium that may contain or store programs for use by or in conjunction with an instruction execution system, apparatus, or device.

[0155] A computer-readable medium may be a computer-readable storage medium, a computer-readable signal medium, or any combination thereof.

[0156] Computer-readable storage media include, but are not limited to, systems, apparatuses, or devices that are electrical, magnetic, optical, electromagnetic, infrared, or semiconductor, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to, electrical connections having one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof. In this disclosure, a computer-readable storage medium can be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. Computer instructions are stored on the computer-readable storage medium that, when executed by a processor, implement the game control method described in any of the foregoing embodiments.

[0157] Computer-readable signal media may include data signals propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. Computer-readable signal media may also be any computer-readable medium other than computer-readable storage media, capable of sending, propagating, or transmitting programs for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical fibers, RF (radio frequency), etc., or any suitable combination thereof.

[0158] The aforementioned computer-readable medium may be included in the aforementioned electronic device; or it may exist independently and not assembled into the electronic device.

[0159] In some embodiments, a computer program is also provided, comprising: instructions that, when executed by a processor, cause the processor to perform the game control method described in any of the foregoing embodiments. For example, the instructions may be embodied in computer program code.

[0160] In embodiments of this disclosure, computer program code for performing the operations of this disclosure can be written in one or more programming languages ​​or a combination thereof. These programming languages ​​include, but are not limited to, object-oriented programming languages ​​such as Java, Smalltalk, and C++, as well as conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network (including a local area network (LAN) or a wide area network (WAN)), or it can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0161] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0162] The functions described above can be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary hardware logic components that can be used include: Field Programmable Gate Arrays (FPGAs), Application-Specific Integrated Circuits (ASICs), Application Standard Products (ASSPs), System-on-Chip (SoCs), Complex Programmable Logic Devices (CPLDs), and so on.

[0163] While specific embodiments of this disclosure have been described in detail by way of example, those skilled in the art should understand that the examples are for illustrative purposes only and not intended to limit the scope of this disclosure. Those skilled in the art should understand that modifications can be made to the above embodiments without departing from the scope and spirit of this disclosure. The scope of this disclosure is defined by the appended claims.

Claims

1. A game control method, comprising: In response to receiving a control command for the game application from at least one user participating in the live interaction, the control command is transmitted to the game installation device via a persistent connection channel; In response to receiving the first media stream of the game application returned by the game installation device, the first media stream is displayed in the live interactive interface, and the first media stream is generated based on the game control result corresponding to the control command.

2. The game control method according to claim 1, wherein, The game installation device has the live streaming tool and the game application installed. The step of responding to receiving a control command for the game application from at least one user participating in the live interaction, and transmitting the control command to the game installation device via a persistent connection channel includes: The control commands are transmitted to the live streaming tool via the persistent connection channel, and the live streaming tool is used to transmit the control commands to the game application.

3. The game control method according to claim 2, wherein, The live streaming tool is used to parse the control commands and transmit the parsing results to the game application.

4. The game control method according to claim 1, wherein, The step of displaying the first media stream in the live streaming interaction interface in response to receiving the first media stream returned by the game installation device includes: The first media stream is received from the streaming media server through the persistent connection channel, and the first media stream is pushed to the streaming media server by the game installation side device through the persistent connection channel. The first media stream is displayed in the live interactive interface.

5. The game control method according to claim 4, wherein, The game installation device is equipped with the live streaming tool for live interaction, and the first media stream is pushed to the streaming media server by the live streaming tool through the persistent connection channel.

6. The game control method according to any one of claims 1-5, wherein, The game installation device is either a cloud gaming server or the local device of the live streamer.

7. The game control method according to any one of claims 1-5, wherein, The step of responding to receiving at least one user's control command for the game application during live interaction and transmitting the control command to the game installation device via a persistent connection channel includes: The second media stream of the game application is displayed in the interface of the live interaction. The second media stream is obtained through the live interaction's live streaming tool, which is installed on the local device of the live interaction's broadcaster. In response to receiving the control command sent by the at least one user based on the second media stream, the control command is transmitted to the game installation device through the persistent connection channel.

8. The game control method according to any one of claims 1-5, wherein: The at least one user includes multiple users, and the game application includes multiple virtual objects, with each user corresponding one-to-one with each virtual object. The game control result includes the control result of the game installation device controlling the corresponding virtual object based on the control instructions of each user for the corresponding virtual object.

9. The game control method according to any one of claims 1-5, wherein, The game installation device is the local device of the streamer participating in the live interaction, and the at least one user includes users who participate in the game interaction with the streamer. The step of responding to receiving a control command for the game application from at least one user participating in the live interaction, and transmitting the control command to the game installation device via a persistent connection channel includes: The system receives control commands from the streamer regarding the game application via a physical controller, and also receives control commands from the participating users regarding the game application via a virtual controller.

10. The game control method according to any one of claims 1-5, wherein, The at least one user includes a user who participates in a game interaction with the streamer during the live broadcast.

11. The game control method according to any one of claims 1-5, wherein, The first media stream includes game visuals and game audio generated based on the game control results corresponding to the control commands.

12. The game control method according to any one of claims 1-5, wherein, The persistent connection channel includes a persistent connection channel for real-time communication.

13. A game control device, comprising: The transmission module is configured to transmit the control command to the game installation device via a persistent connection channel in response to receiving a control command for the game application from at least one user participating in the live interaction. The display module is configured to display the first media stream in the live interactive interface in response to receiving the first media stream returned by the game installation side device. The first media stream is generated based on the game control result corresponding to the control command.

14. A game control device, comprising: Memory; and A processor coupled to the memory, the processor being configured to execute the game control method of any one of claims 1-12 based on instructions stored in the memory.

15. A computer-readable storage medium having stored thereon computer instructions that, when executed by a processor, implement the game control method according to any one of claims 1-12.

16. A computer program product comprising instructions that, when executed by a processor, cause the processor to perform the game control method according to any one of claims 1-12.