Data processing method, user terminal, system, and storage medium

Abstract

Embodiments of the present application disclose a data processing method, a user terminal, a system and a storage medium. The method comprises: a first user terminal running a game client, and collecting audio and video data of the game client; the first user terminal sending the audio and video data to a browser in at least one second user terminal; the browser in the second user terminal displaying the audio and video data in a browser page; the second user terminal acquiring user operation data generated in the process of displaying the audio and video data, and sending the user operation data to the first user terminal; and the game client in the first user terminal updating game audio and video in the game client according to the user operation data. According to the scheme, only one party needs to run the game client, and other parties can realize multi-player online gaming without downloading and installing the game client, thereby saving storage and memory resources of the user terminals of the other parties, reducing the threshold for the other parties to participate in multi-player online gaming, and improving the game participation efficiency and user experience of the other parties.

Description

Technical Field

[0001] The embodiments of the present invention relate to the field of data processing technology, and in particular to a data processing method, a user terminal, a system, and a storage medium. Background Art

[0002] Multiplayer online games are a type of gaming that supports multiple parties participating in the same game simultaneously. In existing technologies, each user needs to download and run a game client, and each user interacts with the game server through their respective game clients to achieve multiplayer online games.

[0003] However, during the implementation process, the inventors discovered that the existing technology has the following defects: since the existing technology requires all users to download and run the game client, it consumes more storage resources and memory resources in the user terminal, increases the threshold for users to participate in multiplayer online games, and poor user experience. Summary of the Invention

[0004] In view of the technical problems in the prior art of multiplayer online game scenarios, such as high resource consumption of user terminals, high barriers to user participation in multiplayer online games, and poor user experience, embodiments of the present invention are proposed to provide a data processing method, user terminal, system, and storage medium that overcome the above-mentioned problems or at least partially solve the above-mentioned problems.

[0005] According to a first aspect of an embodiment of the present invention, a data processing method is provided, comprising: a first user terminal runs a game client located in the first user terminal and collects audio and video data of the game client; the first user terminal sends the audio and video data to a browser in at least one second user terminal; the browser in the second user terminal displays the audio and video data in a browser page; the second user terminal obtains user operation data generated in the process of displaying the audio and video data, and sends the user operation data to the first user terminal; the game client in the first user terminal updates the game audio and video in the game client according to the user operation data.

[0006] In an optional embodiment, after the first user terminal runs the game client located in the first user terminal, the method further includes: the first user terminal collects device control instructions generated by the game client during operation; and the second user terminal executes the device control instructions.

[0007] In an optional implementation, before the first user terminal sends the audio and video data to the browser in at least one second user terminal, the method further includes: establishing a data transmission channel between the first user terminal and the browser in the second user terminal.

[0008] In an optional embodiment, establishing a data transmission channel between the first user terminal and the browser in the second user terminal further includes: establishing a point-to-point transmission channel between the web instant messaging module in the first user terminal and the browser in the second user terminal;

[0009] The first user terminal sending the audio and video data to the browser in the second user terminal further includes: the first user terminal sending the audio and video data to the browser in the second user terminal through the point-to-point transmission channel.

[0010] In an optional embodiment, establishing the data transmission channel between the first user terminal and the browser in the second user terminal further includes: configuring a transfer node, and establishing a first transmission channel between the web instant messaging module in the first user terminal and the transfer node, and establishing a second transmission channel between the transfer node and the browser in the second user terminal;

[0011] The first user terminal sending the audio and video data to the browser in the second user terminal further includes: the first user terminal sending the audio and video data to the transfer node through the first transmission channel, and the transfer node sending the audio and video data to the browser in the second user terminal through the second transmission channel.

[0012] In an optional embodiment, the transfer node is a first transfer node; then establishing the first transmission channel between the web instant messaging module in the first user terminal and the transfer node further includes: establishing, for any second user terminal, a first transmission channel corresponding to the second user terminal; wherein the first transmission channel is a bidirectional transmission channel;

[0013] The establishing of the second transmission channel between the transfer node and the browser in the second user terminal further includes: establishing a second transmission channel corresponding to any second user terminal; wherein the second transmission channel is a bidirectional transmission channel;

[0014] The first user terminal sends the audio and video data to the transfer node through the first transmission channel, and the transfer node sends the audio and video data to the browser in the second user terminal through the second transmission channel further includes: for any second user terminal, the first user terminal sends the audio and video data to the transfer node through the first transmission channel corresponding to the second user terminal, and the transfer node sends the audio and video data to the browser in the second user terminal through the second transmission channel corresponding to the second user terminal.

[0015] In an optional embodiment, the transfer node is a second transfer node; then establishing the first transmission channel between the web instant messaging module in the first user terminal and the transfer node further includes: establishing a single first transmission channel between the web instant messaging module in the first user terminal and the transfer node; wherein the first transmission channel is a unidirectional transmission channel from the first user terminal to the transfer node;

[0016] The establishing of the second transmission channel between the transfer node and the browser in the second user terminal further includes: establishing, for any second user terminal, a second transmission channel corresponding to the second user terminal; wherein the second transmission channel is a unidirectional transmission channel from the transfer node to the second user terminal;

[0017] The first user terminal sends the audio and video data to the transfer node through the first transmission channel, and the transfer node sends the audio and video data to the browser in the second user terminal through the second transmission channel further includes: the first user terminal sends the audio and video data to the transfer node through the single first transmission channel, and the transfer node sends the audio and video data to the browser in each second user terminal through the second transmission channel corresponding to each second user terminal.

[0018] In an optional embodiment, the configuring the transfer node further includes: obtaining the number of second user terminals; determining whether the number of the second user terminals is less than a preset threshold; if so, configuring the first transfer node; if not, configuring the second transfer node.

[0019] In an optional embodiment, the establishment of a data transmission channel between the first user terminal and the browser in the second user terminal further includes: for any second user terminal, determining whether a point-to-point transmission channel can be established between the web instant messaging module in the first user terminal and the browser in the second user terminal; if so, establishing a point-to-point transmission channel between the web instant messaging module in the first user terminal and the browser in the second user terminal, so that the first user terminal can send the audio and video data to the browser in the second user terminal through the point-to-point transmission channel; if not, configuring a transfer node, and establishing a first transmission channel between the web instant messaging module in the first user terminal and the transfer node, and establishing a second transmission channel between the transfer node and the browser in the second user terminal, so that the first user terminal can send the audio and video data to the transfer node through the first transmission channel and the transfer node can send the audio and video data to the browser in the second user terminal through the second transmission channel.

[0020] In an optional embodiment, the establishing of a data transmission channel between the browser in the first user terminal and the second user terminal further includes: configuring a first transfer node and a second transfer node; establishing a third transmission channel between the web page instant messaging module in the first user terminal and the first transfer node, establishing a fourth transmission channel between the web page instant messaging module in the first user terminal and the second transfer node, establishing a fifth transmission channel between the first transfer node and the second user terminal, and establishing a sixth transmission channel between the second transfer node and the second user terminal;

[0021] The first user terminal sending the audio and video data to the browser in the second user terminal further includes: the first user terminal sending the audio and video data of the game client during operation to the second transfer node through the fourth transmission channel, and the second transfer node transmitting the audio and video data to the second user terminal through the sixth transmission channel;

[0022] The method further includes: the first user terminal sends a device control instruction generated by the game client during operation to the first transfer node through the third transmission channel, and the first transfer node transmits the device control instruction to the second user terminal through the fifth transmission channel.

[0023] In an optional embodiment, the user operation data includes: handle status data; then the second user terminal obtains the user operation data generated in the process of displaying the audio and video data further includes: the second user terminal collects operation data of a physical game handle in the second user terminal during the display of the audio and video data, and generates the handle status data according to the operation data of the physical game handle; and / or, the second user terminal displays a virtual handle interaction page during the display of the audio and video data, collects trigger operations on the virtual handle interaction page, and generates the handle status data according to the trigger operations on the virtual handle interaction page; and / or, the second user terminal collects operation data of a keyboard and / or mouse in the second user terminal during the display of the audio and video data, and generates the handle status data according to the operation data of the keyboard and / or mouse;

[0024] The game client in the first user terminal updates the game audio and video in the game client according to the user operation data further includes: the game client in the first user terminal generates a game control instruction according to the handle state data, and executes the game control instruction to update the game audio and video in the game client.

[0025] According to a second aspect of an embodiment of the present invention, a data processing method is provided, comprising: running a game client and collecting audio and video data of the game client; sending the audio and video data to a browser in at least one second user terminal, so that the browser in the second user terminal displays the audio and video data in a browser page; receiving user operation data generated in the process of displaying the audio and video data sent by the second user terminal; and the game client updating the game audio and video in the game client according to the user operation data.

[0026] In an optional implementation, after running the game client, the method further includes: collecting device control instructions generated by the game client during the running process.

[0027] In an optional implementation, the method further includes: establishing a data transmission channel with a browser in the second user terminal.

[0028] In an optional embodiment, said establishing a data transmission channel with the browser in the second user terminal further comprises: establishing a point-to-point transmission channel between the web instant messaging module and the browser in the second user terminal;

[0029] The sending of the audio and video data to the browser in the second user terminal further includes: sending the audio and video data to the browser in the second user terminal through the point-to-point transmission channel.

[0030] In an optional embodiment, the establishing of the data transmission channel with the browser in the second user terminal further includes: establishing a first transmission channel between the web instant messaging module and the transfer node; wherein a second transmission channel is established between the transfer node and the browser in the second user terminal;

[0031] The sending of the audio and video data to the browser in the second user terminal further includes: sending the audio and video data to the transfer node through the first transmission channel, so that the transfer node sends the audio and video data to the browser in the second user terminal through the second transmission channel.

[0032] In an optional embodiment, the transfer node is a first transfer node; then establishing the first transmission channel between the web page instant messaging module and the transfer node further includes: for any second user terminal, establishing a first transmission channel corresponding to the web page instant messaging module and the second user terminal; wherein the first transmission channel is a bidirectional transmission channel;

[0033] The sending of the audio and video data to the transfer node through the first transmission channel further includes: for any second user terminal, sending the audio and video data to the transfer node through the first transmission channel corresponding to the second user terminal, so that the transfer node sends the audio and video data to the browser in the second user terminal through the second transmission channel corresponding to the second user terminal.

[0034] In an optional embodiment, the transfer node is a second transfer node; then establishing the first transmission channel between the web instant messaging module and the transfer node further includes: establishing a single first transmission channel between the web instant messaging module and the transfer node; the first transmission channel is a unidirectional transmission channel from the first user terminal to the transfer node;

[0035] The sending of the audio and video data to the transfer node through the first transmission channel further includes: sending the audio and video data to the transfer node through the single first transmission channel, so that the transfer node sends the audio and video data to the browser in each second user terminal through the second transmission channel corresponding to each second user terminal.

[0036] In an optional embodiment, the establishment of a data transmission channel between the browser in the second user terminal further includes: for any second user terminal, determining whether a point-to-point transmission channel can be established between the web instant messaging module and the browser in the second user terminal; if so, establishing a point-to-point transmission channel between the web instant messaging module and the browser in the second user terminal, so that the audio and video data can be sent to the browser in the second user terminal through the point-to-point transmission channel; if not, establishing a first transmission channel between the web instant messaging module and the transfer node, so that the first user terminal can send the audio and video data to the transfer node through the first transmission channel and the transfer node can send the audio and video data to the browser in the second user terminal through the second transmission channel between the transfer node and the second user terminal.

[0037] In an optional embodiment, the establishing of the data transmission channel with the browser in the second user terminal further includes: establishing a third transmission channel between the web instant messaging module and the first transfer node, and establishing a fourth transmission channel between the web instant messaging module and the second transfer node;

[0038] The sending of the audio and video data to the browser in the second user terminal further includes: sending the audio and video data of the game client to the second transfer node through the fourth transmission channel, so that the second transfer node transmits the audio and video data to the second user terminal through the sixth transmission channel between the second transfer node and the second user terminal;

[0039] The method also includes: sending device control instructions generated by the game client during operation to the first transfer node through the third transmission channel, so that the first transfer node can transmit the device control instructions to the second user terminal through the fifth transmission channel between the first transfer node and the second user terminal.

[0040] In an optional embodiment, the user operation data includes: handle status data; the game client updating the game audio and video in the game client according to the user operation data further includes: generating game control instructions according to the handle status data, and executing the game control instructions to update the game audio and video in the game client.

[0041] According to a third aspect of an embodiment of the present invention, a data processing method is provided, comprising: a browser receiving audio and video data of a game client sent by a first user terminal; wherein the game client runs in the first user terminal; the browser displaying the audio and video data in a browser page; obtaining user operation data generated in the process of displaying the audio and video data; and sending the user operation data to the first user terminal, so that the game client in the first user terminal updates the game audio and video in the game client according to the user operation data.

[0042] In an optional embodiment, the user operation data includes: handle status data; then the acquisition of user operation data generated in the process of displaying the audio and video data further includes: in the process of displaying the audio and video data, collecting the operation data of the physical game handle, and generating the handle status data according to the operation data of the physical game handle; and / or, in the process of displaying the audio and video data, displaying a virtual handle interaction page, collecting the trigger operation on the virtual handle interaction page, and generating the handle status data according to the trigger operation on the virtual handle interaction page; and / or, in the process of displaying the audio and video data, collecting the operation data of the keyboard and / or mouse in the second user terminal, and generating the handle status data according to the operation data of the keyboard and / or mouse.

[0043] According to a fourth aspect of an embodiment of the present invention, a first user terminal is provided, comprising: a game client for providing game services and updating game audio and video in the game client according to user operation data; a collection module for collecting audio and video data of the game client; a transmission module for sending the audio and video data to a browser in at least one second user terminal, so that the browser in the second user terminal displays the audio and video data on a browser page; and receiving user operation data generated in the process of displaying the audio and video data, which is acquired by the second user terminal.

[0044] In an optional implementation, the acquisition module is used to: acquire device control instructions generated by the game client during operation.

[0045] In an optional implementation, the transmission module is configured to establish a data transmission channel with a browser in the second user terminal.

[0046] In an optional implementation, the transmission module is configured to: establish a point-to-point transmission channel between the web instant messaging module and the browser in the second user terminal; and send the audio and video data to the browser in the second user terminal via the point-to-point transmission channel.

[0047] In an optional embodiment, the transmission module is used to: establish a first transmission channel between the web instant messaging module and the transfer node; wherein a second transmission channel is established between the transfer node and the browser in the second user terminal; and send the audio and video data to the transfer node through the first transmission channel, so that the transfer node can send the audio and video data to the browser in the second user terminal through the second transmission channel.

[0048] In an optional embodiment, the transmission module is used to: the transfer node is a first transfer node; for any second user terminal, a first transmission channel corresponding to the second user terminal is established; wherein the first transmission channel is a bidirectional transmission channel; for any second user terminal, the audio and video data is sent to the transfer node through the first transmission channel corresponding to the second user terminal, so that the transfer node can send the audio and video data to the browser in the second user terminal through the second transmission channel corresponding to the second user terminal.

[0049] In an optional embodiment, the transmission module is used to: the transfer node is a second transfer node; establish a single first transmission channel between the web instant messaging module and the transfer node; wherein the first transmission channel is a one-way transmission channel from the web instant messaging module to the transfer node; send the audio and video data to the transfer node through the single first transmission channel, so that the transfer node can send the audio and video data to the browser in each second user terminal through the second transmission channel corresponding to each second user terminal.

[0050] In an optional embodiment, the transmission module is used to: for any second user terminal, determine whether a point-to-point transmission channel can be established between the web instant messaging module and the browser in the second user terminal; if so, establish a point-to-point transmission channel between the web instant messaging module and the browser in the second user terminal, so that the audio and video data can be sent to the browser in the second user terminal through the point-to-point transmission channel; if not, establish a first transmission channel between the web instant messaging module and the transfer node, so that the first user terminal can send the audio and video data to the transfer node through the first transmission channel and the transfer node can send the audio and video data to the browser in the second user terminal through the second transmission channel between the transfer node and the second user terminal.

[0051] In an optional embodiment, the transmission module is used to: establish a third transmission channel between the web instant messaging module and the first transfer node, and establish a fourth transmission channel between the web instant messaging module and the second transfer node; send device control instructions generated by the game client during operation to the first transfer node through the third transmission channel, so that the first transfer node can transmit the device control instructions to the second user terminal through the fifth transmission channel between the first transfer node and the second user terminal; send audio and video data of the game client to the second transfer node through the fourth transmission channel, so that the second transfer node can transmit the audio and video data to the second user terminal through the sixth transmission channel between the second transfer node and the second user terminal.

[0052] In an optional embodiment, the user operation data includes: handle status data; the game client is used to: generate game control instructions according to the handle status data, and execute the game control instructions to update the game audio and video in the game client.

[0053] According to a fifth aspect of an embodiment of the present invention, a second user terminal is provided, comprising: a browser, wherein the browser is configured to: receive audio and video data of a game client sent by a first user terminal; wherein the game client runs on the first user terminal; display the audio and video data on a browser page; obtain user operation data generated in the process of displaying the audio and video data; and send the user operation data to the first user terminal, so that the game client in the first user terminal updates the game audio and video in the game client according to the user operation data.

[0054] In an optional embodiment, the user operation data includes: handle status data; the browser is used to: collect the operation data of the physical game handle during the display of the audio and video data, and generate the handle status data based on the operation data of the physical game handle; and / or, during the display of the audio and video data, display a virtual handle interaction page, collect the triggering operation on the virtual handle interaction page, and generate the handle status data based on the triggering operation on the virtual handle interaction page; and / or, during the display of the audio and video data, collect the operation data of the keyboard and / or mouse in the second user terminal, and generate the handle status data based on the operation data of the keyboard and / or mouse.

[0055] According to a sixth aspect of an embodiment of the present invention, there is provided a data processing system, comprising: the above-mentioned first user terminal and at least one of the above-mentioned second user terminals.

[0056] According to the seventh aspect of an embodiment of the present invention, an electronic device is provided, comprising: a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface communicate with each other through the communication bus; the memory is used to store at least one executable instruction, and the executable instruction enables the processor to perform operations corresponding to the above-mentioned data processing method.

[0057] According to an eighth aspect of an embodiment of the present invention, a computer storage medium is provided, wherein the storage medium stores at least one executable instruction, and the executable instruction enables a processor to execute an operation corresponding to the above-mentioned data processing method.

[0058] In a multiplayer online game, in an embodiment of the present invention, only one user among the multiple parties runs the game client on their user terminal. The other parties, through the browser in their user terminal, obtain the audio and video data of the game client for presentation and feedback the user operation data to the game client, which then processes the user operation data to update the game audio and video in the game client. This eliminates the need for the other parties to download, install, and run the game client on their user terminals, thereby conserving storage and memory resources on their user terminals, lowering the barrier to entry for other parties to participate in the multiplayer online game, and improving their game participation efficiency and user experience.

[0059] In the embodiment of the present invention, the device control instructions generated by the game client can be accurately transmitted to the second user terminal, thereby facilitating enhancing the game immersion of the user of the second user terminal.

[0060] The embodiment of the present invention establishes a data transmission channel between the browsers in the first user terminal and the second user terminal, thereby facilitating accurate data transmission.

[0061] The embodiment of the present invention establishes a point-to-point transmission channel between the web instant messaging module in the first user terminal and the browser in the second user terminal, thereby eliminating the need for a transfer node to transfer data, reducing system costs and improving data transmission efficiency.

[0062] The embodiment of the present invention configures a transfer node and establishes a first transmission channel between the web instant messaging module in the first user terminal and the transfer node, and establishes a second transmission channel between the transfer node and the browser in the second user terminal. The transfer node serves as the data transfer center between the first user terminal and the second user terminal, thereby ensuring the stability of data transmission.

[0063] The embodiment of the present invention establishes a first transmission channel corresponding to any second user terminal and a second transmission channel corresponding to the second user terminal, so that this transmission method can ensure the accuracy of data transmission and avoid interference between different transmission links.

[0064] This embodiment of the present invention establishes a single first transmission channel between the web instant messaging module in a first user terminal and a transit node. For any second user terminal, a second transmission channel corresponding to that second user terminal is established. In this transmission method, only one transmission channel needs to be established between the first user terminal and the second transit node, thereby reducing the frequency of audio and video data transmission between the first user terminal and the second transit node and conserving transmission resources.

[0065] In this embodiment of the present invention, the first or second transit node is configured based on the number of second user terminals. Therefore, when there are fewer second user terminals, the first transit node is configured, improving data transmission accuracy without occupying too many transmission resources. When there are more second user terminals, the second transit node is configured, thus conserving transmission resources while ensuring data transmission accuracy.

[0066] This embodiment of the present invention determines, for any second user terminal, whether a peer-to-peer transmission channel can be established between the web instant messaging module in the first user terminal and the browser in the second user terminal. If so, a peer-to-peer transmission channel is established between the web instant messaging module in the first user terminal and the browser in the second user terminal. If not, a relay node is configured. This prioritizes establishing the peer-to-peer transmission channel, and if a peer-to-peer transmission channel is unavailable, a transmission channel is established via the relay node. This ensures both the stability of audio and video data transmission and improved data transmission efficiency.

[0067] The embodiment of the present invention configures a first transfer node and a second transfer node. Control instructions are transmitted through the first transfer node. Since the control instruction data volume is small, there is no need to consume more transmission resources and the data transmission accuracy can be improved. Audio and video data are transmitted through the second transfer node. Since audio and video data usually have a large data volume, the first user terminal only needs to transmit a copy of the audio and video data to the second transfer node, thereby reducing the consumption of transmission resources.

[0068] The embodiment of the present invention obtains the handle status data in the second user terminal, so that the game audio and video of the game client can be accurately changed according to the handle status data.

[0069] The above description is only an overview of the technical solutions of the embodiments of the present invention. In order to more clearly understand the technical means of the embodiments of the present invention, they can be implemented in accordance with the contents of the specification. In order to make the above and other purposes, features and advantages of the embodiments of the present invention more obvious and easy to understand, the specific implementation methods of the embodiments of the present invention are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0070] Various other advantages and benefits will become apparent to those skilled in the art upon reading the detailed description of the preferred embodiment below. The accompanying drawings are for illustration purposes only and are not to be considered as limiting the embodiments of the present invention. The same reference numerals are used throughout the accompanying drawings to denote the same components. In the accompanying drawings:

[0071] Figure 1 A schematic diagram showing a flow chart of a data processing method provided by an embodiment of the present invention is shown;

[0072] Figure 2 A schematic diagram of a first audio and video data transmission method provided by an embodiment of the present invention is shown;

[0073] Figure 3 A schematic diagram of a second audio and video data transmission method provided by an embodiment of the present invention is shown;

[0074] Figure 4 A schematic diagram of a third audio and video data transmission method provided by an embodiment of the present invention is shown;

[0075] Figure 5 A schematic diagram of a fourth audio and video data transmission method provided by an embodiment of the present invention is shown;

[0076] Figure 6 A schematic diagram of a fifth audio and video data transmission method provided by an embodiment of the present invention is shown;

[0077] Figure 7 A schematic diagram of a sixth audio and video data transmission method provided by an embodiment of the present invention is shown;

[0078] Figure 8 A schematic diagram of a seventh audio and video data transmission method provided by an embodiment of the present invention is shown;

[0079] Figure 9 A schematic flow chart of another data processing method provided by an embodiment of the present invention is shown;

[0080] Figure 10 A schematic diagram showing a flow chart of another data processing method provided by an embodiment of the present invention is shown;

[0081] Figure 11 A schematic structural diagram of a first user terminal provided by an embodiment of the present invention is shown;

[0082] Figure 12 A schematic structural diagram of a second user terminal provided by an embodiment of the present invention is shown;

[0083] Figure 13 A schematic structural diagram of a data processing system provided by an embodiment of the present invention is shown;

[0084] Figure 14 A schematic structural diagram of an electronic device provided by an embodiment of the present invention is shown. DETAILED DESCRIPTION

[0085] Exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present invention are shown in the accompanying drawings, it should be understood that the present invention can be implemented in various forms and should not be limited by the embodiments described herein. Rather, these embodiments are provided to enable a more thorough understanding of the present invention and to fully convey the scope of the present invention to those skilled in the art.

[0086] Through research into existing technologies, the inventors of this application discovered that in multiplayer online games, each user must download, install, and run a game client. Each game client collects and sends information about the corresponding user's operations to a game server, which then processes the information to generate new game data and feeds it back to each game client. This requires users to download, install, and run a game client to participate in online games. This requires additional storage space on the user's device to store the game client data, as well as additional memory and computing resources to run the game client. This also increases the user participation threshold, reduces the efficiency of participating in the service, and results in a poor user experience.

[0087] In view of this, in an embodiment of the present invention, in a multiplayer online game scenario, only one of the multiple parties runs the game client on their user terminal. The other parties obtain the audio and video data of the game client through the browser in the user terminal for presentation, and feedback the operation data to the game client, which then processes the operation data. Because the browser is a required program in the user terminal, the embodiment of the present invention does not require the other parties to download, install, and run the game client on their user terminal, thereby saving storage and memory resources on the user terminals of the other parties, lowering the threshold for the other parties to participate in the multiplayer online game, and improving the game participation efficiency and user experience of the other parties.

[0088] The implementation process of the present invention is described in detail below through various embodiments:

[0089] Figure 1 This figure shows a flow chart of a data processing method provided by an embodiment of the present invention. The data processing method provided by this embodiment is applied to a multiplayer online game scenario. The data processing method provided by this embodiment of the present invention is executed by a data processing system. The flow charts in this embodiment of the present invention are not intended to limit the order in which the steps are executed. Some steps in this flow chart may be added or deleted as needed.

[0090] Specifically, if Figure 1 As shown, the method includes the following steps:

[0091] Step S110: The first user terminal runs a game client located in the first user terminal.

[0092] In the embodiments of the present invention, the first user terminal and the second user terminal are user terminals used by users simultaneously participating in a multiplayer online game. These user terminals include, but are not limited to, computers, mobile phones, e-readers, and smart wearable devices. The first user terminal is a user terminal with a game client installed, while the second user terminal may not have a game client installed. There is typically one first user terminal, also referred to as the host terminal, and there may be one or more second user terminals, also referred to as the guest terminal.

[0093] Step S120: The first user terminal collects audio and video data from the game client.

[0094] The audio data and / or display image data generated by the game client during operation are the audio and video data of the game client. The embodiment of the present invention can collect the audio and video data of the game client through a corresponding collection method.

[0095] In an optional embodiment, during the specific collection process, the audio and video data generated by the corresponding thread of the game client can be continuously collected at a corresponding collection frequency. The embodiment of the present invention does not limit the specific collection method. For example, the audio and video data of the game client during operation can be collected using tools such as OBS (Open Broadcaster Software).

[0096] In another optional embodiment, the device control instructions generated by the game client during operation are collected. The device control instructions can specifically be device vibration instructions, etc. For example, in a multiplayer online game service, when the virtual character corresponding to the second user terminal collides with an obstacle, a device vibration instruction can be generated, so that the second user terminal executes the device vibration instruction. If the second user terminal is a computer with an external handle, the handle can be vibrated; if the second user terminal is a mobile phone, the mobile phone can be vibrated, thereby enhancing the user's sense of immersion; In addition, the device control instruction can also be a force feedback instruction, that is, after the second user terminal returns the user operation data in the second user terminal, the game client generates a force feedback instruction based on the user operation data. The force feedback instruction is an instruction that instructs the force feedback device (such as a handle, etc.) in the second user terminal to show the corresponding force or direction. For example, when playing a racing game, sometimes it is difficult to turn left due to the effect of the curvature, and a certain resistance will be generated on the force feedback device, making the user feel that turning left is more difficult. In the specific collection process, the device control instruction can be collected after the device control instruction is generated, thereby reducing the resource waste caused by frequent collection.

[0097] Step S130: The first user terminal sends the audio and video data to the browser in the second user terminal.

[0098] Before the first user terminal sends the audio and video data to the browser in the second user terminal, a data transmission channel is pre-established between the first user terminal and the browser in the second user terminal, so that the first user terminal can send the audio and video data to the browser in the second user terminal based on the data transmission channel.

[0099] In an optional implementation, the audio and video data may be transmitted using one or more of the following transmission modes:

[0100] Transmission method one: Establishing a point-to-point transmission channel between the web instant communication module in the first user terminal and the browser in the second user terminal. Among them, the first user terminal includes a web instant communication module, and the web instant communication module is specifically a WebRTC (Web Real-Time Communications) library module. The WebRTC library module can establish a point-to-point (Peer-to-Peer, abbreviated as P2P) connection with the browser, so that a point-to-point transmission channel can be established between the web instant communication module in the first user terminal and the browser in the second user terminal in this establishment method. Among them, the point-to-point transmission channel is specifically a bidirectional transmission channel, that is, the first user terminal can transmit data to the second user terminal through the point-to-point transmission channel, and the second user terminal can also transmit data to the first user terminal through the point-to-point transmission channel. Specifically, the first user terminal sends audio and video data to the browser in the second user terminal through the point-to-point transmission channel.

[0101] like Figure 2 As shown, currently user 1 and user 2 are playing a multiplayer online game, and the user terminals used by user 1 and user 2 are user terminal A and user terminal B respectively, wherein a game client is installed in user terminal A, then user terminal A is specifically the first user terminal A, and user terminal B is the second user terminal B. The WebRTC library of the web instant communication module in the first user terminal A establishes a point-to-point transmission channel with the browser in the second user terminal B, and the point-to-point transmission channel is constructed based on the WebRTC connection. The first user terminal uses an audio and video acquisition tool to capture the audio and video data of the game client, and uses a handle driver module to capture device control instructions. The handle driver module is specifically a ViGemBus virtual handle driver module, etc. The WebRTC library module in the first user terminal A sends the audio and video data and / or device control instructions in the first user terminal A to the browser of the second user terminal B through a point-to-point transmission channel. In this way, it is only necessary to establish a point-to-point transmission channel between the first user terminal and the second user terminal, so that there is no need for a transfer node to transfer data, reducing system costs and improving data transmission efficiency.

[0102] In addition, if Figure 3 As shown in FIG, audio and video data and device control instructions can also be transmitted through different point-to-point transmission channels. Figure 3 As shown, audio and video data can be transmitted through point-to-point transmission channel 1, and device control instructions can be transmitted through point-to-point transmission channel 2.

[0103] Transmission method 2: Configure the transfer node, and establish a first transmission channel between the web instant messaging module in the first user terminal and the transfer node, and establish a second transmission channel between the transfer node and the browser in the second user terminal. In this transmission method, the transmission channel between the first user terminal and the transfer node is called the first transmission channel, and the transmission channel between the transfer node and the second user terminal is called the second transmission channel. Thus, the first user terminal sends the audio and video data to the transfer node through the first transmission channel, and the transfer node sends the audio and video data to the browser in the second user terminal through the second transmission channel. Figure 4 As shown, the first user terminal A establishes a first transmission channel with the transit node, and the transit node establishes a second transmission channel with the second user terminal B and the second user terminal C (the terminals corresponding to user 3), respectively. Thus, through the first and second transmission channels, audio and video data and / or device control instructions can be transmitted from the first user terminal A to the second user terminals B and C. In this method, the transit node serves as the data transfer center between the first user terminal and the second user terminal, thereby ensuring the stability of data transmission.

[0104] Further optionally, the transfer node can specifically be a first transfer node, such as a TURN node, etc. Then, for any second user terminal, a first transmission channel corresponding to the second user terminal is established, and a second transmission channel corresponding to the second user terminal is established. Thus, for any second user terminal, the first user terminal sends the audio and video data and / or device control instructions to the transfer node through the first transmission channel corresponding to the second user terminal, and the transfer node sends the audio and video data and / or device control instructions to the browser in the second user terminal through the second transmission channel corresponding to the second user terminal. The first transmission channel is a bidirectional transmission channel, and the second transmission channel is a bidirectional transmission channel. In this transmission mode, each second user terminal has an independent transmission link, which is composed of the first transmission channel and the second transmission channel corresponding to the second user terminal. As Figure 5 As shown, the data transmission link corresponding to the second user terminal B is the first transmission channel 1 and the second transmission channel 1, that is, the first user terminal A sends the audio and video data and / or device control instructions to the first transfer node TURN through the first transmission channel 1, and the first transfer node TURN forwards the audio and video data and / or device control instructions to the second user terminal B through the second transmission channel 1; correspondingly, the data transmission link corresponding to the second user terminal C is the first transmission channel 2 and the second transmission channel 2, that is, the first user terminal A sends the audio and video data and / or device control instructions to the first transfer node TURN through the first transmission channel 2, and the first transfer node TURN forwards the audio and video data and / or device control instructions to the second user terminal C through the second transmission channel 2. This transmission method can ensure the accuracy of data transmission and avoid interference between different transmission links.

[0105] Further optionally, the transfer node can specifically be a second transfer node, such as an SFU node, etc. Then a single first transmission channel is established between the web instant messaging module in the first user terminal and the transfer node, and for any second user terminal, a second transmission channel corresponding to the second user terminal is established. Among them, the first transmission channel is a one-way transmission channel from the first user terminal to the transfer node, and the second transmission channel is a one-way transmission channel from the transfer node to the second user terminal. Thus, the first user terminal sends the audio and video data and / or device control instructions to the transfer node through the single first transmission channel, and the transfer node sends the audio and video data and / or device control instructions to the browser in each second user terminal through the second transmission channel corresponding to each second user terminal. As Figure 6 As shown, a unidirectional first transmission channel 1 is established between the WebRTC library in the first user terminal A and the second transfer node SFU, a unidirectional second transmission channel 1 is established between the second transfer node SFU and the second user terminal B, and a unidirectional second transmission channel 2 is established between the second transfer node SFU and the second user terminal C. As a result, the first user terminal A sends audio and video data and / or device control instructions to the second transfer node via the first transmission channel 1, the second transfer node sends the audio and video data and / or device control instructions to the second user terminal B via the second transmission channel 1, and the second transfer node sends the audio and video data and / or device control instructions to the second user terminal C via the second transmission channel 2. It can be seen that in this transmission mode, the first user terminal and the second transfer node only need to establish one transmission channel, thereby reducing the frequency of data transmission between the first user terminal and the second transfer node and saving transmission resources.

[0106] Further, optionally, during the configuration of the relay node, the number of second user terminals can be obtained to determine whether the number of second user terminals is less than a preset threshold; if so, the first relay node is configured; if not, the second relay node is configured. In this embodiment, when there are fewer second user terminals, the first relay node is configured, thereby improving the accuracy of data transmission without occupying too many transmission resources; when there are more second user terminals, the second relay node is configured, thereby saving transmission resources while ensuring the accuracy of data transmission.

[0107] Transmission method three: for any second user terminal, determine whether it is possible to establish a point-to-point transmission channel between the web instant communication module in the first user terminal and the browser in the second user terminal; if so, establish a point-to-point transmission channel between the web instant communication module in the first user terminal and the browser in the second user terminal, so that the first user terminal sends the audio and video data to the browser in the second user terminal through the point-to-point transmission channel; if not, configure a transit node, and establish a first transmission channel between the web instant communication module in the first user terminal and the transit node, and establish a second transmission channel between the transit node and the browser in the second user terminal, so that the first user terminal sends the audio and video data and / or device control instructions to the transit node through the first transmission channel, and the transit node sends the audio and video data to the browser in the second user terminal through the second transmission channel. Figure 7 As shown, due to network and other factors, a point-to-point transmission channel cannot be established between first user terminal A and second user terminal B, and a point-to-point transmission channel cannot be established between first user terminal A and second user terminal C. Therefore, a first transmission channel is established between first user terminal A and a transit node, and a second transmission channel is established between the transit node and second user terminal B and second user terminal C. If a point-to-point transmission channel can be established between first user terminal A and second user terminal D, a point-to-point transmission channel is established between first user terminal A and second user terminal D. Consequently, first user terminal A transmits audio and video data and / or device control instructions to the transit node, which forwards the audio and video data and / or device control instructions to second user terminals B and C. First user terminal A also sends the audio and video data and / or device control instructions to second user terminal D via the point-to-point transmission channel. In this transmission mode, point-to-point transmission channels are prioritized. If a point-to-point transmission channel cannot be established, a transmission channel is established through the transit node. This ensures both the stability of audio and video data transmission and improves data transmission efficiency. Among them, in this transmission mode, the configuration mode of the transfer node and the specific transmission mode can refer to the description in the second transmission channel establishment mode, and will not be repeated here.

[0108] Transmission method four: configure the first transfer node and the second transfer node; establish a third transmission channel between the web instant messaging module in the first user terminal and the first transfer node, establish a fourth transmission channel between the web instant messaging module in the first user terminal and the second transfer node, establish a fifth transmission channel between the first transfer node and the second user terminal, and establish a sixth transmission channel between the second transfer node and the second user terminal. Thus, the first user terminal sends the device control instructions generated by the game client during operation to the first transfer node through the third transmission channel, and the first transfer node transmits the device control instructions to the second user terminal through the fifth transmission channel; the first user terminal sends the audio and video data of the game client to the second transfer node through the fourth transmission channel, and the second transfer node transmits the audio and video data to the second user terminal through the sixth transmission channel. As Figure 8 As shown, the first user terminal A establishes a third transmission channel 1 and a third transmission channel 2 with the first transfer node TURN, the first user terminal A establishes a fourth transmission channel 1 with the second transfer node SFU, the first transfer node establishes a fifth transmission channel 1 and a fifth transmission channel 2 with the second user terminals B and C respectively; and the second transfer node establishes a sixth transmission channel 1 and a sixth transmission channel 2 with the second user terminals B and C respectively. The third and fifth transmission channels are bidirectional transmission channels, the fourth transmission channel is a unidirectional transmission channel from the first user terminal to the second transfer node, and the sixth transmission channel is a unidirectional transmission channel from the second transfer node to the second user terminal. First user terminal A sends a device control command to the first relay node via third transmission channel 1. The first relay node sends the device control command to second user device B via fifth transmission channel 1. First user terminal A sends the device control command to the first relay node via third transmission channel 2. The first relay node sends the device control command to second user device C via fifth transmission channel 2. First user terminal A sends audio and video data to the second relay node via fourth transmission channel 1. The second relay node sends the audio and video data to second user device B via sixth transmission channel 1. The second relay node sends the audio and video data to second user device C via sixth transmission channel 2. In this transmission method, the control command is transmitted through the first relay node. Since the control command data volume is small, it does not consume a lot of transmission resources and can improve data transmission accuracy. The audio and video data is transmitted through the second relay node. Since audio and video data is usually large in volume, the first user terminal only needs to transmit a copy of the audio and video data to the second relay node, thereby reducing transmission resource consumption.

[0109] Step S140: The browser in the second user terminal displays the audio and video data on the browser page.

[0110] After receiving the audio and video data, the browser in the second user terminal displays the audio and video data in the browser page, so that the second user terminal can view the display content and / or audio content of the game client without downloading the game client.

[0111] In addition, the second user terminal may also receive a device control instruction, and the second user terminal executes the device control instruction. For example, if the device control instruction is a handle vibration instruction, the second user terminal calls the handle driver to control the handle to vibrate.

[0112] Step S150: The second user terminal collects user operation data generated during the process of displaying audio and video data.

[0113] Through step S140, the user of the second user terminal can obtain the real-time running status of the game client. This step further simulates the scenario of the second user terminal participating in the game service and also collects user operation data generated during the display of audio and video data. Among them, the user operation data includes controller status data.

[0114] In an optional embodiment, the second user terminal collects operation data of a physical game controller in the second user terminal during the display of audio and video data, and generates controller state data based on the operation data of the physical game controller. Specifically, the state data of each operation key in the physical game controller is obtained based on the operation data of the physical game controller, and the state data of the operation key is the controller state data.

[0115] In another optional embodiment, the second user terminal displays a virtual handle interaction page during the display of the audio and video data, collects trigger operations on the virtual handle interaction page, and generates handle status data based on the trigger operations on the virtual handle interaction page. If the second user terminal does not include a physical handle, the second user terminal will also display the virtual handle interaction page when displaying the audio and video data. In the case of displaying the virtual handle interaction page, if the second user terminal supports trigger operations on virtual controls (for example, when the second user terminal is a smart phone, tablet, or other device that includes a touch screen, it supports user trigger operations on virtual controls), the user's trigger operations on the virtual handle interaction page are collected. The trigger operations of each virtual control in the virtual handle interaction page have a mapping relationship with the trigger operations of the physical handle, so that after the trigger operation of the virtual handle is obtained, the trigger number operation of the virtual handle is mapped to the operation data of the physical handle, and the handle status data is obtained based on the operation data of the mapped physical handle.

[0116] In another optional embodiment, the second user terminal collects the operation data of the keyboard and / or mouse in the second user terminal during the display of audio and video data, and generates handle status data based on the operation data of the keyboard and / or mouse. If the second user terminal does not include a physical handle, and does not include components such as a touch screen and does not support the trigger operation of the virtual control (such as a computer that does not include a touch screen, etc.), then when the second user terminal displays the virtual handle interaction page, it will also display the mapping relationship between each virtual control in the virtual handle and the keyboard and / or mouse buttons, so as to obtain the user's keyboard and / or mouse operation data in this scenario, and obtain the trigger operation of the virtual handle through the mapping relationship between the virtual controls in the virtual handle and the keyboard and / or mouse buttons, and then map the trigger operation of the virtual handle to the operation data of the physical handle according to the mapping relationship between the trigger operation of each virtual control in the virtual handle interaction page and the trigger operation of the physical handle, and obtain the handle status data based on the operation data of the mapped physical handle.

[0117] Step S160: The second user terminal sends the user operation data to the first user terminal.

[0118] Specifically, if a point-to-point transmission channel is established between the second user terminal and the first user terminal, since the point-to-point transmission channel is a bidirectional transmission channel, the second user terminal sends the user operation data to the first user terminal through the point-to-point transmission channel.

[0119] If the second user terminal only establishes a data transmission channel with the first transit node, since the data transmission channel is a bidirectional transmission channel, the second user terminal sends user operation data to the first transit node through the data transmission channel, so that the first transit node sends the user operation data to the first user terminal.

[0120] If the second user terminal only has a data transmission channel established with the second transit node, since this data transmission channel is a unidirectional transmission channel, an additional data transmission channel must be established from the second user terminal to the second transit node. The user operation data is then sent to the second transit node based on this established data transmission channel. Furthermore, an additional data transmission channel must be established from the second transit node to the first user terminal, so that the second transit node can send the user operation data to the first user terminal.

[0121] If the second user terminal has established data transmission channels with both the first transfer node and the second transfer node, the second user terminal sends the user operation data to the first transfer node through the corresponding data transmission channel, and the first transfer node sends the user operation data to the first user terminal.

[0122] Step S170: The game client in the first user terminal performs data processing according to the user operation data.

[0123] The first user terminal processes the user operation data from the second user terminal to update the game audio and video in the game client, and the new audio and video data is retransmitted to the second user terminal. Specifically, the game client in the first user terminal generates game control instructions based on the handle state data and executes the game control instructions to update the game audio and video in the game client. For example, if the handle state data transmitted by the second user terminal B includes pressing the jump key, a jump instruction corresponding to virtual object X is generated for the second user terminal B, thereby generating a jump image and jump sound effect for virtual object X.

[0124] It can be seen that in the embodiment of the present invention, in a multiplayer online game, only one user among the multiple parties runs the game client in the user terminal, and the other parties obtain the audio and video data of the game client through the browser in the user terminal for presentation, and feedback operation data to the game client, which processes the operation data. As a result, there is no need for the other parties to download, install and run the game client in the user terminal, thereby saving the storage and memory resources of the user terminal of the other parties, lowering the threshold for other parties to participate in the multiplayer online game, and improving the multiplayer online game participation efficiency and user experience of other parties.

[0125] In addition, the embodiments of the present invention can also be applied to document co-creation scenarios. In this scenario, multiple people need to edit the same document at the same time. The user terminal with the document editing client installed is the first user terminal, and the user terminal without the document editing client installed is the second user terminal. The first user terminal runs the document editing client located in the first user terminal, and collects the screen data of the document editing client; the first user terminal sends the screen data of the document editing client to the browser in at least one second user terminal; the browser in the second user terminal displays the screen data of the document editing client in the browser page; the second user terminal obtains the document editing operation data generated in the process of displaying the screen data, and sends the document editing operation data to the first user terminal; the document editing client in the first user terminal updates the screen data in the document editing client according to the document editing operation data, thereby realizing the editing of the document by the second user terminal user and realizing multi-person document co-creation.

[0126] Figure 9 A schematic flow chart of another data processing method provided by an embodiment of the present invention is shown. The data processing method provided by this embodiment is applied to a multiplayer online game scenario. The data processing method provided by this embodiment of the present invention is executed by a first user terminal. The flow charts in this embodiment of the present invention are not intended to limit the order in which the steps are executed. Some steps in this flow chart may be added or deleted as needed.

[0127] Specifically, if Figure 9As shown, the method includes the following steps:

[0128] Step S910: Run the game client and collect audio and video data of the game client.

[0129] Step S920: sending the audio and video data to a browser in at least one second user terminal, so that the browser in the second user terminal displays the audio and video data in a browser page.

[0130] Step S930: receiving user operation data generated during the display of audio and video data from the second user terminal.

[0131] Step S940: The game client updates the game audio and video in the game client according to the user operation data.

[0132] In an optional implementation, after running the game client, the method further includes: collecting device control instructions generated by the game client during operation, and sending the device control instructions to a browser in the second user terminal.

[0133] In an optional implementation, the method further includes: establishing a data transmission channel with a browser in the second user terminal.

[0134] In an optional embodiment, establishing a data transmission channel with the browser in the second user terminal further includes: establishing a point-to-point transmission channel between the web instant messaging module and the browser in the second user terminal; sending the audio and video data to the browser in at least one second user terminal further includes: sending the audio and video data to the browser in at least one second user terminal through the point-to-point transmission channel.

[0135] In an optional embodiment, the establishment of a data transmission channel with the browser in the second user terminal further includes: establishing a first transmission channel between the web instant messaging module and the transfer node; wherein a second transmission channel is established between the transfer node and the browser in the second user terminal; the sending of the audio and video data to the browser in at least one second user terminal further includes: sending the audio and video data to the transfer node through the first transmission channel, so that the transfer node sends the audio and video data to the browser in at least one second user terminal through the second transmission channel.

[0136] In an optional embodiment, the transfer node is a first transfer node; then the establishment of a first transmission channel between the web instant messaging module and the transfer node further includes: for any second user terminal, establishing a first transmission channel corresponding to the second user terminal; wherein the first transmission channel is a bidirectional transmission channel; the sending of the audio and video data to the transfer node through the first transmission channel further includes: for any second user terminal, sending the audio and video data to the transfer node through the first transmission channel corresponding to the second user terminal, so that the transfer node can send the audio and video data to the browser in the second user terminal through the second transmission channel corresponding to the second user terminal.

[0137] In an optional embodiment, the transfer node is a second transfer node; then the establishment of the first transmission channel between the web instant messaging module and the transfer node further includes: establishing a single first transmission channel between the web instant messaging module and the transfer node; wherein the first transmission channel is a one-way transmission channel from the web instant messaging module to the transfer node; the sending of the audio and video data to the transfer node through the first transmission channel further includes: sending the audio and video data to the transfer node through the single first transmission channel, so that the transfer node sends the audio and video data to the browser in each second user terminal through the second transmission channel corresponding to each second user terminal.

[0138] In an optional embodiment, the establishment of a data transmission channel between the browser in the second user terminal further includes: for any second user terminal, determining whether a point-to-point transmission channel can be established between the web instant messaging module and the browser in the second user terminal; if so, establishing a point-to-point transmission channel between the web instant messaging module and the browser in the second user terminal, so that the audio and video data are sent to the browser in the second user terminal through the point-to-point transmission channel; if not, establishing a first transmission channel between the web instant messaging module and the transfer node, so that the audio and video data are sent to the transfer node through the first transmission channel and the transfer node sends the audio and video data to the browser in the second user terminal through the second transmission channel between the transfer node and the second user terminal.

[0139] In an optional embodiment, establishing a data transmission channel with the browser in the second user terminal further includes: establishing a third transmission channel between the web instant messaging module and the first transfer node, and establishing a fourth transmission channel between the web instant messaging module and the second transfer node; sending the audio and video data to the browser in at least one second user terminal further includes: sending the audio and video data of the game client to the second transfer node through the fourth transmission channel, so that the second transfer node can transmit the audio and video data to the second user terminal through the sixth transmission channel between the second transfer node and the second user terminal.

[0140] The method also includes: sending device control instructions generated by the game client during operation to the first transfer node through the third transmission channel, so that the first transfer node can transmit the device control instructions to the second user terminal through the fifth transmission channel between the first transfer node and the second user terminal.

[0141] In an optional embodiment, the user operation data includes: handle status data; the game client updating the game audio and video in the game client according to the user operation data further includes: generating game control instructions according to the handle status data, and executing the game control instructions to update the game audio and video in the game client.

[0142] The specific implementation process of the embodiment of the present invention can refer to the description in other method embodiments and will not be repeated here.

[0143] It can be seen from this that the embodiment of the present invention only requires one party to run the game client, and the other parties do not need to download and install the game client to realize multiplayer online games, saving the storage and memory resources of the user terminals of the other parties, lowering the threshold for other parties to participate in the service, and improving the game participation efficiency and user experience of other parties.

[0144] Figure 10 A schematic flow chart of another data processing method provided by an embodiment of the present invention is shown. The data processing method provided by this embodiment is applied to a multiplayer online game scenario. The data processing method provided by this embodiment of the present invention is executed by a second user terminal. The flow charts in this embodiment of the present invention are not intended to limit the order in which the steps are executed. Some steps in this flow chart may be added or deleted as needed.

[0145] Specifically, if Figure 10 As shown, the method includes the following steps:

[0146] Step S1010: The browser receives audio and video data of a game client sent by a first user terminal; wherein the game client runs in the first user terminal.

[0147] Step S1020: The browser displays the audio and video data on the browser page.

[0148] Step S1030: Acquire user operation data generated during the process of displaying audio and video data.

[0149] In an optional embodiment, the user operation data includes: handle status data; then, in the process of displaying the audio and video data, the operation data of the physical game handle is collected, and the handle status data is generated based on the operation data of the physical game handle; and / or, in the process of displaying the audio and video data, a virtual handle interaction page is displayed, the trigger operation on the virtual handle interaction page is collected, and the handle status data is generated based on the trigger operation on the virtual handle interaction page; and / or, in the process of displaying the audio and video data, the operation data of the keyboard and / or mouse in the second user terminal is collected, and the handle status data is generated based on the operation data of the keyboard and / or mouse.

[0150] Step S1040: Send the user operation data to the first user terminal, so that the game client in the first user terminal updates the game audio and video in the game client according to the user operation data.

[0151] The specific implementation process of the embodiment of the present invention can refer to the description in other method embodiments and will not be repeated here.

[0152] It can be seen from this that the embodiment of the present invention only requires one party to run the game client, and the other parties do not need to download and install the game client to realize multiplayer online games, saving the storage and memory resources of the user terminals of the other parties, lowering the threshold for other parties to participate in the service, and improving the game participation efficiency and user experience of other parties.

[0153] Figure 11 FIG. 1 shows a schematic diagram of the structure of a first user terminal provided by an embodiment of the present invention. Figure 11 As shown, the first user terminal 1100 includes: a game client 1110 , a collection module 1120 , and a transmission module 1130 .

[0154] Game client 1110, used to provide game services and update game audio and video in the game client according to user operation data;

[0155] The acquisition module 1120 is used to collect audio and video data from the game client;

[0156] The transmission module 1130 is used to send the audio and video data to the browser in at least one second user terminal so that the browser in the second user terminal can display the audio and video data in the browser page; and receive user operation data generated by the second user terminal during the display of the audio and video data.

[0157] In an optional implementation, the acquisition module is used to: acquire device control instructions generated by the game client during operation.

[0158] In an optional implementation, the transmission module is configured to establish a data transmission channel with a browser in the second user terminal.

[0159] In an optional implementation, the transmission module is configured to: establish a point-to-point transmission channel between the web instant messaging module and the browser in the second user terminal; and send the audio and video data to the browser in the second user terminal via the point-to-point transmission channel.

[0160] In an optional embodiment, the transmission module is used to: establish a first transmission channel between the web instant messaging module and the transfer node; wherein a second transmission channel is established between the transfer node and the browser in the second user terminal; and send the audio and video data to the transfer node through the first transmission channel, so that the transfer node can send the audio and video data to the browser in the second user terminal through the second transmission channel.

[0161] In an optional embodiment, the transmission module is used to: the transfer node is a first transfer node; for any second user terminal, a first transmission channel corresponding to the second user terminal is established; wherein the first transmission channel is a bidirectional transmission channel; for any second user terminal, the audio and video data is sent to the transfer node through the first transmission channel corresponding to the second user terminal, so that the transfer node can send the audio and video data to the browser in the second user terminal through the second transmission channel corresponding to the second user terminal.

[0162] In an optional embodiment, the transmission module is used to: the transfer node is a second transfer node; establish a single first transmission channel between the web instant messaging module and the transfer node; wherein the first transmission channel is a one-way transmission channel from the web instant messaging module to the transfer node; send the audio and video data to the transfer node through the single first transmission channel, so that the transfer node can send the audio and video data to the browser in each second user terminal through the second transmission channel corresponding to each second user terminal.

[0163] In an optional embodiment, the transmission module is used to: for any second user terminal, determine whether a point-to-point transmission channel can be established between the web instant messaging module and the browser in the second user terminal; if so, establish a point-to-point transmission channel between the web instant messaging module and the browser in the second user terminal, so that the audio and video data can be sent to the browser in the second user terminal through the point-to-point transmission channel; if not, establish a first transmission channel between the web instant messaging module and the transfer node, so that the first user terminal can send the audio and video data to the transfer node through the first transmission channel and the transfer node can send the audio and video data to the browser in the second user terminal through the second transmission channel between the transfer node and the second user terminal.

[0164] In an optional embodiment, the transmission module is used to: establish a third transmission channel between the web instant messaging module and the first transfer node, and establish a fourth transmission channel between the web instant messaging module and the second transfer node; send device control instructions generated by the game client during operation to the first transfer node through the third transmission channel, so that the first transfer node can transmit the device control instructions to the second user terminal through the fifth transmission channel between the first transfer node and the second user terminal; send audio and video data of the game client to the second transfer node through the fourth transmission channel, so that the second transfer node can transmit the audio and video data to the second user terminal through the sixth transmission channel between the second transfer node and the second user terminal.

[0165] In an optional embodiment, the user operation data includes: handle status data; the game client is used to: generate game control instructions according to the handle status data, and execute the game control instructions to update the game audio and video in the game client.

[0166] It can be seen from this that the embodiment of the present invention only requires one party to run the game client, and the other parties do not need to download and install the game client to realize multiplayer online games, saving the storage and memory resources of the user terminals of the other parties, lowering the threshold for other parties to participate in the service, and improving the game participation efficiency and user experience of other parties.

[0167] Figure 12 FIG. 1 shows a schematic diagram of the structure of a second user terminal provided by an embodiment of the present invention. Figure 12 As shown, the second user terminal 1200 includes: a browser 1210 .

[0168] The browser 1210 is used to: receive audio and video data of a game client sent by a first user terminal; wherein the game client is running on the first user terminal; display the audio and video data on a browser page; obtain user operation data generated in the process of displaying the audio and video data; and send the user operation data to the first user terminal so that the game client in the first user terminal can update the game audio and video in the game client according to the user operation data.

[0169] The user operation data includes: handle status data; the browser is used to: collect the operation data of the physical game handle during the display of the audio and video data, and generate the handle status data based on the operation data of the physical game handle; and / or, during the display of the audio and video data, display a virtual handle interaction page, collect the triggering operation on the virtual handle interaction page, and generate the handle status data based on the triggering operation on the virtual handle interaction page; and / or, during the display of the audio and video data, collect the operation data of the keyboard and / or mouse in the second user terminal, and generate the handle status data based on the operation data of the keyboard and / or mouse.

[0170] It can be seen from this that the embodiment of the present invention only requires one party to run the game client, and the other parties do not need to download and install the game client to realize multiplayer online games, saving the storage and memory resources of the user terminals of the other parties, lowering the threshold for other parties to participate in the service, and improving the game participation efficiency and user experience of other parties.

[0171] Figure 13 FIG. 1 shows a schematic diagram of the structure of a data processing system provided by an embodiment of the present invention. Figure 13 As shown, the data processing system 1300 includes Figure 11 The first user terminal 1100 shown and at least one Figure 12 The second user terminal 1200 is shown.

[0172] Figure 14 FIG1 shows a schematic diagram of the structure of an electronic device provided by an embodiment of the present invention. The specific embodiments of the present invention do not limit the specific implementation of the electronic device. Figure 14 As shown, the electronic device may include: a processor (processor) 1402 , a communication interface (Communications Interface) 1404 , a memory (memory) 1406 , and a communication bus 1408 .

[0173] Processor 1402, communication interface 1404, and memory 1406 communicate with each other via communication bus 1408. Communication interface 1404 is used to communicate with other devices, such as clients or other server network elements. Processor 1402 is used to execute program 1410, which may specifically perform the steps described above in the data processing method embodiment.

[0174] Specifically, program 1410 may include program code, which includes computer operating instructions. Processor 1402 may be a central processing unit (CPU), an application-specific integrated circuit (ASIC), or one or more integrated circuits configured to implement embodiments of the present invention. The one or more processors included in the electronic device may be processors of the same type, such as one or more CPUs, or may be processors of different types, such as one or more CPUs and one or more ASICs.

[0175] Memory 1406 is used to store program 1410. Memory 1406 may include high-speed RAM memory, or may also include non-volatile memory (non-volatile memory), such as at least one disk storage. Program 1410 can specifically be used to cause processor 1402 to execute any of the above method embodiments.

[0176] An embodiment of the present invention provides a non-volatile computer storage medium, wherein the computer storage medium stores at least one executable instruction, and the computer executable instruction can execute the data processing method in any of the above method embodiments.

[0177] The algorithm or display provided herein is not inherently related to any particular computer, virtual system or other device. Various general-purpose systems can also be used together with the teachings based on this. According to the above description, it is obvious that the structure required for constructing such systems. In addition, the embodiment of the present invention is not directed to any specific programming language. It should be understood that various programming languages ​​can be utilized to implement the content of the embodiment of the present invention described herein, and the above description of specific languages ​​is for the purpose of disclosing the best mode of implementation of the embodiment of the present invention.

[0178] In the description provided herein, numerous specific details are described. However, it is understood that embodiments of the present invention can be practiced without these specific details. In some instances, well-known methods, structures, and techniques are not shown in detail so as not to obscure the understanding of this description.

[0179] Similarly, it should be understood that in order to streamline the embodiments of the invention and aid in understanding one or more of the various inventive aspects, in the above description of exemplary embodiments of the embodiments of the invention, various features of the embodiments of the invention are sometimes grouped together into a single embodiment, figure, or description thereof. However, this disclosed approach should not be interpreted as reflecting an intention that the claimed embodiments of the invention require more features than are expressly recited in each claim. Rather, as reflected in the claims below, inventive aspects lie in less than all of the features of the individual embodiments disclosed above. Accordingly, the claims that follow the detailed description are hereby expressly incorporated into the detailed description, with each claim itself serving as a separate embodiment of the embodiments of the invention.

[0180] Those skilled in the art will appreciate that the modules in the devices in the embodiments may be adaptively changed and arranged in one or more devices different from the embodiments. The modules or units or components in the embodiments may be combined into one module or unit or component, and in addition may be divided into multiple submodules or subunits or subcomponents. All features disclosed in this specification (including the accompanying claims, abstracts and drawings) and all processes or units of any method or device disclosed herein may be combined in any combination, except that at least some of such features and / or processes or units are mutually exclusive. Unless expressly stated otherwise, each feature disclosed in this specification (including the accompanying claims, abstracts and drawings) may be replaced by an alternative feature providing the same, equivalent or similar purpose.

[0181] Furthermore, those skilled in the art will appreciate that although some embodiments herein include certain features included in other embodiments but not other features, combinations of features from different embodiments are intended to be within the scope of the present invention and to form different embodiments. For example, in the claims below, any of the claimed embodiments may be used in any combination.

[0182] The various component embodiments of the embodiments of the present invention can be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. Those skilled in the art will appreciate that a microprocessor or digital signal processor (DSP) can be used in practice to implement some or all of the functions of some or all of the components according to the embodiments of the present invention. The embodiments of the present invention can also be implemented as a device or apparatus program (e.g., a computer program and a computer program product) for executing part or all of the methods described herein. Such a program implementing an embodiment of the present invention can be stored on a computer-readable medium, or can have the form of one or more signals. Such a signal can be downloaded from an Internet website, or provided on a carrier signal, or provided in any other form.

[0183] It should be noted that the above embodiments illustrate rather than limit embodiments of the invention, and that a person skilled in the art may devise alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between brackets shall not be construed as limiting the claims. The word "comprising" does not exclude the presence of elements or steps not listed in the claims. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. Embodiments of the invention may be implemented by means of hardware comprising several different elements and by means of appropriately programmed computers. In a unit claim enumerating several means, several of these means may be embodied by the same item of hardware. The use of the words first, second, and third etc. does not indicate any order. These words may be interpreted as names. The steps in the above embodiments should not be understood as limiting the order of execution unless otherwise specified.

Claims

1. A data processing method, characterized in that: include: Establishing a data transmission channel between the browser in the first user terminal and the browser in the second user terminal; The first user terminal runs a game client located in the first user terminal and collects audio and video data of the game client; wherein the first user terminal is a user terminal that has installed the game client; The first user terminal sends the audio and video data to a browser in at least one second user terminal; the second user terminal is a user terminal that does not have a game client installed; The browser in the second user terminal displays the audio and video data on the browser page; The second user terminal acquires user operation data generated during the display of the audio and video data, and sends the user operation data to the first user terminal; The game client in the first user terminal updates the game audio and video in the game client according to the user operation data; The first user terminal collects device control instructions generated by the game client during operation, and sends the device control instructions to the browser in the second user terminal; the second user terminal executes the device control instructions.

2. The method according to claim 1, characterized in that The establishing of a data transmission channel between the first user terminal and the browser in the second user terminal further includes: establishing a point-to-point transmission channel between the webpage instant messaging module in the first user terminal and the browser in the second user terminal; The first user terminal sending the audio and video data to the browser in the second user terminal further includes: the first user terminal sending the audio and video data to the browser in the second user terminal through the point-to-point transmission channel.

3. The method according to claim 1, characterized in that The establishing of the data transmission channel between the first user terminal and the browser in the second user terminal further includes: configuring a transfer node, and establishing a first transmission channel between the web instant messaging module in the first user terminal and the transfer node, and establishing a second transmission channel between the transfer node and the browser in the second user terminal; The first user terminal sending the audio and video data to the browser in the second user terminal further includes: the first user terminal sending the audio and video data to the transfer node through the first transmission channel, and the transfer node sending the audio and video data to the browser in the second user terminal through the second transmission channel.

4. The method according to claim 3, characterized in that The transfer node is a first transfer node; Then, the step of establishing the first transmission channel between the web instant messaging module in the first user terminal and the transfer node further includes: establishing, for any second user terminal, a first transmission channel corresponding to the second user terminal; wherein the first transmission channel is a bidirectional transmission channel; The establishing of the second transmission channel between the transfer node and the browser in the second user terminal further includes: establishing a second transmission channel corresponding to any second user terminal; wherein the second transmission channel is a bidirectional transmission channel; The first user terminal sends the audio and video data to the transfer node through the first transmission channel, and the transfer node sends the audio and video data to the browser in the second user terminal through the second transmission channel further includes: for any second user terminal, the first user terminal sends the audio and video data to the transfer node through the first transmission channel corresponding to the second user terminal, and the transfer node sends the audio and video data to the browser in the second user terminal through the second transmission channel corresponding to the second user terminal.

5. The method according to claim 3, characterized in that The transfer node is a second transfer node; Then, establishing the first transmission channel between the web page instant messaging module in the first user terminal and the transfer node further includes: establishing a single first transmission channel between the web page instant messaging module in the first user terminal and the transfer node; the first transmission channel is a unidirectional transmission channel from the first user terminal to the transfer node; The establishing of the second transmission channel between the transfer node and the browser in the second user terminal further includes: establishing, for any second user terminal, a second transmission channel corresponding to the second user terminal; wherein the second transmission channel is a unidirectional transmission channel from the transfer node to the second user terminal; The first user terminal sends the audio and video data to the transfer node through the first transmission channel, and the transfer node sends the audio and video data to the browser in the second user terminal through the second transmission channel further includes: the first user terminal sends the audio and video data to the transfer node through the single first transmission channel, and the transfer node sends the audio and video data to the browser in each second user terminal through the second transmission channel corresponding to each second user terminal.

6. The method according to any one of claims 3 to 5, characterized in that The configuration transfer node further includes: Obtaining the number of second user terminals; Determining whether the number of the second user terminals is less than a preset threshold; If yes, configure the first transfer node; if no, configure the second transfer node.

7. The method according to claim 1, characterized in that The step of establishing a data transmission channel between the browser in the first user terminal and the browser in the second user terminal further includes: For any second user terminal, determining whether a point-to-point transmission channel can be established between the web instant messaging module in the first user terminal and the browser in the second user terminal; If so, establishing a point-to-point transmission channel between the web instant messaging module in the first user terminal and the browser in the second user terminal, so that the first user terminal can send the audio and video data to the browser in the second user terminal through the point-to-point transmission channel; If not, configure a transfer node, and establish a first transmission channel between the web instant messaging module in the first user terminal and the transfer node, and establish a second transmission channel between the transfer node and the browser in the second user terminal, so that the first user terminal sends the audio and video data to the transfer node through the first transmission channel and the transfer node sends the audio and video data to the browser in the second user terminal through the second transmission channel.

8. The method according to claim 1, characterized in that The step of establishing a data transmission channel between the browser in the first user terminal and the browser in the second user terminal further includes: Configure a first transfer node and a second transfer node; Establishing a third transmission channel between the web instant messaging module in the first user terminal and the first transfer node, establishing a fourth transmission channel between the web instant messaging module in the first user terminal and the second transfer node, establishing a fifth transmission channel between the first transfer node and the second user terminal, and establishing a sixth transmission channel between the second transfer node and the second user terminal; The first user terminal sending the audio and video data to the browser in the second user terminal further includes: the first user terminal sending a device control instruction generated by the game client during operation to the first transfer node through the third transmission channel, and the first transfer node transmitting the device control instruction to the second user terminal through the fifth transmission channel; The first user terminal sends the audio and video data of the game client to the second transfer node through the fourth transmission channel, and the second transfer node transmits the audio and video data to the second user terminal through the sixth transmission channel.

9. The method according to any one of claims 1 to 5, characterized in that The user operation data includes: handle status data; The second user terminal acquiring the user operation data generated during the display of the audio and video data further includes: The second user terminal collects operation data of a physical game controller in the second user terminal during the display of the audio and video data, and generates the controller state data according to the operation data of the physical game controller; and / or, the second user terminal displays a virtual handle interaction page during the display of the audio and video data, collects triggering operations on the virtual handle interaction page, and generates the handle state data according to the triggering operations on the virtual handle interaction page; and / or, the second user terminal collects keyboard and / or mouse operation data in the second user terminal during the display of the audio and video data, and generates the handle state data according to the keyboard and / or mouse operation data; The game client in the first user terminal updates the game audio and video in the game client according to the user operation data further includes: the game client in the first user terminal generates a game control instruction according to the handle state data, and executes the game control instruction to update the game audio and video in the game client.

10. A data processing method, characterized in that: The method is executed on a first user terminal side, where the first user terminal is a user terminal on which a game client has been installed, and the method includes: Establishing a data transmission channel with the browser in the second user terminal; Running a game client and collecting audio and video data of the game client; the second user terminal is a user terminal that does not have the game client installed; Sending the audio and video data to a browser in at least one second user terminal, so that the browser in the second user terminal displays the audio and video data on a browser page; receiving user operation data generated during the display of the audio and video data, sent by a second user terminal; The game client updates the game audio and video in the game client according to the user operation data; The device control instructions generated by the game client during operation are collected and sent to the browser in the second user terminal so that the second user terminal can execute the device control instructions.

11. The method according to claim 10, characterized in that The establishing of a data transmission channel with the browser in the second user terminal further comprises: establishing a point-to-point transmission channel between the webpage instant messaging module and the browser in the second user terminal; The sending of the audio and video data to a browser in at least one second user terminal further includes sending the audio and video data to the browser in at least one second user terminal through the point-to-point transmission channel.

12. The method according to claim 10, characterized in that The establishing of a data transmission channel with the browser in the second user terminal further includes: establishing a first transmission channel between the web instant messaging module and the transfer node; wherein a second transmission channel is established between the transfer node and the browser in the second user terminal; The sending of the audio and video data to the browser in at least one second user terminal further includes: sending the audio and video data to the transfer node through the first transmission channel, so that the transfer node sends the audio and video data to the browser in at least one second user terminal through the second transmission channel.

13. The method according to claim 12, characterized in that The transfer node is a first transfer node; Then, the step of establishing the first transmission channel between the web instant messaging module and the transfer node further includes: establishing, for any second user terminal, a first transmission channel corresponding to the second user terminal; wherein the first transmission channel is a bidirectional transmission channel; The sending of the audio and video data to the transfer node through the first transmission channel further includes: for any second user terminal, sending the audio and video data to the transfer node through the first transmission channel corresponding to the second user terminal, so that the transfer node sends the audio and video data to the browser in the second user terminal through the second transmission channel corresponding to the second user terminal.

14. The method according to claim 12, characterized in that The transfer node is a second transfer node; Then, the step of establishing the first transmission channel between the web page instant messaging module and the transfer node further includes: establishing a single first transmission channel between the web page instant messaging module and the transfer node; wherein the first transmission channel is a unidirectional transmission channel from the web page instant messaging module to the transfer node; The sending of the audio and video data to the transfer node through the first transmission channel further includes: sending the audio and video data to the transfer node through the single first transmission channel, so that the transfer node sends the audio and video data to the browser in each second user terminal through the second transmission channel corresponding to each second user terminal.

15. The method according to claim 10, characterized in that The establishing of a data transmission channel with the browser in the second user terminal further includes: For any second user terminal, determining whether a point-to-point transmission channel can be established between the web instant messaging module and the browser in the second user terminal; If so, establishing a point-to-point transmission channel between the web instant messaging module and the browser in the second user terminal, so as to send the audio and video data to the browser in the second user terminal through the point-to-point transmission channel; If not, a first transmission channel is established between the web instant messaging module and the transfer node, so that the audio and video data are sent to the transfer node through the first transmission channel, and the transfer node sends the audio and video data to the browser in the second user terminal through the second transmission channel between the transfer node and the second user terminal.

16. The method according to claim 10, characterized in that The establishing of a data transmission channel with the browser in the second user terminal further includes: Establishing a third transmission channel between the web page instant messaging module and the first transfer node, and establishing a fourth transmission channel between the web page instant messaging module and the second transfer node; The sending of the audio and video data to the browser in at least one second user terminal further includes: sending the audio and video data of the game client to the second transfer node via the fourth transmission channel, so that the second transfer node transmits the audio and video data to the second user terminal via the sixth transmission channel between the second transfer node and the second user terminal; The method also includes: sending device control instructions generated by the game client during operation to the first transfer node through the third transmission channel, so that the first transfer node can transmit the device control instructions to the second user terminal through the fifth transmission channel between the first transfer node and the second user terminal.

17. The method according to any one of claims 10 to 16, characterized in that The user operation data includes: handle status data; The game client updating the game audio and video in the game client according to the user operation data further includes: generating a game control instruction according to the handle state data, and executing the game control instruction to update the game audio and video in the game client.

18. A data processing method, characterized in that: The method is executed on a second user terminal side, where the second user terminal is a user terminal that does not have a game client installed; the method includes: Establishing a data transmission channel between the browser and a first user terminal; wherein the first user terminal is a user terminal on which a game client has been installed; The browser receives audio and video data of a game client sent by a first user terminal; wherein the game client is running in the first user terminal; The browser displays the audio and video data on the browser page; Acquiring user operation data generated during the display of the audio and video data; Sending the user operation data to the first user terminal, so that the game client in the first user terminal updates the game audio and video in the game client according to the user operation data; Execute the device control instruction sent by the first user terminal; wherein the first user terminal collects the device control instruction generated by the game client during operation.

19. The method according to claim 18, characterized in that The user operation data includes: handle status data; Then the acquiring of user operation data generated during the display of the audio and video data further includes: During the display of the audio and video data, collecting operation data of a physical game controller, and generating the controller state data according to the operation data of the physical game controller; and / or, during the display of the audio and video data, displaying a virtual handle interaction page, collecting triggering operations on the virtual handle interaction page, and generating the handle state data according to the triggering operations on the virtual handle interaction page; And / or, during the display of the audio and video data, keyboard and / or mouse operation data in the second user terminal are collected, and the handle status data is generated according to the keyboard and / or mouse operation data.

20. A first user terminal, characterized in that: The first user terminal is a user terminal on which a game client is installed, and the first user terminal establishes a data transmission channel with a browser in a second user terminal; The first user terminal includes: A game client, used to provide game services and update the game audio and video in the game client according to user operation data; A collection module, used to collect audio and video data of the game client; a transmission module configured to transmit the audio and video data to a browser in at least one second user terminal, so that the browser in the second user terminal displays the audio and video data on a browser page; and to receive user operation data generated during the display of the audio and video data, acquired by the second user terminal; the second user terminal is a user terminal that does not have a game client installed; The device control instructions generated by the game client during operation are collected and sent to the browser in the second user terminal so that the second user terminal can execute the device control instructions.

21. A second user terminal, characterized in that: The second user terminal is a user terminal that does not have a game client installed; a data transmission channel is established between the browser of the second user terminal and the first user terminal; The second user terminal includes: A browser, the browser being configured to: receive audio and video data from a game client sent by a first user terminal; wherein the game client is running on the first user terminal; display the audio and video data on a browser page; obtain user operation data generated during the display of the audio and video data; transmit the user operation data to the first user terminal so that the game client in the first user terminal updates the game audio and video in the game client according to the user operation data; and execute device control instructions sent by the first user terminal; wherein the first user terminal collects device control instructions generated by the game client during operation.

22. A data processing system, characterized in that: include: A first user terminal as claimed in claim 20 and at least one second user terminal as claimed in claim 21.

23. An electronic device, characterized in that: include: A processor, a memory, a communication interface, and a communication bus, wherein the processor, the memory, and the communication interface communicate with each other via the communication bus; The memory is used to store at least one executable instruction, and the executable instruction enables the processor to perform an operation corresponding to the data processing method according to any one of claims 1 to 19.

24. A computer storage medium, characterized in that The storage medium stores at least one executable instruction, and the executable instruction enables the processor to execute an operation corresponding to the data processing method according to any one of claims 1 to 19.

25. A computer program product, characterized in that The computer program product is used to execute operations corresponding to the data processing method according to any one of claims 1 to 19.

Images