Data transmission method, device, equipment, medium and product

By allocating a targeted gateway to the virtual terminal equipment and room servers, the problem of untimely data synchronization between the virtual terminal equipment and the server in virtual reality is solved, and efficient data transmission is achieved.

CN118945207APending Publication Date: 2024-11-12BEIJING ZITIAO NETWORK TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202310525128.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-05-10
Publication Date
2024-11-12

AI Technical Summary

Technical Problem

In the virtual reality multi-computer interaction scenario, the data forwarding efficiency between the virtual terminal device and the server is low, resulting in the data synchronization between the virtual terminal device being untimely.

Method used

By allocating a targeted gateway to the room server and the target virtual terminal device, the exclusive data transmission path between the target virtual terminal device and the room server is realized, and data transmission efficiency is improved.

Benefits of technology

It improves the data synchronization rate between the virtual terminal device and the server, ensures low-latency data transmission in the virtual environment, and solves the problem of untimely data synchronization.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118945207A_ABST
    Figure CN118945207A_ABST
Patent Text Reader

Abstract

Embodiments of the present disclosure provide a data transmission method, apparatus, device, medium and product, the method comprising: displaying a virtual room, the virtual room comprising at least one virtual user image, the virtual user image being associated with a user of a respective virtual terminal device; determining a room server corresponding to the virtual room; obtaining a directional gateway allocated to the room server and the target virtual terminal equipment; and executing data transmission between the target virtual terminal equipment and the room server based on the directional gateway. Through the directional gateway, exclusive path transmission between the target virtual terminal equipment and the room server can be realized, and the data transmission efficiency is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The embodiments of the present disclosure relate to the field of computer and network communication technology, and in particular, to a data transmission method, device, equipment, medium and product. Background Art

[0002] In the multi-machine interaction scenario in the field of virtual reality, multiple virtual terminal devices can be added to the same room, each virtual terminal device can synchronously display the virtual room, and at least one virtual user image can be displayed in the virtual room. The virtual user image can be a three-dimensional dynamic image associated with the user wearing the virtual terminal device, and the virtual user image can specifically be a virtual human body, a cartoon image, etc. The posture of each virtual user image in the room can be updated with the user's actions. For example, when the user raises his hand, the corresponding virtual user image can raise his hand; when the user walks, the corresponding virtual user image can walk; when the user shakes his head, the corresponding virtual user image can shake his head.

[0003] In order to achieve synchronous display of multiple virtual terminal devices, the virtual terminal devices in the same room need to communicate data. However, different network protocols are generally used between each virtual terminal device and the server, and a gateway is required to forward the data between the two devices. At present, the gateway has a low efficiency in forwarding data between the virtual terminal device and the server, resulting in insufficient synchronization of data between multiple virtual terminal devices. Summary of the invention

[0004] The embodiments of the present disclosure provide a data transmission method, apparatus, device, medium and product to overcome the problem that in current multi-machine interaction scenarios, the data forwarding efficiency between multiple virtual terminal devices and a server is low, resulting in insufficient data synchronization between multiple virtual terminal devices.

[0005] In a first aspect, an embodiment of the present disclosure provides a data transmission method, which is applied to a target virtual terminal device, and the method includes:

[0006] displaying a virtual room, the virtual room including at least one virtual user image, the virtual user image being associated with a user of a respective virtual terminal device;

[0007] Determine the room server corresponding to the virtual room;

[0008] Obtain the directional gateway assigned to the room server and the target virtual terminal device;

[0009] Based on the directional gateway, data transmission between the target virtual terminal device and the room server is performed.

[0010] In a second aspect, a data transmission method is provided, which is applied to a directional gateway, wherein the directional gateway is associated with a target virtual terminal device, and the method includes:

[0011] receiving a first data message sent by a target virtual terminal device, the first data message including a network address of a room server and a network address of a directional gateway and data to be transmitted, the virtual room including at least one virtual user image, the virtual user image corresponding to each terminal device, and each virtual terminal device joining the virtual room;

[0012] Parsing the first data message to obtain the network address of the room server;

[0013] The first data message is sent to the room server according to the network address of the room server.

[0014] In a third aspect, a data transmission method is provided, which is applied to a load balancing device, and the method includes:

[0015] receiving a gateway configuration request sent by a target virtual terminal device, the gateway configuration request including a room server of a virtual room and a target virtual terminal device; the virtual room includes at least one virtual user image, the virtual user image corresponds to each terminal device, and each virtual terminal joins the virtual room;

[0016] In response to the gateway configuration request, allocating a directional gateway to the room server and the target virtual terminal device;

[0017] The identification information of the directional gateway is fed back to the target virtual terminal device, and the directional gateway is used for data transmission between the target virtual terminal device and the room server.

[0018] In a fourth aspect, a data transmission device is provided, which is located in a target virtual terminal device, and includes:

[0019] A display unit, for displaying a virtual room, the virtual room including at least one virtual user image, the virtual user image being associated with a user of a respective virtual terminal device;

[0020] A determination unit, used for determining a room server corresponding to the virtual room;

[0021] A directional unit, used for obtaining a directional gateway assigned to a room server and a target virtual terminal device;

[0022] The transmission unit is used for performing data transmission between the target virtual terminal device and the room server based on the directional gateway.

[0023] In a fifth aspect, a data transmission device is provided, located in a directional gateway, and the device includes:

[0024] A receiving unit, configured to receive a first data message sent by a target virtual terminal device, wherein the first data message includes a network address of a room server and a network address of a directional gateway and data to be transmitted, wherein the virtual room includes at least one virtual user image, the virtual user image corresponds to a respective terminal device, and each virtual terminal device joins the virtual room;

[0025] A parsing unit, used for parsing the first data message to obtain a network address of a room server;

[0026] The sending unit is used to send the first data message to the room server according to the network address of the room server.

[0027] In a sixth aspect, a gateway allocation device is provided, which is located in a load balancing device, and the device includes:

[0028] The request unit is used to receive a gateway configuration request sent by a virtual terminal device, wherein the gateway configuration request includes a room server of a virtual room and a target virtual terminal device; the virtual room includes at least one virtual user image, the virtual user image corresponds to each terminal device, and each virtual terminal joins the virtual room;

[0029] an allocating unit, configured to allocate a directional gateway to a room server and a target virtual terminal device in response to a gateway configuration request;

[0030] The feedback unit is used to feed back the directional gateway to the target virtual terminal device, and the directional gateway is used to transmit data between the target virtual terminal device and the room server.

[0031] In a seventh aspect, an electronic device is provided, comprising: at least one processor and a memory;

[0032] Memory stores computer-executable instructions;

[0033] At least one processor executes the computer-executable instructions stored in the memory, so that the at least one processor executes the data transmission method of the first aspect, the second aspect, the third aspect and various possible designs of the aspects described above.

[0034] In an eighth aspect, a computer-readable storage medium is provided, in which computer execution instructions are stored. When a processor executes the computer execution instructions, the data transmission method of the first aspect, the second aspect, the third aspect and various possible designs of each aspect are implemented.

[0035] In the ninth aspect, a computer program product is provided, including a computer program, which, when executed by a processor, implements the data transmission method of the first aspect, the second aspect, the third aspect, and various possible designs of the above aspects.

[0036] In the data transmission method provided in this embodiment, the virtual terminal device can display a virtual room. The virtual room can include at least one virtual user image, and the virtual user image can be associated with the user of the respective virtual terminal device. In the process of displaying the virtual room, the target virtual terminal device can determine the room server corresponding to the virtual room. The room server can be a server set for the virtual room for storing various data in the room. It is also possible to obtain a directional gateway assigned to the room server and the target virtual terminal device from the gateway cluster. The directional gateway can be responsible for executing the data transmission between the target virtual terminal device and the room server, and realizing fast data transmission between the target virtual terminal device and the room server. The directional gateway can realize exclusive channel transmission between the target virtual terminal device and the room server, improve the data transmission efficiency, and then timely synchronize the data of the virtual terminal devices in the virtual room. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0038] Figure 1 This is a structural example diagram of a data transmission system in the prior art;

[0039] Figure 2 A system architecture diagram of a data transmission system provided in an embodiment of the present disclosure;

[0040] Figure 3 A flowchart of an embodiment of a data transmission method provided by an embodiment of the present disclosure;

[0041] Figure 4 An exemplary diagram of a data transmission method provided by an embodiment of the present disclosure;

[0042] Figure 5 An example diagram of data transmission provided by an embodiment of the present disclosure;

[0043] Figure 6 A flowchart of another embodiment of a data transmission method provided by the embodiment of the present disclosure;

[0044] Figure 7 Another example diagram of a data transmission method provided by an embodiment of the present disclosure;

[0045] Figure 8 A flowchart of another embodiment of a data transmission method provided by the embodiment of the present disclosure;

[0046] Fig. 9 A schematic diagram of the structure of an embodiment of a data transmission device provided by an embodiment of the present disclosure;

[0047] Fig.10 A schematic structural diagram of another embodiment of a data transmission device provided by an embodiment of the present disclosure;

[0048] Fig.11 A schematic structural diagram of another embodiment of a data transmission device provided by an embodiment of the present disclosure;

[0049] Fig.12 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0050] In order to make the purpose, technical solution and advantages of the embodiments of the present disclosure clearer, the technical solution in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are part of the embodiments of the present disclosure, not all of the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present disclosure.

[0051] The technical solution disclosed in the present invention can be applied to human-computer interaction scenarios with multiple virtual terminal devices. A room server can be assigned to a virtual room, and a directional gateway can be assigned to the room server and the virtual terminal device. The directional gateway can be used to realize data transmission between the corresponding virtual terminal device and the room server, so that the directional gateway can provide targeted data transmission services, improve data transmission efficiency, and make the data synchronization rate between the virtual terminal device and the server higher.

[0052] refer to Figure 1 , is a structural example diagram of a data transmission system in the prior art. Figure 1The data transmission system shown is generally a gateway 13 set between multiple virtual terminal devices 11 and a server 12. Among them, the server 12 can be a distributed server, and the distributed data can be distributed by polling, weighted polling, hash algorithm and the like. However, the distribution result of this distribution method is generally that multiple virtual terminal devices correspond to the same gateway, that is, the data of multiple virtual terminal devices and room servers can only be forwarded through one gateway, and the actual room server can be distributed data. When the gateway forwards the data to the server, it is necessary to determine the allocated server again. This results in a large amount of data forwarding by the gateway and a relatively large processing pressure. Therefore, the data transmission efficiency between multiple virtual terminal devices and room servers is low, resulting in the data synchronization of multiple virtual terminal devices not being timely enough. Even when the data transmission is slow, it is easy to cause the virtual user image in the virtual room to change slowly, have shadows and the like, which will cause the user to feel dizzy when wearing the virtual terminal device to watch at least one virtual user image in the virtual room. Therefore, how to realize data transmission in a virtual environment in a low-latency manner is a technical problem that needs to be solved urgently.

[0053] According to the technical solution disclosed in the present invention, a virtual terminal device can display a virtual room. The virtual room can include at least one virtual user image. The virtual user image can be associated with the user of the respective virtual terminal device. In the process of displaying the virtual room, the target virtual terminal device can determine the room server corresponding to the virtual room. The room server can be a server set for the virtual room for storing various data in the room. It is also possible to obtain a directional gateway assigned to the room server and the target virtual terminal device from the gateway cluster. The directional gateway can be responsible for executing data transmission between the target virtual terminal device and the room server, and realizing fast data transmission between the target virtual terminal device and the room server. The directional gateway can realize exclusive channel transmission between the target virtual terminal device and the room server, improve data transmission efficiency, and thus synchronize the data of the virtual terminal devices in the virtual room in a timely manner.

[0054] The technical solution of the present disclosure will be described in detail below with reference to the accompanying drawings.

[0055] like Figure 2 , which is a system architecture diagram of a data transmission system provided by an embodiment of the present disclosure. The data transmission system may include multiple virtual terminal devices 21, and the multiple virtual terminal devices 21 may be worn by a user. Any virtual terminal device 21 may display a virtual room, and the virtual room may include at least one virtual user image. The virtual user image may be associated with a user of the corresponding virtual terminal device, and the actions of the virtual user image may be consistent with the actions of the user.

[0056] In addition, the data transmission system may further include a gateway cluster 22, which may include multiple gateway nodes. The gateway cluster 22 may be connected to a CLB (Classic Load Balancer) device 23. The load balancing device 23 may also be connected to multiple virtual terminal devices 21. The gateway cluster 22 may also be connected to a server cluster 24. The server cluster 24 may be a distributed server cluster. The room server 241 may be a node in the server cluster 24 allocated to the virtual room, that is, multiple virtual terminal devices 21 corresponding to the virtual room may perform data transmission with the room server 241. In actual applications, the load balancing device 23 may include multiple, Figure 2 One is shown in FIG.

[0057] In order to improve the data transmission efficiency, the target virtual terminal device 211 can display the virtual room and determine the room server 241 corresponding to the virtual room, and the IP (Internet Protocol Address) address of the room server 241 is known. After that, the directional gateway 221 assigned by the load balancing device 23 to the room server 241 and the target virtual terminal device 211 can be obtained. The directional gateway 221 can be a gateway node in the gateway cluster 22. Based on the directional gateway 221, data transmission between the target virtual terminal device 211 and the room server 241 can be performed, thereby improving the data transmission efficiency between the room server 241 and the target virtual terminal device 211, thereby reducing the delay of data transmission, and ensuring that multiple virtual terminal devices in the same virtual room can achieve data synchronization. In addition, the directional gateway 221 can also perform data transmission between other virtual terminal devices 21 and the room server 241.

[0058] It should be noted that Figure 2 In the figure, the connection structure between the load balancing device and the gateway node, and the connection structure between each gateway node and each server node in the server cluster 24 are merely schematic and should not constitute a specific limitation on the node connection structure of different clusters. The node connection relationship between different clusters can be configured according to actual usage requirements.

[0059] Figure 3 A flowchart of an embodiment of a data transmission method provided by an embodiment of the present disclosure, the method can be applied to a target virtual terminal device, and the method may include:

[0060] S301: Display a virtual room, where the virtual room includes at least one virtual user image, and the virtual user image is associated with a user of a respective virtual terminal device.

[0061] Optionally, the virtual room may be a three-dimensional space established by a three-dimensional space coordinate system, which may be obtained by constructing a three-dimensional room model and rendering a room interior map. The virtual terminal device may be a VR (Virtual Reality) device or an XR (Extended Reality) device, such as VR glasses, XR glasses, etc. In this embodiment, the specific device type of the virtual terminal device is not limited too much.

[0062] Based on the room entry request triggered by the user, the virtual terminal device can obtain the room identification of the virtual room in the room entry request, obtain the display data of the virtual room through the room identification, display the virtual room based on the display data, and display at least one virtual user image in the virtual room, where the virtual user image is the character image corresponding to the user who joins the virtual room. Of course, in actual applications, the user can choose to display his or her virtual user image or not, and the display of the virtual user image can be automatically controlled according to actual needs. The action of the virtual user image can be consistent with that of the user. For example, when the virtual terminal device detects that the user performs a nod action, the virtual user image in the virtual room can synchronously perform a nod action, etc. Of course, the virtual user images displayed in each virtual terminal device can all perform a nod action. If the virtual room is a game scene, it is also possible to associate and display associated controls such as a vitality progress bar with the virtual user image in the virtual room.

[0063] Among them, the virtual room can be initiated by the user, and can be initiated by the virtual terminal device corresponding to the user, or can be initiated by a third-party terminal device, such as a mobile phone. After the virtual room is established, any virtual terminal device can request to join the virtual room and determine the virtual user image of its user, and display the virtual user image corresponding to the newly joined user in the virtual room. The virtual user image can be a virtual character corresponding to the user using the virtual terminal device, such as a cartoon character selected by the user, or a three-dimensional digital human body reconstructed based on the user's height, weight and other data. In this embodiment, there are no excessive restrictions on the specific image types of the virtual user image. The virtual user image can change continuously with the user's movement posture.

[0064] S302: Determine the room server corresponding to the virtual room.

[0065] Optionally, the room server may be a real server (RS) that provides data receiving, storage and forwarding services for the virtual room. The room server of a virtual room may be determined after the virtual room is established, that is, after the virtual room is established, a room server may be allocated to the virtual room, and the IP address of the room server is known. After the virtual room is established, the virtual terminal device accessing the virtual room may be determined, and the room server may be pre-synchronized for each virtual terminal device corresponding to the same virtual room, that is, the IP address of the room server may be recorded in each virtual terminal device accessing the virtual room. Each virtual terminal device may send data to the room server through the recorded IP address of the room server.

[0066] Step 302 may also include: determining a server identifier of a room server corresponding to the virtual room, where the server identifier may be, for example, an IP address. The IP address of the room server may be used to generate a message, and may be used as a header in the message to indicate that data needs to be sent to the room server corresponding to the IP address recorded in the message header. The virtual terminal device may establish a correspondence between the room identifier of the virtual room, the IP address of the room server, and the device IP address, and may perform data transmission through the correspondence.

[0067] S303: Acquire the directional gateway allocated to the room server and the target virtual terminal device.

[0068] Optionally, the target virtual terminal device may join any one of a plurality of virtual terminal devices in the virtual room.

[0069] Optionally, the directional gateway may be a gateway node in a gateway cluster, or may be a gateway scheduled for a target virtual terminal device by a gateway cluster. Step 303 may include: obtaining a directional gateway allocated to a room server and a target virtual terminal from a gateway cluster. Specifically, the directional gateway allocated to a room server and a target virtual terminal by a CLB from a gateway cluster may be obtained.

[0070] S304: Based on the directional gateway, execute data transmission between the target virtual terminal device and the room server.

[0071] The directional gateway may refer to a fixed gateway for data transmission between the room server and the target virtual terminal device. Through the setting of the directional gateway, the data between the room server and the target virtual terminal device can be directional transmitted. The data transmission efficiency through the directional gateway is higher, which can improve the data transmission efficiency.

[0072] In the disclosed embodiment, a virtual terminal device can display a virtual room. The virtual room can include at least one virtual user image. The virtual user image can be associated with the user of the respective virtual terminal device. In the process of displaying the virtual room, the target virtual terminal device can determine the room server corresponding to the virtual room. The room server can be a server set for the virtual room for storing various data in the room. It is also possible to obtain a directional gateway assigned to the room server and the target virtual terminal device from the gateway cluster. The directional gateway can be responsible for executing data transmission between the target virtual terminal device and the room server, and realizing fast data transmission between the target virtual terminal device and the room server. The directional gateway can realize exclusive channel transmission between the target virtual terminal device and the room server, improve data transmission efficiency, and thus synchronize the data of the virtual terminal devices in the virtual room in a timely manner.

[0073] Further, based on any of the above embodiments, executing data transmission between the target virtual terminal device and the room server based on the directional gateway includes:

[0074] Determine the data to be transmitted corresponding to the target virtual terminal device.

[0075] According to the network address of the room server and the network address of the directional gateway, the data to be transmitted is encapsulated into a first data message.

[0076] Based on the directional gateway, the first data message is sent to the room server.

[0077] Optionally, the data to be transmitted may include posture data of the user corresponding to the target virtual terminal device, and the data to be transmitted may also include voice data, video data, etc. collected by the target virtual terminal device. The data to be transmitted may be any type of data.

[0078] Optionally, based on the directional gateway, sending the first data message to the room server may include: sending the first data message to the CLB, and the CLB sending the first data message to the directional gateway according to the IP address of the directional gateway in the first data message. After receiving the first data message, the directional gateway may parse the first data message, convert the first data message into a second data message, and send the second data message to the room server. After receiving the second data message, the room server obtains the IP address of the room server contained in the second data message, and if the IP address is the same as the IP address of the main body, it is determined that the second data message is received.

[0079] In the disclosed embodiment, the data to be transmitted corresponding to the target virtual terminal device can be used to generate a data message. Specifically, the data to be transmitted can be encapsulated into a first data message according to the network address of the room server and the network address of the directional gateway. The first data message can be a grid address of the room server and the network address of the directional gateway encapsulated, so that the sending path of the first data message is fixed by the directional gateway, and then the first data message can be sent to the room server through the directional gateway, so that the data to be transmitted is sent in the form of a message, thereby improving the efficiency and effectiveness of data transmission.

[0080] Further, optionally, according to the network address of the room server and the network address of the directional gateway, encapsulating the data to be transmitted into a first data message includes:

[0081] Generate the real server field based on the network address of the room server.

[0082] A first header field is generated according to the network address of the directional gateway.

[0083] The first header field, the real server field and the data to be transmitted are sequentially spliced ​​to obtain a first data message.

[0084] Generating the first header field according to the network address of the directional gateway may include: generating the first header field according to the network address of the target virtual terminal device and the network address of the directional gateway. The first header field may include the network address of the target virtual terminal device and the network address of the directional gateway.

[0085] Optionally, the first header field may include the network address of the target virtual terminal device and the network address of the directional gateway. Specifically, the network address of the target virtual terminal device may point to the network address of the directional gateway. Please refer to the content in the first table shown in Table 1 below: CIP->Gateway IP, which may indicate that the target virtual terminal device (CIP, clientIP) sends data to the directional gateway (Gateway IP).

[0086] Optionally, the real server field may represent the network address of the room server, and the network address of the room server may be represented by RS (real server) IP. The network address of the room server may be converted to the real server field, for example, the room server network address represented in decimal may be converted to the real server field.

[0087] In this embodiment, the network address may be an IP address. The IP address of each device may be unique, and the device may be identified using its IP address.

[0088] For ease of understanding, the first data message may be shown in Table 1 below:

[0089] CIP—>Gateway IP RS IP Data to be transmitted

[0090] Table 1

[0091] In the disclosed embodiment, when generating the first data message, a real server field can be generated according to the network address of the room server, and the real server field can represent the network address of the room server. The real server field can be generated according to the network address of the room server, and can represent the network address of the real server to which the data is to be sent. The first header field is generated by the network address of the target virtual terminal device and the network address of the directional gateway. The first header field can include the network address of the target virtual terminal device and the network address of the directional gateway, and can accurately indicate the destination of the data this time, that is, from the network address of the target virtual terminal device to the network address of the directional gateway. The first data message can realize accurate encapsulation of the data to be transmitted, and the transmission purpose of the data can be indicated by its first header field, and its real transmission destination can be indicated by its real server field, so as to realize accurate description of the data transmission process and improve the accuracy and efficiency of data transmission.

[0092] Further, optionally, based on the directional gateway, sending the first data message to the room server includes:

[0093] The first data message is sent to the directional gateway so that the first data message is converted into a second data message by the directional gateway. The second data message is sent to the room server by the directional gateway. The second data message includes a second header field, a first header field and data to be transmitted. The second header field includes the network address of the room server in the real server field and the network address of the directional gateway.

[0094] Optionally, the first data packet is converted into a second data packet by the directional gateway, and the second data packet is sent to the room server by the directional gateway. The second data packet is obtained by sequentially splicing the second header field, the first header field and the data to be transmitted, and the second header field is obtained by converting the network address of the room server in the real server field combined with the network address of the directional gateway.

[0095] Optionally, sending the first data message to the directional gateway may include sending the first data message to the directional gateway through a first header field. The first header field may indicate a source and a destination of the data, and may achieve accurate transmission of the data.

[0096] Optionally, after receiving the first data message, the directional gateway can identify the message received by the directional gateway from the target virtual terminal device based on the network address in the first header field of the first data message. The second header field can be obtained by converting the network address (RS IP) of the room server in the real server field and the network address (GatewayIP) of the directional gateway, and can be used to indicate that the data is sent from the directional gateway to the room server. The first header field can remain unchanged. For ease of understanding, the second data message can be shown in Table 2 below:

[0097] Gateway IP—>RS IP CIP—>Gateway IP Data to be transmitted

[0098] Table 2

[0099] The room server may receive the second data message sent by the directional gateway.

[0100] like Figure 4 As shown, it is an example diagram of a data transmission method provided by an embodiment of the present disclosure. When the target virtual terminal device 41 sends data to the room server, the data to be transmitted can be first encapsulated into a first data message 401. The message format of the first data message 401 can refer to Table 1. The first data message 401 is sent to the directional gateway 42. The directional gateway 42 can convert the first data message 401 into a second data message 402. The message format of the second data message 402 can refer to Table 2. Among them, the second data message 402 can be sent to the room server 43, so that the room server 43 can parse the second data message 402 to obtain the data to be transmitted sent by the target virtual terminal device.

[0101] After receiving the first data message, the positioning gateway may re-encapsulate the first data message. Specifically, the first data message may be converted into a second data message that can be received by the room server. The message conversion process can refer to the detailed description of the following message conversion embodiment, which will not be repeated here.

[0102] Optionally, in actual applications, a CLB may be connected between the target virtual terminal device and the target gateway, that is, the target virtual terminal device may be connected to the CLB, the CLB may be connected to the target gateway, and the target gateway may be connected to the room server. Therefore, sending the first data message to the directional gateway may include forwarding the first data message to the directional gateway via the CLB. That is, the first data message may be first sent to the CLB, and then forwarded to the gateway by the CLB.

[0103] In this embodiment, after sending the first data packet to the directional gateway, the directional gateway can convert the first data packet into a second data packet, and the second data packet is more suitable for data transmission with the room server. Therefore, data forwarding in message format can be achieved through the directional gateway, and accurate data forwarding can be achieved, thereby improving data forwarding efficiency and accuracy.

[0104] Further, based on any of the above embodiments, obtaining a directional gateway allocated to a room server and a target virtual terminal device from a gateway cluster includes:

[0105] Sending a gateway configuration request for the room server and the target virtual terminal device to the load balancing device, the gateway configuration request instructing the load balancing device to allocate a directional gateway from the gateway cluster for the room server and the target virtual terminal device;

[0106] Get the directional gateway assigned by the load balancing device from the gateway cluster.

[0107] The load balancing device can be located between the virtual terminal device and the gateway and used for data distribution. Figure 5 The target virtual terminal device 51 can send a room establishment request to the room allocation server 52 to establish a virtual room and obtain the IP address of the room server corresponding to the virtual room. The target virtual terminal device 51 can also be connected to the load balancing device 53, and the load balancing device 53 can allocate a directional gateway 54 to the target virtual terminal device 51. The directional gateway 54 can be connected to the room server 55.

[0108] When the target virtual terminal device 51 sends data to the room server 55 , the first data message sent by the target virtual terminal device 51 is forwarded by the CLB 53 and reaches the directional gateway 54 . The directional gateway 54 converts the first data message into a second data message and sends it to the room server 55 .

[0109] When the room server 55 sends data to the target virtual terminal device 51, the room server 55 may send the fourth data message to the directional gateway 54. The directional gateway 54 may convert the fourth data message into a third data message, and forward the converted third data message to the target virtual terminal device 51 via the CLB53.

[0110] In the disclosed embodiment, the target virtual terminal device can send a gateway configuration request to the load balancing device. The gateway configuration request can be a targeted gateway configuration request for the room server and the target virtual terminal device. Through the gateway configuration request, a directional gateway assigned by the load balancing device can be obtained. Through the directional gateway, data transmission between the room server and the target virtual terminal device can be achieved to ensure the timeliness of data transmission and reduce the delay of data transmission.

[0111] Further, based on any of the above embodiments, before executing data transmission between the target virtual terminal device and the room server based on the directional gateway, the method further includes:

[0112] Receiving a gateway update request sent by a load balancing device, the gateway update request including identification information of a target gateway, the gateway update request being generated when the load balancing device determines that a directional gateway meets an update condition;

[0113] According to the identification information of the target gateway, update the directional gateway to the target gateway.

[0114] After the directional gateway is updated to the target gateway, data transmission between the target virtual terminal device and the room server can be performed based on the updated directional gateway, that is, data transmission between the target virtual terminal device and the room server is performed through the target gateway.

[0115] Optionally, the identification information of the target gateway may include a network address of the target gateway. The network address may refer to information that can uniquely identify the gateway on the Internet, such as an IP address. The IP address may be IPV4 (Internet Protocol version 4) or IPV6 (Internet Protocol version 6).

[0116] The IP address of the original directional gateway is deleted, and the IP address of the target gateway is used as the new directional gateway.

[0117] In the disclosed embodiment, the target virtual terminal device may receive a gateway update request sent by the load balancing device, and the gateway update request may include identification information of the target gateway. The identification information of the target gateway may be used to update the directional gateway to the target gateway. The gateway update request may be generated when the load balancing device determines that the original directional gateway meets the update conditions, so that the directional gateway is updated in time when the update conditions are met, so that the new target grid is put into the data transmission between the target virtual terminal device and the room server, ensuring the stability of the data transmission link, avoiding data loss, transmission failure, etc., and improving the security of data transmission.

[0118] Furthermore, based on any of the above embodiments, the method further includes:

[0119] A third data message sent by the directional gateway is received, where the third data message includes a network address and valid data of a target virtual terminal device.

[0120] Parse the third data message to obtain valid data in the third data message.

[0121] Update the display content in the virtual room according to the valid data.

[0122] Optionally, the third data message may be obtained by the directional gateway forwarding the fourth data message sent by the room server, the third data message includes a third header field, and the third header field is generated based on the network address of the target virtual terminal device and the network address of the directional gateway. Updating the display content in the virtual room may include: updating at least one virtual user image displayed in the virtual room. Of course, the room environment in the virtual room may also be updated.

[0123] For specific information of the third data message and the fourth data message, reference may be made to the description of the following embodiments and will not be repeated here.

[0124] In the disclosed embodiment, a third data message sent by a directional gateway can be received. That is, the target virtual terminal device can also receive data. The third data message can be obtained by forwarding a fourth data message sent by the room server to the directional gateway. The third data message can include the network address and valid data of the target virtual terminal device, and the valid data can be used to update the display content in the virtual room to achieve real-time update of the virtual room. The directional gateway can be used to enable the room server to send data to the target virtual terminal device, realize the rapid transmission of valid data, and improve the timeliness of the update of the virtual direction.

[0125] Further, optionally, the valid data includes user position and / or posture data of the target user; the displayed content includes at least one virtual user image;

[0126] Updating at least one virtual user image in the virtual room according to the valid data, including:

[0127] Determine a target virtual user image corresponding to the target user in at least one virtual user image;

[0128] According to the user position and / or posture data of the target user, the position and / or posture of the target virtual user image is updated.

[0129] Optionally, the user position and / or posture data of the target user may be subjected to posture analysis to obtain a target action corresponding to the target user at the target position. The target action may be used as a target action corresponding to the target virtual user image. The user position and / or posture data may be acquired through sensor collection.

[0130] In the disclosed embodiment, the valid data may include the user position and / or posture data of the target user, and the target virtual user image of the target user may be determined based on the target data, and the target virtual user image needs to be updated in posture and position. The action update of the target virtual user image corresponding to the target user may be realized by updating the user position and / or posture data, and the timely conversion of data to action may be realized, reflecting the timeliness of data update.

[0131] Further, based on any of the above embodiments, determining the room server corresponding to the virtual room includes:

[0132] Sending a room establishment request to a room allocation server, the room establishment request instructs the room allocation server to establish a virtual room and allocate a room server to the virtual room, the network address of the room server is known;

[0133] Get the room server provided by the room allocation server.

[0134] Optionally, the room allocation server can be used to establish a virtual room and allocate a room server of the virtual room. The network address of the room server is known.

[0135] Optionally, before sending the room establishment request to the room allocation server, the room establishment request initiated by the user corresponding to the target virtual terminal device may also be detected.

[0136] In any embodiment, the room server may be a server node in a server cluster, and each server node may be scored based on parameters such as usage rate and memory usage of each server node, and a server node with a high usage score may be used as a room server for a newly established virtual room.

[0137] In addition, a virtual room can also be established by requesting other virtual terminal devices. The target virtual terminal device can also send a room joining request of a virtual room to the room allocation server. The room joining request can include a room identifier of the virtual room, such as a room number, a room name, etc. The room allocation server can determine the room server corresponding to the virtual room based on the room identifier of the virtual room in the room joining request, and feed the room server back to the target virtual terminal device. The target virtual terminal device can obtain the room server provided by the room allocation server, which can specifically be a server identifier of the room server, such as an IP address.

[0138] Exemplarily, a virtual room may be associated with at least one room server. A room allocation server may allocate at least one room server to a virtual room. When a target virtual terminal device requests to join a virtual room, a corresponding room server may be allocated to the target virtual terminal device, that is, a room server in an available state may be allocated to the target virtual terminal device from at least one room server in the virtual room. The room server being in an available state means that the number of terminal devices that can be connected to the room server is not greater than or equal to the maximum number of devices.

[0139] In the disclosed embodiment, the target virtual terminal device may initiate a room establishment request for a virtual room, and then send the room establishment request to a room allocation server. The room allocation server may establish a virtual room and allocate a room server for the virtual room. The network address of the room server is known. The room allocation server may feed back the network address of the room server to the target virtual terminal device, and the target virtual terminal device may obtain the room server provided by the room allocation server. The server allocation of the virtual room may be realized through the room allocation server, and the corresponding relationship between the virtual room and the room server may be established.

[0140] like Figure 6 FIG. 1 is a flowchart of another embodiment of a data transmission method provided by an embodiment of the present disclosure, and the data transmission method can be applied to a directional gateway. The directional gateway can be used for data transmission between a target virtual terminal device and a room server. The method includes:

[0141] S601: Receive a first data message sent by a target virtual terminal device, wherein the first data message includes a network address of a room server and a network address of a directional gateway and data to be transmitted. The virtual room includes at least one virtual user image, and the virtual user image corresponds to each terminal device. Each virtual terminal device joins the virtual room.

[0142] Optionally, the first data message may be obtained by encapsulating the data to be transmitted by the target virtual terminal device based on the network address of the room server and the network address of the directional gateway.

[0143] S602: Parse the first data message to obtain the network address of the room server.

[0144] S603: Send the first data message to the room server according to the network address of the room server.

[0145] Optionally, by parsing the first data message, each field in the data message can be obtained, and by reading the field content of each field, the network address of the room server can be obtained.

[0146] In the disclosed embodiment, the directional gateway can receive the first data message sent by the target virtual terminal device, and the first data message can be parsed to obtain the network address of the room server, and the first data message can be sent according to the network address of the room server. The directional gateway can be responsible for executing the data transmission between the target virtual terminal device and the room server, and realizing the fast data transmission between the target virtual terminal device and the room server. The directional gateway can realize the exclusive channel transmission between the target virtual terminal device and the room server, improve the data transmission efficiency, and then timely synchronize the data synchronization of the virtual terminal devices in the virtual room.

[0147] Further, based on any of the above embodiments, sending the first data message to the room server according to the network address of the room server includes:

[0148] Parsing the first data message to obtain a first header field, a real server field, and data to be transmitted, wherein the first header field is generated according to the network address of the target virtual terminal device and the network address of the directional gateway, and the real server field is generated according to the network address of the room server;

[0149] The network address of the room server in the real server field is combined with the network address translation of the directional gateway to obtain the second header field;

[0150] Sequentially concatenate the second header field, the first header field, and the data to be transmitted to obtain a second data message;

[0151] The second data message is sent to the room server, so that the room server parses the second data message to obtain the data to be transmitted and stores it.

[0152] In the disclosed embodiment, the first data message can be parsed to obtain a first header field, a real server field, and data to be transmitted. The first header field can be generated based on the network address of the target virtual terminal device and the network address of the directional gateway, and the real server field can be generated based on the network address of the room server. The network address of the room server in the real server field can be converted with the network address of the directional gateway to obtain a second header field. The second header field, the first header field, and the data to be transmitted can be sequentially spliced ​​to obtain a second data message. By sending the second data message to the room server, the room server can parse the second data message, obtain the data to be transmitted and store it. Through the conversion of the data message, the first data message of the target virtual terminal device can be forwarded to the room server, so as to realize data forwarding, improve data transmission efficiency, and thus timely synchronize the data of the virtual terminal devices in the virtual room.

[0153] Furthermore, based on any of the above embodiments, the method further includes:

[0154] A fourth data message sent by the room server is received, where the fourth data message includes a network address and valid data of the target virtual terminal device.

[0155] The fourth data message is parsed to obtain valid data and a network address of a target virtual terminal device.

[0156] The valid data and the network address of the target virtual terminal device are encapsulated to obtain a third data message.

[0157] The third data message is sent to the target virtual terminal device, and the valid data in the third data message is used by the virtual terminal device to update the display content.

[0158] Optionally, the fourth data message may include: a third header field, a fourth header field, and valid data. The third header field is generated based on the network address (CIP, client Internet Protocol) of the target virtual terminal device and the network address (Gateway IP, Gateway Internet Protocol) of the directional gateway, and the fourth header field is generated based on the network address (Gateway IP) of the directional gateway and the network address (RS IP, real server Internet Protocol) of the room server. Parsing the fourth data message can obtain valid data, the third header field, and the fourth header field. The valid data and the third header field can also be encapsulated to obtain a third data message. The third data message is sent to the target virtual terminal device, and the valid data in the third data message is used by the virtual terminal device to update the display content of the virtual room.

[0159] Optionally, the fourth data message may include: a third header field, a fourth header field, and valid data. The third header field may indicate that the network address of the directional gateway sends data to the network address of the target virtual terminal device. The fourth header field may indicate that the IP address of the room server sends data to the IP address of the directional gateway. The message format of the fourth data message may be specifically referred to Table 3.

[0160] RS IP—>Gateway IP Gateway IP—>CIP Valid data

[0161] Table 3

[0162] The third data message may include a third header field and valid data. The message format of the third data message may refer to Table 4:

[0163] Gateway IP—>CIP Valid data

[0164] Table 4

[0165] The English abbreviations in Table 3 and Table 4 can refer to the relevant records in Table 1 and Table 2, and will not be repeated here.

[0166] For ease of understanding, Figure 7 As shown, it is an example diagram of a data transmission method provided by an embodiment of the present disclosure. When the room server 71 sends data to the target virtual terminal device 73, the data to be transmitted can be first encapsulated into a fourth data message 701. The message format of the fourth data message 701 can refer to Table 3. The fourth data message 701 is sent to the directional gateway 72. The directional gateway 72 can convert the fourth data message 701 into a third data message 702. The message format of the third data message 702 can refer to Table 4. Among them, the third data message 702 can be sent to the target virtual terminal device 73, so that the target virtual terminal device 73 can parse the third data message 702 to obtain the valid data sent by the room server.

[0167] Optionally, the valid data may include data to be transmitted sent by the virtual terminal device, and may also include control instructions sent to the virtual terminal device, such as a vibration instruction to the virtual terminal device. In this embodiment, the specific data type of the valid data is not excessively limited.

[0168] In the disclosed embodiment, a fourth data message sent by a room server can be received. The fourth data message may include a third header field, a fourth header field, and valid data. Among them, the third header field may include the network address of the target virtual terminal device and the network address of the directional gateway, and the fourth header field may include the network address of the directional gateway and the network address of the room server. The third header field may indicate that the message is sent by the room server to the directional gateway. The fourth data header may indicate that it is sent by the directional gateway to the target virtual terminal device. Data transmission from the room server to the target virtual terminal device can be achieved through message conversion, thereby improving data transmission efficiency, and thus timely synchronizing the data of the virtual terminal devices in the virtual room.

[0169] like Figure 8 FIG. 1 is a flowchart of another embodiment of a data transmission method provided by an embodiment of the present disclosure. The data transmission method can be applied to a load balancing device. The method includes:

[0170] S801: receiving a gateway configuration request sent by a target virtual terminal device, the gateway configuration request including a room server of a virtual room and a target virtual terminal device; the virtual room includes at least one virtual user image, the virtual user image corresponds to each terminal device, and each virtual terminal joins the virtual room.

[0171] S802: In response to the gateway configuration request, a directional gateway is allocated to the room server and the target virtual terminal device.

[0172] S803: Feedback identification information of the directional gateway to the target virtual terminal device. The directional gateway is used for data transmission between the target virtual terminal device and the room server.

[0173] The identification information of the directional gateway may include the IP address of the directional gateway.

[0174] Optionally, a gateway configuration request may be generated for a target virtual terminal device and sent to a load balancing device. A room server may be identified using its IP address.

[0175] In the disclosed embodiment, the load balancing device can make a gateway configuration request to the virtual terminal device. The gateway configuration request can be a targeted gateway configuration request for the room server and the target virtual terminal device. Through the gateway configuration request, a directional gateway assigned by the load balancing device can be obtained. Through the directional gateway, data transmission between the room server and the target virtual terminal device can be achieved to ensure the timeliness of data transmission and reduce the delay of data transmission.

[0176] Furthermore, based on any of the above embodiments, the method further includes:

[0177] If it is determined that the directional gateway meets the update conditions, the target gateway is determined;

[0178] Based on the target gateway, a gateway update request is generated;

[0179] A gateway update request is sent to the target virtual terminal device, the gateway update request instructing the target virtual terminal device to update the directional gateway to the target gateway, the target gateway is used to replace the directional gateway to perform data transmission between the target virtual terminal device and the room server.

[0180] Optionally, the directional gateway meets the update condition, which may include: a forwarding failure occurs in the directional gateway, or the directional gateway triggers a retransmission mechanism.

[0181] Optionally, in order to make the IP address of the directional gateway recorded by the target virtual terminal device and the room server the same, the target virtual terminal device can send UDP (User Datagram Protocol) datagrams to the directional gateway at a certain frequency. The UDP datagrams can include the IP address of the directional gateway. The IP address of the directional gateway can be promptly notified to the room server through the UDP datagram, so that the room server can promptly update the IP address of the directional gateway.

[0182] In the disclosed embodiment, the load balancing device determines the target grid when determining that the directional gateway meets the update conditions. Based on the identification information of the target gateway, a gateway update request is generated to send the gateway update request to the target virtual terminal device. The target virtual terminal device can receive the gateway update request sent by the load balancing device, and the gateway update request may include the identification information of the target gateway. The identification information of the target gateway can be used to update the directional gateway to the target gateway. The gateway update request can be generated when the load balancing device determines that the original directional gateway meets the update conditions, so that the directional gateway is updated in time when the update conditions are met, so that the new target grid is put into the data transmission between the target virtual terminal device and the room server, ensuring the stability of the data transmission link, avoiding data loss, transmission failure and the like, and improving the security of data transmission.

[0183] like Fig. 9 FIG. 1 is a schematic diagram of a structure of an embodiment of a data transmission device provided by an embodiment of the present disclosure. The data transmission device 900 may be located in a target virtual terminal device, and the device may include:

[0184] Display unit 901: used to display a virtual room, the virtual room includes at least one virtual user image, and the virtual user image is associated with a user of a respective virtual terminal device;

[0185] Determining unit 902: used to determine the room server corresponding to the virtual room;

[0186] Directional unit 903: used to obtain a directional gateway allocated to the room server and the target virtual terminal device;

[0187] Transmission unit 904: used to perform data transmission between the target virtual terminal device and the room server based on the directional gateway.

[0188] Further, based on any of the above embodiments, the transmission unit 904 includes:

[0189] A data determination module, used to determine the data to be transmitted corresponding to the target virtual terminal device;

[0190] A data encapsulation module, used for encapsulating the data to be transmitted into a first data message according to the network address of the room server and the network address of the directional gateway;

[0191] The first sending module is used to send the first data message to the room server based on the directional gateway.

[0192] Further, based on any of the above embodiments, the data encapsulation module includes:

[0193] A first generating submodule, used for generating a real server field according to the network address of the room server;

[0194] A second generating submodule, used for generating a first header field according to the network address of the directional gateway;

[0195] The field splicing submodule is used to sequentially splice the first header field, the real server field and the data to be transmitted to obtain a first data message.

[0196] Further, based on any of the above embodiments, the first sending module includes:

[0197] The first sending submodule is used to send the first data message to the directional gateway so that the first data message is converted into a second data message by the directional gateway, and the second data message is sent to the room server by the directional gateway. The second data message includes a second header field, a first header field and data to be transmitted, and the second header field includes the network address of the room server in the real server field and the network address of the directional gateway.

[0198] Further, based on any of the above embodiments, the orientation unit 903 includes:

[0199] A gateway configuration module, used to send a gateway configuration request of a room server and a target virtual terminal device to a load balancing device, wherein the gateway configuration request instructs the load balancing device to allocate a directional gateway from a gateway cluster for the room server and the target virtual terminal device;

[0200] Get the directional gateway assigned by the load balancing device from the gateway cluster.

[0201] Furthermore, based on any of the above embodiments, the method further includes:

[0202] An update receiving unit, used to receive a gateway update request sent by a load balancing device, the gateway update request including identification information of a target gateway, the gateway update request being generated when the load balancing device determines that a directional gateway meets an update condition;

[0203] The gateway updating unit is used to update the directional gateway to the target gateway according to the identification information of the target gateway.

[0204] Furthermore, based on any of the above embodiments, the method further includes:

[0205] A first receiving unit, configured to receive a third data message sent by the directional gateway, wherein the third data message includes a network address and valid data of a target virtual terminal device;

[0206] A first parsing unit, used for parsing valid data in a third data message;

[0207] The image updating unit is used to update the display content in the virtual room according to the valid data.

[0208] Further, based on any of the above embodiments, the effective data includes user position and / or posture data of the target user; the display content includes at least one virtual user image;

[0209] Image update unit, including:

[0210] An image determination module, used to determine a target virtual user image corresponding to a target user in at least one virtual user image;

[0211] The action determination module is used to update the position and / or posture of the target virtual user image according to the user position and / or posture data of the target user.

[0212] Further, based on any of the above embodiments, the determining unit includes:

[0213] The request sending module is used to send a room establishment request to the room allocation server, where the room establishment request instructs the room allocation server to establish a virtual room and allocate a room server to the virtual room.

[0214] The room acquisition module is used to obtain the room server provided by the room allocation server.

[0215] like Fig.10 FIG. 1 is a schematic diagram of a structure of an embodiment of a data transmission device provided by an embodiment of the present disclosure. The data transmission device 1000 may be located in a directional gateway, and the device may include:

[0216] Receiving unit 1001: receives a first data message sent by a target virtual terminal device, wherein the first data message includes a network address of a room server and a network address of a directional gateway and data to be transmitted. The virtual room includes at least one virtual user image, and the virtual user image corresponds to each terminal device. Each virtual terminal device joins the virtual room.

[0217] Parsing unit 1002: used to parse the first data message to obtain the network address of the room server.

[0218] The sending unit 1003 is configured to send the first data packet to the room server according to the network address of the room server.

[0219] Further, based on any of the above embodiments, the sending unit includes:

[0220] A message parsing module, used for parsing the first data message to obtain a first header field, a real server field and data to be transmitted, wherein the first header field is generated according to the network address of the target virtual terminal device and the network address of the directional gateway, and the real server field is generated according to the network address of the room server;

[0221] An address translation module, used for converting the network address of the room server in the real server field into the network address of the directional gateway to obtain a second header field;

[0222] A message conversion module, used for sequentially splicing the second header field, the first header field and the data to be transmitted to obtain a second data message;

[0223] The second sending module is used to send the second data message to the room server, so that the room server can parse the second data message to obtain the data to be transmitted and store it.

[0224] Furthermore, based on any of the above embodiments, the method further includes:

[0225] A second receiving unit, configured to receive a fourth data message sent by the room server, wherein the fourth data message includes a network address and valid data of a target virtual terminal device;

[0226] A second parsing unit, used for parsing the fourth data message to obtain valid data and a network address of a target virtual terminal device;

[0227] A message encapsulation unit, used for encapsulating the valid data and the network address of the target virtual terminal device to obtain a third data message;

[0228] The message sending unit is used to send a third data message to a target virtual terminal device, wherein the valid data in the third data message is used by the virtual terminal device to update the display content of the virtual room.

[0229] like Fig.11 FIG. 1 is a schematic diagram of a structure of an embodiment of a data transmission device provided by an embodiment of the present disclosure. The data transmission device 1100 may be located in a load balancing device, and the device may include:

[0230] Request unit 1101: used to receive a gateway configuration request sent by a virtual terminal device, the gateway configuration request includes a room server of a virtual room and a target virtual terminal device; the virtual room includes at least one virtual user image, the virtual user image corresponds to each terminal device, and each virtual terminal joins the virtual room;

[0231] Allocating unit 1102: configured to allocate a directional gateway to a room server and a target virtual terminal device in response to a gateway configuration request;

[0232] Feedback unit 1103: used for feeding back the directional gateway to the target virtual terminal device, where the directional gateway is used for transmitting data between the target virtual terminal device and the room server.

[0233] Furthermore, based on any of the above embodiments, the method further includes:

[0234] A target determination unit, configured to determine a target gateway if it is determined that the directional gateway satisfies the update condition;

[0235] A request generating unit, used for generating a gateway update request based on the identification information of the target gateway;

[0236] The request sending unit is used to send a gateway update request to the target virtual terminal device, the gateway update request instructs the target virtual terminal device to update the directional gateway to the target gateway, and the target gateway is used to replace the directional gateway to perform data transmission between the target virtual terminal device and the room server.

[0237] In order to implement the above embodiment, the embodiment of the present disclosure also provides an electronic device.

[0238] refer to Fig.12 , which shows a schematic diagram of the structure of an electronic device 1200 suitable for implementing the embodiment of the present disclosure, and the electronic device 1200 may be a terminal device or a server. The terminal device may include but is not limited to mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, personal digital assistants (PDAs), tablet computers (Portable Android Devices, PADs), portable multimedia players (PMPs), vehicle terminals (such as vehicle navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Fig.12 The electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0239] like Fig.12 As shown, the electronic device 1200 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 1201, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1202 or a program loaded from a storage device 1208 to a random access memory (RAM) 1203. Various programs and data required for the operation of the electronic device 1200 are also stored in the RAM 1203. The processing device 1201, the ROM 1202, and the RAM 1203 are connected to each other via a bus 1204. An input / output (I / O) interface 1205 is also connected to the bus 1204.

[0240] Typically, the following devices may be connected to the I / O interface 1205: input devices 1206 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; output devices 1207 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; storage devices 1208 including, for example, a magnetic tape, a hard disk, etc.; and communication devices 1209. The communication device 1209 may allow the electronic device 1200 to communicate with other devices wirelessly or by wire to exchange data. Although Fig.12 The electronic device 1200 is shown with various devices, but it should be understood that it is not required to implement or possess all the devices shown. More or fewer devices may be implemented or possessed instead.

[0241] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program contains program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device 1209, or installed from a storage device 1208, or installed from a ROM 1202. When the computer program is executed by the processing device 1201, the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.

[0242] In the embodiment of the present application, the hardware structure of each virtual terminal device, gateway device, and load balancing device can refer to Fig.12 For the electronic devices shown, the special functions of each device can be actually set with a corresponding hardware structure based on the needs of each device, and will not be described in detail here.

[0243] It should be noted that the computer-readable medium disclosed above may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, device or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, in which a computer-readable program code is carried. This propagated data signal may take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. The computer readable signal medium may also be any computer readable medium other than a computer readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0244] The computer-readable medium may be included in the electronic device, or may exist independently without being installed in the electronic device.

[0245] The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device executes the method shown in the above embodiment.

[0246] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as an independent software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0247] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0248] The units involved in the embodiments described in the present disclosure may be implemented by software or hardware. The name of a unit does not limit the unit itself in some cases. For example, the first acquisition unit may also be described as a "unit for acquiring at least two Internet Protocol addresses".

[0249] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

[0250] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0251] In a first aspect, according to one or more embodiments of the present disclosure, a data transmission method is provided, which is applied to a target virtual terminal device, and the method includes:

[0252] displaying a virtual room, the virtual room including at least one virtual user image, the virtual user image being associated with a user of a respective virtual terminal device;

[0253] Determine the room server corresponding to the virtual room;

[0254] Obtain the directional gateway assigned to the room server and the target virtual terminal device;

[0255] Based on the directional gateway, data transmission between the target virtual terminal device and the room server is performed.

[0256] According to one or more embodiments of the present disclosure, based on the directional gateway, executing data transmission between the target virtual terminal device and the room server includes:

[0257] Determine the data to be transmitted corresponding to the target virtual terminal device;

[0258] Encapsulating the data to be transmitted into a first data message according to the network address of the room server and the network address of the directional gateway;

[0259] Based on the directional gateway, the first data message is sent to the room server.

[0260] According to one or more embodiments of the present disclosure, encapsulating the data to be transmitted into a first data message according to the network address of the room server and the network address of the directional gateway includes:

[0261] Generate the real server field based on the network address of the room server;

[0262] Generate a first header field according to the network address of the directional gateway;

[0263] The first header field, the real server field and the data to be transmitted are sequentially spliced ​​to obtain a first data message.

[0264] According to one or more embodiments of the present disclosure, based on the directional gateway, sending the first data message to the room server includes:

[0265] The first data message is sent to the directional gateway so that the first data message is converted into a second data message by the directional gateway. The second data message is sent to the room server by the directional gateway. The second data message includes a second header field, a first header field and data to be transmitted. The second header field includes the network address of the room server in the real server field and the network address of the directional gateway.

[0266] According to one or more embodiments of the present disclosure, obtaining a directional gateway allocated to a room server and a target virtual terminal device includes:

[0267] Sending a gateway configuration request for the room server and the target virtual terminal device to the load balancing device, the gateway configuration request instructing the load balancing device to allocate a directional gateway from the gateway cluster for the room server and the target virtual terminal device;

[0268] Get the directional gateway assigned by the load balancing device from the gateway cluster.

[0269] According to one or more embodiments of the present disclosure, the present invention further includes:

[0270] Receiving a gateway update request sent by a load balancing device, the gateway update request including identification information of a target gateway, the gateway update request being generated when the load balancing device determines that a directional gateway meets an update condition;

[0271] According to the identification information of the target gateway, update the directional gateway to the target gateway.

[0272] According to one or more embodiments of the present disclosure, the present invention further includes:

[0273] receiving a third data message sent by the directional gateway, wherein the third data message includes a network address and valid data of a target virtual terminal device;

[0274] Parsing the third data message to obtain valid data in the third data message;

[0275] Update the display content in the virtual room according to the valid data.

[0276] According to one or more embodiments of the present disclosure, the valid data includes user position and / or posture data of the target user; the display content includes at least one virtual user image;

[0277] Updating at least one virtual user image in the virtual room according to the valid data, including:

[0278] Determine a target virtual user image corresponding to the target user in at least one virtual user image;

[0279] According to the user position and / or posture data of the target user, the position and / or posture of the target virtual user image is updated.

[0280] According to one or more embodiments of the present disclosure, determining that a virtual room corresponds to a room server includes:

[0281] A room establishment request is sent to a room allocation server, where the room establishment request instructs the room allocation server to establish a virtual room and allocate a room server to the virtual room.

[0282] Get the room server provided by the room allocation server.

[0283] In a second aspect, according to one or more embodiments of the present disclosure, a data transmission method is provided, which is applied to a directional gateway, and the method includes:

[0284] receiving a first data message sent by a target virtual terminal device, the first data message including a network address of a room server and a network address of a directional gateway and data to be transmitted, the virtual room including at least one virtual user image, the virtual user image corresponding to each terminal device, and each virtual terminal device joining the virtual room;

[0285] Parsing the first data message to obtain the network address of the room server;

[0286] The first data message is sent to the room server according to the network address of the room server.

[0287] According to one or more embodiments of the present disclosure, sending a first data packet to a room server according to a network address of the room server includes:

[0288] Parsing the first data message to obtain a first header field, a real server field, and data to be transmitted, wherein the first header field is generated according to the network address of the target virtual terminal device and the network address of the directional gateway, and the real server field is generated according to the network address of the room server;

[0289] The network address of the room server in the real server field is combined with the network address translation of the directional gateway to obtain the second header field;

[0290] Sequentially concatenate the second header field, the first header field, and the data to be transmitted to obtain a second data message;

[0291] The second data message is sent to the room server, so that the room server parses the second data message to obtain the data to be transmitted and stores it.

[0292] According to one or more embodiments of the present disclosure, the present invention further includes:

[0293] receiving a fourth data message sent by the room server, wherein the fourth data message includes a network address and valid data of a target virtual terminal device;

[0294] Parsing the fourth data message to obtain valid data and a network address of a target virtual terminal device;

[0295] Encapsulating the valid data and the network address of the target virtual terminal device to obtain a third data message;

[0296] The third data message is sent to the target virtual terminal device, and the valid data in the third data message is used by the virtual terminal device to update the display content of the virtual room.

[0297] In a third aspect, according to one or more embodiments of the present disclosure, a data transmission method is provided, which is applied to a load balancing device, and the method includes:

[0298] receiving a gateway configuration request sent by a target virtual terminal device, the gateway configuration request including a room server of a virtual room and a target virtual terminal device; the virtual room includes at least one virtual user image, the virtual user image corresponds to each terminal device, and each virtual terminal joins the virtual room;

[0299] In response to the gateway configuration request, allocating a directional gateway to the room server and the target virtual terminal device;

[0300] The identification information of the directional gateway is fed back to the target virtual terminal device, and the directional gateway is used for data transmission between the target virtual terminal device and the room server.

[0301] According to one or more embodiments of the present disclosure, the present invention further includes:

[0302] If it is determined that the directional gateway meets the update conditions, the target gateway is determined;

[0303] Generate a gateway update request based on the identification information of the target gateway;

[0304] A gateway update request is sent to the target virtual terminal device, the gateway update request instructing the target virtual terminal device to update the directional gateway to the target gateway, the target gateway is used to replace the directional gateway to perform data transmission between the target virtual terminal device and the room server.

[0305] In a fourth aspect, according to one or more embodiments of the present disclosure, there is provided a data transmission apparatus, located in a target virtual terminal device, the apparatus comprising:

[0306] A display unit, for displaying a virtual room, the virtual room including at least one virtual user image, the virtual user image being associated with a user of a respective virtual terminal device;

[0307] A determination unit, used for determining a room server corresponding to the virtual room;

[0308] A directional unit, used for obtaining a directional gateway assigned to a room server and a target virtual terminal device;

[0309] The transmission unit is used for performing data transmission between the target virtual terminal device and the room server based on the directional gateway.

[0310] In a fifth aspect, according to one or more embodiments of the present disclosure, a data transmission device is provided, located at a directional gateway, and the device includes:

[0311] A receiving unit, configured to receive a first data message sent by a target virtual terminal device, wherein the first data message is obtained by encapsulating data to be transmitted by the target virtual terminal device based on a network address of a room server and a network address of a directional gateway, wherein the virtual room includes at least one virtual user image, the virtual user image corresponds to each terminal device, and each virtual terminal joins the virtual room;

[0312] A parsing unit, used for parsing the first data message to obtain a network address of a room server;

[0313] The sending unit is used to send the first data message to the room server according to the network address of the room server.

[0314] In a sixth aspect, according to one or more embodiments of the present disclosure, a gateway allocation device is provided, located in a load balancing device, and the device includes:

[0315] The request unit is used to receive a gateway configuration request sent by a virtual terminal device, wherein the gateway configuration request includes a room server of a virtual room and a target virtual terminal device; the virtual room includes at least one virtual user image, the virtual user image corresponds to each terminal device, and each virtual terminal joins the virtual room;

[0316] an allocating unit, configured to allocate a directional gateway to a room server and a target virtual terminal device in response to a gateway configuration request;

[0317] The feedback unit is used to feed back the directional gateway to the target virtual terminal device, and the directional gateway is used to transmit data between the target virtual terminal device and the room server.

[0318] In a seventh aspect, according to one or more embodiments of the present disclosure, there is provided an electronic device, comprising: at least one processor and a memory;

[0319] Memory stores computer-executable instructions;

[0320] At least one processor executes the computer-executable instructions stored in the memory, so that the at least one processor executes the data transmission method of the first aspect, the second aspect, the third aspect and various possible designs of the aspects described above.

[0321] In the eighth aspect, according to one or more embodiments of the present disclosure, a computer-readable storage medium is provided, in which computer execution instructions are stored. When the processor executes the computer execution instructions, the data transmission method of the first aspect, the second aspect, the third aspect and various possible designs of each aspect are implemented.

[0322] In the ninth aspect, according to one or more embodiments of the present disclosure, a computer program product is provided, including a computer program, which, when executed by a processor, implements the data transmission method of the first aspect, the second aspect, the third aspect and various possible designs of the above aspects.

[0323] The above description is only a preferred embodiment of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, the above features are replaced with the technical features with similar functions disclosed in the present disclosure (but not limited to) by each other to form a technical solution.

[0324] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details are included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0325] Although the subject matter has been described in language specific to structural features and / or methodological logical actions, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. On the contrary, the specific features and actions described above are merely example forms of implementing the claims.

Claims

1. A data transmission method, It is characterized in that Applied to a target virtual terminal device, the method comprises: displaying a virtual room, the virtual room including at least one virtual user image, the virtual user image being associated with a user of a respective virtual terminal device; Determining a room server corresponding to the virtual room; Acquire a directional gateway allocated to the room server and the target virtual terminal device; Based on the directional gateway, data transmission between the target virtual terminal device and the room server is performed.

2. The method according to claim 1, It is characterized in that The performing of data transmission between the target virtual terminal device and the room server based on the directional gateway includes: Determining the data to be transmitted corresponding to the target virtual terminal device; Encapsulating the data to be transmitted into a first data message according to the network address of the room server and the network address of the directional gateway; Based on the directional gateway, the first data message is sent to the room server.

3. The method according to claim 2, It is characterized in that The step of encapsulating the data to be transmitted into a first data message according to the network address of the room server and the network address of the directional gateway comprises: Generate a real server field according to the network address of the room server; Generate a first header field according to the network address of the directional gateway; The first header field, the real server field and the data to be transmitted are sequentially spliced ​​to obtain the first data message.

4. The method according to claim 3, It is characterized in that The sending the first data message to the room server based on the directional gateway includes: The first data packet is sent to the directional gateway so that the first data packet is converted into a second data packet by the directional gateway, and the second data packet is sent by the directional gateway to the room server, the second data packet includes a second header field, the first header field and the data to be transmitted, and the second header field includes the network address of the room server in the real server field and the network address of the directional gateway.

5. The method according to claim 1, It is characterized in that The obtaining of the directional gateway allocated to the room server and the target virtual terminal device comprises: Sending a gateway configuration request of the room server and the target virtual terminal device to a load balancing device, wherein the gateway configuration request instructs the load balancing device to allocate a directional gateway from the gateway cluster for the room server and the target virtual terminal device; Obtain the directional gateway allocated by the load balancing device from the gateway cluster.

6. The method according to claim 1, It is characterized in that Before executing the data transmission between the target virtual terminal device and the room server based on the directional gateway, the method further includes: Receiving a gateway update request sent by a load balancing device, the gateway update request including identification information of a target gateway, the gateway update request being generated when the load balancing device determines that the directional gateway meets an update condition; According to the identification information of the target gateway, the directional gateway is updated to be the target gateway.

7. The method according to claim 1, It is characterized in that Also includes: receiving a third data message sent by the directional gateway, wherein the third data message includes a network address and valid data of the target virtual terminal device; Parsing the third data message to obtain valid data in the third data message; The display content in the virtual room is updated according to the valid data.

8. The method according to claim 7, It is characterized in that The valid data includes the user position and / or posture data of the target user; the display content includes at least one of the virtual user images; The updating of at least one virtual user image in the virtual room according to the valid data comprises: Determine a target virtual user image corresponding to the target user in at least one of the virtual user images; The position and / or posture of the target virtual user image is updated according to the user position and / or posture data of the target user.

9. The method according to claim 1, It is characterized in that The determining that the virtual room corresponds to a room server includes: Sending a room establishment request to a room allocation server, wherein the room establishment request instructs the room allocation server to establish the virtual room and allocate a room server to the virtual room; Acquire the room server provided by the room allocation server.

10. A data transmission method, It is characterized in that Applied to a directional gateway, the method comprises: receiving a first data message sent by a target virtual terminal device, wherein the first data message includes a network address of a room server and a network address of the directional gateway and data to be transmitted, wherein the virtual room includes at least one virtual user image, the virtual user image corresponds to a respective terminal device, and each virtual terminal device joins the virtual room; Parsing the first data message to obtain the network address of the room server; The first data packet is sent to the room server according to the network address of the room server.

11. The method according to claim 10, It is characterized in that The sending the first data message to the room server according to the network address of the room server includes: Parsing the first data message to obtain a first header field, a real server field, and the data to be transmitted, wherein the first header field is generated according to the network address of the target virtual terminal device and the network address of the directional gateway, and the real server field is generated according to the network address of the room server; The network address of the room server in the real server field is converted with the network address of the directional gateway to obtain a second header field; Sequentially concatenate the second header field, the first header field, and the data to be transmitted to obtain a second data message; The second data message is sent to the room server, so that the room server parses the second data message to obtain the data to be transmitted.

12. The method according to claim 10, It is characterized in that Also includes: receiving a fourth data message sent by the room server, wherein the fourth data message includes a network address and valid data of the target virtual terminal device; Parsing the fourth data message to obtain the valid data and the network address of the target virtual terminal device; Encapsulating the valid data and the network address of the target virtual terminal device to obtain a third data message; The third data message is sent to the target virtual terminal device, and the valid data in the third data message is used by the virtual terminal device to update the display content of the virtual room.

13. A data transmission method, It is characterized in that Applied to a load balancing device, the method comprises: receiving a gateway configuration request sent by a target virtual terminal device, wherein the gateway configuration request includes a room server of a virtual room and a target virtual terminal device; the virtual room includes at least one virtual user image, the virtual user image corresponds to a respective terminal device, and each virtual terminal joins the virtual room; In response to the gateway configuration request, allocating a directional gateway to the room server and the target virtual terminal device; The identification information of the directional gateway is fed back to the target virtual terminal device, and the directional gateway is used for data transmission between the target virtual terminal device and the room server.

14. The method according to claim 13, It is characterized in that Also includes: If it is determined that the directional gateway meets the update condition, then determining the target gateway; Generate a gateway update request based on the identification information of the target gateway; The gateway update request is sent to the target virtual terminal device, wherein the gateway update request instructs the target virtual terminal device to update the directional gateway to the target gateway, and the target gateway is used to replace the directional gateway to perform data transmission between the target virtual terminal device and the room server.

15. A data transmission device, It is characterized in that Located in the target virtual terminal device, the device includes: A display unit, configured to display a virtual room, wherein the virtual room includes at least one virtual user image, and the virtual user image is associated with a user of a respective virtual terminal device; A determining unit, configured to determine a room server corresponding to the virtual room; A directional unit, used for acquiring a directional gateway allocated to the room server and the target virtual terminal device; A transmission unit is used to perform data transmission between the target virtual terminal device and the room server based on the directional gateway.

16. A data transmission device, It is characterized in that Located at the directional gateway, the device includes: a receiving unit, configured to receive a first data message sent by a target virtual terminal device, wherein the first data message includes a network address of a room server and a network address of the directional gateway and data to be transmitted, wherein the virtual room includes at least one virtual user image, the virtual user image corresponds to a respective terminal device, and each virtual terminal device joins the virtual room; A parsing unit, configured to parse the first data message to obtain a network address of the room server; A sending unit is used to send the first data message to the room server according to the network address of the room server.

17. A gateway allocation device, It is characterized in that Located in a load balancing device, the device comprises: A request unit, configured to receive a gateway configuration request sent by a virtual terminal device, wherein the gateway configuration request includes a room server of a virtual room and a target virtual terminal device; the virtual room includes at least one virtual user image, the virtual user image corresponds to a respective terminal device, and each virtual terminal joins the virtual room; an allocating unit, configured to allocate a directional gateway to the room server and the target virtual terminal device in response to the gateway configuration request; A feedback unit is used to feed back the directional gateway to the target virtual terminal device, and the directional gateway is used to transmit data between the target virtual terminal device and the room server.

18. An electronic device, It is characterized in that include: Processor and memory; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory, so that the processor executes the data transmission method according to any one of claims 1-9 or 10-12 or 13.

19. A computer-readable storage medium, It is characterized in that The computer-readable storage medium stores computer-executable instructions. When the processor executes the computer-executable instructions, the data transmission method according to any one of claims 1 to 9 or 10 to 12 or 13 is implemented.

20. A computer program product comprising a computer program, It is characterized in that When the computer program is executed by a processor, the method for information display according to any one of claims 1-9 or 10-12 or 13 is implemented.