Virtual scene data transmission method, device, equipment, medium and program product

Abstract

The present application provides a data transmission method, device, equipment, medium and program product for a virtual scene. The method is applied to a client running a virtual scene, and the client includes a coordination service and multiple logical services of different types, and the multiple logical services at least include an interactive logical service that controls the interaction of different virtual objects in the virtual scene; the method includes: the coordination service obtains the data generated by the multiple logical services; the coordination service stores the data of the multiple logical services in the transmission queues corresponding to the logical services, and the priorities of the transmission queues corresponding to the multiple logical services are different, and the priority of the transmission queue corresponding to the interactive logical service is the highest; the coordination service sends the data in the transmission queues of the multiple logical services to the server based on the priorities of the transmission queues of the multiple logical services. Through the embodiments of the present application, transmission resources can be reasonably allocated within the client running the virtual scene, thereby ensuring the smooth operation of the virtual scene.

Description

Technical Field

[0001] The present application relates to data transmission technology, and in particular to a data transmission method, device, electronic device, computer-readable storage medium and computer program product for a virtual scene. Background Art

[0002] In the prior art, there are two approaches to addressing accessibility issues in virtual scenes, such as games: implementing accessibility in-game via a third-party client outside of the game client, or implementing accessibility within the game client via a voice call software development kit. However, in both approaches, game data and accessibility data are transmitted over shared network bandwidth, which can easily lead to accessibility data preempting game data transmission, resulting in game lag. Summary of the Invention

[0003] The embodiments of the present application provide a data transmission method, device, electronic device, computer-readable storage medium and computer program product for a virtual scene, which can reasonably allocate transmission resources within a client running the virtual scene, thereby ensuring smooth operation of the virtual scene.

[0004] The technical solution of the embodiment of the present application is implemented as follows:

[0005] An embodiment of the present application provides a data transmission method in a virtual scene, which is applied to a client running the virtual scene, wherein the client includes a coordination service and multiple logical services of different types, wherein the multiple logical services include at least an interactive logical service for controlling the interaction between different virtual objects in the virtual scene. The method includes:

[0006] The coordination service obtains data generated by the multiple logical services;

[0007] The coordination service stores the data of the multiple logical services in transmission queues corresponding to the logical services, respectively, wherein the transmission queues corresponding to the multiple logical services have different priorities, and the transmission queue corresponding to the interactive logical service has the highest priority;

[0008] The coordination service sends the data in the transmission queues of the plurality of logical services to the server based on the priorities of the transmission queues of the plurality of logical services.

[0009] An embodiment of the present application provides a data transmission device for a virtual scene, the device comprising: a coordination service module and a plurality of logic service modules;

[0010] The coordination service module is configured to run a coordination service, obtain data generated by multiple logical services, and store the data of the multiple logical services in transmission queues corresponding to the logical services, wherein the transmission queues corresponding to the multiple logical services have different priorities, and the transmission queue corresponding to the interactive logical service has the highest priority; and transmit the data in the transmission queues of the multiple logical services to a server based on the priorities of the transmission queues of the multiple logical services;

[0011] The multiple logic service modules are used to run corresponding logic services.

[0012] An embodiment of the present application provides an electronic device, including:

[0013] a memory for storing executable instructions;

[0014] The processor is used to implement the data transmission method of the virtual scene provided in the embodiment of the present application when executing the executable instructions stored in the memory.

[0015] An embodiment of the present application provides a computer-readable storage medium storing executable instructions for implementing the data transmission method of the virtual scene provided in the embodiment of the present application when executed by a processor.

[0016] The present invention provides a computer program product including computer instructions stored in a computer-readable storage medium. A processor of an electronic device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the electronic device to perform the virtual scene data transmission method described in the present invention.

[0017] The embodiments of the present application have the following beneficial effects:

[0018] The coordination service in the client running the virtual scene stores data from different logical services in corresponding transmission queues. Data from these queues is then sent to the server based on their priorities. This prioritization of data from the interactive logical service's transmission queue ensures smooth operation of the virtual scene without relying on terminal programs or external network equipment. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1 1 is a schematic diagram of the architecture of a data transmission system 100 for a virtual scene provided in an embodiment of the present application;

[0020] Figure 2 4 is a schematic diagram of the structure of the terminal 400 provided in an embodiment of the present application;

[0021] Figures 3A-3D1 is a flow chart of a data transmission method for a virtual scene provided in an embodiment of the present application;

[0022] Figure 4 1 is a flow chart of a data transmission method for a virtual scene provided in an embodiment of the present application;

[0023] Figure 5A-5G It is a schematic diagram of a data transmission method for a virtual scene provided in an embodiment of the present application. DETAILED DESCRIPTION

[0024] In order to make the purpose, technical solutions and advantages of this application clearer, the application will be further described in detail below with reference to the accompanying drawings. The described embodiments should not be regarded as limiting this application. All other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.

[0025] In the following description, reference is made to “some embodiments”, which describes a subset of all possible embodiments, but it will be understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0026] In the following description, the terms "first\second\third" involved are merely used to distinguish similar objects and do not represent a specific ordering of the objects. It can be understood that "first\second\third" can be interchanged with a specific order or sequence where permitted, so that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described herein.

[0027] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by those skilled in the art to which this application pertains. The terms used herein are for the purpose of describing the embodiments of this application only and are not intended to limit this application.

[0028] Before further describing the embodiments of the present application in detail, the nouns and terms involved in the embodiments of the present application are explained. The nouns and terms involved in the embodiments of the present application are subject to the following interpretations.

[0029] 1) Game Server: This refers to a network service device responsible for coordinating, transmitting, and synchronizing data across multiple game clients. Game servers are typically hosted on the public internet, allowing all users in the same game to connect to the server and exchange data.

[0030] 2) Game client: also known as the client that runs the virtual scene, refers to the application on the mobile phone, personal computer, simulator and other devices used to run the virtual scene such as the game. The game client communicates with the game server and can obtain the game status information from the game server for rendering and display. At the same time, the game client's action data can be transmitted to the game server through the network.

[0031] 3) In-game auxiliary functions: These are services that are unrelated to the game service itself and that consume network transmission resources. The most common are multimedia services such as voice and video in-game. Examples include real-time or offline voice communication with game partners, or live streaming of the game.

[0032] 4) Virtual scene: also known as virtual game scene, refers to a scene that is different from the real world and is output by a device. Visual perception of the virtual scene can be formed with the naked eye or the assistance of the device, such as two-dimensional images output by a display screen, and three-dimensional images output by stereoscopic display technologies such as stereo projection, virtual reality and augmented reality. In addition, various possible hardware can also be used to form various perceptions that simulate the real world, such as auditory perception, tactile perception, olfactory perception and motion perception.

[0033] 5) Virtual Objects: These are the images of various people and objects that can interact in a virtual scene, or movable objects within the virtual scene. These movable objects can be virtual people, virtual animals, cartoon characters, etc. For example, people, animals, plants, oil drums, walls, rocks, etc. displayed within the virtual scene. A virtual object can be a virtual avatar that represents the user within the virtual scene. A virtual scene can include multiple virtual objects, each with its own unique shape and volume, occupying a portion of the space within the virtual scene.

[0034] 6) Coordination Service: This service resides within the game client and is responsible for transmitting and managing data from multiple logical services within the game client. The coordination service prioritizes the data in the transmission queues of various logical services and arranges the data for transmission.

[0035] In the prior art, there are two approaches to addressing accessibility issues in virtual scenes, such as games: implementing accessibility in-game via a third-party client outside of the game client, or implementing accessibility within the game client via a voice call software development kit. However, in both approaches, game data and accessibility data are transmitted over shared network bandwidth, which can easily lead to accessibility data preempting game data transmission, resulting in game lag.

[0036] The embodiments of the present application provide a method, apparatus, device, medium and program product for data transmission of a virtual scene, which can reasonably allocate transmission resources within the client running the virtual scene, thereby ensuring the smooth operation of the virtual scene. The following describes an exemplary application of an electronic device for performing data transmission of a virtual scene provided by an embodiment of the present application. The electronic device for performing data transmission of a virtual scene provided by an embodiment of the present application can be implemented as various types of user terminals such as laptop computers, tablet computers, desktop computers, set-top boxes, mobile devices (for example, mobile phones, portable music players, personal digital assistants, dedicated messaging devices, portable gaming devices), etc., storing data generated by multiple logical services in corresponding transmission queues, and sending data in the transmission queues of multiple logical services to a server based on the priorities of the transmission queues of the multiple logical services. Below, an exemplary application when the electronic device is implemented as a terminal will be described.

[0037] The data transmission method of the virtual scene provided in the embodiment of the present application can be completed by the terminal and the server in collaboration. Figure 1 , Figure 1 1 is a schematic diagram of the architecture of a system 100 for transmitting data of a virtual scene provided in an embodiment of the present application, including a server 200, a network 300, and a terminal 400. The terminal 400 is connected to the server 200 via the network 300, which can be a wide area network or a local area network, or a combination of the two.

[0038] In some embodiments, a coordination service in a client running a virtual scene in terminal 400 obtains data generated by multiple logical services, stores the data of the multiple logical services in transmission queues corresponding to the logical services, and transmits the data in the transmission queues of the multiple logical services to server 200 via network 300 based on the priorities of the transmission queues of the multiple logical services. Server 200 returns corresponding data processing results to terminal 400 based on the data transmitted by terminal 400 via network 300.

[0039] In some embodiments, the server 200 can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers. It can also be a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms. The terminal 400 can be a smart phone, tablet computer, laptop computer, desktop computer, smart speaker, smart watch, etc., but is not limited to this. The terminal and the server can be directly or indirectly connected via wired or wireless communication, which is not limited in the embodiments of the present application.

[0040] See below. Figure 2 , Figure 2 is a schematic diagram of the structure of the terminal 400 provided in an embodiment of the present application, Figure 2 The terminal 400 shown includes: at least one processor 410, a memory 430, and at least one network interface 420. The various components in the terminal 400 are coupled together via a bus system 440. It is understood that the bus system 440 is used to achieve connection and communication between these components. In addition to the data bus, the bus system 440 also includes a power bus, a control bus, and a status signal bus. However, for the sake of clarity, the bus system 440 is not described in detail. Figure 2 Various buses are labeled as bus system 440 .

[0041] The processor 410 can be an integrated circuit chip with signal processing capabilities, such as a general-purpose processor, a digital signal processor (DSP), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc., where the general-purpose processor can be a microprocessor or any conventional processor, etc.

[0042] The memory 430 may be removable, non-removable, or a combination thereof. Exemplary hardware devices include solid-state memory, hard drives, optical drives, etc. The memory 430 may optionally include one or more storage devices that are physically remote from the processor 410.

[0043] The memory 430 includes volatile memory or non-volatile memory, or may include both volatile and non-volatile memory. The non-volatile memory may be a read-only memory (ROM), and the volatile memory may be a random access memory (RAM). The memory 430 described in the embodiments of the present application is intended to include any suitable type of memory.

[0044] In some embodiments, memory 430 can store data to support various operations, examples of which include programs, modules, and data structures, or a subset or superset thereof, as exemplified below.

[0045] The operating system 431 includes system programs for processing various basic system services and performing hardware-related tasks, such as a framework layer, a core library layer, a driver layer, etc., which are used to implement various basic businesses and process hardware-based tasks.

[0046] The network communication module 432 is used to reach other computing devices via one or more (wired or wireless) network interfaces 420. Exemplary network interfaces 420 include Bluetooth, Wireless LAN (WiFi), and Universal Serial Bus (USB).

[0047] In some embodiments, the data transmission device of the virtual scene provided in the embodiments of the present application can be implemented in software. Figure 2 Device 433 stored in memory 430 is shown. This device 433 can be software in the form of a program or plug-in, and includes the following software modules: a coordination service module 4331, a logic service module 4332-1, a logic service module 4332-2, and a logic module 4332-n. Logic service module 4332-1 can be an interactive logic service module, logic service module 4332-2 can be a multimedia logic service module, and logic service module 4332-n can be another logic service module. These modules are logical and can be arbitrarily combined or further separated according to the functions they implement.

[0048] The following will describe the data transmission method for a virtual scene provided by the embodiment of the present application in conjunction with the exemplary application and implementation of the terminal provided by the embodiment of the present application. It can be understood that the following method can be executed by the terminal 400 described above.

[0049] For example, see Figure 4 , Figure 4 A flowchart of a data transmission method for a virtual scene provided in an embodiment of the present application. The data transmission method for a virtual scene provided in an embodiment of the present application is applied to a client running the virtual scene, wherein the client includes a coordination service and multiple logical services of different types, wherein the multiple logical services include at least an interactive logical service for controlling the interaction between different virtual objects in the virtual scene, and the multiple logical services may also include a multimedia logical service.

[0050] Below Figure 4 The flowchart of the data transmission method of the virtual scene is further explained. Figure 3A , Figure 3A This is a flow chart of a data transmission method for a virtual scene provided by an embodiment of the present application. Figure 3A The steps shown are explained.

[0051] In step 101 , a coordination service obtains data generated by multiple logical services.

[0052] As an example, the coordination service may actively request to obtain data generated by multiple logical services during the operation of the virtual scene, or passively receive data generated by multiple logical services.

[0053] See also Figure 3B , Figure 3B Schematic diagram of the flow of the data transmission method of the virtual scene provided in the embodiment of the present application. Figure 3A , Figure 3BThe illustrated step 101 includes steps 104 to 106. Steps 104 to 106 will be described below.

[0054] In step 104 , each logical service determines the network bandwidth of the logical service.

[0055] As an example, each logical service may periodically determine its own network bandwidth.

[0056] In step 105 , each logical service determines a target network bandwidth interval where the network bandwidth of the logical service is located among a plurality of set network bandwidth intervals, and obtains a transmission strategy pre-associated with the target network bandwidth interval.

[0057] As an example, each logical service determines a target network bandwidth interval within which its available network bandwidth falls within a plurality of predefined network bandwidth intervals, and based on the determined target network bandwidth interval, obtains a transmission policy pre-associated with the target network bandwidth interval. For example, each logical service is pre-configured with a table of correspondences between target network bandwidth intervals and transmission policies. After determining the target network bandwidth interval, each logical service queries the table based on the target network bandwidth interval to determine the corresponding transmission policy.

[0058] In step 106, each logical service adjusts the transmission parameters of the original data generated by the logical service based on the transmission strategy corresponding to the target network bandwidth interval, and sends the adjusted data to the coordination service.

[0059] As an example, after each logical service determines the corresponding transmission strategy, it adjusts the transmission parameters of the generated original data based on the corresponding transmission strategy, and after the adjustment is completed, sends the adjusted data to the coordination service.

[0060] In the related art, with the help of the program in the terminal and external network devices such as servers and routers, the (Type Of Service, TOS) marks corresponding to different types of data packets in the client are adjusted, thereby adjusting the transmission order of different types of data packets. In an embodiment of the present application, each logical service in the client running the virtual scene determines the corresponding transmission strategy based on the target network bandwidth interval where the network bandwidth is located, and adjusts the original data according to the corresponding transmission strategy, without relying on the assistance of the program in the terminal or the external network device, thereby reducing the delay of the data adjustment process. In addition, each logical service sends the adjusted data to the coordination service, which can make the data sent to the coordination service more consistent with the current network bandwidth of the logical service, thereby improving the smoothness of data transmission in the client running the virtual scene.

[0061] See also Figure 3C , Figure 3C Schematic diagram of the flow of the data transmission method of the virtual scene provided in the embodiment of the present application. Figure 3B , Figure 3C The illustrated step 106 may further include step 1061 and step 1062. Step 1061 and step 1062 will be described below.

[0062] In step 1061 , when the logical service is a multimedia logical service, the multimedia logical service adjusts at least one of the following transmission parameters of the original data generated by the multimedia logical service: forward error correction level, bit rate, and multi-link transmission state.

[0063] As an example, when the logical service is a multimedia logical service, the multimedia logical service may adjust the transmission parameters of the original data generated by itself: Forward Error / Erasure Correction (FEC) level, bit rate, and multi-link transmission status.

[0064] Table 1 Transmission strategies corresponding to multimedia logical services

[0065]

[0066]

[0067] Table 1 above shows the transmission strategies corresponding to multimedia logical services. It can be seen that, depending on the network bandwidth interval in which the multimedia logical service's network bandwidth is located, the transmission strategies corresponding to the multimedia logical service are different, and each transmission strategy corresponds to different FEC levels, bit rates, and multimedia transmission states. For example, the FEC level is negatively correlated with the network bandwidth of the multimedia logical service. For example, the network bandwidth in the network bandwidth intervals corresponding to Q1 to Q3 decreases in sequence, while the FEC level corresponding to Q1 to Q3 increases gradually. The bit rate is positively correlated with the network bandwidth of the multimedia logical service. For example, the network bandwidth in the network bandwidth interval corresponding to Q1 is greater than the network bandwidth in the network bandwidth interval corresponding to Q4, and the bit rate corresponding to Q1 is also greater than the bit rate corresponding to Q4. The network bandwidth of the multimedia logical service corresponding to the multi-link transmission enabled state is greater than the network bandwidth of the multimedia logical service corresponding to the multi-link transmission disabled state. For example, the network bandwidth in the network bandwidth interval corresponding to Q2 is greater than the network bandwidth in the network bandwidth interval corresponding to Q5, so the multi-link state corresponding to Q2 is enabled, and the multi-link state corresponding to Q5 is disabled.

[0068] In step 1062 , when the logical service is an interactive logical service, the interactive logical service adjusts at least one of the following transmission parameters of the original data generated by the interactive logical service: forward error correction level and multi-link transmission state.

[0069] As an example, in the case where the logical service is an interactive logical service, the interactive logical service may adjust the transmission parameters of the original data generated by itself: FEC level and multi-link transmission status.

[0070] Table 2 Transmission strategies corresponding to interactive logic services

[0071]

[0072] Table 2 above shows the transmission strategies corresponding to the interactive logic service. It can be seen that the transmission strategies corresponding to the interactive logic service are different according to the different network bandwidth intervals in which the network bandwidth of the interactive logic service is located. The FEC level and multimedia transmission status corresponding to each transmission strategy are different. As an example, the forward error correction level is negatively correlated with the network bandwidth of the interactive logic service. For example, the network bandwidth in the network bandwidth interval corresponding to q1 is greater than the network bandwidth in the network bandwidth interval corresponding to q2, and the FEC level corresponding to q1 is lower than the FEC level corresponding to q2; the network bandwidth of the interactive logic service corresponding to the multi-link transmission on state is smaller than the network bandwidth of the interactive logic service corresponding to the multi-link transmission off state. For example, the network bandwidth in the network bandwidth interval corresponding to q3 is smaller than the network bandwidth in the network bandwidth interval corresponding to q1, and the multi-link transmission state corresponding to q3 is the on state, and the multi-link transmission state corresponding to q1 is the off state.

[0073] It should be noted that, since the adjustment process of the generated original data by different logical services may be performed periodically, here, different logical services adjust the transmission parameters of the original data in the current period.

[0074] In related technologies, the TOS tags corresponding to different types of data packets in the client are adjusted with the help of programs in the terminal and external network devices such as servers and routers, thereby adjusting the transmission order of different types of data packets. In the embodiment of the present application, by running the logical service in the client of the virtual scene, corresponding transmission strategies are adopted to adjust the corresponding transmission parameters for different logical services. This can make more targeted adjustments to the original data of different logical services without relying on the assistance of programs in the terminal or external network devices. This not only reduces the delay of the data adjustment process, but also makes the data of different logical services in the client running the virtual scene more reasonable after adjustment.

[0075] In some embodiments, the values ​​of multiple set network bandwidth intervals are all less than the network bandwidth threshold. The network bandwidth threshold is the minimum bandwidth to ensure that multiple logical services will not cause lag in the virtual scene. The network bandwidth threshold is obtained based on the historical operation data of the client. The historical operation data includes the client's network bandwidth and feedback data on the network bandwidth.

[0076] As an example, the values ​​of multiple set network bandwidth intervals are all less than the network bandwidth threshold, wherein the network bandwidth threshold is the minimum bandwidth to ensure that multiple logical services will not cause the virtual scene to freeze (for example, the interactive logical service freezes, the multimedia logical service freezes). The network bandwidth threshold can be obtained based on the historical operation data of the client. The historical operation data includes the historical network bandwidth of the client, and feedback data on the historical network bandwidth, such as user feedback on whether the historical network bandwidth is frozen. By setting the values ​​of multiple set network bandwidth intervals to be less than the network bandwidth threshold, it can be ensured that the transmission strategy corresponding to each set network bandwidth interval is designed for the freeze phenomenon of the virtual scene, thereby ensuring that after the data is adjusted based on the transmission strategy corresponding to each set network bandwidth interval, the virtual scene in the client running the virtual scene can run smoothly.

[0077] In some embodiments, each logical service determines the target network bandwidth interval in which the network bandwidth of the logical service is located among multiple set network bandwidth intervals, which is achieved in the following manner: when the network bandwidth of the logical service is less than a network bandwidth threshold, each logical service determines the target network bandwidth interval in which the network bandwidth of the logical service is located among multiple set network bandwidth intervals.

[0078] As an example, if each logical service determines that the network bandwidth of the logical service is less than the network bandwidth threshold, it means that the current network bandwidth of the logical service may cause lag. At this time, each logical service will determine the target network bandwidth interval of the logical service's network bandwidth among multiple set network bandwidth intervals, and adjust the original data generated by the logical service according to the transmission strategy corresponding to the target network bandwidth interval.

[0079] If each logical service determines that its network bandwidth is greater than or equal to the network bandwidth threshold, it indicates that the logical service's current network bandwidth will not cause lag. Therefore, there is no need to adjust the original data generated by the logical service based on the transmission policy corresponding to the logical service's network bandwidth, nor is there any need to determine the target network bandwidth interval within multiple set network bandwidth intervals for the logical service's network bandwidth. By determining the target network bandwidth interval for each logical service only when the network bandwidth of the logical service in the client running the virtual scene is less than the network bandwidth threshold, there is no need to rely on the assistance of programs in the terminal or external network devices, effectively improving the efficiency of determining the target network bandwidth interval for the logical service's network bandwidth.

[0080] In some embodiments, each of the multiple set network bandwidth intervals is pre-associated with a corresponding transmission strategy; the head network bandwidth interval corresponds to the network bandwidth interval of the multimedia logic service and the interactive logic service, wherein the head network bandwidth interval is at least one interval with a front value among the multiple set network bandwidth intervals; the middle network bandwidth interval corresponds to the network bandwidth interval of the multimedia logic service and the interactive logic service, wherein the middle network bandwidth interval is at least one interval with a middle value among the multiple set network bandwidth intervals; the tail network bandwidth interval corresponds to the network bandwidth interval of the multimedia logic service, wherein the tail network bandwidth interval is at least one interval with a back value among the multiple set network bandwidth intervals; in the case where the logical service is a multimedia logic service, the multimedia logic service is based on the target network bandwidth interval. The corresponding transmission strategy adjusts the transmission parameters of the original data generated by the logical service, which is achieved in the following ways: when the target network bandwidth interval of the network bandwidth of the multimedia logical service is the head network bandwidth interval, the transmission parameters of the original data generated by the multimedia logical service are adjusted based on the transmission strategy corresponding to the head network bandwidth interval; when the target network bandwidth interval of the network bandwidth of the multimedia logical service is the middle network bandwidth interval, the transmission parameters of the original data generated by the multimedia logical service are adjusted based on the transmission strategy corresponding to the middle network bandwidth interval; when the target network bandwidth interval of the network bandwidth of the multimedia logical service is the tail network bandwidth interval, the transmission parameters of the original data generated by the multimedia logical service are adjusted based on the transmission strategy corresponding to the tail network bandwidth interval.

[0081] As an example, each set network bandwidth interval is pre-associated with a corresponding transmission strategy, that is, there is a one-to-one correspondence between the set network bandwidth interval and the transmission strategy. The head network bandwidth interval with a value at the front among multiple set network bandwidth intervals corresponds to the network bandwidth interval of the multimedia logic service and the interactive logic service; the middle network bandwidth interval with a value in the middle among multiple set network bandwidth intervals corresponds to the network bandwidth interval of the multimedia logic service and the interactive logic service. That is to say, the network bandwidth interval of the multimedia logic service and the interactive logic service can be the head network bandwidth interval or the middle network bandwidth interval. The tail network bandwidth interval with a value at the back among multiple set network bandwidth intervals corresponds to the network bandwidth interval of the multimedia logic service, that is, the network bandwidth interval of the multimedia logic service can also be the tail network bandwidth interval.

[0082] In the case where the logical service is a multimedia logical service, if the target network bandwidth interval of the network bandwidth of the multimedia logical service is the head network bandwidth interval, since the head network bandwidth interval corresponds to the network bandwidth interval of the multimedia logic and the interactive logic, the transmission strategy corresponding to the head network bandwidth interval includes both the transmission strategy corresponding to the multimedia logical service and the transmission strategy corresponding to the interactive logic service. In this case, the transmission parameters of the original data generated by the multimedia logical service are adjusted based on both the transmission strategy corresponding to the multimedia logical service and the transmission strategy corresponding to the interactive logic service.

[0083] If the target network bandwidth interval of the multimedia logic service's network bandwidth is the middle network bandwidth interval, similarly, since the middle network bandwidth interval corresponds to the network bandwidth intervals of the multimedia logic and interactive logic, the transmission strategy corresponding to the middle network bandwidth interval includes both the transmission strategy corresponding to the multimedia logic service and the transmission strategy corresponding to the interactive logic service. In this case, the transmission parameters of the original data generated by the multimedia logic service are adjusted based on both the transmission strategy corresponding to the multimedia logic service and the transmission strategy corresponding to the interactive logic service.

[0084] If the target network bandwidth interval of the multimedia logic service's network bandwidth is the tail network bandwidth interval, since the tail network bandwidth interval only corresponds to the multimedia logic network bandwidth interval, the transmission strategy corresponding to the tail network bandwidth interval only includes the transmission strategy corresponding to the multimedia logic service. In this case, the transmission parameters of the original data generated by the multimedia logic service are adjusted only based on the transmission strategy corresponding to the multimedia logic service.

[0085] In related technologies, the TOS tags corresponding to different types of data packets in the client are adjusted with the help of programs in the terminal and external network devices such as servers and routers, thereby adjusting the transmission order of different types of data packets. In the embodiments of the present application, different transmission strategies are adopted to adjust the original data generated by the multimedia logic service in the client running the virtual scene based on the different network bandwidth ranges in which the multimedia logic service is located. This does not require the assistance of programs in the terminal or external network devices, not only reducing the delay of the data adjustment process, but also making the data of the adjusted multimedia logic service more reasonable.

[0086] In step 102 , the coordination service stores data of multiple logical services in transmission queues corresponding to the logical services respectively.

[0087] For example, the coordination service stores the data of each logical service in the transmission queue corresponding to the logical service. The coordination service sets up a transmission queue for each logical service, and the transmission queue corresponding to each logical service has a different priority, among which the transmission queue corresponding to the interactive logical service has the highest priority.

[0088] For example, multiple logical services include multimedia logical services and interactive logical services. The coordination service sets up a transmission queue for the multimedia logical service and the interactive logical service respectively. Among the transmission queues corresponding to these two logical services, the priority of the transmission queue corresponding to the interactive logical service is higher than the priority of the transmission queue corresponding to the multimedia logical service.

[0089] See also Figure 3D , Figure 3D A schematic diagram of a data transmission method for a virtual scene provided in an embodiment of the present application. Figure 3A , Figure 3D The illustrated step 102 further includes steps 1021 to 1023, and step 103 further includes steps 1031 to 1033. Step 103 further includes step 107. Steps 1021 to 1023, steps 1031 to 1033, and step 107 will be described below.

[0090] In step 1021 , the coordination service determines the network bandwidth of the logical service.

[0091] As an example, the coordination service may determine the network bandwidth for each logical service.

[0092] In step 1022 , the coordination service determines a target network bandwidth interval where the network bandwidth of the logical service is located among a plurality of set network bandwidth intervals, and obtains a transmission strategy pre-associated with the target network bandwidth interval.

[0093] As an example, after determining the network bandwidth of each logical service, the coordination service determines a target network bandwidth interval corresponding to the network bandwidth of each logical service, and acquires a corresponding transmission strategy according to the determined target network bandwidth interval.

[0094] In step 1023, the coordination service adjusts the transmission parameters of the original data generated by the logical service based on the transmission strategy corresponding to the target network bandwidth interval, and stores the adjusted data in the transmission queue corresponding to the logical service.

[0095] As an example, after the coordination service obtains the transmission strategy corresponding to each logical service, it adjusts the transmission parameters of the original data generated by the logical service according to the transmission strategy corresponding to each logical service, and stores the adjusted data in the transmission queue corresponding to the logical service.

[0096] In related technologies, the TOS tags corresponding to different types of data packets in the client are adjusted with the help of programs in the terminal and external network devices such as servers and routers, thereby adjusting the transmission order of different types of data packets. In the embodiments of the present application, before the data of the logical service is stored in the transmission queue corresponding to the logical service, the coordination service in the client running the virtual scene adjusts the transmission parameters of the original data generated by the logical service. This does not require the assistance of programs in the terminal or external network devices, not only reducing the delay of the data adjustment process, but also making the data stored in the transmission queue more reasonable.

[0097] In step 103 , the coordination service sends the data in the transmission queues of the multiple logical services to the server based on the priorities of the transmission queues of the multiple logical services.

[0098] As an example, the coordination service can send data in the transmission queues of multiple logical services to a unified server, or it can send data in the transmission queues of multiple logical services to the servers corresponding to the logical services. Figure 4 , the coordination service sends the data of the interactive logic service to the interactive logic server, and sends the data of the multimedia logic service to the multimedia logic server.

[0099] Continuing with the above example, since the priority of the transmission queue corresponding to the interactive logic service is higher than the priority of the transmission queue corresponding to the multimedia logic service, when the coordination service sends data to the server, it first sends the data in the transmission queue corresponding to the interactive logic service, and then sends the data in the transmission queue corresponding to the multimedia logic.

[0100] In step 1031 , the coordination service obtains a transmission strategy pre-associated with a target network bandwidth interval based on the target network bandwidth interval where the network bandwidth of each logical service in the plurality of logical services is located among the plurality of set network bandwidth intervals.

[0101] As an example, when the coordination service sends data in the transmission queues of multiple logical services to the server, the coordination service first obtains the corresponding transmission strategy based on the target network bandwidth interval of each logical service, that is, determines the transmission strategy corresponding to each logical service.

[0102] In step 1032 , the coordination service adjusts the transmission parameters of the data in the transmission queue of each logical service based on the transmission policy corresponding to each logical service to obtain adjusted data.

[0103] As an example, after determining the transmission strategy corresponding to each logical service, the coordination service adjusts the transmission parameters in the transmission queue of each logical service based on the transmission strategy corresponding to each logical service. The transmission parameters may include FEC level, bit rate, and multi-link transmission status.

[0104] In step 10321, the coordination service performs sliding sampling on the data in the transmission queue of each logical service through a sampling window, and obtains the transmission strategy pre-associated with the target network bandwidth interval based on the target network bandwidth interval in which the network bandwidth of each logical service is located in multiple set network bandwidth intervals when sampling in the sampling window.

[0105] As an example, the coordination service performs sliding sampling on the data in the transmission queue of each logical service through a sampling window. When sampling, the sampling window corresponds to a sampling time point. The transmission strategy corresponding to each logical service is obtained according to the target network bandwidth range of the network bandwidth of each logical service at the sampling time point corresponding to the sampling window.

[0106] In step 10322, the coordination service adjusts the transmission parameters of the data in the transmission queue of each logical service within the sampling window based on the transmission policy corresponding to each logical service to obtain adjusted data.

[0107] For example, the coordination service adjusts the transmission parameters of the data within a sampling window in the transmission queue of each logical service based on the transmission policy obtained for each logical service, thereby obtaining adjusted data. The sampling window can sample a fixed amount of data, i.e., the amount of data sampled within each sampling window is the same. The sampling window can also sample data generated within a fixed duration, i.e., the sampling duration corresponding to the data within each sampling window is the same.

[0108] In related technologies, the TOS tags corresponding to different types of data packets in the client are adjusted with the help of programs in the terminal and external network devices such as servers and routers, thereby adjusting the transmission order of different types of data packets. In an embodiment of the present application, the coordination service in the client running the virtual scene adjusts the transmission parameters of the data within the sampling window according to the transmission strategy corresponding to the network bandwidth of the logical service at the time of sampling in the sampling window. This does not require the assistance of programs in the terminal or external network devices. This not only reduces the delay of the data adjustment process, but also adjusts the data in the transmission queue according to the transmission strategy corresponding to the real-time network bandwidth of the logical service at the time of sampling, making the adjusted data more reasonable.

[0109] In step 1033 , the coordination service sends the adjusted data in the transmission queues of the multiple logical services to the server.

[0110] For example, the coordination service adjusts the transmission parameters of the data in each logical service's transmission queue and then sends the adjusted data in the transmission queues of the multiple logical services to the server. By adjusting the transmission parameters of the data in the transmission queues before sending the adjusted data to the server, the data sent to the server can be more reasonable.

[0111] In step 10331 , the coordination service sends the adjusted data in the transmission queues of the multiple logical services within the sampling window to the server.

[0112] As an example, after adjusting the transmission parameters of the data in the transmission queue of each logical service within the sampling window, the coordination service sends the adjusted data in the transmission queue of each logical service within the sampling window to the server.

[0113] In related technologies, different types of data packets are transmitted accordingly based on the TOS tags corresponding to different types of data packets in the client, using programs in the terminal and external network devices such as servers and routers. In the embodiments of the present application, the coordination service in the client running the virtual scene sends the adjusted data within the sampling window in the transmission queue of each logical service to the server, without relying on the assistance of programs in the terminal or external network devices. This not only reduces the delay in the data transmission process, but also makes the data sent to the server more reasonable.

[0114] In some embodiments, the coordination service sends data in the transmission queues of multiple logical services to the server based on the priorities of the transmission queues of multiple logical services, which is achieved in the following manner: sliding sampling of the data in the transmission queues of multiple logical services is performed through a sampling window, and the data in the transmission queues of multiple logical services that is within the sampling window is sent to the server according to the priorities of the transmission queues of multiple logical services; wherein the sampling window is used to sample a fixed amount of data, or to sample data generated within a fixed time period.

[0115] For example, the coordination service performs sliding sampling of data in the transmission queues of multiple logical services using a sampling window. The data within the sampling window is sent to the server based on the priority of the transmission queues of the multiple logical services. Sampling windows can be used to collect a fixed amount of data, meaning each sampling window collects the same amount of data. Sampling windows can also be used to collect data generated within a fixed duration, meaning each sampling window has the same sampling duration.

[0116] For example, multiple logical services include an interactive logical service and a multimedia logical service. Sliding sampling is performed on the data in the transmission queues of the interactive logical service and the multimedia logical service using a sampling window. Because the priority of the transmission queue of the interactive logical service is higher than that of the transmission queue of the multimedia logical service, for data within each sampling window, the data in the transmission queue of the interactive logical service is sent first. After the data in the transmission queue of the interactive logical service within the sampling window is completely sent, the data in the transmission queue of the multimedia logical service within the same sampling window is sent. Data within each sampling window is sent in this manner.

[0117] In related technologies, different types of data packets are transmitted accordingly based on the TOS tags corresponding to different types of data packets in the client, using programs in the terminal and external network devices such as servers and routers. In an embodiment of the present application, a coordination service in a client running a virtual scene performs sliding sampling of data in the transmission queues of multiple logical services based on a sampling window. For the data in each sampling window, the data in the transmission queues of multiple logical services within each sampling window is sent according to the priority of the transmission queue of the logical service. This does not require the assistance of programs in the terminal or external network devices, thereby reducing the delay in the data transmission process and improving the data transmission efficiency in the client running the virtual scene.

[0118] In step 107 , the coordination service receives the data returned by the server and sends the data returned by the server to the corresponding logical service.

[0119] For example, after receiving data returned by the server, the coordination service sends the data to the corresponding logical service based on the logical service identifier carried in the returned data. For example, if the data returned by the server carries the identifier of an interactive logical service, the coordination service will send the data returned by the server to the interactive logical service.

[0120] In related technologies, different types of data packets are sent to the client based on the transmission strategies of different types of data packets in the client, using programs in the terminal and external network devices such as servers and routers. In the embodiments of the present application, the data returned by the server is sent to the corresponding logical service through the coordination service in the client running the virtual scene, without relying on the assistance of programs in the terminal or external network devices. This not only reduces the delay in the data transmission process, but also allows the accurate transmission of data returned by the server, thereby improving data transmission efficiency.

[0121] In the embodiments of the present application, a coordination service in a client running a virtual scene stores data from different logical services in corresponding transmission queues. Data from these queues is then sent to the server based on their priorities. By prioritizing data from the transmission queues of interactive logical services, the virtual scene operates smoothly without relying on programs in the terminal or external network devices.

[0122] Below, we will take the client running the virtual scene as a game client, the interactive logic service as a game logic service, and the multimedia logic service as a voice logic service as an example to illustrate the exemplary application of the embodiment of the present application in an actual virtual scene data transmission application scenario.

[0123] The embodiments of the present application may have the following application scenarios. For example, a game client includes a game logic service and a multimedia logic service. A network collaboration module (i.e., a coordination service) is set in such a game client. The priority of the transmission queue corresponding to each logic service is set through the network collaboration module, and the priority of the transmission queue corresponding to the game logic service is set to the highest. The network collaboration module transmits the data in the transmission queue corresponding to the logic service in sequence according to the priority of the transmission queue corresponding to the logic service. Since the transmission queue corresponding to the game logic service has the highest priority, the network collaboration module gives priority to transmitting the data in the transmission queue of the game logic service.

[0124] See also Figure 5A , Figure 5A Schematic diagram of the data transmission method of the virtual scene provided by the embodiment of the present application. The game logic service and the multimedia logic service are integrated into the same game client, and a network collaboration module (i.e., coordination service) is added to the game client to uniformly manage the transmission process of the data generated by each logic service in the game client through the network collaboration module. The network collaboration module can sort and transmit the data in the transmission queues of different logic services according to the priority of the transmission queues corresponding to the game logic service and the multimedia logic service. For example, the priority of the transmission queue corresponding to the game logic service can be set to be higher than the priority of the transmission queue corresponding to the multimedia logic service. In this way, when data transmission is performed, the network collaboration module gives priority to transmitting the data in the transmission queue of the game logic service, thereby minimizing game delay.

[0125] join Figure 5B , Figure 5BThis is a schematic diagram of a data transmission method for a virtual scene provided by an embodiment of the present application. The network collaboration module (i.e., coordination service) includes: a multimedia logic service feedback input module, a game logic service feedback input module, a network link screening module, a network bandwidth estimation module, a network link discovery and maintenance module, a multimedia logic service data input module, a game logic service data input module, and a transmission queue module.

[0126] The multimedia logic service feedback input module is used to receive feedback data of the multimedia logic service, for example, receiving a packet loss event fed back by the multimedia logic service.

[0127] The game logic service feedback input module is used to receive feedback data from the game logic service, for example, receiving packet loss events fed back by the game logic service.

[0128] The network link screening module is used to determine whether the network link is available based on the packet loss events fed back by the multimedia logic service and the game logic service, and to screen the network link based on whether the network link is available.

[0129] The network bandwidth estimation module is used to estimate the available network bandwidth corresponding to the multimedia logic service and the available network bandwidth corresponding to the game logic service based on the packet loss events fed back by the multimedia logic service and the game logic service.

[0130] The network link discovery and maintenance module is used to poll the available status of network links, discover available network links through the polling process, and maintain and manage the available network links.

[0131] The multimedia logic service data input module is used to receive the generated multimedia logic service data sent by the multimedia logic service.

[0132] The game logic service data input module is used to receive the generated game logic service data sent by the game logic service.

[0133] The transmission queue module is used to store the received multimedia logic service data or game logic service data into the corresponding transmission queue.

[0134] As an example, the interaction between the network collaboration module and the game logic service and the multimedia logic service mainly includes two aspects: in terms of data interaction, the network collaboration module transmits the generated data for the game logic service and the multimedia logic service, allowing the game logic service and the multimedia logic service to specify the priority of the corresponding transmission queue when sending data to the network collaboration module, and then the network collaboration module stores the data of the logic service in the corresponding transmission queue; in terms of transmission quality feedback interaction, the application layer of the game logic service and the multimedia logic service can clearly know the network jamming situation of their own network, and provide real-time feedback to the network collaboration module by calling a specific application programming interface (API). In other words, the application layer of the game logic service and the multimedia logic service can timely perceive the packet loss event of the network transmission. When the packet loss event is perceived, the application layer of the game logic service or the multimedia logic service sends the packet loss event to the network collaboration module by calling the OnPacketLost (int type) interface, where the type parameter is used to identify which logic service's application layer detected the packet loss event. Since the game logic service and the multimedia logic service are relatively independent, both need to uniformly feedback the packet loss event to the network collaboration module. The network collaboration module evaluates the network status of each logical service based on the packet loss events fed back by the application layer, that is, it estimates the available network bandwidth of each logical service, and controls the game logic service or multimedia logic service through callbacks to adjust the data transmission strategy based on the estimated available network bandwidth.

[0135] The network collaboration module itself is mainly responsible for handling various abnormal situations in the game client network, implementing network anomaly processing and shielding at the bottom layer, and preventing the application layer from perceiving too much network error information.

[0136] join Figure 5C , Figure 5CIt is a schematic diagram of the data transmission method of the virtual scene provided by an embodiment of the present application. After the game client is initialized, the network collaboration module (i.e., coordination service) in the game client is initialized, and then the game logic service and the multimedia logic service are loaded. The network collaboration module determines the network bandwidth corresponding to the game logic service, and determines the network bandwidth corresponding to the multimedia logic service, and feeds back the determined network bandwidth to the corresponding logic service. When the network bandwidth of two logic services is less than the network bandwidth threshold, each logic service determines the target network bandwidth interval of its own network bandwidth in a plurality of set network bandwidth intervals, and obtains the transmission strategy corresponding to the target network bandwidth interval, that is, determines the transmission strategy corresponding to each logic service. Each logic service adjusts the transmission parameters of the data generated by itself according to its corresponding transmission strategy. Among them, the network bandwidth threshold is the minimum bandwidth that ensures that each logic service will not cause a freeze in the virtual scene.

[0137] See also Figure 5D , Figure 5D It is a schematic diagram of the data transmission method of the virtual scene provided in an embodiment of the present application. Figure 5D The data transmission method of the virtual scene shown is Figure 5C Further description of the data transmission method for the virtual scene shown. When the game logic service has data to be sent, the game logic service first sends the data to the network collaboration module (i.e., the coordination service), and the network collaboration module stores the data in the transmission queue corresponding to the game logic service. When the multimedia logic service has data to be sent, the multimedia logic service first sends the data to the network collaboration module, and the network collaboration module stores the data in the transmission queue corresponding to the multimedia logic service. The network collaboration module sends the data in the transmission queue corresponding to the logic service to the server based on the priority of the transmission queue corresponding to the logic service.

[0138] After receiving the data returned by the server, the network collaboration module sends the data returned by the server to the corresponding logical service according to the identifier of the logical service carried in the data returned by the server.

[0139] When the game logic service detects a packet loss event, that is, when the game logic service experiences network lag, it reports the network lag to the network collaboration module. The network collaboration module determines the network bandwidth of the game logic service based on the reported network lag (i.e., packet loss event) and sends the determined network bandwidth of the game logic service to the game logic service. The game logic service determines the target network bandwidth interval within multiple set network bandwidth intervals, obtains the transmission strategy corresponding to the target network bandwidth interval, and adjusts the transmission parameters of the data it generates based on the corresponding transmission strategy.

[0140] When the multimedia logic service detects a packet loss event (i.e., network lag), it reports the lag to the network collaboration module. The network collaboration module determines the network bandwidth of the multimedia logic service based on the reported lag (i.e., packet loss) and sends the determined network bandwidth to the multimedia logic service. The multimedia logic service then determines the target network bandwidth interval within a plurality of predefined network bandwidth intervals, obtains the transmission policy corresponding to the target network bandwidth interval, and adjusts the transmission parameters of the data it generates based on the corresponding transmission policy.

[0141] As an example, Figures 5B to 5D The functions of the network collaboration module (i.e., coordination service) in the data transmission method of the virtual scene shown include: 1. Managing the network link of the game client; 2. Managing the transmission queue and sending the data in the transmission queue according to the priority of the transmission queue; 3. Setting the FEC mechanism of the data in the transmission queue; 4. Collaborative control of data generated by the game logic service and the data generated by the multimedia logic service.

[0142] In the transmission queue management section, the network collaboration module uses the transmission queue to manage data. After the game logic service or multimedia logic service sends the generated data to the network collaboration module, the network collaboration module stores the data generated by the logic service in the transmission queue corresponding to the logic service.

[0143] In the setting of the FEC mechanism for data in the transmission queue, in order to minimize the delay of network transmission, the FEC mechanism is introduced in the network collaboration module. The purpose of the FEC mechanism is to recover packet loss. The data sender performs FEC encoding and introduces redundant data packets. The data receiver recovers the lost data packets based on the redundant data packets after FEC decoding, thereby ensuring that the transmitted data can be recovered in time in the event of packet loss. Since the network link discovery and maintenance module is introduced in the network collaboration module, data may be transmitted on multiple network links at the same time. Therefore, the network collaboration module can set the corresponding FEC level according to the transmission quality of each network link.

[0144] In the collaborative control part of the data generated by the game logic service and the data generated by the multimedia logic service, in order to ensure that the data generated by the game logic service can be transmitted smoothly, when the game logic service detects that the network is stuck, that is, when the game logic service detects that a packet loss event has occurred (that is, the available network bandwidth is less than the network bandwidth threshold), the network collaboration module determines the network bandwidth corresponding to the game logic service based on the packet loss event feedback from the game logic service, and sends the determined network bandwidth to the game logic service. The game logic service obtains the transmission strategy corresponding to the target network bandwidth interval based on the target network bandwidth interval in multiple set network bandwidth intervals, and adjusts the transmission parameters of the data generated by itself based on the corresponding transmission strategy. The transmission parameters include the FEC level and the multi-link transmission status.

[0145] To ensure smooth transmission of data generated by the multimedia logic service, when the multimedia logic service detects network lag, that is, when the multimedia logic service detects packet loss (i.e., the available network bandwidth is less than the network bandwidth threshold), the network collaboration module determines the network bandwidth corresponding to the multimedia logic service based on the packet loss event reported by the multimedia logic service, and sends the determined network bandwidth to the multimedia logic service. The multimedia logic service determines the target network bandwidth interval based on the network bandwidth in multiple set network bandwidth intervals, obtains the transmission strategy corresponding to the target network bandwidth interval, and adjusts the transmission parameters of the data generated by itself based on the corresponding transmission strategy. The transmission parameters include FEC level, bit rate, and multi-link transmission status.

[0146] Table 3 Transmission strategies corresponding to multimedia logical services

[0147]

[0148]

[0149] Table 3 above lists the transmission strategies corresponding to multimedia logical services. Different transmission strategies for multimedia logical services vary in FEC level, bit rate, and multi-link transmission status. As shown in Table 3, each transmission strategy corresponds to a network bandwidth range. Different transmission strategies correspond to different network bandwidth ranges for multimedia logical services.

[0150] As an example, the FEC level is negatively correlated with the network bandwidth of the multimedia logical service. For example, the network bandwidth in the network bandwidth interval corresponding to Q1 to Q3 becomes smaller in sequence, while the FEC level corresponding to Q1 to Q3 gradually increases; the bit rate is positively correlated with the network bandwidth of the multimedia logical service. For example, the network bandwidth in the network bandwidth interval corresponding to Q1 is greater than the network bandwidth in the network bandwidth interval corresponding to Q4, and the bit rate corresponding to Q1 is also greater than the bit rate corresponding to Q4; the network bandwidth of the multimedia logical service corresponding to the multi-link transmission on state is greater than the network bandwidth of the multimedia logical service corresponding to the multi-link transmission off state. For example, the network bandwidth in the network bandwidth interval corresponding to Q2 is greater than the network bandwidth in the network bandwidth interval corresponding to Q5, so the multi-link state corresponding to Q2 is the on state, and the multi-link state corresponding to Q5 is the off state.

[0151] See also Figure 5E , Figure 5E : This is a schematic diagram of a data transmission method for a virtual scene provided by an embodiment of the present application. As an example, the process of adjusting the adjustment parameters of the generated original data by the multimedia logic service based on the transmission strategy corresponding to the network bandwidth interval in which it is located is as follows: When the network bandwidth interval in which the multimedia logic service is located is Q1, that is, when the transmission strategy corresponding to the multimedia logic service is H0, if the multimedia logic service detects a jamming situation, that is, the current available network bandwidth of the multimedia logic service is less than the network bandwidth interval Q1, then the multimedia logic service determines the corresponding transmission strategy based on the network bandwidth interval in which the current available network bandwidth is located. For example, if it is determined that the network bandwidth interval in which the current available network bandwidth is located is Q3, then at this time, the transmission strategy corresponding to the multimedia logic service is H2, and the FEC level, bit rate, and multi-link transmission status of the original data generated by the multimedia logic service are adjusted according to H2. If the network bandwidth interval in which the multimedia logic service is located is Q3, that is, when the transmission strategy corresponding to the multimedia logic service is H2, if the multimedia logic service detects a jamming situation again, then the adjustment process is the same as the above process.

[0152] It should be noted that in Table 3 above, the network bandwidths in the network bandwidth intervals corresponding to Q1-Q9 become smaller in sequence, so Q1-Q3 are the head network bandwidth intervals with the values ​​at the front, Q4-Q6 are the middle network bandwidth intervals with the values ​​in the middle, and Q7-Q9 are the tail network bandwidth intervals with the values ​​at the back. The head network bandwidth interval and the middle network bandwidth interval can both correspond to the network bandwidth intervals of the multimedia logic service and the network bandwidth intervals of the game logic service. Therefore, when the network bandwidth interval of the multimedia logic service is the head network bandwidth interval or the middle network bandwidth interval, the original data generated by the multimedia logic service is adjusted based on the transmission strategy corresponding to the head network bandwidth interval or the transmission strategy corresponding to the middle network bandwidth interval, that is, the adjustment is made based on the transmission strategy corresponding to the multimedia logic service and the transmission strategy corresponding to the game logic at the same time. Figure 5E As shown, when the transmission strategy corresponding to the multimedia logic service is H0-H2, or M0-M2, that is, the network bandwidth interval corresponding to the multimedia logic service is Q1-Q3, or Q4-Q6, that is, the network bandwidth interval of the multimedia logic service is the head network bandwidth interval or the middle network bandwidth interval, adjustments are made based on the transmission strategy corresponding to the multimedia logic service (that is, the transmission strategy corresponding to when multimedia freeze is detected) and the transmission strategy corresponding to the game logic (that is, the transmission strategy corresponding when game freeze is detected).

[0153] When the transmission strategy corresponding to the multimedia logical service is S0-S2, that is, the network bandwidth interval corresponding to the multimedia logical service is Q7-Q9, that is, the network bandwidth interval of the multimedia logical service is the tail network bandwidth interval, adjustments are made only based on the transmission strategy corresponding to the multimedia logical service (that is, the transmission strategy corresponding to when multimedia freeze is detected).

[0154] Table 4 Transmission strategies corresponding to game logic services

[0155]

[0156] Table 4 above shows the transmission strategies corresponding to the game logic service. It can be seen that the transmission strategies corresponding to the game logic service are different depending on the network bandwidth interval in which the network bandwidth of the game logic service is located. The FEC level and multimedia transmission status corresponding to each transmission strategy are different. As an example, the forward error correction level is negatively correlated with the network bandwidth of the game logic service. For example, the network bandwidth in the network bandwidth interval corresponding to q1 is greater than the network bandwidth in the network bandwidth interval corresponding to q2, and the FEC level corresponding to q1 is lower than the FEC level corresponding to q2. The network bandwidth of the game logic service corresponding to the multi-link transmission on state is less than the network bandwidth of the game logic service corresponding to the multi-link transmission off state. For example, the network bandwidth in the network bandwidth interval corresponding to q3 is less than the network bandwidth in the network bandwidth interval corresponding to q1, and the multi-link transmission state corresponding to q3 is on, and the multi-link transmission state corresponding to q1 is off.

[0157] See also Figure 5F , Figure 5F A schematic diagram of a data transmission method for a virtual scene provided in an embodiment of the present application. As an example, the process of adjusting the adjustment parameters of the generated raw data by the game logic service based on the transmission strategy corresponding to the network bandwidth interval in which it is located is as follows: When the network bandwidth interval in which the game logic service is located is q1, that is, when the transmission strategy corresponding to the game logic service is L0, if the game logic service detects that a jam occurs, that is, the current available network bandwidth of the game logic service is already less than the network bandwidth interval q1, then the game logic service determines the corresponding transmission strategy based on the network bandwidth interval in which the current available network bandwidth is located. For example, if it is determined that the network bandwidth interval in which the current available network bandwidth is located is q2, then at this time, the transmission strategy corresponding to the game logic service is L1, and the FEC level and multi-link transmission status of the raw data generated by the game logic service are adjusted according to L1. If the network bandwidth interval in which the game logic service is located is q2, that is, when the transmission strategy corresponding to the game logic service is L1, if the game logic service detects that a jam occurs again, then the adjustment process is the same as the above process.

[0158] See 5G, Figure 5GA schematic diagram of a data transmission method for a virtual scene provided in an embodiment of the present application. As an example, when processing the data generated by the logic service in the game client, according to business needs, in addition to the data generated by the game logic service and the data generated by the multimedia logic service, the data generated by other logic services can also be sent to the network collaboration module (i.e., coordination service). The network collaboration module stores the data of multiple logic services in the transmission queues corresponding to the logic services respectively. The transmission queues of different logic services have different priorities, among which the transmission queue corresponding to the game logic service has the highest priority. The network collaboration module sends the data in the transmission queue of the logic service to the server according to the priority of the transmission queue of the logic service. The data generated by each logic service in the game client is uniformly managed by the network collaboration module, which facilitates the network collaboration module to reasonably allocate transmission resources, thereby ensuring the smooth operation of the game.

[0159] It is understandable that in the embodiments of the present application, when user information and other related data are involved, when the embodiments of the present application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of relevant data must comply with relevant laws, regulations and standards of relevant countries and regions.

[0160] The following continues to describe the exemplary structure of the data transmission device 433 of the virtual scene provided by the embodiment of the present application implemented as a software module. In some embodiments, such as Figure 2 As shown, the software modules in the data transmission device 433 in the virtual scene stored in the memory 430 may include: a coordination service module 4331, used to run the coordination service and obtain data generated by multiple logical services; and store the data of the multiple logical services in the transmission queues corresponding to the logical services, respectively, wherein the priorities of the transmission queues corresponding to the multiple logical services are different, and the priority of the transmission queue corresponding to the interactive logical service is the highest; and based on the priorities of the transmission queues of the multiple logical services, send the data in the transmission queues of the multiple logical services to the server; logical service modules 4332-1 to 4332-n, used to run the corresponding logical services.

[0161] In the above scheme, the logic service modules 4332-1 to 4332-n are used to run the corresponding logic service and determine the network bandwidth of the logic service; and determine the target network bandwidth interval in which the network bandwidth of the logic service is located among multiple set network bandwidth intervals, and obtain the transmission strategy pre-associated with the target network bandwidth interval; and based on the transmission strategy corresponding to the target network bandwidth interval, adjust the transmission parameters of the original data generated by the logic service, and send the adjusted data to the coordination service.

[0162] In the above scheme, the values ​​of multiple set network bandwidth intervals are all less than the network bandwidth threshold. The network bandwidth threshold is the minimum bandwidth to ensure that multiple logical services will not cause lag in the virtual scene. The network bandwidth threshold is obtained based on the client's historical operation data. The historical operation data includes the client's network bandwidth and feedback data on the network bandwidth.

[0163] In the above scheme, the logic service module 4332-2 can be a multimedia logic service module, which is used to run the multimedia logic service and adjust at least one of the following transmission parameters of the original data generated by the multimedia logic service: forward error correction level, bit rate and multi-link transmission status; wherein the forward error correction level is negatively correlated with the network bandwidth of the multimedia logic service, the bit rate is positively correlated with the network bandwidth of the multimedia logic service, and the network bandwidth of the multimedia logic service corresponding to the multi-link transmission on state is greater than the network bandwidth of the multimedia logic service corresponding to the multi-link transmission off state; the logic service module 4332-1 can be an interactive logic service module, which is used to run the interactive logic service and adjust at least one of the following transmission parameters of the original data generated by the interactive logic service: forward error correction level and multi-link transmission status; wherein the forward error correction level is negatively correlated with the network bandwidth of the interactive logic service, and the network bandwidth of the interactive logic service corresponding to the multi-link transmission on state is less than the network bandwidth of the interactive logic service corresponding to the multi-link transmission off state.

[0164] In the above module, each of the multiple set network bandwidth intervals is pre-associated with a corresponding transmission strategy; the head network bandwidth interval corresponds to the network bandwidth interval of the multimedia logic service and the interactive logic service, wherein the head network bandwidth interval is at least one interval with a front value among the multiple set network bandwidth intervals; the middle network bandwidth interval corresponds to the network bandwidth interval of the multimedia logic service and the interactive logic service, wherein the middle network bandwidth interval is at least one interval with a middle value among the multiple set network bandwidth intervals; the tail network bandwidth interval corresponds to the network bandwidth interval of the multimedia logic service, wherein the tail network bandwidth interval is at least one interval with a back value among the multiple set network bandwidth intervals; the logic service module 4332-2 can be multimedia The logic service module is used to run the multimedia logic service, and when the target network bandwidth interval of the network bandwidth of the multimedia logic service is the head network bandwidth interval, adjust the transmission parameters of the original data generated by the multimedia logic service based on the transmission strategy corresponding to the head network bandwidth interval; when the target network bandwidth interval of the network bandwidth of the multimedia logic service is the middle network bandwidth interval, adjust the transmission parameters of the original data generated by the multimedia logic service based on the transmission strategy corresponding to the middle network bandwidth interval; when the target network bandwidth interval of the network bandwidth of the multimedia logic service is the tail network bandwidth interval, adjust the transmission parameters of the original data generated by the multimedia logic service based on the transmission strategy corresponding to the tail network bandwidth interval.

[0165] In the above scheme, the coordination service module 4331 is used to run the coordination service, and based on the target network bandwidth interval in which the network bandwidth of each logical service among multiple logical services is located in multiple set network bandwidth intervals, obtain a transmission strategy pre-associated with the target network bandwidth interval; based on the transmission strategy corresponding to each logical service, adjust the transmission parameters of the data in the transmission queue of each logical service to obtain adjusted data; and send the adjusted data in the transmission queues of multiple logical services to the server.

[0166] In the above scheme, the coordination service module 4331 is used to run the coordination service, perform sliding sampling of the data in the transmission queue of each logical service through a sampling window, and obtain a transmission strategy pre-associated with the target network bandwidth interval based on the target network bandwidth interval in which the network bandwidth of each logical service is located in multiple set network bandwidth intervals when sampling in the sampling window; based on the transmission strategy corresponding to each logical service, adjust the transmission parameters of the data of each logical service located in the sampling window to obtain adjusted data; wherein the sampling window is used to sample a fixed amount of data, or to sample data generated within a fixed time length; sending the adjusted data in the transmission queues of multiple logical services to the server includes: sending the adjusted data in the transmission queues of multiple logical services located in the sampling window to the server.

[0167] In the above scheme, the coordination service module 4331 is used to run the coordination service, determine the network bandwidth of the logical service; determine the target network bandwidth interval in which the network bandwidth of the logical service is located among multiple set network bandwidth intervals, and obtain a transmission strategy pre-associated with the target network bandwidth interval; based on the transmission strategy corresponding to the target network bandwidth interval, adjust the transmission parameters of the original data generated by the logical service, and store the adjusted data in the transmission queue corresponding to the logical service.

[0168] In the above scheme, the coordination service module 4331 is used to run the coordination service, perform sliding sampling on the data in the transmission queues of multiple logical services through a sampling window, and send the data in the transmission queues of multiple services within the sampling window to the server according to the priority of the transmission queues of multiple logical services; wherein, the sampling window is used to sample a fixed amount of data, or to sample data generated within a fixed time period.

[0169] In the above solution, the coordination service module 4331 is used to run the coordination service, receive data returned by the server, and send the data returned by the server to the corresponding logical service.

[0170] The present invention provides a computer program product or computer program, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the virtual scene transmission method described in the present invention.

[0171] An embodiment of the present application provides a computer-readable storage medium storing executable instructions, wherein the executable instructions are stored. When the executable instructions are executed by a processor, the processor will execute the data transmission method of the virtual scene provided by the embodiment of the present application.

[0172] In some embodiments, the computer-readable storage medium may be a memory such as FRAM, ROM, PROM, EPROM, EEPROM, flash memory, magnetic surface memory, optical disk, or CD-ROM; or various devices including one or any combination of the above memories.

[0173] In some embodiments, executable instructions may be in the form of a program, software, software module, script, or code, written in any form of programming language (including compiled or interpreted languages, or declarative or procedural languages), and may be deployed in any form, including as a stand-alone program or as a module, component, subroutine, or other unit suitable for use in a computing environment.

[0174] By way of example, executable instructions may be deployed to be executed on one computing device, or on multiple computing devices at one site, or on multiple computing devices distributed across multiple sites and interconnected by a communication network.

[0175] In summary, the embodiments of the present application can, through the coordination service in the client running the virtual scene, store the data of different logical services in corresponding transmission queues and send the data in different transmission queues to the server based on the priority of each transmission queue. By giving priority to the data in the transmission queue of the interactive logical service, the smooth operation of the virtual scene is guaranteed without relying on the assistance of the terminal program or external network equipment.

[0176] The above are merely examples of the present application and are not intended to limit the scope of protection of the present application. Any modifications, equivalent replacements, and improvements made within the spirit and scope of the present application are included in the scope of protection of the present application.

Claims

1. A data transmission method for a virtual scene, characterized in that: A client for running a virtual scene includes a coordination service and multiple logical services of different types, wherein the multiple logical services include at least an interactive logical service for controlling the interaction between different virtual objects in the virtual scene. The coordination service is located in the client and is capable of transmitting and managing data of the multiple logical services in the client. The method comprises: Each of the logical services performs the following processing: determining the network bandwidth of the logical service; determining the target network bandwidth interval in which the network bandwidth of the logical service is located among multiple set network bandwidth intervals, and obtaining a transmission strategy pre-associated with the target network bandwidth interval; adjusting the transmission parameters of the original data generated by the logical service based on the transmission strategy corresponding to the target network bandwidth interval, and sending the adjusted data to the coordination service, wherein adjusting the transmission parameters of the original data generated by the logical service based on the transmission strategy corresponding to the target network bandwidth interval includes: when the logical service is a multimedia logical service, adjusting at least one of the following transmission parameters of the original data: forward error correction level, bit rate, and multi-link transmission status, the forward error correction level is negatively correlated with the network bandwidth of the multimedia logical service, the bit rate is positively correlated with the network bandwidth of the multimedia logical service, and the network bandwidth of the multimedia logical service corresponding to the multi-link transmission on state is greater than the network bandwidth of the multimedia logical service corresponding to the multi-link transmission off state; when the logical service is the interactive logical service, adjusting at least one of the following transmission parameters of the original data: the forward error correction level and the multi-link transmission status, the forward error correction level is negatively correlated with the network bandwidth of the interactive logical service, and the network bandwidth of the interactive logical service corresponding to the multi-link transmission on state is less than the network bandwidth of the interactive logical service corresponding to the multi-link transmission off state; The coordination service obtains data generated by the multiple logical services; The coordination service stores the data of the multiple logical services in transmission queues corresponding to the logical services, respectively, wherein the transmission queues corresponding to the multiple logical services have different priorities, and the transmission queue corresponding to the interactive logical service has the highest priority; The coordination service sends the data in the transmission queues of the plurality of logical services to the server based on the priorities of the transmission queues of the plurality of logical services.

2. The method according to claim 1, characterized in that The values ​​of the multiple set network bandwidth intervals are all less than the network bandwidth threshold. The network bandwidth threshold is the minimum bandwidth that ensures that the multiple logical services will not cause lag in the virtual scene. The network bandwidth threshold is obtained based on statistics of the historical operation data of the client, and the historical operation data includes the network bandwidth of the client and feedback data on the network bandwidth.

3. The method according to claim 1, characterized in that Each of the plurality of set network bandwidth intervals is pre-associated with a corresponding transmission strategy; The head network bandwidth interval corresponds to the network bandwidth interval of the multimedia logical service and the interactive logical service, wherein the head network bandwidth interval is at least one interval with a front value among the multiple set network bandwidth intervals; The middle network bandwidth interval corresponds to the network bandwidth intervals of the multimedia logical service and the interactive logical service, wherein the middle network bandwidth interval is at least one interval with a middle value among the multiple set network bandwidth intervals; The tail network bandwidth interval corresponds to the network bandwidth interval of the multimedia logical service, wherein the tail network bandwidth interval is at least one interval with a later value among the multiple set network bandwidth intervals; In a case where the logical service is a multimedia logical service, adjusting the transmission parameters of the original data generated by the logical service based on the transmission strategy corresponding to the target network bandwidth interval includes: When the target network bandwidth interval of the network bandwidth of the multimedia logical service is a head network bandwidth interval, adjusting transmission parameters of the original data generated by the multimedia logical service based on the transmission policy corresponding to the head network bandwidth interval; When the target network bandwidth interval of the network bandwidth of the multimedia logical service is a middle network bandwidth interval, adjusting the transmission parameters of the original data generated by the multimedia logical service based on the transmission policy corresponding to the middle network bandwidth interval; When the target network bandwidth interval of the network bandwidth of the multimedia logical service is a tail network bandwidth interval, the transmission parameters of the original data generated by the multimedia logical service are adjusted based on the transmission policy corresponding to the tail network bandwidth interval.

4. The method according to claim 1, wherein The sending the data in the transmission queues of the plurality of logical services to the server comprises: acquiring, based on a target network bandwidth interval in which the network bandwidth of each logical service in the plurality of logical services lies among a plurality of set network bandwidth intervals, a transmission strategy pre-associated with the target network bandwidth interval; Adjusting, based on the transmission policy corresponding to each logical service, transmission parameters of the data in the transmission queue of each logical service to obtain adjusted data; The adjusted data in the transmission queues of the plurality of logical services is sent to the server.

5. The method according to claim 4, characterized in that The adjusting, based on the transmission policy corresponding to each logical service, the transmission parameters of the data in the transmission queue of each logical service to obtain the adjusted data includes: performing sliding sampling of data in the transmission queue of each logical service through a sampling window, and obtaining a transmission policy pre-associated with the target network bandwidth interval based on the target network bandwidth interval in which the network bandwidth of each logical service falls during sampling within the sampling window. Adjusting, based on the transmission policy corresponding to each logical service, transmission parameters of the data in the transmission queue of each logical service and within the sampling window to obtain adjusted data; The sampling window is used to sample a fixed amount of data, or to sample data generated within a fixed time period; The sending the adjusted data in the transmission queues of the plurality of logical services to the server includes: The adjusted data in the transmission queues of the plurality of logical services and within the sampling window are sent to the server.

6. The method according to claim 1, characterized in that The coordination service stores the data of the plurality of logical services in transmission queues corresponding to the logical services respectively, including: The coordination service performs the following processing for each of the logical services: determining a network bandwidth for the logical service; Determine a target network bandwidth interval in which the network bandwidth of the logical service is located among a plurality of set network bandwidth intervals, and obtain a transmission strategy pre-associated with the target network bandwidth interval; Based on the transmission strategy corresponding to the target network bandwidth interval, the transmission parameters of the original data generated by the logical service are adjusted, and the adjusted data is stored in the transmission queue corresponding to the logical service.

7. The method according to claim 1, characterized in that The sending the data in the transmission queues of the plurality of logical services to the server comprises: Slidingly sampling the data in the transmission queues of the multiple logical services through a sampling window, and sending the data in the transmission queues of the multiple logical services within the sampling window to a server according to the priorities of the transmission queues of the multiple logical services; The sampling window is used to sample a fixed amount of data, or to sample data generated within a fixed time period.

8. The method according to claim 1, characterized in that The method further comprises: The coordination service receives the data returned by the server and sends the data returned by the server to the corresponding logic service.

9. A data transmission device for a virtual scene, characterized in that: The device includes: a coordination service module and a plurality of logic service modules; The multiple logical service modules are used to determine the network bandwidth of the logical service; determine the target network bandwidth interval in which the network bandwidth of the logical service is located among multiple set network bandwidth intervals, and obtain a transmission strategy pre-associated with the target network bandwidth interval; adjust the transmission parameters of the original data generated by the logical service based on the transmission strategy corresponding to the target network bandwidth interval, and send the adjusted data to the coordination service, wherein the adjustment of the transmission parameters of the original data generated by the logical service based on the transmission strategy corresponding to the target network bandwidth interval includes: when the logical service is a multimedia logical service, adjusting at least one of the following transmission parameters of the original data: forward error correction level, bit rate, and multi-link transmission transmission state, the forward error correction level is negatively correlated with the network bandwidth of the multimedia logical service, the bit rate is positively correlated with the network bandwidth of the multimedia logical service, and the network bandwidth of the multimedia logical service corresponding to the multi-link transmission on state is greater than the network bandwidth of the multimedia logical service corresponding to the multi-link transmission off state; when the logical service is the interactive logical service, at least one of the following transmission parameters of the original data is adjusted: the forward error correction level and the multi-link transmission state, the forward error correction level is negatively correlated with the network bandwidth of the interactive logical service, and the network bandwidth of the interactive logical service corresponding to the multi-link transmission on state is less than the network bandwidth of the interactive logical service corresponding to the multi-link transmission off state; The coordination service module is configured to run a coordination service, obtain data generated by multiple logical services, and store the data of the multiple logical services in transmission queues corresponding to the logical services, respectively, wherein the transmission queues corresponding to the multiple logical services have different priorities, and the transmission queue corresponding to the interactive logical service has the highest priority; and send the data in the transmission queues of the multiple logical services to a server based on the priorities of the transmission queues of the multiple logical services; The multiple logic service modules are further used to run corresponding logic services.

10. The device according to claim 9, characterized in that The device further comprises: The coordination service module is further configured to run the coordination service, obtain a transmission strategy pre-associated with a target network bandwidth interval based on the target network bandwidth interval in which the network bandwidth of each logical service among the multiple logical services is located in the multiple set network bandwidth intervals; adjust the transmission parameters of the data in the transmission queue of each logical service based on the transmission strategy corresponding to each logical service to obtain adjusted data; and send the adjusted data in the transmission queues of the multiple logical services to the server.

11. The device according to claim 9, characterized in that The device further comprises: The coordination service module is further configured to run the coordination service, perform sliding sampling of data in the transmission queue of each logical service through a sampling window, and obtain a transmission strategy pre-associated with the target network bandwidth interval based on the target network bandwidth interval within which the network bandwidth of each logical service falls within multiple set network bandwidth intervals when sampling in the sampling window; adjust transmission parameters of data within the sampling window for each logical service based on the transmission strategy corresponding to each logical service to obtain adjusted data; wherein the sampling window is configured to sample a fixed amount of data or data generated within a fixed duration; and send the adjusted data in the transmission queues of multiple logical services to the server, including: sending the adjusted data within the sampling window in the transmission queues of multiple logical services to the server.

12. An electronic device, characterized in that: The electronic device comprises: a memory for storing executable instructions; The processor is configured to implement the data transmission method for the virtual scene according to any one of claims 1 to 8 when executing the executable instructions stored in the memory.

13. A computer-readable storage medium, characterized in that Executable instructions are stored, which are used to implement the data transmission method of the virtual scene according to any one of claims 1 to 8 when executed by a processor.

14. A computer program product comprising a computer program or instructions, characterized in that When the computer program or instruction is executed by a processor, the data transmission method of the virtual scene according to any one of claims 1 to 8 is implemented.

Images