Rendering data transmission method, device and equipment and readable storage medium

Abstract

The invention provides a rendering data transmission method, device and equipment and a readable storage medium, and relates to the technical field of data transmission. The rendering data transmission method comprises the steps that an illumination item spherical harmonic coefficient and a light transmission item spherical harmonic coefficient are sent to a core network device, and the core network device is used for transmitting the illumination item spherical harmonic coefficient and the light transmission item spherical harmonic coefficient to a terminal through an access network device, the illumination item spherical harmonic coefficient and the light transmission item spherical harmonic coefficient are used for indicating the terminal to render the first picture frame. According to the scheme, the cloud transmits the spherical harmonic coefficient to the terminal for rendering, and compared with the prior art that the cloud transmits the irradiance map of the picture frame to the terminal for rendering, the requirement for wireless communication air interface bandwidth resources is lowered.

Description

Technical Field

[0001] The present invention relates to the technical field of data transmission, and in particular to a rendering data transmission method, device, equipment and readable storage medium. Background Art

[0002] Rendering technology is a key technology for cloud extended reality (Extended Reality, XR for short), the metaverse, and 6G services. Lighting processing is an important process in rendering technology. In order to simulate realistic rendering results, the existing lighting processing needs to consider light from all directions and all possible propagation forms, and the convergence speed is extremely slow, so it is necessary to consider how to distribute the rendering tasks of the cloud and the terminal. In the existing technical solutions, the cloud transmits the irradiance map of the picture frame to the terminal for rendering, or the cloud transmits the rendering result of the lighting processing directly to the terminal for display. This processing method has very high requirements on the wireless communication air interface bandwidth resources. Summary of the invention

[0003] The purpose of the technical solution of the present invention is to provide a rendering data transmission method, device, equipment and readable storage medium to solve the problem that in the prior art, the cloud transmits the irradiance map of the picture frame to the terminal for rendering, or the cloud directly transmits the rendering result to the terminal for display, resulting in high requirements for wireless communication air interface bandwidth resources.

[0004] To achieve the above object, an embodiment of the present invention provides a rendering data transmission method, which is applied to the cloud. The method includes:

[0005] The spherical harmonic coefficients of the illumination item and the spherical harmonic coefficients of the light transmission item are sent to the core network device, and the core network device is used to transmit the spherical harmonic coefficients of the illumination item and the spherical harmonic coefficients of the light transmission item to the terminal through the access network device, and the spherical harmonic coefficients of the illumination item and the spherical harmonic coefficients of the light transmission item are used to instruct the terminal to render the first picture frame.

[0006] Optionally, the rendering data transmission method further comprises:

[0007] Index information is sent to the core network device, where the index information is used to instruct the core network device to determine the service quality parameters for the access network device to transmit the spherical harmonic coefficients of the illumination item to the terminal, and to instruct the core network device to determine the service quality parameters for the access network device to transmit the spherical harmonic coefficients of the light transmission item to the terminal.

[0008] Optionally, in the rendering data transmission method, the index information includes first index information corresponding to the first multiplexing factor and second index information corresponding to the second multiplexing factor;

[0009] The first multiplexing factor is used to indicate the multiplexing of the illumination item spherical harmonic coefficients of the first picture frame to the illumination item spherical harmonic coefficients of the second picture frame;

[0010] The second multiplexing factor is used to indicate the multiplexing of the spherical harmonic coefficients of the light transmission items of the first picture frame with the spherical harmonic coefficients of the light transmission items of the second picture frame;

[0011] The first index information is used to instruct the core network device to determine the quality of service parameter of the spherical harmonic coefficient of the illumination item transmitted by the access network device;

[0012] The second index information is used to instruct the core network device to determine the quality of service parameter of the spherical harmonic coefficient of the light transmission item transmitted by the access network device;

[0013] The second picture frame is a previous picture frame of the first picture frame.

[0014] Optionally, in the rendering data transmission method, the quality of service parameter of the illumination item spherical harmonic coefficient and the quality of service parameter of the light transmission item spherical harmonic coefficient satisfy at least one of the following:

[0015] The transmission priority of the spherical harmonic coefficients of the illumination term is higher than the transmission priority of the spherical harmonic coefficients of the light transmission term;

[0016] If the first multiplexing factor is greater than the third multiplexing factor, the transmission bandwidth of the illumination item spherical harmonic coefficients of the first picture frame is less than the transmission bandwidth of the illumination item spherical harmonic coefficients of the second picture frame, and the third multiplexing factor is used to indicate the multiplexing of the illumination item spherical harmonic coefficients of the second picture frame with the illumination item spherical harmonic coefficients of the third picture frame;

[0017] If the second multiplexing factor is less than the fourth multiplexing factor, the transmission bandwidth of the spherical harmonic coefficients of the light transmission items of the first picture frame is greater than the transmission bandwidth of the spherical harmonic coefficients of the light transmission items of the second picture frame, and the fourth multiplexing factor is used to indicate the multiplexing of the spherical harmonic coefficients of the light transmission items of the second picture frame with the spherical harmonic coefficients of the light transmission items of the third picture frame;

[0018] The third picture frame is a previous picture frame of the second picture frame.

[0019] Optionally, in the rendering data transmission method, before sending the index information to the core network device, the method further includes:

[0020] Determine the first index information according to the first multiplexing factor and a first corresponding relationship, where the first corresponding relationship is used to indicate the first index information corresponding to the first multiplexing factor;

[0021] The second index information is determined according to the second multiplexing factor and the second corresponding relationship, where the second corresponding relationship is used to indicate the second index information corresponding to the second multiplexing factor.

[0022] Optionally, in the rendering data transmission method, the quality of service parameter includes at least one of the following:

[0023] Transmission priority; transmission bandwidth; packet loss rate threshold.

[0024] To achieve the above object, an embodiment of the present invention further provides a rendering data transmission method, which is applied to a core network device, and the method includes:

[0025] Receive the spherical harmonic coefficients of illumination term and light transmission term sent by the cloud;

[0026] The spherical harmonic coefficients of the illumination item and the spherical harmonic coefficients of the light transmission item are sent to an access network device, and the access network device is used to transmit the spherical harmonic coefficients of the illumination item and the spherical harmonic coefficients of the light transmission item to a terminal, and the spherical harmonic coefficients of the illumination item and the spherical harmonic coefficients of the light transmission item are used to instruct the terminal to render a first picture frame.

[0027] Optionally, the rendering data transmission method further comprises:

[0028] Receiving index information sent by the cloud;

[0029] Determining, according to the index information, a quality of service parameter for transmitting the illumination item spherical harmonic coefficients from the access network device to the terminal, and a quality of service parameter for transmitting the light transmission item spherical harmonic coefficients from the access network device to the terminal;

[0030] The quality of service parameters of the spherical harmonic coefficients of the illumination item and the quality of service parameters of the spherical harmonic coefficients of the light transmission item are sent to the access network device.

[0031] Optionally, in the rendering data transmission method, the index information includes first index information corresponding to a first multiplexing factor and second index information corresponding to a second multiplexing factor, wherein the first multiplexing factor is used to indicate the multiplexing of the illumination item spherical harmonic coefficients of the first picture frame with the illumination item spherical harmonic coefficients of the second picture frame, and the second multiplexing factor is used to indicate the multiplexing of the light transmission item spherical harmonic coefficients of the first picture frame with the light transmission item spherical harmonic coefficients of the second picture frame, and the second picture frame is a picture frame previous to the first picture frame;

[0032] Determining, according to the index information, a service quality parameter for transmitting the illumination item spherical harmonic coefficients from the access network device to the terminal, and determining a service quality parameter for transmitting the light transmission item spherical harmonic coefficients from the access network device to the terminal, comprises:

[0033] Determine, according to the first index information and the third corresponding relationship, a service quality parameter of the illumination item spherical harmonic coefficient, wherein the third corresponding relationship is used to indicate the service quality parameter of the illumination item spherical harmonic coefficient corresponding to the first index information;

[0034] The quality of service parameter of the spherical harmonic coefficient of the light transmission item is determined according to the second index information and a fourth corresponding relationship, wherein the fourth corresponding relationship is used to indicate the quality of service parameter of the spherical harmonic coefficient of the light transmission item corresponding to the second index information.

[0035] To achieve the above object, an embodiment of the present invention further provides a rendering data transmission method, which is applied to an access network device, and the method includes:

[0036] Receive the illumination term spherical harmonic coefficients and light transmission term spherical harmonic coefficients sent by the core network equipment;

[0037] The illumination item spherical harmonic coefficient and the light transmission item spherical harmonic coefficient are sent to a terminal, where the illumination item spherical harmonic coefficient and the light transmission item spherical harmonic coefficient are used to instruct the terminal to render a first picture frame.

[0038] Optionally, the rendering data transmission method further comprises:

[0039] Receiving the quality of service parameters of the illumination item spherical harmonic coefficients and the quality of service parameters of the light transmission item spherical harmonic coefficients sent by the core network device;

[0040] Sending the illumination term spherical harmonic coefficient and the light transmission term spherical harmonic coefficient to the terminal includes:

[0041] The spherical harmonic coefficients of the illumination item are sent to the terminal using the service quality parameters of the spherical harmonic coefficients of the illumination item, and the spherical harmonic coefficients of the light transmission item are sent to the terminal using the service quality parameters of the spherical harmonic coefficients of the light transmission item.

[0042] To achieve the above object, an embodiment of the present invention further provides a rendering data transmission method, which is applied to a terminal, and the method includes:

[0043] Receive the illumination item spherical harmonic coefficients and light transmission item spherical harmonic coefficients sent by the access network equipment;

[0044] The first picture frame is rendered using the illumination term spherical harmonic coefficients and the light transmission term spherical harmonic coefficients to obtain a rendering result.

[0045] Optionally, in the rendering data transmission method, the step of receiving the illumination term spherical harmonic coefficients and the light transmission term spherical harmonic coefficients sent by the access network device comprises:

[0046] Receive the illumination item spherical harmonic coefficients sent by the access network device using the service quality parameters of the illumination item spherical harmonic coefficients, and receive the light transmission item spherical harmonic coefficients sent by the access network device using the service quality parameters of the light transmission item spherical harmonic coefficients.

[0047] Optionally, the rendering data transmission method, wherein the step of rendering the first picture frame using the illumination term spherical harmonic coefficients and the light transmission term spherical harmonic coefficients to obtain a rendering result, comprises:

[0048] Decoding the illumination term spherical harmonic coefficients and the light transmission term spherical harmonic coefficients respectively;

[0049] The decoded illumination item spherical harmonic coefficients and light transport item spherical harmonic coefficients are used to perform vertex shading and fragment shading on the first picture frame to obtain the rendering result.

[0050] To achieve the above object, an embodiment of the present invention further provides a rendering data transmission device, which is applied to the cloud, and the device includes:

[0051] The first sending module is used to send the spherical harmonic coefficients of the illumination item and the spherical harmonic coefficients of the light transmission item to the core network device, and the core network device is used to transmit the spherical harmonic coefficients of the illumination item and the spherical harmonic coefficients of the light transmission item to the terminal through the access network device, and the spherical harmonic coefficients of the illumination item and the spherical harmonic coefficients of the light transmission item are used to instruct the terminal to render the first picture frame.

[0052] To achieve the above object, an embodiment of the present invention further provides a rendering data transmission device, which is applied to a core network device, and the device includes:

[0053] The first receiving module is used to receive the spherical harmonic coefficients of the illumination term and the spherical harmonic coefficients of the light transmission term sent by the cloud;

[0054] The second sending module is used to send the spherical harmonic coefficients of the illumination item and the spherical harmonic coefficients of the light transmission item to the access network device, and the access network device is used to transmit the spherical harmonic coefficients of the illumination item and the spherical harmonic coefficients of the light transmission item to the terminal, and the spherical harmonic coefficients of the illumination item and the spherical harmonic coefficients of the light transmission item are used to instruct the terminal to render the first picture frame.

[0055] To achieve the above object, an embodiment of the present invention further provides a rendering data transmission device, which is applied to an access network device, and the device includes:

[0056] The second receiving module is used to receive the spherical harmonic coefficients of the illumination term and the spherical harmonic coefficients of the light transmission term sent by the core network device;

[0057] The third sending module is used to send the spherical harmonic coefficients of the illumination item and the spherical harmonic coefficients of the light transmission item to the terminal, and the spherical harmonic coefficients of the illumination item and the spherical harmonic coefficients of the light transmission item are used to instruct the terminal to render the first picture frame.

[0058] To achieve the above object, an embodiment of the present invention further provides a rendering data transmission device, which is applied to a terminal, and the device includes:

[0059] The third receiving module is used to receive the spherical harmonic coefficients of the illumination term and the spherical harmonic coefficients of the light transmission term sent by the access network device;

[0060] The rendering module is used to render the first picture frame using the illumination term spherical harmonic coefficients and the light transmission term spherical harmonic coefficients to obtain a rendering result.

[0061] To achieve the above objectives, an embodiment of the present invention further provides a rendering data transmission device, comprising: a processor, a memory, and a program stored in the memory and executable on the processor, wherein the program, when executed by the processor, implements the rendering data transmission method as described in any one of the above items.

[0062] To achieve the above object, an embodiment of the present invention further provides a readable storage medium, on which a program is stored, and when the program is executed by a processor, the rendering data transmission method as described in any one of the above items is implemented.

[0063] The beneficial effects of the above technical solution of the present invention are as follows:

[0064] The rendering data transmission method described in the embodiment of the present invention is adopted to send the illumination item spherical harmonic coefficient and the light transmission item spherical harmonic coefficient to the core network device, and the core network device is used to transmit the illumination item spherical harmonic coefficient and the light transmission item spherical harmonic coefficient to the terminal through the access network device, and the illumination item spherical harmonic coefficient and the light transmission item spherical harmonic coefficient are used to instruct the terminal to render the first picture frame. In this way, the spherical harmonic coefficient is transmitted to the terminal for rendering by the cloud. Compared with the prior art that the cloud transmits the irradiance map of the picture frame to the terminal for rendering, or the cloud directly transmits the rendering result to the terminal, the order of the spherical harmonic coefficient can be controlled (within the third order) and can be further compressed, so that the wireless communication air interface bandwidth resources can be reduced, and the utilization rate of the wireless communication air interface resources can be improved, thereby solving the problem of high requirements for the wireless communication air interface bandwidth resources. In addition, the cloud determines the spherical harmonic coefficient, and the terminal uses the spherical harmonic coefficient for rendering, which can utilize the resources on both sides of the cloud and the terminal to achieve load balancing and improve rendering efficiency, thereby ensuring user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0065] Figure 1 A schematic diagram of an application system architecture of the rendering data transmission method according to an embodiment of the present invention;

[0066] Figure 2 A schematic diagram of a flow chart of a rendering data transmission method according to one embodiment of the present invention;

[0067] Figure 3 A schematic diagram of a flow chart of a rendering data transmission method according to another embodiment of the present invention;

[0068] Figure 4 A schematic diagram of a flow chart of a rendering data transmission method according to another embodiment of the present invention;

[0069] Figure 5 A schematic diagram of a flow chart of a rendering data transmission method according to another embodiment of the present invention;

[0070] Figure 6 A schematic diagram of a flow chart of one implementation of the method described in an embodiment of the present invention;

[0071] Figure 7 It is a structural schematic diagram of a rendering data transmission device according to one embodiment of the present invention;

[0072] Figure 8 It is a structural schematic diagram of a rendering data transmission device according to another embodiment of the present invention;

[0073] Fig. 9 It is a structural schematic diagram of a rendering data transmission device according to another embodiment of the present invention;

[0074] Fig.10 It is a schematic diagram of the structure of a rendering data transmission device according to another embodiment of the present invention. DETAILED DESCRIPTION

[0075] In order to make the technical problems, technical solutions and advantages to be solved by the present invention more clear, a detailed description will be given below with reference to the accompanying drawings and specific embodiments.

[0076] The application system architecture of the rendering data transmission method according to the embodiment of the present invention is as follows: Figure 1As shown, it includes a terminal and a cloud, wherein the terminal includes an acquisition module, a vertex shading module, a fragment shading module and a display module, and the cloud includes an ambient lighting calculation module. Specifically, the acquisition module collects relevant information of the picture frame to be rendered and sends it to the ambient lighting calculation module, the ambient lighting calculation module calculates the spherical harmonic coefficients of the illumination item and the spherical harmonic coefficients of the light transmission item of the picture frame to be rendered, and returns the spherical harmonic coefficients of the illumination item and the spherical harmonic coefficients of the light transmission item to the vertex shading module and the fragment shading module through the downlink network, the vertex shading module performs vertex shading, and the fragment shading module performs fragment shading, generates rendering results, and displays them on the display module, so as to realize real-time rendering and global illumination effects of objects in different ambient light scenes.

[0077] In order to solve the problem in the prior art that the cloud transmits the irradiance map of the picture frame to the terminal for rendering, or the cloud directly transmits the rendering result to the terminal for display, resulting in high requirements for wireless communication air interface bandwidth resources, an embodiment of the present invention provides a rendering data transmission method, the cloud sends the spherical harmonic coefficients of the illumination item and the spherical harmonic coefficients of the light transmission item to the core network device, the core network device is used to transmit the spherical harmonic coefficients of the illumination item and the spherical harmonic coefficients of the light transmission item to the terminal through the access network device, the spherical harmonic coefficients of the illumination item and the spherical harmonic coefficients of the light transmission item are used to instruct the terminal to render the first picture frame, so by adopting this implementation mode, the cloud The end transmits the spherical harmonic coefficients to the terminal for rendering. Compared with the prior art that the cloud transmits the irradiance map of the picture frame to the terminal for rendering, or the cloud directly transmits the rendering result to the terminal for display, the order of the spherical harmonic coefficients can be controlled (within the third order) and can be further compressed. Therefore, it is possible to reduce the wireless communication air interface bandwidth resources, improve the utilization rate of the wireless communication air interface resources, and solve the problem of high requirements for the wireless communication air interface bandwidth resources. Moreover, the cloud determines the spherical harmonic coefficients, and the terminal uses the spherical harmonic coefficients for rendering, which can utilize the resources on both the cloud and the terminal to achieve load balancing and improve rendering efficiency, thereby ensuring user experience.

[0078] One embodiment of the present invention, as Figure 2 As shown, a rendering data transmission method is provided, which is applied to the cloud, and the method includes:

[0079] Step 201, sending spherical harmonic coefficients of illumination items and spherical harmonic coefficients of light transmission items to a core network device, wherein the core network device is used to transmit the spherical harmonic coefficients of illumination items and the spherical harmonic coefficients of light transmission items to a terminal through an access network device, wherein the spherical harmonic coefficients of illumination items and the spherical harmonic coefficients of light transmission items are used to instruct the terminal to render a first picture frame.

[0080] It should be noted that in the rendering scene of ambient light mapping, the representation of ambient light can be a spherical function, so spherical harmonics can be used to represent ambient light. Spherical harmonic lighting is a lighting algorithm that can calculate the surrounding ambient light as spherical harmonic coefficients, and then use spherical harmonic coefficients to restore the lighting during rendering.

[0081] The rendering equation can be divided into two parts, the illumination part and the light transmission part. Both the illumination term and the light transmission term are spherical functions. By projecting the spherical functions of the illumination term and the light transmission term onto the basis function, the coefficients of the spherical harmonic functions, namely the spherical harmonic coefficients of the illumination term and the spherical harmonic coefficients of the light transmission term, can be calculated to restore the illumination.

[0082] In this embodiment of the present invention, the cloud determines the illumination term spherical harmonic coefficients and the light transmission term spherical harmonic coefficients of the first picture frame by completing the illumination term calculation and the light transmission term calculation. The illumination condition of the first picture frame can be any illumination condition. Optionally, the first picture frame is the current picture frame.

[0083] The terminal obtains the rendering result of the first picture frame based on the spherical harmonic coefficients of the illumination term and the spherical harmonic coefficients of the light transmission term, thereby achieving load balancing between the cloud and the terminal. The cloud transmits the spherical harmonic coefficients to the terminal through the core network equipment and the access network equipment. Compared with the prior art, the cloud transmits the irradiance map or rendering result of the first picture frame to the terminal, which can save a lot of air interface transmission bandwidth. Moreover, the spherical harmonic coefficients in text format can be compressed to further reduce the air interface transmission bandwidth.

[0084] It should also be noted that the illumination term spherical harmonic coefficients and the light transmission term spherical harmonic coefficients of the embodiment of the present invention can be applied to the rendering of diffuse reflection scene.

[0085] In one embodiment, optionally, the method further comprises:

[0086] Index information is sent to the core network device, where the index information is used to instruct the core network device to determine the quality of service (QoS) parameters for the access network device to transmit the spherical harmonic coefficients of the illumination item to the terminal, and to instruct the core network device to determine the QoS parameters for the access network device to transmit the spherical harmonic coefficients of the light transmission item to the terminal.

[0087] In this embodiment of the present invention, the cloud sends index information to the core network device, instructing the core network device to determine the QoS parameters of the spherical harmonic coefficients of the illumination item transmitted by the access network device to the terminal, and instructing the core network device to determine the QoS parameters of the spherical harmonic coefficients of the light transmission item transmitted by the access network device to the terminal, so as to ensure data transmission.

[0088] It should be noted that the cloud can send index information to the core network device at the same time as sending the spherical harmonic coefficients of the illumination term and the spherical harmonic coefficients of the light transmission term to the core network device, or the cloud can also send index information to the core network device before sending the spherical harmonic coefficients of the illumination term and the spherical harmonic coefficients of the light transmission term to the core network device. The embodiment of the present invention is not limited here.

[0089] It should also be noted that the cloud in the embodiment of the present invention may be a cloud server.

[0090] The core network equipment may include multiple network elements, among which the network elements for processing spherical harmonic coefficient data packets and the network elements for processing QoS parameters may be different. For example, a user plane function (UPF) network element may be used to process spherical harmonic coefficient data packets, and a session management function (SMF) network element and an access and mobility management function (AMF) network element may be used to process QoS parameters. However, this is explained based on the existing network structure as an example, and it does not rule out changes in the network structure and the functions of the network elements in the future, or the same network element may be used to process spherical harmonic data packets and QoS parameters.

[0091] In the embodiment of the present invention, optionally, the index information includes first index information corresponding to the first multiplexing factor and second index information corresponding to the second multiplexing factor;

[0092] The first multiplexing factor is used to indicate the multiplexing of the illumination item spherical harmonic coefficients of the first picture frame to the illumination item spherical harmonic coefficients of the second picture frame;

[0093] The second multiplexing factor is used to indicate the multiplexing of the spherical harmonic coefficients of the light transmission items of the first picture frame with the spherical harmonic coefficients of the light transmission items of the second picture frame;

[0094] The first index information is used to instruct the core network device to determine the QoS parameter of the spherical harmonic coefficient of the illumination item transmitted by the access network device to the terminal;

[0095] The second index information is used to instruct the core network device to determine the QoS parameter of the spherical harmonic coefficient of the light transmission item transmitted by the access network device to the terminal;

[0096] The second picture frame is a previous picture frame of the first picture frame.

[0097] In this embodiment of the present invention, firstly, the first index information corresponding to the first multiplexing factor is determined, and the second index information corresponding to the second multiplexing factor is determined. Then, according to the first index information, the core network device is instructed to determine the QoS parameters of the spherical harmonic coefficients of the illumination item transmitted by the access network device to the terminal. According to the second index information, the core network device is instructed to determine the QoS parameters of the spherical harmonic coefficients of the light transmission item transmitted by the access network device to the terminal. Thereby, the QoS parameters are used to ensure the transmission of the spherical harmonic coefficients, improve the utilization rate of the air interface resources, and ensure the user experience.

[0098] It should be noted that in 6G services, the requirements for QoS parameters will be more detailed and diverse, and core network equipment needs to formulate flexible QoS parameters to ensure transmission. Since the multiplexing of illumination between different picture frames is inconsistent, the multiplexing of light transmission is inconsistent, and therefore the multiplexing factors are also inconsistent, the spherical harmonic coefficients of different multiplexing factors have inconsistent requirements for access network device transmission. In an embodiment of the present invention, corresponding index information is determined based on the multiplexing factor, and then the index information is used to instruct the core network device to formulate QoS parameters for the spherical harmonic coefficients of the access network device to transmit, so as to achieve transmission guarantee for different spherical harmonic coefficients.

[0099] In the embodiment of the present invention, optionally, the QoS parameter includes at least one of the following:

[0100] Transmission priority; transmission bandwidth; packet loss rate threshold.

[0101] It can be understood that the QoS parameters of the spherical harmonic coefficients of the illumination item include at least one of the transmission priority, transmission bandwidth and packet loss rate threshold; the QoS parameters of the spherical harmonic coefficients of the light transmission item also include at least one of the transmission priority, transmission bandwidth and packet loss rate threshold.

[0102] In the embodiment of the present invention, optionally, the QoS parameter of the illumination term spherical harmonic coefficient and the QoS parameter of the light transmission term spherical harmonic coefficient satisfy at least one of the following:

[0103] The transmission priority of the spherical harmonic coefficients of the illumination term is higher than the transmission priority of the spherical harmonic coefficients of the light transmission term;

[0104] If the first multiplexing factor is greater than the third multiplexing factor, the transmission bandwidth of the illumination item spherical harmonic coefficients of the first picture frame is less than the transmission bandwidth of the illumination item spherical harmonic coefficients of the second picture frame, and the third multiplexing factor is used to indicate the multiplexing of the illumination item spherical harmonic coefficients of the second picture frame with the illumination item spherical harmonic coefficients of the third picture frame;

[0105] If the second multiplexing factor is less than the fourth multiplexing factor, the transmission bandwidth of the spherical harmonic coefficients of the light transmission items of the first picture frame is greater than the transmission bandwidth of the spherical harmonic coefficients of the light transmission items of the second picture frame, and the fourth multiplexing factor is used to indicate the multiplexing of the spherical harmonic coefficients of the light transmission items of the second picture frame with the spherical harmonic coefficients of the light transmission items of the third picture frame;

[0106] The third picture frame is a previous picture frame of the second picture frame.

[0107] It should be noted that spherical harmonics have functions of different frequencies. The higher the frequency, the more basis functions it contains. Since the order of basis functions can be infinite, the higher the order, the better the details that can be restored, but more coefficients will bring greater storage and computing pressure. Therefore, the spherical harmonic coefficients of illumination terms and light transmission terms of different frequencies have different requirements on the network during transmission, and different QoS parameters need to be formulated.

[0108] When the access network device transmits the data packet of spherical harmonic coefficients sent from the cloud over the network, the data packet size of the spherical harmonic coefficients is different due to the different sizes of the multiplexing factors, and the requirements for QoS parameters during transmission are also different. Among them, the larger the multiplexing factor, the smaller the data packet representing the transmitted spherical harmonic coefficients, and the smaller the requirement for the transmission bandwidth; the smaller the multiplexing factor, the larger the data packet representing the transmitted spherical harmonic coefficients, and the greater the requirement for the transmission bandwidth. Therefore, the core network device can formulate different transmission rules for the transmission of spherical harmonic coefficients according to the multiplexing factor. According to the above principles, the core network device formulates different QoS parameters for the data packets of spherical harmonic coefficients with different multiplexing factors, and the access network device performs QoS guarantee for transmission. The access network device can be a radio access network (Ratio Access Network, referred to as RAN) device.

[0109] In addition, since the illumination spherical harmonic coefficients are independent of the number of object vertices, they occupy less memory. The illumination spherical harmonic coefficients are relatively small, and each order of coefficients reflects the characteristics of ambient lighting. The illumination spherical harmonic coefficients of the first three orders can be used to restore the approximate ambient lighting, and the illumination spherical harmonic coefficients change in real time with the scene selected by the user. The light transmission spherical harmonic coefficients are relatively large, which are the product of the number of object vertices and the number of illumination spherical harmonic coefficients. When the object is fixed, the light transmission coefficients change little, and the requirement for packet loss during transmission can be reduced. Therefore, the priority of the illumination spherical harmonic coefficients is higher than that of the light transmission spherical harmonic coefficients.

[0110] In one implementation manner, optionally, before sending the index information to the core network device, the method further includes:

[0111] Determine the first index information according to the first multiplexing factor and a first corresponding relationship, where the first corresponding relationship is used to indicate the first index information corresponding to the first multiplexing factor;

[0112] The second index information is determined according to the second multiplexing factor and the second corresponding relationship, where the second corresponding relationship is used to indicate the second index information corresponding to the second multiplexing factor.

[0113] It should be noted that the first corresponding relationship and the second corresponding relationship mentioned above can both be in a table format. Here, the following Table 1 is taken as an example to illustrate the corresponding table between the reuse factor and the index relationship.

[0114] Table 1 Corresponding table of reuse factors and index relationships

[0115] Reuse factor α 0 (0,1 / 4] (1 / 4,1 / 2] (1 / 2,3 / 4] (3 / 4,1] Index information 0 1 2 3 4

[0116] The first corresponding relationship and the second corresponding relationship mentioned above can be formulated in advance based on a large amount of experimental data or experience, and are not limited here.

[0117] Another embodiment of the present invention, as Figure 3 As shown, a rendering data transmission method is also provided, which is applied to a core network device, and the method includes:

[0118] Step 301, receiving the illumination term spherical harmonic coefficients and the light transmission term spherical harmonic coefficients sent by the cloud.

[0119] It should be noted that the QoS parameters guarantee the transmission quality of the spherical harmonic coefficients.

[0120] Step 302: Send the spherical harmonic coefficients of the illumination item and the spherical harmonic coefficients of the light transmission item to the access network device, wherein the access network device is used to transmit the spherical harmonic coefficients of the illumination item and the spherical harmonic coefficients of the light transmission item to the terminal, and the spherical harmonic coefficients of the illumination item and the spherical harmonic coefficients of the light transmission item are used to instruct the terminal to render the first picture frame.

[0121] In one embodiment, optionally, the method further comprises:

[0122] Receiving index information sent by the cloud;

[0123] Determine, according to the index information, a QoS parameter for transmitting the illumination item spherical harmonic coefficients from the access network device to the terminal, and a QoS parameter for transmitting the light transmission item spherical harmonic coefficients from the access network device to the terminal;

[0124] The QoS parameters of the spherical harmonic coefficients of the illumination item and the QoS parameters of the spherical harmonic coefficients of the light transmission item are sent to the access network device.

[0125] In this embodiment of the present invention, the core network device can determine different QoS parameters according to index information for different spherical harmonic coefficients to perform differentiated QoS guarantees, thereby improving the utilization of wireless resources and ensuring user experience.

[0126] It should be noted that the core network device can receive the index information sent by the cloud at the same time as receiving the spherical harmonic coefficients of the illumination item and the spherical harmonic coefficients of the light transmission item sent by the cloud, or the core network device can also receive the index information sent by the cloud before receiving the spherical harmonic coefficients of the illumination item and the spherical harmonic coefficients of the light transmission item sent by the cloud. The embodiment of the present invention is not limited here.

[0127] It should also be noted that the QoS parameters guarantee the transmission quality of the spherical harmonic coefficients.

[0128] In one implementation manner, optionally, the index information includes first index information corresponding to a first multiplexing factor and second index information corresponding to a second multiplexing factor, wherein the first multiplexing factor is used to indicate the multiplexing of the illumination item spherical harmonic coefficients of the first picture frame with the illumination item spherical harmonic coefficients of the second picture frame, and the second multiplexing factor is used to indicate the multiplexing of the light transmission item spherical harmonic coefficients of the first picture frame with the light transmission item spherical harmonic coefficients of the second picture frame, and the second picture frame is a picture frame previous to the first picture frame;

[0129] Determining, according to the index information, a QoS parameter for transmitting the illumination item spherical harmonic coefficients from the access network device to the terminal, and determining a QoS parameter for transmitting the light transmission item spherical harmonic coefficients from the access network device to the terminal, comprises:

[0130] Determine the QoS parameter of the spherical harmonic coefficient of the illumination item according to the first index information and the third corresponding relationship, wherein the third corresponding relationship is used to indicate the QoS parameter of the spherical harmonic coefficient of the illumination item corresponding to the first index information;

[0131] The QoS parameter of the spherical harmonic coefficient of the light transmission item is determined according to the second index information and the fourth corresponding relationship, and the fourth corresponding relationship is used to indicate the QoS parameter of the spherical harmonic coefficient of the light transmission item corresponding to the second index information.

[0132] It should be noted that the third correspondence relationship and the fourth correspondence relationship mentioned above can both be in table form. Here, the following Table 2 is taken as an example to illustrate the correspondence table between index information and QoS parameters.

[0133] Table 2 Correspondence table between index information and QoS parameters

[0134] Index information 0 1 2 3 4 QoS parameters QoS 0 QoS 1 QoS 2 QoS 3 QoS 4

[0135] Among them, QoS 0, QoS 1, QoS 2, QoS 3 and QoS 4 in the table all include at least one of transmission priority, transmission bandwidth, and packet loss rate threshold, and different QoS parameters include different transmission priority, transmission bandwidth, and packet loss rate threshold.

[0136] The third corresponding relationship and the fourth corresponding relationship mentioned above can be formulated in advance based on a large amount of experimental data or experience, and are not limited here.

[0137] Another embodiment of the present invention, as Figure 4 As shown, a rendering data transmission method is also provided, which is applied to an access network device, and the method includes:

[0138] Step 401, receiving illumination term spherical harmonic coefficients and light transmission term spherical harmonic coefficients sent by a core network device;

[0139] Step 402: Send the illumination item spherical harmonic coefficient and the light transmission item spherical harmonic coefficient to the terminal, where the illumination item spherical harmonic coefficient and the light transmission item spherical harmonic coefficient are used to instruct the terminal to render the first picture frame.

[0140] In one embodiment, optionally, the method further comprises:

[0141] Receiving the QoS parameters of the spherical harmonic coefficients of the illumination item and the QoS parameters of the spherical harmonic coefficients of the light transmission item sent by the core network device;

[0142] Step 402 includes:

[0143] The spherical harmonic coefficients of the illumination item are sent to the terminal using the QoS parameters of the spherical harmonic coefficients of the illumination item, and the spherical harmonic coefficients of the light transmission item are sent to the terminal using the QoS parameters of the spherical harmonic coefficients of the light transmission item.

[0144] In this embodiment of the present invention, the access network device uses the QoS parameters of the spherical harmonic coefficients formulated by the core network device to transmit the spherical harmonic coefficients to the terminal, thereby ensuring the transmission quality of the spherical harmonic coefficients.

[0145] It should be noted that the access network device can receive the QoS parameters of the illumination item spherical harmonic coefficients and the QoS parameters of the light transmission item spherical harmonic coefficients sent by the core network device at the same time as receiving the illumination item spherical harmonic coefficients and the light transmission item spherical harmonic coefficients sent by the core network device, or the access network device can receive the QoS parameters of the illumination item spherical harmonic coefficients and the QoS parameters of the light transmission item spherical harmonic coefficients sent by the core network device before receiving the illumination item spherical harmonic coefficients and the light transmission item spherical harmonic coefficients sent by the core network device, and the embodiments of the present invention are not limited here.

[0146] Another embodiment of the present invention, as Figure 5As shown, a rendering data transmission method is also provided, which is applied to a terminal, and the method includes:

[0147] Step 501: Receive illumination term spherical harmonic coefficients and light transmission term spherical harmonic coefficients sent by an access network device.

[0148] It should be noted that the terminal receives the spherical harmonic coefficients of the illumination term and the spherical harmonic coefficients of the light transmission term. Compared with the irradiance map or rendering result of the picture frame received by the terminal in the prior art, it can reduce the wireless communication air interface bandwidth resources and achieve load balancing between the cloud and the terminal.

[0149] Step 502: Render the first picture frame using the illumination term spherical harmonic coefficients and the light transmission term spherical harmonic coefficients to obtain a rendering result.

[0150] In one implementation mode, optionally, step 501 includes:

[0151] Receive the illumination item spherical harmonic coefficients sent by the access network device using the QoS parameters of the illumination item spherical harmonic coefficients, and receive the light transmission item spherical harmonic coefficients sent by the access network device using the QoS of the light transmission item spherical harmonic coefficients.

[0152] The core network equipment determines the corresponding QoS parameters according to the index information for different spherical harmonic coefficients, and then the access network equipment uses the QoS parameters to transmit the corresponding spherical harmonic coefficients to the terminal, which can ensure the transmission of spherical harmonic coefficients, improve the utilization of air interface resources, and ensure user experience.

[0153] In one implementation mode, optionally, step 502 includes:

[0154] Decoding the illumination term spherical harmonic coefficients and the light transmission term spherical harmonic coefficients respectively;

[0155] The decoded illumination item spherical harmonic coefficients and light transport item spherical harmonic coefficients are used to perform vertex shading and fragment shading on the first picture frame to obtain the rendering result.

[0156] In this embodiment of the present invention, the terminal creates and calls the material, decodes the spherical harmonic coefficients of the illumination item and the spherical harmonic coefficients of the light transmission item, performs vertex shading and fragment shading, and outputs the final rendering effect of the first picture frame.

[0157] It should be noted that the number of illumination spherical harmonic coefficients is relatively small, and each order of coefficients reflects the characteristics of ambient lighting. The terminal can restore the approximate ambient lighting using the illumination spherical harmonic coefficients of the first three orders. The spherical harmonic coefficients of the light transmission term are proportional to the number of object vertices, which is the product of the number of object vertices and the spherical harmonic coefficients of the illumination term. The terminal performs a dot product of these two coefficients on each channel of the first frame to reconstruct the lighting.

[0158] like Figure 6 The figure is a flow chart of the rendering data transmission method according to the embodiment of the present invention. According to the embodiment, the rendering data transmission method comprises the following steps:

[0159] Step 601: The terminal sends a rendering service request to the cloud.

[0160] In step 602, the cloud calculates spherical harmonic coefficients, determines a reuse factor, and determines index information corresponding to the reuse factor.

[0161] Step 603: The cloud sends index information related to the spherical harmonic coefficients to the SMF network element.

[0162] Step 604: The SMF network element configures QoS guarantee rules for transmission of spherical harmonic coefficient data packets according to the index information, so as to enable the access network device to transmit the spherical harmonic coefficients to the terminal.

[0163] Step 605, the SMF network element sends QoS configuration information to the AMF network element.

[0164] Step 606: The SMF network element sends QoS configuration information to the UPF network element.

[0165] Step 607: The AMF network element sends QoS configuration information to the access network device.

[0166] Step 608: The UPF network element sends a spherical harmonic coefficient data packet and a QoS flow identifier (QoS Flow Identifier, QFI for short) to the access network device.

[0167] In step 609, the access network device uses the QoS configuration information to ensure the transmission of the spherical harmonic coefficients and modify the data radio bearer (DRB), that is, the service data adaptation protocol (SDAP) entity completes the mapping between the QoS flow and the DRB.

[0168] In summary, the rendering data transmission method described in the embodiment of the present invention is adopted, and the cloud transmits the illumination item spherical harmonic coefficients and the light transmission item spherical harmonic coefficients to the terminal through the core network device and the access network device. The core network device formulates the QoS parameters for the access network device to transmit the illumination item spherical harmonic coefficients and the light transmission item spherical harmonic coefficients to the terminal to ensure transmission. The terminal uses the illumination item spherical harmonic coefficients and the light transmission item spherical harmonic coefficients to render the first picture frame to obtain the rendering result. Compared with the prior art in which the cloud transmits the irradiance map or rendering result of the first picture frame to the terminal, the wireless communication air interface bandwidth resources can be reduced, and the load balancing of the cloud and the terminal can be achieved at the same time. Moreover, the spherical harmonic coefficients in text format can further reduce the requirements for the air interface transmission bandwidth by compression, saving a large amount of wireless communication air interface bandwidth resources. The access network device uses different QoS parameters to ensure the transmission of different spherical harmonic coefficients, improve the utilization rate of wireless air interface resources, and ensure user experience.

[0169] Another embodiment of the present invention further provides a rendering data transmission device, which is applied to the cloud. Figure 7 As shown, the device comprises:

[0170] The first sending module 701 is used to send the spherical harmonic coefficients of the illumination item and the spherical harmonic coefficients of the light transmission item to the core network device, and the core network device is used to transmit the spherical harmonic coefficients of the illumination item and the spherical harmonic coefficients of the light transmission item to the terminal through the access network device, and the spherical harmonic coefficients of the illumination item and the spherical harmonic coefficients of the light transmission item are used to instruct the terminal to render the first picture frame.

[0171] Optionally, the rendering data transmission device further comprises:

[0172] The fourth sending module is used to send index information to the core network device, wherein the index information is used to instruct the core network device to determine the service quality parameters of the access network device for transmitting the spherical harmonic coefficients of the illumination item to the terminal, and to instruct the core network device to determine the service quality parameters of the access network device for transmitting the spherical harmonic coefficients of the light transmission item to the terminal.

[0173] Optionally, in the rendering data transmission device, the index information includes first index information corresponding to the first multiplexing factor and second index information corresponding to the second multiplexing factor;

[0174] The first multiplexing factor is used to indicate the multiplexing of the illumination item spherical harmonic coefficients of the first picture frame to the illumination item spherical harmonic coefficients of the second picture frame;

[0175] The second multiplexing factor is used to indicate the multiplexing of the spherical harmonic coefficients of the light transmission items of the first picture frame with the spherical harmonic coefficients of the light transmission items of the second picture frame;

[0176] The first index information is used to instruct the core network device to determine the quality of service parameter of the illumination item spherical harmonic coefficient transmitted by the access network device to the terminal;

[0177] The second index information is used to instruct the core network device to determine the quality of service parameter of the spherical harmonic coefficients of the light transmission item transmitted by the access network device to the terminal;

[0178] The second picture frame is a previous picture frame of the first picture frame.

[0179] Optionally, in the rendering data transmission device, the quality of service parameter of the illumination item spherical harmonic coefficient and the quality of service parameter of the light transmission item spherical harmonic coefficient satisfy at least one of the following:

[0180] The transmission priority of the spherical harmonic coefficients of the illumination term is higher than the transmission priority of the spherical harmonic coefficients of the light transmission term;

[0181] If the first multiplexing factor is greater than the third multiplexing factor, the transmission bandwidth of the illumination item spherical harmonic coefficients of the first picture frame is less than the transmission bandwidth of the illumination item spherical harmonic coefficients of the second picture frame, and the third multiplexing factor is used to indicate the multiplexing of the illumination item spherical harmonic coefficients of the second picture frame with the illumination item spherical harmonic coefficients of the third picture frame;

[0182] If the second multiplexing factor is less than the fourth multiplexing factor, the transmission bandwidth of the spherical harmonic coefficients of the light transmission items of the first picture frame is greater than the transmission bandwidth of the spherical harmonic coefficients of the light transmission items of the second picture frame, and the fourth multiplexing factor is used to indicate the multiplexing of the spherical harmonic coefficients of the light transmission items of the second picture frame with the spherical harmonic coefficients of the light transmission items of the third picture frame;

[0183] The third picture frame is a previous picture frame of the second picture frame.

[0184] Optionally, the rendering data transmission device further comprises:

[0185] a third determining module, configured to determine the first index information according to the first multiplexing factor and a first corresponding relationship, wherein the first corresponding relationship is used to indicate the first index information corresponding to the first multiplexing factor;

[0186] The fourth determining module is used to determine the second index information according to the second multiplexing factor and a second corresponding relationship, where the second corresponding relationship is used to indicate the second index information corresponding to the second multiplexing factor.

[0187] Optionally, in the rendering data transmission device, the quality of service parameter includes at least one of the following:

[0188] Transmission priority; transmission bandwidth; packet loss rate threshold.

[0189] Another embodiment of the present invention further provides a rendering data transmission device, which is applied to a core network device, such as Figure 8 As shown, the device comprises:

[0190] The first receiving module 801 is used to receive the spherical harmonic coefficients of the illumination term and the spherical harmonic coefficients of the light transmission term sent by the cloud;

[0191] The second sending module 802 is used to send the spherical harmonic coefficients of the illumination item and the spherical harmonic coefficients of the light transmission item to the access network device, and the access network device is used to transmit the spherical harmonic coefficients of the illumination item and the spherical harmonic coefficients of the light transmission item to the terminal, and the spherical harmonic coefficients of the illumination item and the spherical harmonic coefficients of the light transmission item are used to instruct the terminal to render the first picture frame.

[0192] Optionally, the rendering data transmission device further comprises:

[0193] A fourth receiving module, used to receive the index information sent by the cloud;

[0194] A first determination module is used to determine, according to the index information, a service quality parameter for transmitting the illumination item spherical harmonic coefficients from the access network device to the terminal, and a service quality parameter for transmitting the light transmission item spherical harmonic coefficients from the access network device to the terminal;

[0195] The fifth sending module is used to send the service quality parameters of the spherical harmonic coefficients of the illumination item and the service quality parameters of the spherical harmonic coefficients of the light transmission item to the access network device.

[0196] Optionally, in the rendering data transmission device, the index information includes first index information corresponding to a first multiplexing factor and second index information corresponding to a second multiplexing factor, wherein the first multiplexing factor is used to indicate the multiplexing of the illumination item spherical harmonic coefficients of the first picture frame with the illumination item spherical harmonic coefficients of the second picture frame, and the second multiplexing factor is used to indicate the multiplexing of the light transmission item spherical harmonic coefficients of the first picture frame with the light transmission item spherical harmonic coefficients of the second picture frame, and the second picture frame is a picture frame previous to the first picture frame;

[0197] The first determining module is specifically configured to:

[0198] Determine, according to the first index information and the third corresponding relationship, a service quality parameter of the illumination item spherical harmonic coefficient, wherein the third corresponding relationship is used to indicate the service quality parameter of the illumination item spherical harmonic coefficient corresponding to the first index information;

[0199] The quality of service parameter of the spherical harmonic coefficient of the light transmission item is determined according to the second index information and a fourth corresponding relationship, wherein the fourth corresponding relationship is used to indicate the quality of service parameter of the spherical harmonic coefficient of the light transmission item corresponding to the second index information.

[0200] Another embodiment of the present invention further provides a rendering data transmission device, which is applied to access network equipment, such as Fig. 9 As shown, the device comprises:

[0201] The second receiving module 901 is used to receive the illumination term spherical harmonic coefficients and the light transmission term spherical harmonic coefficients sent by the core network device;

[0202] The third sending module 902 is used to send the illumination item spherical harmonic coefficient and the light transmission item spherical harmonic coefficient to the terminal, and the illumination item spherical harmonic coefficient and the light transmission item spherical harmonic coefficient are used to instruct the terminal to render the first picture frame.

[0203] Optionally, the rendering data transmission device further comprises:

[0204] A fifth receiving module, configured to receive the quality of service parameters of the illumination spherical harmonic coefficients and the quality of service parameters of the light transmission spherical harmonic coefficients sent by the core network device;

[0205] The third sending module 902 is specifically configured to:

[0206] The spherical harmonic coefficients of the illumination item are sent to the terminal using the service quality parameters of the spherical harmonic coefficients of the illumination item, and the spherical harmonic coefficients of the light transmission item are sent to the terminal using the service quality parameters of the spherical harmonic coefficients of the light transmission item.

[0207] Another embodiment of the present invention further provides a rendering data transmission device, which is applied to a terminal, such as Fig.10 As shown, the device comprises:

[0208] The third receiving module 1001 is used to receive the spherical harmonic coefficients of the illumination term and the spherical harmonic coefficients of the light transmission term sent by the access network device;

[0209] The rendering module 1002 is used to render the first picture frame using the illumination term spherical harmonic coefficients and the light transmission term spherical harmonic coefficients to obtain a rendering result.

[0210] Optionally, in the rendering data transmission device, the third receiving module 1001 is specifically configured to:

[0211] Receive the illumination item spherical harmonic coefficients sent by the access network device using the service quality parameters of the illumination item spherical harmonic coefficients, and receive the light transmission item spherical harmonic coefficients sent by the access network device using the service quality parameters of the light transmission item spherical harmonic coefficients.

[0212] Optionally, in the rendering data transmission device, the rendering module 1002 is specifically configured to:

[0213] Decoding the illumination term spherical harmonic coefficients and the light transmission term spherical harmonic coefficients respectively;

[0214] The decoded illumination item spherical harmonic coefficients and light transport item spherical harmonic coefficients are used to perform vertex shading and fragment shading on the first picture frame to obtain the rendering result.

[0215] One embodiment of the present invention provides a rendering data transmission device, which is cloud-based and includes: a processor; and a memory connected to the processor via a bus interface, the memory being used to store programs and data used by the processor when performing operations, and the processor calling and executing the programs and data stored in the memory.

[0216] Wherein, the rendering data transmission device further comprises a transceiver, the transceiver being connected to the bus interface and being used for receiving and sending data under the control of the processor;

[0217] Specifically, the transceiver performs the following process:

[0218] The spherical harmonic coefficients of the illumination item and the spherical harmonic coefficients of the light transmission item are sent to the core network device, and the core network device is used to transmit the spherical harmonic coefficients of the illumination item and the spherical harmonic coefficients of the light transmission item to the terminal through the access network device, and the spherical harmonic coefficients of the illumination item and the spherical harmonic coefficients of the light transmission item are used to instruct the terminal to render the first picture frame.

[0219] Optionally, in the rendering data transmission device, the transceiver further performs the following process:

[0220] Index information is sent to the core network device, where the index information is used to instruct the core network device to determine the service quality parameters for the access network device to transmit the spherical harmonic coefficients of the illumination item to the terminal, and to instruct the core network device to determine the service quality parameters for the access network device to transmit the spherical harmonic coefficients of the light transmission item to the terminal.

[0221] Optionally, in the rendering data transmission device, the index information includes first index information corresponding to the first multiplexing factor and second index information corresponding to the second multiplexing factor;

[0222] The first multiplexing factor is used to indicate the multiplexing of the illumination item spherical harmonic coefficients of the first picture frame to the illumination item spherical harmonic coefficients of the second picture frame;

[0223] The second multiplexing factor is used to indicate the multiplexing of the spherical harmonic coefficients of the light transmission items of the first picture frame with the spherical harmonic coefficients of the light transmission items of the second picture frame;

[0224] The first index information is used to instruct the core network device to determine the quality of service parameter of the illumination item spherical harmonic coefficient transmitted by the access network device to the terminal;

[0225] The second index information is used to instruct the core network device to determine the quality of service parameter of the spherical harmonic coefficient of the light transmission item transmitted by the access network device;

[0226] The second picture frame is a previous picture frame of the first picture frame.

[0227] Optionally, in the rendering data transmission device, the quality of service parameter of the illumination item spherical harmonic coefficient and the quality of service parameter of the light transmission item spherical harmonic coefficient satisfy at least one of the following:

[0228] The transmission priority of the spherical harmonic coefficients of the illumination term is higher than the transmission priority of the spherical harmonic coefficients of the light transmission term;

[0229] If the first multiplexing factor is greater than the third multiplexing factor, the transmission bandwidth of the illumination item spherical harmonic coefficients of the first picture frame is less than the transmission bandwidth of the illumination item spherical harmonic coefficients of the second picture frame, and the third multiplexing factor is used to indicate the multiplexing of the illumination item spherical harmonic coefficients of the second picture frame with the illumination item spherical harmonic coefficients of the third picture frame;

[0230] If the second multiplexing factor is less than the fourth multiplexing factor, the transmission bandwidth of the spherical harmonic coefficients of the light transmission items of the first picture frame is greater than the transmission bandwidth of the spherical harmonic coefficients of the light transmission items of the second picture frame, and the fourth multiplexing factor is used to indicate the multiplexing of the spherical harmonic coefficients of the light transmission items of the second picture frame with the spherical harmonic coefficients of the light transmission items of the third picture frame;

[0231] The third picture frame is a previous picture frame of the second picture frame.

[0232] Optionally, in the rendering data transmission device, the processor performs the following process:

[0233] Determine the first index information according to the first multiplexing factor and a first corresponding relationship, where the first corresponding relationship is used to indicate the first index information corresponding to the first multiplexing factor;

[0234] The second index information is determined according to the second multiplexing factor and a second corresponding relationship, where the second corresponding relationship is used to indicate the second index information corresponding to the second multiplexing factor.

[0235] Optionally, in the rendering data transmission device, the quality of service parameter includes at least one of the following:

[0236] Transmission priority; transmission bandwidth; packet loss rate threshold.

[0237] The bus architecture may include any number of interconnected buses and bridges, specifically one or more processors represented by a processor and various circuits represented by a memory linked together. The bus architecture may also link together various other circuits such as peripherals, voltage regulators, and power management circuits, which are well known in the art and are therefore not further described herein. The bus interface provides a user interface. The transceiver may be a plurality of components, i.e., a transmitter and a receiver, providing a unit for communicating with various other devices on a transmission medium. The processor is responsible for managing the bus architecture and general processing, and the memory may store data used by the processor when performing operations.

[0238] Another embodiment of the present invention also provides a rendering data transmission device, which is a core network element, including: a processor; and a memory connected to the processor through a bus interface, the memory being used to store programs and data used by the processor when performing operations, and the processor calling and executing the programs and data stored in the memory.

[0239] Wherein, the rendering data transmission device further comprises a transceiver, the transceiver being connected to the bus interface and being used for receiving and sending data under the control of the processor;

[0240] Specifically, the transceiver performs the following process:

[0241] Receive the spherical harmonic coefficients of illumination term and light transmission term sent by the cloud;

[0242] The spherical harmonic coefficients of the illumination item and the spherical harmonic coefficients of the light transmission item are sent to the access network device, and the access network device is used to transmit the spherical harmonic coefficients of the illumination item and the spherical harmonic coefficients of the light transmission item to the terminal, and the spherical harmonic coefficients of the illumination item and the spherical harmonic coefficients of the light transmission item are used to instruct the terminal to render the first picture frame.

[0243] Optionally, in the rendering data transmission device, the transceiver further performs the following process:

[0244] Receiving index information sent by the cloud;

[0245] The processor executes the following processes:

[0246] Determining, according to the index information, a quality of service parameter for transmitting the illumination item spherical harmonic coefficients from the access network device to the terminal, and a quality of service parameter for transmitting the light transmission item spherical harmonic coefficients from the access network device to the terminal;

[0247] The transceiver further performs the following process:

[0248] The quality of service parameters of the spherical harmonic coefficients of the illumination item and the quality of service parameters of the spherical harmonic coefficients of the light transmission item are sent to the access network device.

[0249] Optionally, the rendering data transmission device, wherein the index information includes first index information corresponding to a first multiplexing factor and second index information corresponding to a second multiplexing factor, wherein the first multiplexing factor is used to indicate the multiplexing of the illumination item spherical harmonic coefficients of the first picture frame with the illumination item spherical harmonic coefficients of the second picture frame, and the second multiplexing factor is used to indicate the multiplexing of the light transmission item spherical harmonic coefficients of the first picture frame with the light transmission item spherical harmonic coefficients of the second picture frame, and the second picture frame is a picture frame previous to the first picture frame;

[0250] The processor executes the following processes:

[0251] Determine, according to the first index information and the third corresponding relationship, a service quality parameter of the illumination item spherical harmonic coefficient, wherein the third corresponding relationship is used to indicate the service quality parameter of the illumination item spherical harmonic coefficient corresponding to the first index information;

[0252] The quality of service parameter of the spherical harmonic coefficient of the light transmission item is determined according to the second index information and a fourth corresponding relationship, wherein the fourth corresponding relationship is used to indicate the quality of service parameter of the spherical harmonic coefficient of the light transmission item corresponding to the second index information.

[0253] The bus architecture may include any number of interconnected buses and bridges, specifically various circuits of one or more processors represented by a processor and a memory represented by a memory linked together. The bus architecture may also link together various other circuits such as peripherals, voltage regulators, and power management circuits, which are well known in the art and are therefore not further described herein. The transceiver may be a plurality of components, i.e., a transmitter and a receiver, providing a unit for communicating with various other devices on a transmission medium. The processor is responsible for managing the bus architecture and general processing, and the memory may store data used by the processor when performing operations.

[0254] Another embodiment of the present invention also provides a rendering data transmission device, which is an access network device, including: a processor; and a memory connected to the processor through a bus interface, the memory being used to store programs and data used by the processor when performing operations, and the processor calling and executing the programs and data stored in the memory.

[0255] Wherein, the rendering data transmission device further comprises a transceiver, the transceiver being connected to the bus interface and being used for receiving and sending data under the control of the processor;

[0256] Specifically, the transceiver performs the following process:

[0257] Receive the illumination term spherical harmonic coefficients and light transmission term spherical harmonic coefficients sent by the core network equipment;

[0258] The illumination item spherical harmonic coefficient and the light transmission item spherical harmonic coefficient are sent to a terminal, where the illumination item spherical harmonic coefficient and the light transmission item spherical harmonic coefficient are used to instruct the terminal to render a first picture frame.

[0259] Optionally, in the rendering data transmission device, the transceiver further performs the following process:

[0260] Receiving the quality of service parameters of the illumination item spherical harmonic coefficients and the quality of service parameters of the light transmission item spherical harmonic coefficients sent by the core network device;

[0261] The spherical harmonic coefficients of the illumination item are sent to the terminal using the service quality parameters of the spherical harmonic coefficients of the illumination item, and the spherical harmonic coefficients of the light transmission item are sent to the terminal using the service quality parameters of the spherical harmonic coefficients of the light transmission item.

[0262] The bus architecture may include any number of interconnected buses and bridges, specifically various circuits of one or more processors represented by a processor and a memory represented by a memory linked together. The bus architecture may also link together various other circuits such as peripherals, voltage regulators, and power management circuits, which are well known in the art and are therefore not further described herein. The transceiver may be a plurality of components, i.e., a transmitter and a receiver, providing a unit for communicating with various other devices on a transmission medium. The processor is responsible for managing the bus architecture and general processing, and the memory may store data used by the processor when performing operations.

[0263] Another embodiment of the present invention also provides a rendering data transmission device, which is a terminal, including: a processor; and a memory connected to the processor through a bus interface, the memory being used to store programs and data used by the processor when performing operations, and the processor calling and executing the programs and data stored in the memory.

[0264] Wherein, the rendering data transmission device further comprises a transceiver, the transceiver being connected to the bus interface and being used for receiving and sending data under the control of the processor;

[0265] Specifically, the transceiver performs the following process:

[0266] Receive the spherical harmonic coefficients of illumination items and light transmission items sent by the access network equipment;

[0267] The processor executes the following processes:

[0268] The first picture frame is rendered using the illumination term spherical harmonic coefficients and the light transmission term spherical harmonic coefficients to obtain a rendering result.

[0269] Optionally, in the rendering data transmission device, the transceiver performs the following process:

[0270] Receive the illumination item spherical harmonic coefficients sent by the access network device using the service quality parameters of the illumination item spherical harmonic coefficients, and receive the light transmission item spherical harmonic coefficients sent by the access network device using the service quality parameters of the light transmission item spherical harmonic coefficients.

[0271] Optionally, in the rendering data transmission device, the processor performs the following process:

[0272] Decoding the illumination term spherical harmonic coefficients and the light transmission term spherical harmonic coefficients respectively;

[0273] The decoded illumination item spherical harmonic coefficients and light transport item spherical harmonic coefficients are used to perform vertex shading and fragment shading on the first picture frame to obtain the rendering result.

[0274] The bus architecture may include any number of interconnected buses and bridges, specifically one or more processors represented by a processor and various circuits represented by a memory linked together. The bus architecture may also link together various other circuits such as peripherals, voltage regulators, and power management circuits, which are well known in the art and are therefore not further described herein. The bus interface provides a user interface. The transceiver may be a plurality of components, i.e., a transmitter and a receiver, providing a unit for communicating with various other devices on a transmission medium. The processor is responsible for managing the bus architecture and general processing, and the memory may store data used by the processor when performing operations.

[0275] In addition, a specific embodiment of the present invention further provides a readable storage medium on which a computer program is stored, wherein the program, when executed by a processor, implements the steps in any one of the rendering data transmission methods described above.

[0276] Specifically, the computer-readable storage medium is applied to the above-mentioned cloud, core network equipment, access network equipment or terminal. When applied to the cloud, core network equipment, access network equipment or terminal, the execution steps in the corresponding rendering data transmission method are described in detail above and will not be repeated here.

[0277] In the several embodiments provided in the present application, it should be understood that the disclosed methods and devices can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0278] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may be physically included separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of hardware plus software functional units.

[0279] The above-mentioned integrated unit implemented in the form of a software functional unit can be stored in a computer-readable storage medium. The above-mentioned software functional unit is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform some steps of the sending and receiving methods described in various embodiments of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory, referred to as ROM), random access memory (Random Access Memory, referred to as RAM), disk or optical disk and other media that can store program codes.

[0280] The above is a preferred embodiment of the present invention. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present invention. These improvements and modifications should also be regarded as the scope of protection of the present invention.

Claims

1. A rendering data transmission method, characterized in that: Applied to the cloud, the method includes: The spherical harmonic coefficients of the illumination item and the spherical harmonic coefficients of the light transmission item are sent to the core network device, and the core network device is used to transmit the spherical harmonic coefficients of the illumination item and the spherical harmonic coefficients of the light transmission item to the terminal through the access network device, and the spherical harmonic coefficients of the illumination item and the spherical harmonic coefficients of the light transmission item are used to instruct the terminal to render the first picture frame.

2. The rendering data transmission method according to claim 1, characterized in that: The method further comprises: Index information is sent to the core network device, where the index information is used to instruct the core network device to determine the service quality parameters for the access network device to transmit the spherical harmonic coefficients of the illumination item to the terminal, and to instruct the core network device to determine the service quality parameters for the access network device to transmit the spherical harmonic coefficients of the light transmission item to the terminal.

3. The rendering data transmission method according to claim 2, characterized in that: The index information includes first index information corresponding to the first multiplexing factor and second index information corresponding to the second multiplexing factor; The first multiplexing factor is used to indicate the multiplexing of the illumination item spherical harmonic coefficients of the first picture frame to the illumination item spherical harmonic coefficients of the second picture frame; The second multiplexing factor is used to indicate the multiplexing of the spherical harmonic coefficients of the light transmission items of the first picture frame with the spherical harmonic coefficients of the light transmission items of the second picture frame; The first index information is used to instruct the core network device to determine the quality of service parameter of the illumination item spherical harmonic coefficient transmitted by the access network device to the terminal; The second index information is used to instruct the core network device to determine the quality of service parameter of the spherical harmonic coefficients of the light transmission item transmitted by the access network device to the terminal; The second picture frame is a previous picture frame of the first picture frame.

4. The rendering data transmission method according to claim 3, characterized in that: The quality of service parameters of the illumination term spherical harmonic coefficients and the quality of service parameters of the light transmission term spherical harmonic coefficients satisfy at least one of the following: The transmission priority of the spherical harmonic coefficients of the illumination term is higher than the transmission priority of the spherical harmonic coefficients of the light transmission term; If the first multiplexing factor is greater than the third multiplexing factor, the transmission bandwidth of the illumination item spherical harmonic coefficients of the first picture frame is less than the transmission bandwidth of the illumination item spherical harmonic coefficients of the second picture frame, and the third multiplexing factor is used to indicate the multiplexing of the illumination item spherical harmonic coefficients of the second picture frame with the illumination item spherical harmonic coefficients of the third picture frame; If the second multiplexing factor is less than the fourth multiplexing factor, the transmission bandwidth of the spherical harmonic coefficients of the light transmission items of the first picture frame is greater than the transmission bandwidth of the spherical harmonic coefficients of the light transmission items of the second picture frame, and the fourth multiplexing factor is used to indicate the multiplexing of the spherical harmonic coefficients of the light transmission items of the second picture frame with the spherical harmonic coefficients of the light transmission items of the third picture frame; The third picture frame is a previous picture frame of the second picture frame.

5. The rendering data transmission method according to claim 3, characterized in that: Before sending the index information to the core network device, the method further includes: Determine the first index information according to the first multiplexing factor and a first corresponding relationship, where the first corresponding relationship is used to indicate the first index information corresponding to the first multiplexing factor; The second index information is determined according to the second multiplexing factor and the second corresponding relationship, where the second corresponding relationship is used to indicate the second index information corresponding to the second multiplexing factor.

6. The rendering data transmission method according to claim 2, characterized in that: The service quality parameter includes at least one of the following: Transmission priority; transmission bandwidth; packet loss rate threshold.

7. A rendering data transmission method, characterized in that: Applied to a core network device, the method comprises: Receive the spherical harmonic coefficients of illumination term and light transmission term sent by the cloud; The spherical harmonic coefficients of the illumination item and the spherical harmonic coefficients of the light transmission item are sent to an access network device, and the access network device is used to transmit the spherical harmonic coefficients of the illumination item and the spherical harmonic coefficients of the light transmission item to a terminal, and the spherical harmonic coefficients of the illumination item and the spherical harmonic coefficients of the light transmission item are used to instruct the terminal to render a first picture frame.

8. The rendering data transmission method according to claim 7, characterized in that: The method further comprises: Receiving index information sent by the cloud; Determining, according to the index information, a quality of service parameter for transmitting the illumination item spherical harmonic coefficients from the access network device to the terminal, and a quality of service parameter for transmitting the light transmission item spherical harmonic coefficients from the access network device to the terminal; The quality of service parameters of the spherical harmonic coefficients of the illumination item and the quality of service parameters of the spherical harmonic coefficients of the light transmission item are sent to the access network device.

9. The rendering data transmission method according to claim 8, characterized in that: The index information includes first index information corresponding to a first multiplexing factor and second index information corresponding to a second multiplexing factor, wherein the first multiplexing factor is used to indicate the multiplexing of the illumination item spherical harmonic coefficients of the first picture frame with the illumination item spherical harmonic coefficients of the second picture frame, and the second multiplexing factor is used to indicate the multiplexing of the light transmission item spherical harmonic coefficients of the first picture frame with the light transmission item spherical harmonic coefficients of the second picture frame, and the second picture frame is a picture frame previous to the first picture frame; Determining, according to the index information, a service quality parameter for transmitting the illumination item spherical harmonic coefficients from the access network device to the terminal, and determining a service quality parameter for transmitting the light transmission item spherical harmonic coefficients from the access network device to the terminal, comprises: Determine, according to the first index information and the third corresponding relationship, a service quality parameter of the illumination item spherical harmonic coefficient, wherein the third corresponding relationship is used to indicate the service quality parameter of the illumination item spherical harmonic coefficient corresponding to the first index information; The quality of service parameter of the spherical harmonic coefficient of the light transmission item is determined according to the second index information and a fourth corresponding relationship, wherein the fourth corresponding relationship is used to indicate the quality of service parameter of the spherical harmonic coefficient of the light transmission item corresponding to the second index information.

10. A rendering data transmission method, characterized in that: Applied to access network equipment, the method comprises: Receive the illumination term spherical harmonic coefficients and light transmission term spherical harmonic coefficients sent by the core network equipment; The illumination item spherical harmonic coefficient and the light transmission item spherical harmonic coefficient are sent to a terminal, where the illumination item spherical harmonic coefficient and the light transmission item spherical harmonic coefficient are used to instruct the terminal to render a first picture frame.

11. The rendering data transmission method according to claim 10, characterized in that: The method further comprises: Receiving the quality of service parameters of the illumination item spherical harmonic coefficients and the quality of service parameters of the light transmission item spherical harmonic coefficients sent by the core network device; Sending the illumination term spherical harmonic coefficient and the light transmission term spherical harmonic coefficient to the terminal includes: The spherical harmonic coefficients of the illumination item are sent to the terminal using the service quality parameters of the spherical harmonic coefficients of the illumination item, and the spherical harmonic coefficients of the light transmission item are sent to the terminal using the service quality parameters of the spherical harmonic coefficients of the light transmission item.

12. A rendering data transmission method, characterized in that: Applied to a terminal, the method comprises: Receive the illumination item spherical harmonic coefficients and light transmission item spherical harmonic coefficients sent by the access network equipment; The first picture frame is rendered using the illumination term spherical harmonic coefficients and the light transmission term spherical harmonic coefficients to obtain a rendering result.

13. The rendering data transmission method according to claim 12, characterized in that: The receiving access network device sends the illumination item spherical harmonic coefficient and the light transmission item spherical harmonic coefficient, including: Receive the illumination item spherical harmonic coefficients sent by the access network device using the service quality parameters of the illumination item spherical harmonic coefficients, and receive the light transmission item spherical harmonic coefficients sent by the access network device using the service quality parameters of the light transmission item spherical harmonic coefficients.

14. The rendering data transmission method according to claim 12, characterized in that: The step of rendering the first picture frame by using the illumination term spherical harmonic coefficient and the light transmission term spherical harmonic coefficient to obtain a rendering result includes: Decoding the illumination term spherical harmonic coefficients and the light transmission term spherical harmonic coefficients respectively; The decoded illumination term spherical harmonic coefficients and light transport term spherical harmonic coefficients are used to perform vertex shading and fragment shading on the first picture frame to obtain the rendering result.

15. A rendering data transmission device, characterized in that: Applied to the cloud, the device comprises: The first sending module is used to send the spherical harmonic coefficients of the illumination item and the spherical harmonic coefficients of the light transmission item to the core network device, and the core network device is used to transmit the spherical harmonic coefficients of the illumination item and the spherical harmonic coefficients of the light transmission item to the terminal through the access network device, and the spherical harmonic coefficients of the illumination item and the spherical harmonic coefficients of the light transmission item are used to instruct the terminal to render the first picture frame.

16. A rendering data transmission device, characterized in that: Applied to core network equipment, the device includes: The first receiving module is used to receive the spherical harmonic coefficients of the illumination term and the spherical harmonic coefficients of the light transmission term sent by the cloud; The second sending module is used to send the spherical harmonic coefficients of the illumination item and the spherical harmonic coefficients of the light transmission item to the access network device, and the access network device is used to transmit the spherical harmonic coefficients of the illumination item and the spherical harmonic coefficients of the light transmission item to the terminal, and the spherical harmonic coefficients of the illumination item and the spherical harmonic coefficients of the light transmission item are used to instruct the terminal to render the first picture frame.

17. A rendering data transmission device, characterized in that: Applied to access network equipment, the device comprises: The second receiving module is used to receive the spherical harmonic coefficients of the illumination term and the spherical harmonic coefficients of the light transmission term sent by the core network device; The third sending module is used to send the spherical harmonic coefficients of the illumination item and the spherical harmonic coefficients of the light transmission item to the terminal, and the spherical harmonic coefficients of the illumination item and the spherical harmonic coefficients of the light transmission item are used to instruct the terminal to render the first picture frame.

18. A rendering data transmission device, characterized in that: Applied to a terminal, the device comprises: The third receiving module is used to receive the spherical harmonic coefficients of the illumination term and the spherical harmonic coefficients of the light transmission term sent by the access network device; The rendering module is used to render the first picture frame by using the illumination term spherical harmonic coefficient and the light transmission term spherical harmonic coefficient to obtain a rendering result.

19. A rendering data transmission device, characterized in that: include: A processor, a memory, and a program stored in the memory and executable on the processor, wherein when the program is executed by the processor, the program implements the rendering data transmission method according to any one of claims 1 to 6, or the rendering data transmission method according to any one of claims 7 to 9, or the rendering data transmission method according to any one of claims 10 to 11, or the rendering data transmission method according to any one of claims 12 to 14.

20. A readable storage medium, characterized in that: The readable storage medium stores a program, and when the program is executed by the processor, it implements the rendering data transmission method according to any one of claims 1 to 6, or the rendering data transmission method according to any one of claims 7 to 9, or the rendering data transmission method according to any one of claims 10 to 11, or the rendering data transmission method according to any one of claims 12 to 14.

Images